Proto commits in google/yggdrasil-decision-forests

These commits are when the Protocol Buffers files have changed: (only the last 100 relevant commits are shown)

Commit:6e74dff
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Expose optional UI link for tuners PiperOrigin-RevId: 936538931

The documentation is generated from this commit.

Commit:1d8fbf5
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Hyperparameter tuner improvements - Added an XManager tuner example - Fixed various typos - Small refactoring of the tuning loop to unify distributed and local code PiperOrigin-RevId: 936505353

Commit:88fd016
Author:Richard Stotz
Committer:Copybara-Service

[YDF] HP tuner improvements PiperOrigin-RevId: 935956548

Commit:644acd1
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Expose UI link for tuners PiperOrigin-RevId: 935999190

Commit:626d487
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Add support for MSLE metric PiperOrigin-RevId: 926632117

Commit:3847463
Author:Guido Muscioni
Committer:Copybara-Service

[YDF] Add full end-to-end support for custom Python secondary metrics in Gradient Boosted Trees PiperOrigin-RevId: 923450822

Commit:3e0030d
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Add field to track the "time" in the GBT training logs. PiperOrigin-RevId: 918411936

Commit:db60d19
Author:Guido Muscioni
Committer:Copybara-Service

[YDF] Add early stopping triggered status to Gradient Boosted Trees model to track whether early stopping was triggered during training. PiperOrigin-RevId: 897708990

Commit:651ceb0
Author:Louis Lai
Committer:Copybara-Service

[YDF] Java Standalone: Add support for initialising with custom resource path PiperOrigin-RevId: 892602172

Commit:42bbec3
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Release PYDF 0.16.0 and YDF-TF 2.21.0 This change includes the required dependency updates, including a new endian tool to accomodate the deprecation of the absl endian tooling. PiperOrigin-RevId: 885049789

Commit:4f2eebb
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Kernel-compatible C export PiperOrigin-RevId: 876277038

Commit:60e869d
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Add an option for C export and rename CC -> Cpp in the proto PiperOrigin-RevId: 875598832

Commit:78152de
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Add option to explicitly pass label classes Note that this fixes a bug where pruning for max_vocab_count did not increase the number of OOD examples. In rare cases, this might lead to a change in behaviour: If many examples are pruned through this rule, the OOD item can become the most frequent item, which changes the behaviour of the global imputation. PiperOrigin-RevId: 853739268

Commit:1ee2e12
Author:Richard Stotz
Committer:Copybara-Service

Rollback of: [YDF] Add option to explicitly pass label classes PiperOrigin-RevId: 852892560

Commit:325b2d3
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Add option to explicitly pass label classes Note that this fixes a bug where pruning for max_vocab_count did not increase the number of OOD examples. In rare cases, this might lead to a change in behaviour: If many examples are pruned through this rule, the OOD item can become the most frequent item, which changes the behaviour of the global imputation. PiperOrigin-RevId: 852772987

Commit:9bd1a35
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Initialize multinomial initial predictions from priors PiperOrigin-RevId: 841758855

Commit:6d56019
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Typo fixes PiperOrigin-RevId: 838731846

Commit:5a1bf38
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Implementation of the guided oblique splits. Currently, guided oblique splits are only available for non-hessian gbts. PiperOrigin-RevId: 834889036

Commit:c454c55
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Rename winner_take_all HP to winner_takes_all PiperOrigin-RevId: 800347994

Commit:587f15b
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Add split column for synthetic datasets PiperOrigin-RevId: 826494497

Commit:6cc0dab
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Fix output_logits for slow prediction engine This unifies the handling of output_logits in the slow prediction engines. This is a breaking change (see below). If `output_logits` is set on a model, the slow engine will populate the new `logits` field on the prediction proto. Otherwise, this field is not populated. The `distribution` field on the proto is **always** with the probabilities. The latter is a breaking change / bugfix, since the distribution field was previously populated with the logits in some cases. PiperOrigin-RevId: 825085209

Commit:749f86d
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Java Standalone: Add specialized conversion PiperOrigin-RevId: 810796390

Commit:aaee682
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Refactor Standalone export to support multiple languages Java standalone export part 1/n PiperOrigin-RevId: 801861447

Commit:31418e6
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Refactor honest splitting to be more easily reproducible. PiperOrigin-RevId: 800829687

Commit:75925d5
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Expose in-bag sampled examples idxs for Random Forests This CL introduces `learner.in_bag_example_indices()`, which returns the in-bag samples used by bootstrapping in Random Forests. Fixes #200 PiperOrigin-RevId: 793523861

Commit:2712501
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Generate c++ code to create categorical feature enum values from string. PiperOrigin-RevId: 785741501

Commit:9be1724
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Add usage monitoring in the standalone inference code. PiperOrigin-RevId: 781886537

Commit:412128a
Author:Yggdrasil Decision Forests Team
Committer:Copybara-Service

Add Survival Analysis task to GBT with Cox Proportional Hazards negative log loss function. PiperOrigin-RevId: 780726376

Commit:dd9278a
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Change default algorithm used by YDF Standalone PiperOrigin-RevId: 780094219

Commit:0177a49
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Model embedding function in python PiperOrigin-RevId: 779181417

Commit:b420d3f
Author:Richard Stotz
Committer:Copybara-Service

[YDF] GBT Training Logs PiperOrigin-RevId: 778868660

Commit:0d31c83
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Add HP to enable/disable vector sequence condition type PiperOrigin-RevId: 778011716

Commit:da7e90d
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Refactorization of the code and first part of the Routing algorithm. PiperOrigin-RevId: 776584496

Commit:c9e8505
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Embed YDF model in binary [Part 5] Accumulator struct. PiperOrigin-RevId: 766542449

Commit:2d1454c
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Add num_threads for cross validation tuning PiperOrigin-RevId: 764318987

Commit:ed6411e
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Enable Cross-Validation for Hyperparameter Tuning PiperOrigin-RevId: 764220079

Commit:273ba6c
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Embed YDF model in binary [Part 4] Output signature. PiperOrigin-RevId: 764120407

Commit:6c03602
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Embed YDF model in binary [Part 1] Code structure for the CC export. PiperOrigin-RevId: 763780409

Commit:83ab869
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Add Mean Average Precision Metric PiperOrigin-RevId: 762303928

Commit:bbf46c8
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Add support for survival analysis PiperOrigin-RevId: 760665297

Commit:9f2f1b7
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

SHAP values in the prediction analysis. PiperOrigin-RevId: 758671143

Commit:1d120b9
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Add total_max_num_nodes_hyperparameter to C++ PiperOrigin-RevId: 756751520

Commit:2e669f4
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Expose the sum of abs values of the shape values as a measure of variable importance. PiperOrigin-RevId: 756641315

Commit:6b84b4a
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Allow custom fields in model metadata PiperOrigin-RevId: 755822672

Commit:b9e968c
Author:Richard Stotz
Committer:Copybara-Service

Optimize handling of indicator labels in NDCG PiperOrigin-RevId: 745955921

Commit:4ddbf46
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Clarify NDCG implementation Fix typos, add comments, bring notation closer to the paper. More meaningful tests that no longer rely on outcome of random values. PiperOrigin-RevId: 745609685

Commit:f71ff3d
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Configure the features and feature orders in the model & prediction analysis. PiperOrigin-RevId: 742296003

Commit:d41c040
Author:Richard Stotz
Committer:Copybara-Service

[YDF] [TF-DF] Fix handling of byte values in CategoricalSpec PiperOrigin-RevId: 733329637

Commit:03f69f4
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Replace a directory move operation (executed by the manager) by multiple file move operations (executed by workers) for distributed GBT training. PiperOrigin-RevId: 730769512

Commit:c94bc47
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Save / Load deep models PiperOrigin-RevId: 728685775

Commit:83220b5
Author:Mathieu Guillame-Bert
Committer:Richard Stotz

Remove CHECK / FATAL from training code. PiperOrigin-RevId: 723457491

Commit:e539028
Author:Richard Stotz
Committer:Richard Stotz

[YDF] Add PDPs for deep models PiperOrigin-RevId: 725207520

Commit:a845b13
Author:Mathieu Guillame-Bert
Committer:Richard Stotz

Fix OSS build. PiperOrigin-RevId: 720170531

Commit:750504d
Author:Mathieu Guillame-Bert
Committer:Richard Stotz

mplement Anchor forests (Part 2) PiperOrigin-RevId: 715752402

Commit:b98a119
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Add PDPs for deep models PiperOrigin-RevId: 725207520

Commit:a7fde2a
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Remove CHECK / FATAL from training code. PiperOrigin-RevId: 723457491

Commit:b89f193
Author:Mathieu Guillame-Bert
Committer:Richard Stotz

Fix OSS build. PiperOrigin-RevId: 720170531

Commit:e17668b
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

mplement Anchor forests (Part 2) PiperOrigin-RevId: 715752402

Commit:ca346cb
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Add sparse_oblique_max_num_projections hyperparameter PiperOrigin-RevId: 701891284

Commit:fd34b13
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Oblique: Add integer weights PiperOrigin-RevId: 701890429

Commit:bd66459
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Oblique: Add power of two weights PiperOrigin-RevId: 701863564

Commit:e7c0eb7
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Deprecate SparseObliqueSplit.binary_weights hyperparameter In favor of `SparseObliqueSplit.weights`. PiperOrigin-RevId: 701854322

Commit:82dc873
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Add standalone evaluation PiperOrigin-RevId: 700701433

Commit:a4cccb6
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Fix regression / ranking CEP PiperOrigin-RevId: 700678738

Commit:075e567
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Feature selection (part 2) PiperOrigin-RevId: 699129506

Commit:2e16cb8
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Implement Anchor forests (slow condition eval; p1) PiperOrigin-RevId: 698739620

Commit:52c6ae0
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Add support for sequence vector features PiperOrigin-RevId: 688968619

Commit:e315892
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Remove TF from YDF build process. PiperOrigin-RevId: 688884179

Commit:1c59e9d
Author:Mathieu Guillame-Bert
Committer:Richard Stotz

Read avro files without dependencies (part 7; last one!) PiperOrigin-RevId: 684390907

Commit:9ae9347
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Read avro files without dependencies (part 7; last one!) PiperOrigin-RevId: 684390907

Commit:a95ab83
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Enable distributed training for Ranking GBT. PiperOrigin-RevId: 676466613

Commit:a7c8db2
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Store loss options in the model PiperOrigin-RevId: 676427940

Commit:7dafafd
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Move loss options definition Old: learner/gradient_boosted_trees/gradient_boosted_trees.proto New: model/gradient_boosted_trees/gradient_boosted_trees.proto PiperOrigin-RevId: 676396458

Commit:0d66aba
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Fix Hyperparameter definition of NDCG truncation This change adds a few fixes to the NDCG truncation - Add a Python test that the learner correctly truncates - Simplify the proto by re-using the existing LambdMart options proto - Set the different ranking options as mutually exclusive hyperparameters - Fix the definition of the truncation hyperparameters as integers PiperOrigin-RevId: 676387366

Commit:ec48a7b
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Add parameter to control the maximum duration of the model analysis. Default to 10 seconds. PiperOrigin-RevId: 675552053

Commit:8b04210
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Allow configuring the truncation of NDCG losses PiperOrigin-RevId: 675173198

Commit:d5630e6
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Rename LAMBDA_MART_NDCG5 to LAMBDA_MART_NDCG We want to make the truncation parameter configurable. Renaming the loss is the first step. PiperOrigin-RevId: 675162089

Commit:2c77d15
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Multi-threaded model prediction and evaluation PiperOrigin-RevId: 675092823

Commit:0b87800
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Add support for compressed tfrecords without tf dependencies. PiperOrigin-RevId: 673388515

Commit:b080eab
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Allow prediction and evaluation with slow engine in Python PiperOrigin-RevId: 671272015

Commit:579c3b8
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Clean up PYDF learner parameters PYDF exposes some parameters on every learner that are only supported on some of them. This change cleans up the lists of hyperparameters. This change also fixes some of the documentation of the learners. PiperOrigin-RevId: 668420630

Commit:00f1c20
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Add anomaly detection quality tests PiperOrigin-RevId: 665378493

Commit:cb01a4d
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Detect user-supplied hyperparameters, Also fixes hyperparameter handling in Isolation Forests PiperOrigin-RevId: 655910265

Commit:4a01e16
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Large amount of clean-up and refactors in preparation to layer-wise learning PiperOrigin-RevId: 653984280

Commit:86f7edf
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Anomaly detection; Enable model and prediction analysis of isolation forest models (part 6) PiperOrigin-RevId: 644041112

Commit:887b122
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Anomaly detection; Isolation forest c++ learner (part 4) PiperOrigin-RevId: 643984861

Commit:933e38d
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Anomaly detection; Isolation forest c++ model (part 3) PiperOrigin-RevId: 643984185

Commit:f319589
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Anomaly detection; ccleaner + decision tree utilities (part 2) PiperOrigin-RevId: 642919627

Commit:33c15ad
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Anomaly detection; Create the ANOMALY_DETECTION task (part 1) PiperOrigin-RevId: 642918719

Commit:2ec3887
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Internal representation of a forest before beeing converted to Jax code PiperOrigin-RevId: 627328319

Commit:d6c9ce3
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Store the training dataset feature dtypes and use it when exporting a model to TensorFlow. PiperOrigin-RevId: 624114118

Commit:68053b9
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Expose max_num_projections hyperparameter Also improve documentation of hyperparameters for oblique splits, in particular fixing the incorrect documentation for the density parameter PiperOrigin-RevId: 615017123

Commit:f1ea1e5
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Add support for model serialization / unserialization to std::string in the C++ API. PiperOrigin-RevId: 610774439

Commit:50a3f02
Author:Richard Stotz
Committer:Copybara-Service

Prepare release of TF-DF 1.9.0rc0 and YDF 1.9.0rc0 PiperOrigin-RevId: 610665881

Commit:dfe9124
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

No change PiperOrigin-RevId: 602751469

Commit:e69b925
Author:Richard Stotz
Committer:Copybara-Service

[PYDF] Fix TF-DF model loading when using categorical columns PiperOrigin-RevId: 599743316

Commit:65316b7
Author:Richard Stotz
Committer:Copybara-Service

[PYDF] Fix confusion table. Checked that the result now matches the CLI output. PiperOrigin-RevId: 589119576

Commit:639861a
Author:Mathieu Guillame-Bert
Committer:Copybara-Service

Add actionnable error when training with monotonic constraints and keep_non_leaf_label_distribution=false. PiperOrigin-RevId: 588829949

Commit:46b7cbb
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Remove unused proto import PiperOrigin-RevId: 586238575

Commit:4639143
Author:Richard Stotz
Committer:Copybara-Service

[YDF] Add allow_tokenization_for_inference_as_categorical_set to dataspec guide PiperOrigin-RevId: 584879316