Proto commits in waymo-research/waymo-open-dataset

These 44 commits are when the Protocol Buffers files have changed:

2025-04-29

Merged commit includes the following changes: 752418516 by Waymo Research: Update metric to show both ADE@3s and ADE@5s. -- 752345912 by Waymo Research: Fix minor issues in the comments. -- 751690276 by Waymo Research: Add functions in the metric implementation to handle the situations including: 1) The number of rated trajectories is less or more than expected. 2) The number of waypoints per trajectory is not equal to what we expect. -- 751535247 by Waymo Research: Add rater feedback metric computation example to tutorial colab. -- 751207399 by Waymo Research: Internal update. -- 750494156 by Waymo Research: Fixes for the Waymo Open Dataset pip package. -- 747480405 by Waymo Research: Add a metric proto and some internal update. -- 746347930 by Waymo Research: Internal dependency fix. -- 743622990 by Waymo Research: Fix shape for WOSAC TL default. Changed Pypi version. -- 742687609 by Waymo Research: Fixing error handling for traffic lights. -- PiperOrigin-RevId: 752418516

The documentation is generated from this commit.

2025-03-31

Merged commit includes the following changes: 742314309 by Waymo Research: Refactored and updated README and LOG version history. -- 742306634 by Waymo Research: Internal changes. -- 742298913 by Waymo Research: Minor change. -- 742249226 by Waymo Research: Improve documentation and comments for releasing WOD Challenges 2025. -- PiperOrigin-RevId: 742314309

2025-03-27

Merged commit includes the following changes: 741239628 by Waymo Research: Internal change. -- 741230322 by Waymo Research: Internal changes. -- 741170597 by Waymo Research: Adding vision-based end-to-end driving challenge tutorial. -- 738857805 by Waymo Research: Add data and submission protos for WOD E2ED. -- 738815552 by Waymo Research: Internal change -- 738470599 by Waymo Research: Remove unused #includes from scenario_conversion.cc -- 738040001 by Waymo Research: Implement red light violation as a WOSAC metric. -- 736436960 by Waymo Research: Introducing filters for certain metrics based on object type. -- 734436579 by Waymo Research: Fixing an existing test. -- 733427871 by Waymo Research: Add WOD scenario gen tutorial. This colab demonstrates the process for generating and evaluating submissions for the WOD Scenario Generation Challenge. This includes the following: * Stripping ground truth scenarios of privileged information which should not be used during inference. * Generating scenarios using a random policy. * Evaluating generated scenarios. * Packaging generated scenarios for submission. -- 729692436 by Waymo Research: Fix dependencies in waymo_open_dataset data conversion and metrics tests. -- 728900236 by Waymo Research: Fix an issue with angle averaging in the WOMD metrics. This was a bug but it has almost no impact on metrics results. This is because the bug can only cause a box to have a flipped heading in some cases, however only the bounds of the box are used so the heading has no effect. Ran metrics on the top current leaderboard entry for WOMD. There was no effect on mAP scores, the only change was that the overlap rate changed from 0.07296534 to 0.072959416 a difference of 0.000005924 or a difference of .008%. -- 728782706 by Waymo Research: Improve IoU computation on edge case. -- 728708303 by Waymo Research: Fix dependency. -- 723102280 by Waymo Research: Remove `srcs_version` and `python_version` attributes, as they already default to `"PY3"` -- 718096234 by Waymo Research: Internal change. -- 716058149 by Waymo Research: Enable WOSAC support both sim agent and scenario gen open challenge, used a base class for those global variable. -- 689436995 by Waymo Research: Change joint_scene_to_trajectories to allow a None `scenario` input arg. In this case, the returned trajectories only include data in `joint_scene` without log validation and history. -- 687996140 by Waymo Research: Automated Code Change -- 685099822 by Waymo Research: Automated Code Change -- 682720169 by Waymo Research: Fix function `scenario_to_joint_scene` to populate dimension and obj_type field in all `simulated_trajectories` of the returned `JointScene`. These `simulated_trajectories` are constructed from tracks returned by `trajectory_utils.ObjectTrajectories.from_scenario(scenario)` which reads dimension and type from Scenario.tracks.states -- 679744096 by Waymo Research: Add object_type and dimension fields in `SimulatedTrajectory` -- 672618721 by Waymo Research: Reduces the log cadence of the detection metrics ops. -- PiperOrigin-RevId: 741239628

2024-04-11

Merged commit includes the following changes: 623876167 by Waymo Research: Internal change. -- 623843892 by Waymo Research: Updating pywheel version and tutorials. -- 623748328 by Waymo Research: Adding new required fields for motion-dataset challenges submissions. New fields: lidar/camera usage, usage of open-source pre-trained model, number of model parameters. -- 623529807 by Waymo Research: Fixed an incorrect error statement. -- 621609924 by Waymo Research: Internal naming change. No feature changes. -- PiperOrigin-RevId: 623876167

2024-03-18

Merged commit includes the following changes: 616745794 by Waymo Research: Modify config for the 2024 WOSAC challenge. -- 616215113 by Waymo Research: Internal changes. -- 616204684 by Waymo Research: Small text and typo fixes. -- 616193525 by Waymo Research: License header updates. -- 616192816 by Waymo Research: Updating pip package and README file. -- 616065453 by Waymo Research: Fix tutorial and api for womd -- 615749226 by Waymo Research: Internal change. -- 615478267 by Waymo Research: Internal changes. -- 614597908 by Waymo Research: Add z-stretching to the computation of distances to polylines. "Z-stretch" is scaling factor for vertical distances used when finding the closest segment to a query point. This prevents wrong associations in cases with under- and over-passes. -- 614597569 by Waymo Research: Modify distance to polylines function to use altitude. Altitudes i.e. z-coordinates are used to find the closest segment to a query point. The distances returned remain 2d distances in the XY plane. -- 614597267 by Waymo Research: Batch computation of distances to polylines. Instead of iterating on polylines one by one, they are stacked with the same padded length and processed all at once. -- 611184527 by Waymo Research: Automated Code Change -- 610359862 by Waymo Research: Automated Code Change -- 607768062 by Waymo Research: Internal fixes. -- 607661995 by Waymo Research: Use central difference instead of forward difference for derivative fields used in Sim Agents metrics. -- 607067387 by Waymo Research: Normalizes the heading difference angle to (-PI, PI) in the motion challenge metrics trajectory classifier. This also adjusts some of the classifier thresholds to improve classification. This CL also adds multiple unit tests to validate the new logic. -- 606237500 by Waymo Research: Modify object distance computation to enable representing objects with rounded rectangles. Set default distance computation to use a rounding factor of `0.7`. -- 605292127 by Waymo Research: Adding simulated collision and offroad rates for sim agents. -- 604720923 by Waymo Research: Update colab, fix pytype errors, reformat occupancy-flow files. -- 602441918 by Waymo Research: Change paper bibtex -- 601226921 by Waymo Research: fix typo api name in tutorial -- 601222323 by Waymo Research: Add tutorial of merging WOMD camera data scenario protos with existing dataset, and extracting camera embeddings from camera tokens. -- 601220113 by Waymo Research: add util functions to load camera data for WOMD -- 600650427 by Waymo Research: Add camera tokens field in scenario proto for WOMD dataset -- 598915141 by Waymo Research: Automated Code Change -- 596061334 by Waymo Research: internal change -- PiperOrigin-RevId: 616745794

2023-08-16

Merged commit includes the following changes: 536507887 by Waymo Research: Internal changes. -- 535644081 by Waymo Research: Update object asset utility functions and add tutorial -- 535501261 by Waymo Research: Expose and register `world_to_image_moving_point` -- 534186236 by Waymo Research: Add object asset utility functions (points/rays/box transform utils; ray-box intersection) -- 534139692 by Waymo Research: Internal changes. -- 534131116 by Waymo Research: Internal changes. -- 534130942 by Waymo Research: Internal changes. -- 534130743 by Waymo Research: Update py_metrics_ops and py_camera_model_ops. -- 532900290 by Waymo Research: Internal update. -- 532893972 by Waymo Research: Fix the camera_segmentation_metrics test -- PiperOrigin-RevId: 536507887 Merged commit includes the following changes: 539986977 by Waymo Research: Internal change. -- 539753670 by Waymo Research: Object Asset tutorial update -- 539718985 by Waymo Research: README update -- 539132857 by Waymo Research: internal change -- 538815866 by Waymo Research: Fix a bug in the Component.schema handled python type aliases. -- 538628065 by Waymo Research: ptype annotation -- 538610689 by Waymo Research: Object asset tutorial update -- 538587104 by Waymo Research: A codec to encode/decode compressed/uncompressed object assets. -- 538586904 by Waymo Research: PCA based compression algorithm for object asset dataset. -- 538586680 by Waymo Research: Utils to create tiles for object asset compression. -- 538384461 by Waymo Research: Internal changes. -- 537605349 by Waymo Research: Update `object_asset` components by representing points and rays in the laser box frame. -- PiperOrigin-RevId: 539986977 Merged commit includes the following changes: 553989430 by Waymo Research: Fix camera_model_ops_test -- 553989342 by Waymo Research: Internal change. -- 553989275 by Waymo Research: Update dependencies. -- 553989200 by Waymo Research: Clean up *.ipynb files. -- 553989060 by Waymo Research: Update pip package version. -- 553898337 by Waymo Research: Expose ray compressed component. -- 552893003 by Waymo Research: fit_pca interface was changed to return a tuple, while the test wasn't updated. This change fixes the issue. -- 549099197 by Waymo Research: bug fix -- 540784140 by Waymo Research: Internal change. -- PiperOrigin-RevId: 553989430 Merged commit includes the following changes: 557327568 by Waymo Research: Update version of the rules_python blaze rules to use py_binary targets. -- 555668128 by Waymo Research: Expose data loading examples from GCP bucket -- 554969726 by Waymo Research: Add support for different types of filtered aligned types -- 554910323 by Waymo Research: Internal change. -- 554784143 by Waymo Research: Internal Code Change -- 554488132 by Waymo Research: Fix typo in docstring (description of wosac attribute shape) -- PiperOrigin-RevId: 557327568

Merged commit includes the following changes: 557327568 by Waymo Research: Update version of the rules_python blaze rules to use py_binary targets. -- 555668128 by Waymo Research: Expose data loading examples from GCP bucket -- 554969726 by Waymo Research: Add support for different types of filtered aligned types -- 554910323 by Waymo Research: Internal change. -- 554784143 by Waymo Research: Internal Code Change -- 554488132 by Waymo Research: Fix typo in docstring (description of wosac attribute shape) -- PiperOrigin-RevId: 557327568

2023-04-08

Merged commit includes the following changes: 522735165 by Waymo Research: Fix typo in waymo_open_dataset/pip_pkg_scripts/build.Dockerfile -- 522414744 by Waymo Research: Increment pip version number to v1.5.1 and add a description for the package. -- 522414631 by Waymo Research: Remove outdated quick_start.md. -- 522349881 by Waymo Research: Add a script to install a trimmed version of deeplab2. -- 522349747 by Waymo Research: Update tutorial/cpu-jupyter.Dockerfile. -- 522349586 by Waymo Research: Add missing wod_detection_evaluator. -- 522349446 by Waymo Research: Update tutorials to install latest pip package. -- 522349341 by Waymo Research: A workaround for building WOD under root user using bazel (e.g. from a colab). -- 522341705 by Waymo Research: Sim Agent object order invariant evaluation re-factor. -- 520969258 by Waymo Research: Update camera_segmentation utils and tutorial to support the v2 dataset. -- 520888886 by Waymo Research: Adding a bucketed version of the sim agents metrics, shown on the leaderboard. -- 520699633 by Waymo Research: Refactor keypoints_data to use Iterable instead of Collection. -- 520479947 by Waymo Research: Add a link to the maps tutorial in colab and add a pip install code block. -- 520076159 by Waymo Research: Update folder structure of WOD source code -- PiperOrigin-RevId: 522735165

2023-03-23

Merged commit includes the following changes: 518755282 by Waymo Research: Internal change 518691042 by Waymo Research: Re-write package build rules/scripts from scratch. Minor fixes for tutorials Rename third_party into wdl_limited Move all source code into src folder. -- PiperOrigin-RevId: 518755282

2023-03-16

Merged commit includes the following changes: 517007585 by Waymo Research: Fix test errors. -- 516987144 by Waymo Research: Fix a typo. -- 516984381 by Waymo Research: Update license headers. -- 516984214 by Waymo Research: Internal change. -- 516975261 by Waymo Research: Fix Docker/PIP build. -- 516973092 by Waymo Research: Update readme -- 516947665 by Waymo Research: Adopt WOD matcher which is consistent with other WOPD tasks. -- 516939776 by Waymo Research: Add python API for open dataset perception object matcher. -- PiperOrigin-RevId: 517007585

2023-03-15

Merged commit includes the following changes: 516944125 by Waymo Research: Fix Docker/PIP build. -- 516875295 by Waymo Research: Internal change. -- 516842075 by Waymo Research: Internal change. -- 516832288 by Waymo Research: Updating the metrics config used for the challenge. -- 516821552 by Waymo Research: Internal changes. -- 516715255 by Waymo Research: Text improvements -- 516706978 by Waymo Research: internal change -- 516652709 by Waymo Research: Update license -- 516406369 by Waymo Research: Internal change -- 516379408 by Waymo Research: Pose Estimation Metric -- 516378371 by Waymo Research: Tutorial section how to prepare a submission for Pose Estimation. -- 516362507 by Waymo Research: Add camera segmentation metadata to camera_segmentation_metrics proto. -- 516343363 by Waymo Research: Moving metrics to subdirectory, updating colab and config. -- 516109769 by Waymo Research: Internal change. -- 515769872 by Waymo Research: Update readme -- 515745780 by Waymo Research: internal change -- 515728914 by Waymo Research: Internal changes. -- 515728628 by Waymo Research: Add unknown types to plot_maps() for the open dataset. -- 515502201 by Waymo Research: Internal change. -- 514673620 by Waymo Research: Adding minADE to metrics for the Sim Agents Challenge. -- 513855661 by Waymo Research: Internal changes. -- 513846431 by Waymo Research: Internal change. -- 513779735 by Waymo Research: Rephrase constant description in `interaction_features.py`. -- 513338470 by Waymo Research: WODv2 Conversion and extraction tools for 3D segmentation labels. -- 513265584 by Waymo Research: Internal change. -- 513092778 by Waymo Research: Minor updates for WOMD tf_example conversion code, dataset.proto, and motion_metrics_utils.cc. -- 513069826 by Waymo Research: Add minor changes. -- 512960385 by Waymo Research: Changes to acceleration and misc comment additions. -- 512886999 by Waymo Research: Adding KernelDensity estimator and fixing a scaling issue with Histograms. -- 512776802 by Waymo Research: Internal Change -- 512726838 by Waymo Research: WODv2 Component for 3D segmentation labels. -- 512567495 by Waymo Research: Fixing typos in the sim agents challenge code. -- 511995607 by Waymo Research: WODv2 Conversion and extraction tools for camera segmentation label component. -- 511917431 by Waymo Research: WODv2 Component for camera segmentation labels. -- 511840902 by Waymo Research: WODv2: Set speed_z and accel_z to zero if missing. -- 511398724 by Waymo Research: Internal change. -- 510493915 by Waymo Research: Silence some pytype errors. -- 510072761 by Waymo Research: Internal change. -- 510064077 by Waymo Research: Internal change -- 510060988 by Waymo Research: Internal change -- 510059595 by Waymo Research: Add V2 tutorial. -- 510043354 by Waymo Research: Public interface for v2. -- 509971368 by Waymo Research: WODv2 Internal change. -- 509962554 by Waymo Research: WODv2 Internal change. -- 509944776 by Waymo Research: Util function to merge DataFrames for V2. -- 509942742 by Waymo Research: WODv2 Utility functions for processing LiDAR sensor data components. -- 509929775 by Waymo Research: WODv2 Internal change. -- 509903757 by Waymo Research: Adding Sim Agents tutorial and visualizations. -- 509731903 by Waymo Research: Internal change. -- 509723346 by Waymo Research: Internal change. -- 509656880 by Waymo Research: WODv2 Internal change. -- 509613276 by Waymo Research: Add text files with lists of frames with camera panoptic segmentation labels. -- 509560071 by Waymo Research: WODv2 Component, conversion and extraction tools for LiDAR human keypoints. -- 509446635 by Waymo Research: WODv2 Conversion and extraction tools for context. -- 509276457 by Waymo Research: WODv2 Components for contexts, including sensor calibration and miscellaneous statistics. -- 509260535 by Waymo Research: WODv2 Conversion and extraction for box label components. -- 509133116 by Waymo Research: WODv2 Components for box labels. -- 508705431 by Waymo Research: WODv2 Internal change -- 508515097 by Waymo Research: WODv2 Conversion and extraction for camera image component. -- 508462742 by Waymo Research: WODv2 Internal change -- 508434074 by Waymo Research: Internal change. -- 508388891 by Waymo Research: add default applicable_licenses -- 508230213 by Waymo Research: Add a perception maps tutorial with an interactive visualization. -- 508172875 by Waymo Research: WODv2 Conversion tools to create LiDAR data components from Frame protos -- 507895137 by Waymo Research: WODv2 Conversion tools to create component classes from Frame protos. -- 507812817 by Waymo Research: Adding time-to-collision metric feature. -- 507803153 by Waymo Research: Adding off-road and distance_to_road_edge features. -- 507531462 by Waymo Research: WODv2 Component for camera image data. -- 507523851 by Waymo Research: fix delta encoder input argument type typo -- 507239563 by Waymo Research: Add a tutorial of merging and extracting lidar data for Waymo Open Motion Dataset (WOMD). -- 507018109 by Waymo Research: WODv2 Rename column types of lists and add new column types of vectors. -- 507012013 by Waymo Research: WODv2 Components for LiDAR sensor data. -- 506818462 by Waymo Research: Implementation of lidar compression algorithm(delta encoding) to compress lidara data for waymo open dataset -- 506787456 by Waymo Research: Add metric computation and challenge submission to the PVPS tutorial notebook. -- 506662752 by Waymo Research: WODv2 Fix the data type of Transform from float32 to float64 (double). -- 506406848 by Waymo Research: WODv2 Dataset and PandasBackend classes. -- 506248934 by Waymo Research: Modified evaluated sim agents logic to return unique set. -- 506187265 by Waymo Research: update license rules -- 505760534 by Waymo Research: Internal change: Add delta encoding proto message -- 505690449 by Waymo Research: Adding the sdc as an evaluated sim agent. -- 505599154 by Waymo Research: Internal change. -- 505577204 by Waymo Research: Add PVPS metrics computation functions and unit tests. -- 505422602 by Waymo Research: WODv2 Components for pose and camera keypoints. -- 505414709 by Waymo Research: Internal changes. -- 505400656 by Waymo Research: WODv2 Base Component class for all components. -- 505400624 by Waymo Research: Create a proto for bounding boxes. -- 505397705 by Waymo Research: Extract Vec{2,3}d protos from keypoints namespace into a shared proto lib. -- 505365980 by Waymo Research: Internal change. -- 505170526 by Waymo Research: Add a map extractor for the perception open dataset. -- 505156348 by Waymo Research: Update camera_segmentation_utils to support writing panoptic labels to proto. -- 505076443 by Waymo Research: Adding collision and distance_to_nearest_object features. -- 505030953 by Waymo Research: Internal change -- 504890114 by Waymo Research: Add protos for camera video panoptic segmentation metrics. -- 504760716 by Waymo Research: Add submission and metric protos for human keypoints challenge. -- 504567220 by Waymo Research: Metrics computation and estimators. -- 504446270 by Waymo Research: These have been removed: - GetBoxesForTrajectoryStep() - PredictionToTrack() -- 504373405 by Waymo Research: - Adds CurrentTrackStep() to get the current (not future) track step. - Renames PredictionToTrack() to PredictionToTrackStep() to clarify that this function returns the track step and also to match CurrentTrackStep()'s name. - Adds a `use_current_box_dimensions` parameter to PredictionToPolygon() to allow using the current box dimensions instead of using the future box dimensions. - Marks these functions as deprecated: - GetBoxesForTrajectoryStep() - PredictionToTrack() -- 504228794 by Waymo Research: Adding metric features interface and implementation of trajectory features. -- 504052560 by Waymo Research: Add a new field in conversion config to customize max_num_modeled_agents. -- 503406518 by Waymo Research: Implementation of utils to handle trajectories and converters to submission protos. -- 501428566 by Waymo Research: Allow custom metrics to be computed. A custom metric is any new metric that is not already declared in the protos; instead, we can add new metrics identified by name. The custom metrics are computed by supplying a callback function, `CustomMetricsFn`. -- 500767944 by Waymo Research: Definition of the submission proto for the new Sim Agents Challenge. -- 499337551 by Waymo Research: Update OSS Waymo Open Dataset build for TF 2.11 -- 496727690 by Waymo Research: [NumPy] Remove references to deprecated NumPy type aliases. This change replaces references to a number of deprecated NumPy type aliases (np.bool, np.int, np.float, np.complex, np.object, np.str) with their recommended replacement (bool, int, float, complex, object, str). NumPy 1.24 drops the deprecated aliases, so we must remove uses before updating NumPy. -- 493723377 by Waymo Research: Update README -- 493156991 by Waymo Research: Factor the scenario conversion to open source. -- 493153260 by Waymo Research: Add a simple Vec3d class to the open dataset code base. -- 489551430 by Waymo Research: Minor fix to the tutorial colab (pointing to new pip package) -- 485454291 by Waymo Research: Update OSS Waymo Open Dataset build for TF 2.10 -- 482620556 by Waymo Research: Add num_objects_gt in WOD tracking metrics. -- 481669617 by Waymo Research: Fix or ignore some pytype errors. -- 479696586 by Waymo Research: Explicitly cast semantic and instance labels to uint32 before combining to prevent overflow. -- 479062018 by Waymo Research: Simplify the conditional with a backward compatible construct. -- 474934287 by Waymo Research: Add downsampling and polygon sampling to the tf.Example conversion. This CL provides user options to change the sample spacing of the roadgraph data in the conversion from Scenario protos to tf.Example protos. The samples are cubic spline interpolated from the 0.5m spaced data in the source Scenario protos. -- 474158453 by Waymo Research: Use a public config proto for tf.Example conversion. -- 473895052 by Waymo Research: Adds "Details" field to TrackingMeasurement proto and populates this during matching. The structure of the TrackingMeasurement::Details proto is designed to match DetectionMeasurement::Details. -- 473763101 by Waymo Research: Replace `tensorflow::Status::OK()` with` tensorflow::OkStatus()`. -- 471373208 by Waymo Research: Internal Only. -- 471092278 by Waymo Research: Add driveways to the open dataset map extraction. -- 470829187 by Waymo Research: Add "Copyright $YEAR Google Inc. All Rights Reserved." notice for relevant files. -- 470828831 by Waymo Research: Use <cstdint> instead of custom integral_type.h -- 470745321 by Waymo Research: internal -- 470744152 by Waymo Research: internal -- 469444575 by Waymo Research: BUILD cleanup -- 468586907 by Waymo Research: Chenge out-of-date confusing code comments. -- 467305955 by Waymo Research: internal changes. -- 460558948 by Waymo Research: Fix bug in pip_pkg_scripts and 2d pvps tutorial. -- PiperOrigin-RevId: 516944125

2022-06-15

Merged commit includes the following changes: 449089867 by Waymo Research: Fix ImportError: cannot import name 'py_camera_model_ops' from 'waymo_open_dataset.camera.ops'. -- PiperOrigin-RevId: 449089867 Merged commit includes the following changes: 450707323 by Waymo Research: Internal change. -- 450569734 by Waymo Research: Add supporting code for camera panoptic segmentation. -- 450524212 by Waymo Research: Add checks for semseg metrics calculation tool for prediction and groundtruth inconsistency. -- 449871784 by Waymo Research: Update default TF version to 2.6 in docker build file. -- 449775899 by Waymo Research: Add camera panoptic segmentation labels and segmentation class descriptions to WOD dataset protos. -- PiperOrigin-RevId: 450707323 Merged commit includes the following changes: 454209626 by Waymo Research: Fix typos in the code related to camera segmentation. -- 454008982 by Waymo Research: Update LICENSE -- 452181739 by Waymo Research: Minor updates to 3D Camera-Only Detection Challenge Tutorial -- 451512476 by Waymo Research: Internal changes -- 451287225 by Waymo Research: internal changes. -- PiperOrigin-RevId: 454209626 Merged commit includes the following changes: 454997235 by Waymo Research: Increment patch version from 1.4.8 to 1.4.9. -- 454996503 by Waymo Research: Internal changes. -- 454753128 by Waymo Research: Update README -- 454688555 by Waymo Research: Fix bug in camera segmentation visualization. -- 454484933 by Waymo Research: Add ego_vehicle segmentation class. -- 454247004 by Waymo Research: Minor updates to camera segmentation build dependencies. -- PiperOrigin-RevId: 454997235

2022-05-13

Merged commit includes the following changes: 448338382 by Waymo Research: Update README for May 2022 update (part 2). -- 448317856 by Waymo Research: Add tutorial for the 3D Camera-Only Detection Challenge. -- 448283343 by Waymo Research: Adopt `num_top_lidar_points_in_box` for metrics computation. -- 448052409 by Waymo Research: Fix bug in computing flow-grounded AUC metric. -- 447871071 by Waymo Research: Include LET-3D-APL to the WOD detection metrics ops. -- 447763686 by Waymo Research: Internal changes. -- PiperOrigin-RevId: 448338382 Merged commit includes the following changes: 448589434 by Waymo Research: Increment patch version number of pip package to 1.4.7. -- 448377142 by Waymo Research: internal changes. -- PiperOrigin-RevId: 448589434

2022-05-06

Merged commit includes the following changes: 446353751 by Waymo Research: Update README for v1.3.2 -- 446350217 by Waymo Research: Include missing dependency for segmentation_metrics.cc -- 446346357 by Waymo Research: Add camera breakdown names in config_util_py. -- 446224710 by Waymo Research: Fix camera model ops with depth. -- 446119384 by Waymo Research: Add tool to compute LET metrics. -- 446051695 by Waymo Research: Update comments on camera-lidar association labels. -- 445471333 by Waymo Research: Add num_top_lidar_points_in_box to label proto. -- 445195261 by Waymo Research: Internal change. -- 445012091 by Waymo Research: internal change. -- 444705255 by Waymo Research: Add implementation for std::clamp so that building the pip package succeeds with C++11. -- 444393213 by Waymo Research: Enable LET metric to compute localization affinity and IoU for top down view box with TYPE_2D. -- 444367914 by Waymo Research: Fix a typo in breakdown_generator.cc. -- PiperOrigin-RevId: 446353751 Merged commit includes the following changes: 446489183 by Waymo Research: Increase patch version of the pip package -- 446488897 by Waymo Research: Fix typo. -- 446448751 by Waymo Research: Fix wheel package. -- PiperOrigin-RevId: 446489183

2022-04-22

Merged commit includes the following changes: 443692694 by Waymo Research: Update the README for the Waymo Open Dataset April 2022 release. -- 443252868 by Waymo Research: Update pip version from 1.4.4 to 1.4.5. -- 442846048 by Waymo Research: Fix camera estimation based on FOV. -- 442691008 by Waymo Research: Add solver divergence check in rolling shutter projection. -- 442314891 by Waymo Research: Handle TYPE_UNKNOWN correctly in metrics. -- 442312573 by Waymo Research: Handle TYPE_UNKNOWN correctly in metrics. -- 442309573 by Waymo Research: Handle TYPE_UNKNOWN correctly in metrics. -- 442146091 by Waymo Research: Exclude blank scenes (waypoints) from occupancy and flow metrics. -- 442136227 by Waymo Research: Remove unused comments related to Python 2 compatibility. -- PiperOrigin-RevId: 443692694

2022-04-15

Merged commit includes the following changes: -- 435451085 by Waymo Research: Add depth in the camera projection. -- 435546971 by Waymo Research: Internal change -- 436651324 by Waymo Research: Add Localization Error Tolerant (LET) Metrics, including LET-3D-AP and LET-3D-APL. -- 437126042 by Waymo Research: Remove lateral error constraint in LET metrics. -- 441839576 by Waymo Research: Add SemSeg to submission_manager -- 441818945 by Waymo Research: Update readme -- 441802666 by Waymo Research: Add instruction on creating 3d semseg submission files. -- 441799995 by Waymo Research: Internal changes. -- 441648297 by Waymo Research: Add a few new utils for Segmentation metric calculation -- 441621310 by Waymo Research: Update readme for the April release -- 441620538 by Waymo Research: Internal change. -- 441582306 by Waymo Research: Add z-axis speed and acceleration in lidar label metadata. -- 441576134 by Waymo Research: Support rolling shutter projection on moving points. -- 441545916 by Waymo Research: Add Camera-Only 3D Detection task to submission proto. -- 441386180 by Waymo Research: Add camera_synced_box to label proto. -- 441274777 by Waymo Research: Fix documentation: order was not correct for height/width on build_camera_depth_image -- 441223622 by Waymo Research: Add Camera breakdown in metrics. -- 440180344 by Waymo Research: Add optional most visible camera name to lidar labels. -- 439742974 by Waymo Research: Fix a bug in segmentation metrics tool which will cause OOM. -- 439414596 by Waymo Research: Minor fix on the comments. -- 442031083 by Waymo Research: Internal change. --

Merged commit includes the following changes: 442031083 by Waymo Research: Internal change. -- PiperOrigin-RevId: 442031083

Merged commit includes the following changes: 441839576 by Waymo Research: Add SemSeg to submission_manager -- 441818945 by Waymo Research: Update readme -- 441802666 by Waymo Research: Add instruction on creating 3d semseg submission files. -- 441799995 by Waymo Research: Internal changes. -- 441648297 by Waymo Research: Add a few new utils for Segmentation metric calculation -- 441621310 by Waymo Research: Update readme for the April release -- 441620538 by Waymo Research: Internal change. -- 441582306 by Waymo Research: Add z-axis speed and acceleration in lidar label metadata. -- 441576134 by Waymo Research: Support rolling shutter projection on moving points. -- 441545916 by Waymo Research: Add Camera-Only 3D Detection task to submission proto. -- 441386180 by Waymo Research: Add camera_synced_box to label proto. -- 441274777 by Waymo Research: Fix documentation: order was not correct for height/width on build_camera_depth_image -- 441223622 by Waymo Research: Add Camera breakdown in metrics. -- 440180344 by Waymo Research: Add optional most visible camera name to lidar labels. -- 439742974 by Waymo Research: Fix a bug in segmentation metrics tool which will cause OOM. -- 439414596 by Waymo Research: Minor fix on the comments. -- PiperOrigin-RevId: 441839576

2022-04-01

Merged commit includes the following changes: -- 435451085 by Waymo Research: Add depth in the camera projection. -- 435546971 by Waymo Research: Internal change -- 436651324 by Waymo Research: Add Localization Error Tolerant (LET) Metrics, including LET-3D-AP and LET-3D-APL. -- 437126042 by Waymo Research: Remove lateral error constraint in LET metrics. --

Merged commit includes the following changes: -- 434613307 by Waymo Research: Make explanation of joint occupancy-flow metrics more accurate. -- 438083067 by Waymo Research: Change task config for Occupancy Flow challenge. Set `cumulative_waypoints = false`. Note that this changes the challenge parameters. Participants should train models and submit predictions with this setting. Add gamma parameter for amplifying predicted occupancy probabilities when visualizing occupancy grids. -- 438179325 by Waymo Research: Minor fixes for the 3d semseg colab. --

Merged commit includes the following changes: 427369385 by Waymo Research: Internal change -- 427363374 by Waymo Research: Add command line tools for semantic segmentation metrics This CL adds a command line tool for generating prediction file and a tool for calculating metrics. -- 427352112 by Waymo Research: Add a colab tutorial for the 3D semantic segmentation labels. -- 427343731 by Waymo Research: Update bibtex citation for motion dataset -- 427337830 by Waymo Research: Update for perception dataset v1.3 release -- 427301282 by Waymo Research: Tutorial for using and visualizing human keypoints. -- 427299085 by Waymo Research: Keypoint util to crop image and keypoints to a bounding box. -- 427283846 by Waymo Research: Fix a typo -- 427005379 by Waymo Research: Add semantic segmentation metrics calculation utils. This cl adds util function to calculate mean iou for semantic segmentation. -- 426999326 by Waymo Research: Functions to draw 2D and 3D keypoints in colab. -- 426440925 by Waymo Research: Add segmentation label type. -- 426274400 by Waymo Research: Functions to build wireframes from human keypoints for visualization purposes. -- 425752522 by Waymo Research: N/A -- 425741762 by Waymo Research: Append TP, FP, FN to the Precision-Recall tensor. -- 425734533 by Waymo Research: An util library to simplify visualization of keypoint keypoints. -- 425734181 by Waymo Research: Add pytype annotations to frame_utils. -- 425657425 by Waymo Research: Changes ParseScenarioAndPredictionsFromTensors to work if the first agent(s) are invalid, but later agents are valid. -- 424706428 by Waymo Research: Add a soft mAP metric to the open motion dataset. -- 424641292 by Waymo Research: Fix pip docker image building scripts. -- 424161283 by Waymo Research: Changes std::vector to use reserve to ensure empty objects are not created. -- 420333827 by Waymo Research: Print better ShardName for BreakdownGeneratorAllButSign -- 418706218 by Waymo Research: Added proto fields to store camera -> lidar object association. -- 418094418 by Waymo Research: Added a new type for FOREHEAD keypoints. -- 413021210 by Waymo Research: Migrate to protobuf default fast c++ extension -- 411919991 by Waymo Research: Migrate to protobuf default fast c++ extension -- 410384101 by Waymo Research: Force garbage collection in reset_states() of detection evaluator. -- 408748477 by Waymo Research: Add an extra namespace for human keypoint protos. -- 407649419 by Waymo Research: Proto messages and fields to store human keypoints for the Perception dataset. -- 398333246 by Waymo Research: Fix memory overbound reading which caused tsan test failure -- PiperOrigin-RevId: 427369385 -- 429336959 by Waymo Research: Internal change -- 429197557 by Waymo Research: Internal change -- 429143515 by Waymo Research: Colab tutorial for WOD occupancy flow challenge. -- 429142549 by Waymo Research: Utilities for WOD occupancy flow challenge. -- 427909488 by Waymo Research: Internal change. -- 427906270 by Waymo Research: OKS metric for human keypoints. -- 427902082 by Waymo Research: Internal change. -- 429712750 by Waymo Research: Add licence headers for new keypoint modules. -- 429712662 by Waymo Research: Add examples into colab how to use metrics. -- 429712618 by Waymo Research: Tools to convert keypoint protos into tensors. -- 429712128 by Waymo Research: Add per class IOU for 3D semantic segmentation. Also fix some lints. -- 429694437 by Waymo Research: Split keypoint utils into data and drawing utils. -- 429693761 by Waymo Research: WOD occupancy flow challenge: add instructions for running a Jupyter kernel locally. -- 429686904 by Waymo Research: Improve wording issues for human keypoints. -- 429685905 by Waymo Research: Tools to create all supported metrics for keypoints. -- 429685685 by Waymo Research: Metric Percetage of Correct Keypoints (PCK). -- 429685523 by Waymo Research: MPJPE metric for human keypoints. -- 429685363 by Waymo Research: Refactor keypoint OKS metric by extracting a base class for all metrics. -- 429667913 by Waymo Research: Update the 3d semseg types and tutorial colab. -- 429662948 by Waymo Research: internal updates -- 429651913 by Waymo Research: Update readme -- 429617238 by Waymo Research: Minor readability changes for the open motion dataset metrics. -- 429466469 by Waymo Research: Add semantic segmentation submission proto and update dummy files. -- 429416918 by Waymo Research: WOD occupancy flow challenge: create a separate submission file for each test shard. This ensures that the output protobufs stay under the 2GB limit. It also reduces the memory requirement for running the colab. -- 430520427 by Waymo Research: Add license headers to files which are missing it. -- 429784107 by Waymo Research: Update a comment -- 33277383 by Waymo Research: Internal change -- 433261081 by Waymo Research: Fix typos and minor issues in the code related to keypoints. -- 433132388 by Waymo Research: Clarify comments in occupancy flow modules. -- 432596992 by Waymo Research: Support compression and uncompression of segmentation labels. -- 432340005 by Waymo Research: Update command for creating submission tar.gz file. -- 432263484 by Waymo Research: Use list of scenario_ids in WOD occupancy flow tutorial notebook. -- 432248767 by Waymo Research: Internal change only. -- 432096622 by Waymo Research: internal change -- 432048666 by Waymo Research: Internal change. -- 432043703 by Waymo Research: Update semantic segmentation proto to allow multiple range images in each frame -- 431090436 by Waymo Research: Specify effective validation set for WOD occupancy flow challenge. Simplify submission proto messages. -- 433359745 by Waymo Research: Add arxiv link for the occupancy flow paper to the colab. -- 433341994 by Waymo Research: Internal updates -- 433377526 by Waymo Research: Normalize sdc yaw when generating occupancy flow ground-truth. -- 433505401 by Waymo Research: Minor fixes to the tutorial colabs. Updated the 3d semseg image. -- 433499289 by Waymo Research: Minor fixes to the keypoint tutorial. -- 433517877 by Waymo Research: Fix json for the keypoint tutorial. -- 433555762 by Waymo Research: Fix json for occupancy flow tutorial notebook. -- 433541722 by Waymo Research: Update the 3d semseg visualization image. Added a legend. --

2022-03-09

Merged commit includes the following changes: 433377526 by Waymo Research: Normalize sdc yaw when generating occupancy flow ground-truth. -- PiperOrigin-RevId: 433377526

Merged commit includes the following changes: 433359745 by Waymo Research: Add arxiv link for the occupancy flow paper to the colab. -- 433341994 by Waymo Research: Internal updates -- PiperOrigin-RevId: 433359745

2022-03-08

Merged commit includes the following changes: 433277383 by Waymo Research: Internal change -- 433261081 by Waymo Research: Fix typos and minor issues in the code related to keypoints. -- 433132388 by Waymo Research: Clarify comments in occupancy flow modules. -- 432596992 by Waymo Research: Support compression and uncompression of segmentation labels. -- 432340005 by Waymo Research: Update command for creating submission tar.gz file. -- 432263484 by Waymo Research: Use list of scenario_ids in WOD occupancy flow tutorial notebook. -- 432248767 by Waymo Research: Internal change only. -- 432096622 by Waymo Research: internal change -- 432048666 by Waymo Research: Internal change. -- 432043703 by Waymo Research: Update semantic segmentation proto to allow multiple range images in each frame -- 431090436 by Waymo Research: Specify effective validation set for WOD occupancy flow challenge. Simplify submission proto messages. -- PiperOrigin-RevId: 433277383

2022-02-19

Merged commit includes the following changes: 429712750 by Waymo Research: Add licence headers for new keypoint modules. -- 429712662 by Waymo Research: Add examples into colab how to use metrics. -- 429712618 by Waymo Research: Tools to convert keypoint protos into tensors. -- 429712128 by Waymo Research: Add per class IOU for 3D semantic segmentation. Also fix some lints. -- 429694437 by Waymo Research: Split keypoint utils into data and drawing utils. -- 429693761 by Waymo Research: WOD occupancy flow challenge: add instructions for running a Jupyter kernel locally. -- 429686904 by Waymo Research: Improve wording issues for human keypoints. -- 429685905 by Waymo Research: Tools to create all supported metrics for keypoints. -- 429685685 by Waymo Research: Metric Percetage of Correct Keypoints (PCK). -- 429685523 by Waymo Research: MPJPE metric for human keypoints. -- 429685363 by Waymo Research: Refactor keypoint OKS metric by extracting a base class for all metrics. -- 429667913 by Waymo Research: Update the 3d semseg types and tutorial colab. -- 429662948 by Waymo Research: internal updates -- 429651913 by Waymo Research: Update readme -- 429617238 by Waymo Research: Minor readability changes for the open motion dataset metrics. -- 429466469 by Waymo Research: Add semantic segmentation submission proto and update dummy files. -- 429416918 by Waymo Research: WOD occupancy flow challenge: create a separate submission file for each test shard. This ensures that the output protobufs stay under the 2GB limit. It also reduces the memory requirement for running the colab. -- PiperOrigin-RevId: 429712750

2022-02-17

Merged commit includes the following changes: 429336959 by Waymo Research: Internal change -- 429197557 by Waymo Research: Internal change -- 429143515 by Waymo Research: Colab tutorial for WOD occupancy flow challenge. -- 429142549 by Waymo Research: Utilities for WOD occupancy flow challenge. -- 427909488 by Waymo Research: Internal change. -- 427906270 by Waymo Research: OKS metric for human keypoints. -- 427902082 by Waymo Research: Internal change. -- PiperOrigin-RevId: 429336959

2022-02-09

Merged commit includes the following changes: 427369385 by Waymo Research: Internal change -- 427363374 by Waymo Research: Add command line tools for semantic segmentation metrics This CL adds a command line tool for generating prediction file and a tool for calculating metrics. -- 427352112 by Waymo Research: Add a colab tutorial for the 3D semantic segmentation labels. -- 427343731 by Waymo Research: Update bibtex citation for motion dataset -- 427337830 by Waymo Research: Update for perception dataset v1.3 release -- 427301282 by Waymo Research: Tutorial for using and visualizing human keypoints. -- 427299085 by Waymo Research: Keypoint util to crop image and keypoints to a bounding box. -- 427283846 by Waymo Research: Fix a typo -- 427005379 by Waymo Research: Add semantic segmentation metrics calculation utils. This cl adds util function to calculate mean iou for semantic segmentation. -- 426999326 by Waymo Research: Functions to draw 2D and 3D keypoints in colab. -- 426440925 by Waymo Research: Add segmentation label type. -- 426274400 by Waymo Research: Functions to build wireframes from human keypoints for visualization purposes. -- 425752522 by Waymo Research: N/A -- 425741762 by Waymo Research: Append TP, FP, FN to the Precision-Recall tensor. -- 425734533 by Waymo Research: An util library to simplify visualization of keypoint keypoints. -- 425734181 by Waymo Research: Add pytype annotations to frame_utils. -- 425657425 by Waymo Research: Changes ParseScenarioAndPredictionsFromTensors to work if the first agent(s) are invalid, but later agents are valid. -- 424706428 by Waymo Research: Add a soft mAP metric to the open motion dataset. -- 424641292 by Waymo Research: Fix pip docker image building scripts. -- 424161283 by Waymo Research: Changes std::vector to use reserve to ensure empty objects are not created. -- 420333827 by Waymo Research: Print better ShardName for BreakdownGeneratorAllButSign -- 418706218 by Waymo Research: Added proto fields to store camera -> lidar object association. -- 418094418 by Waymo Research: Added a new type for FOREHEAD keypoints. -- 413021210 by Waymo Research: Migrate to protobuf default fast c++ extension -- 411919991 by Waymo Research: Migrate to protobuf default fast c++ extension -- 410384101 by Waymo Research: Force garbage collection in reset_states() of detection evaluator. -- 408748477 by Waymo Research: Add an extra namespace for human keypoint protos. -- 407649419 by Waymo Research: Proto messages and fields to store human keypoints for the Perception dataset. -- 398333246 by Waymo Research: Fix memory overbound reading which caused tsan test failure -- PiperOrigin-RevId: 427369385

2021-09-21

Merged commit includes the following changes: 398049518 by Waymo Research: Add support for tf 2.6.0 -- 398022899 by Waymo Research: Store detection metrics details as repeated field so that different frames' results can be maintained. -- 397235629 by Waymo Research: Add custom iou functor to API -- 397103341 by Waymo Research: Add option for measurement details -- 396744255 by Waymo Research: Internal change -- 395271718 by Waymo Research: Add custom IOU calculation. -- PiperOrigin-RevId: 398049518

2021-09-02

Merged commit includes the following changes: 394570841 by Waymo Research: Add docs for boundaries and neighbors. -- 389931006 by Waymo Research: Handle empty prediction and ground truth sets when computing DetectionMetrics -- 389062697 by Waymo Research: Add boundary information for all lanes in the motion open dataset. -- 388692756 by Waymo Research: Internal change -- PiperOrigin-RevId: 394570841

2021-07-13

Merged commit includes the following changes: 384573389 by Waymo Research: Support tf 2.5.0 -- 382130107 by Waymo Research: Add lane connections and lane neighbors to the motion open dataset. -- 379335412 by Waymo Research: Internal change -- 375561943 by Waymo Research: Increment version number. -- PiperOrigin-RevId: 384573389

2021-03-10

Merged commit includes the following changes: 361979574 by Waymo Research: Internal fixes. -- 361978695 by Waymo Research: Internal fixes. -- 361977304 by Waymo Research: Internal fix. -- 361976035 by Waymo Research: Remove infra related documents not helpful for external users. -- 361972477 by Waymo Research: Internal fixes. -- 361963216 by Waymo Research: Internal fix. -- 361951534 by Waymo Research: Support sharded files in the latency eval checking script -- 361874698 by Waymo Research: Internal fixes. -- 361866199 by Waymo Research: Internal fixes. -- 361864127 by Waymo Research: Internal fixes. -- 361859594 by Waymo Research: Internal change. -- 361854185 by Waymo Research: Doc update -- PiperOrigin-RevId: 361979574

2021-03-09

Merged commit includes the following changes: 361849909 by Waymo Research: Add motion dataset and latency challenge. -- 361750962 by Waymo Research: Update the tutorial colab to work with the latest dataset. -- PiperOrigin-RevId: 361849909

2020-12-20

Merged commit includes the following changes: 346724176 by Waymo Research: Update Waymo Open Dataset quick start instructions on GitHub based on legal suggestion - direct people to Waymo Open Dataset website to sign agreement as the first step -- 345385613 by Waymo Research: Add tf.metric interface for tracking metrics. -- 345165072 by Waymo Research: Internal change -- 343933361 by Waymo Research: Add explanations of no-flow-label. -- 343759835 by Waymo Research: Add scene_flow to waymo open dataset proto. -- 343010370 by Waymo Research: Changes two assert_less(x, pow(2, k) - 1.001) to assert_less_equal(x, pow(2, k) - 1.) -- 338684728 by Waymo Research: Add op and python interface for tracking metrics. -- 337610591 by Waymo Research: Update a comment regarding bazel version -- 337610409 by Waymo Research: Add support for tf 2.3.0 -- 330165583 by Waymo Research: Fix transform_box for batched tensors -- 329727295 by Waymo Research: Internal change -- PiperOrigin-RevId: 346724176

2020-08-11

Merged commit includes the following changes: 325897695 by Waymo Research: Internal change -- 322229379 by Waymo Research: Fix the initialization of the metrics variables tp support TPUEstimator. -- 320970608 by Waymo Research: Purely Google refactor -- 318516763 by Waymo Research: Add fields to the Open Dataset proto for third-party extensions. -- 317327330 by Waymo Research: Add BEV box utils -- 316303115 by Waymo Research: Fully qualify uses of namespaced int64 to guard against the situation where others have defined int64 to be a different primitive type. (On many platforms either long or long long are acceptable definitions.) -- 315382146 by Waymo Research: Minor comment update. -- PiperOrigin-RevId: 325897695

2020-03-27

Merged commit includes the following changes: 303136843 by Waymo Research: Add a comment to clarify ALL_NS -- 303134886 by Waymo Research: Update example. -- PiperOrigin-RevId: 303136843

2020-03-20

Merged commit includes the following changes: 301743955 by Waymo Research: Do no enforce [-pi, pi] limit in metrics computation. -- 300022349 by Waymo Research: no op -- 299864259 by Waymo Research: Add ALL_BUT_SIGN breakdown. -- 298632480 by Waymo Research: Support shift in range image crop -- 296523377 by Waymo Research: Add domain adaptation support. -- 293905686 by Waymo Research: Update submission format -- PiperOrigin-RevId: 301743955

2019-12-16

Merged commit includes the following changes: 285790697 by Waymo Research: Update comment about angular velocity -- PiperOrigin-RevId: 285790697

2019-12-15

Update dataset.proto (#80) fix the comment of rotation calculation from the angular velocity

2019-12-11

Merged commit includes the following changes: 284922430 by Waymo Research: Add more options to detection metrics. -- 284050774 by Waymo Research: Correct a comment -- PiperOrigin-RevId: 284922430

2019-12-05

Merged commit includes the following changes: 283864064 by Waymo Research: INTERNAL CHANGE -- 283829381 by Waymo Research: Release camera model code -- 283817372 by Waymo Research: INTERNAL CHANGE -- 283807046 by Waymo Research: INTERNAL UPDATE -- 283356326 by Waymo Research: nop -- 282476443 by Waymo Research: Internal only change. -- 282476424 by Waymo Research: Internal only change. -- 282471719 by Waymo Research: Update submission proto -- 281367390 by Waymo Research: Use TF's MaxParallelism() API for number of threads. -- 281136877 by Waymo Research: Add a missing license -- 280744230 by Waymo Research: Internal change -- 280080825 by Waymo Research: Internal change -- 280031428 by Waymo Research: Add camera model license -- 279553622 by Waymo Research: Bug fix. Remove 'has_'. -- 279538682 by Waymo Research: Support camera name in the metrics computation tool -- 279419306 by Waymo Research: Populate camera name in the object proto. -- 279342012 by Waymo Research: Internal update. -- 279338440 by Waymo Research: Added proto for challenge submissions. -- 278944377 by Waymo Research: Add difficulty in the detection metrics computation tool. -- PiperOrigin-RevId: 283864064

2019-11-05

Merged commit includes the following changes: 278672950 by Waymo Research: Update configure.sh to switch workspace on different tf versions -- 278447530 by Waymo Research: Ground truth only breakdown impl (detection metrics only) -- 278424046 by Waymo Research: Add ground_truth_speed to detection_metrics TF op. -- 278027787 by Waymo Research: Change Velocity breakdown metric to be per class. -- 278026221 by Waymo Research: Fixes EstimateObjectSpeed usage so pds lives the lifetime of the matcher. -- 278017957 by Waymo Research: Fixes error and segfault in EstimateObjectSpeed when there are no groundtruth. -- 277320480 by Waymo Research: Fixes typo -- 276780711 by Waymo Research: Update tutorial frames based on latest v.1.0.1 data. -- 276528105 by Waymo Research: Improve speed breakdown by estimating velocity in predictions based on its nearest ground truth. -- 276100270 by Waymo Research: Add speed breakdown for computing metrics broken down by object speed. This breakdown may be subject to change: - Thresholds / buckets may change - Assignment of groundtruth to predictions may be changed to operate more like difficulty. -- 275306496 by Waymo Research: Remove an incorrect #include -- PiperOrigin-RevId: 278672950

2019-10-17

Merged commit includes the following changes: 275167206 by Waymo Research: Add a tool to compute tracking metrics -- 275070230 by Waymo Research: Add a field to pass the number of lidar points in the label proto. -- 274838665 by Waymo Research: Update a comment -- 274284872 by Waymo Research: Upgrade to tf 2.0 -- PiperOrigin-RevId: 275167206

2019-09-27

Merged commit includes the following changes: 271476762 by Waymo Research: Fix a confusing comment -- 269873244 by Waymo Research: Internal change -- 269632544 by Waymo Research: Internal change -- PiperOrigin-RevId: 271476762

2019-08-21

Waymo Open Dataset v1.0.0