Proto commits in tensorflow/profiler

These commits are when the Protocol Buffers files have changed: (only the last 100 relevant commits are shown)

Commit:271caa3
Author:Profiler Team
Committer:Copybara-Service

Input Pipeline Analysis: Flat Host Metrics Downstream Consumption PiperOrigin-RevId: 939719525

Commit:34588b6
Author:Profiler Team
Committer:Copybara-Service

Input Pipeline Analysis: Flat Host Metrics Utility Updates PiperOrigin-RevId: 939708138

Commit:94ec319
Author:Profiler Team
Committer:Copybara-Service

Input Pipeline Analysis: Flat Host Metrics Converter Implementation PiperOrigin-RevId: 939701840

Commit:f2d6008
Author:Profiler Team
Committer:Copybara-Service

Input Pipeline Analysis: Flat Host Metrics Proto Changes PiperOrigin-RevId: 939684524

Commit:b857563
Author:Profiler Team
Committer:Copybara-Service

Add ConvertDeviceTraceXPlaneToFlatOpMetricsDb to parse GPU XPlanes natively into FlatOpMetricsDb using XEventsFlatOpMetricsDbBuilder. PiperOrigin-RevId: 940620823

The documentation is generated from this commit.

Commit:6e40965
Author:Profiler Team
Committer:Copybara-Service

Integrate FlatOpMetricsDb into the Roofline Model pipeline and support incomplete steps. PiperOrigin-RevId: 936077242

Commit:fbf69f6
Author:Profiler Team
Committer:Copybara-Service

Support combining FlatOpMetricsDb in OpStats combination pipeline. PiperOrigin-RevId: 938552869

Commit:e5a6d08
Author:Profiler Team
Committer:Copybara-Service

Integrate FlatOpMetricsDb into XPlane-to-StepEvents conversion pipeline. PiperOrigin-RevId: 938234267

Commit:b49e3d9
Author:Profiler Team
Committer:Copybara-Service

Add GetFlatOpKeyFromXEvent utility to extract OpKey from XEvent. PiperOrigin-RevId: 938546019

Commit:ff6b072
Author:Profiler Team
Committer:Copybara-Service

Add utilities to convert FlatOpMetrics to standard Record format for Roofline model. PiperOrigin-RevId: 936077240

Commit:cfc01f6
Author:Profiler Team
Committer:Copybara-Service

Add utilities to aggregate Device FlatOpMetrics into Framework (TF/JAX) Op Metrics. PiperOrigin-RevId: 936077239

Commit:ee7cb18
Author:Profiler Team
Committer:Copybara-Service

Add FlatOpMetricsDb support to OpStats and StepDetails. PiperOrigin-RevId: 925237403

Commit:8dd658f
Author:Profiler Team
Committer:Copybara-Service

Internal change PiperOrigin-RevId: 914722263

The documentation is generated from this commit.

Commit:eaa1c6a
Author:Profiler Team
Committer:Copybara-Service

Internal change PiperOrigin-RevId: 909900419

The documentation is generated from this commit.

Commit:9cfd31e
Author:Profiler Team
Committer:Copybara-Service

Internal change PiperOrigin-RevId: 911717012

The documentation is generated from this commit.

Commit:b9f2537
Author:Profiler Team
Committer:Copybara-Service

Refactor FlatOpMetricsDb conversion logic to code readability. PiperOrigin-RevId: 911717012

The documentation is generated from this commit.

Commit:facbc7f
Author:Profiler Team
Committer:Copybara-Service

Add ConvertDeviceTraceXPlaneToFlatOpMetricsDb to parse GPU XPlanes natively into FlatOpMetricsDb using XEventsFlatOpMetricsDbBuilder. PiperOrigin-RevId: 935588208

The documentation is generated from this commit.

Commit:7f40311
Author:Profiler Team
Committer:Copybara-Service

Project import generated by Copybara PiperOrigin-RevId: 929104288

Commit:bb8eb70
Author:Sai Ganesh Muthuraman
Committer:Copybara-Service

Enable scroll and zoom out in Trace Viewer V2 when loading deep-linked traces. PiperOrigin-RevId: 919479016

Commit:4fad2cd
Author:Profiler Team
Committer:Copybara-Service

Added XSpace-to-FlatProfileMap conversion support for power data. PiperOrigin-RevId: 916029727

Commit:67e98d3
Author:Profiler Team
Committer:Copybara-Service

Add additional data to overview screenshot test. PiperOrigin-RevId: 906362969

Commit:65b8d04
Author:Profiler Team
Committer:Copybara-Service

Adding Functionality : ConvertXSpaceToFlatOpMetricsDb PiperOrigin-RevId: 913633636

Commit:b03d265
Author:Profiler Team
Committer:Copybara-Service

Addition of Flat Device Op Metric Db to OpStats PiperOrigin-RevId: 913605984

Commit:9d320d4
Author:Sai Ganesh Muthuraman
Committer:Copybara-Service

Add `details` field to TraceDataResponse proto for compressed traces. PiperOrigin-RevId: 906149238

Commit:e65e8c4
Author:Nancy Li
Committer:Copybara-Service

[XProf: trace viewer] Add trace_lite.proto PiperOrigin-RevId: 906016226

Commit:f3d49a2
Author:Profiler Team
Committer:Copybara-Service

Add Sparse Core ops to HLO Op Stats tool. PiperOrigin-RevId: 905236948

Commit:def69ce
Author:Profiler Team
Committer:Copybara-Service

Add flat_op_metrics.proto to define a flat structure for operation metrics across different core types. PiperOrigin-RevId: 904282580

Commit:6f341d9
Author:Profiler Team
Committer:Copybara-Service

Add TraceDataResponse proto definition. This would be used for transferring trace data over the wire significantly reducing the payload size from the current JSON baseline. PiperOrigin-RevId: 892755054

Commit:d45fbe2
Author:Profiler Team
Committer:Copybara-Service

Internal Change PiperOrigin-RevId: 888002603

Commit:7088a10
Author:Ruiyang Zhu
Committer:Copybara-Service

Create EventFractionAnalyzerResults Proto PiperOrigin-RevId: 886331240

Commit:acf601a
Author:Charles Alaras
Committer:Copybara-Service

Fix documentation typo in OpMetrics proto PiperOrigin-RevId: 876320696

Commit:b5257f5
Author:Charles Alaras
Committer:Copybara-Service

⚠️ Deprecate `flops` → `flops_v2` and `model_flops` → `model_flops_v2` PiperOrigin-RevId: 875515357

Commit:c6a3380
Author:Profiler Team
Committer:Copybara-Service

Display disaggregated serving avg decoding step time on TPU in the XProf overview page PiperOrigin-RevId: 874418602

Commit:9fea95a
Author:Sai Ganesh Muthuraman
Committer:Copybara-Service

Add mandatory device and resource regexes to TraceFilterConfig PiperOrigin-RevId: 870869716

Commit:ee7b24f
Author:Profiler Team
Committer:Copybara-Service

Update `GetEventTimeFractionAnalyzerResult` in 3P ToolDataProviderImpl to use `GetToolDataHelper` API PiperOrigin-RevId: 867894263

Commit:b8d26f0
Author:Profiler Team
Committer:Copybara-Service

Initial proto for Disaggregared Serving Latency PiperOrigin-RevId: 858648057

Commit:c5760f7
Author:Profiler Team
Committer:Copybara-Service

Enable Memory Profile to correlate memory usage with HLO module execution. PiperOrigin-RevId: 855749344

Commit:a06e8dc
Author:Profiler Team
Committer:Copybara-Service

Op Profile adjustments. PiperOrigin-RevId: 847910843

Commit:f6efc9c
Author:Profiler Team
Committer:Copybara-Service

Add a `suppress_others` flag in `smart_suggestion.proto` to suppress other suggestions once the flag is on. PiperOrigin-RevId: 845499158

Commit:e7edebd
Author:Charles Alaras
Committer:Copybara-Service

Support SparseCore events in OpMetricsDb PiperOrigin-RevId: 844869212

Commit:59579f0
Author:Profiler Team
Committer:Copybara-Service

Include per-host event fraction for each step in `EventTimeFractionAnalyzer` proto. PiperOrigin-RevId: 843778153

Commit:a170c8d
Author:Yin Zhang
Committer:Copybara-Service

Updates to the run environment data processing in op stats. No-op for now. PiperOrigin-RevId: 843423093

Commit:7363782
Author:Yin Zhang
Committer:Copybara-Service

update the task proto, this is non-func change now. PiperOrigin-RevId: 842579755

Commit:e50b7f2
Author:Profiler Team
Committer:Copybara-Service

Added HBM Utilization metric to overview page and restructured Memory Bandwidth Utilization section to match FLOPS Utilization section. PiperOrigin-RevId: 840057194

Commit:8328bd9
Author:Profiler Team
Committer:Copybara-Service

Refactor EventTimeFractionAnalyzer to group results by chip. PiperOrigin-RevId: 839477708

Commit:e58a1b8
Author:Yin Zhang
Committer:Copybara-Service

Add dvfs time scale multiplier processing logic for roofline model. PiperOrigin-RevId: 836277274

Commit:1922ba3
Author:Profiler Team
Committer:Copybara-Service

Move event_time_fraction_analyzer proto to OSS PiperOrigin-RevId: 834859827

Commit:fc53a4f
Author:Yin Zhang
Committer:Copybara-Service

Removed the uncapp flops utilization UI controller, and always use the raw uncapped flops by default on the UI. PiperOrigin-RevId: 834150070

Commit:72e48ec
Author:Subham Soni
Committer:Copybara-Service

Add worker ID to responses and configure gRPC channels for retries and load balancing. PiperOrigin-RevId: 834135653

Commit:3da39d8
Author:Subham Soni
Committer:Copybara-Service

Add worker ID to responses and configure gRPC channels for retries and load balancing. PiperOrigin-RevId: 827391460

Commit:0ebecf4
Author:Subham Soni
Committer:Copybara-Service

Add worker ID to responses and configure gRPC channels for retries and load balancing. PiperOrigin-RevId: 827391460

Commit:c21b6f3
Author:Yin Zhang
Committer:Copybara-Service

Removed the uncapp flops utilization UI controller, and always use the raw uncapped flops by default on the UI. PiperOrigin-RevId: 805146752

Commit:d6051c1
Author:Yin Zhang
Committer:Copybara-Service

Add dvfs time scale multiplier processing logic for roofline model. PiperOrigin-RevId: 805986876

Commit:3fa0faa
Author:Yin Zhang
Committer:Copybara-Service

Add normalized_total_op_time_ps (on default dvfs) to opstats.device_op_metrics_db, together with the total_op_time_ps, it will give us a weighted average dvfs multiplier, which can be used to calculate dvfs normalized flops utilization and so on. - The aggregated dvfs multiplier will be shown in roofline page top as part of the device info, and used for device spec normalization. - The agg dvfs multiplier will also be used a an identifier if dvfs normalization control knobs should be displayed on UI or not. (show the knob with a valid multiplier, which is >0 and <1) PiperOrigin-RevId: 824384537

Commit:85fa4ce
Author:Yin Zhang
Committer:Copybara-Service

Add normalized_total_op_time_ps (on default dvfs) to opstats.device_op_metrics_db, together with the total_op_time_ps, it will give us a weighted average dvfs multiplier, which can be used to calculate dvfs normalized flops utilization and so on. - The aggregated dvfs multiplier will be shown in roofline page top as part of the device info, and used for device spec normalization. - The agg dvfs multiplier will also be used a an identifier if dvfs normalization control knobs should be displayed on UI or not. (show the knob with a valid multiplier, which is >0 and <1) PiperOrigin-RevId: 817431887

Commit:0d1b55e
Author:Yin Zhang
Committer:Copybara-Service

Add normalized_total_op_time_ps (on default dvfs) to opstats.device_op_metrics_db, together with the total_op_time_ps, it will give us a weighted average dvfs multiplier, which can be used to calculate dvfs normalized flops utilization and so on. - The aggregated dvfs multiplier will be shown in roofline page top as part of the device info, and used for device spec normalization. - The agg dvfs multiplier will also be used a an identifier if dvfs normalization control knobs should be displayed on UI or not. (show the knob with a valid multiplier, which is >0 and <1) PiperOrigin-RevId: 817431887

Commit:b073e99
Author:Yin Zhang
Committer:Copybara-Service

Add normalized_total_op_time_ps (on default dvfs) to opstats.device_op_metrics_db, together with the total_op_time_ps, it will give us a weighted average dvfs multiplier, which can be used to calculate dvfs normalized flops utilization and so on. - The aggregated dvfs multiplier will be shown in roofline page top as part of the device info, and used for device spec normalization. - The agg dvfs multiplier will also be used a an identifier if dvfs normalization control knobs should be displayed on UI or not. (show the knob with a valid multiplier, which is >0 and <1) PiperOrigin-RevId: 817431887

Commit:a5182ac
Author:Yin Zhang
Committer:Copybara-Service

Add normalized_total_op_time_ps (on default dvfs) to opstats.device_op_metrics_db, together with the total_op_time_ps, it will give us a weighted average dvfs multiplier, which can be used to calculate dvfs normalized flops utilization and so on. - The aggregated dvfs multiplier will be shown in roofline page top as part of the device info, and used for device spec normalization. - The agg dvfs multiplier will also be used a an identifier if dvfs normalization control knobs should be displayed on UI or not. (show the knob with a valid multiplier, which is >0 and <1) PiperOrigin-RevId: 817431887

Commit:f0bc3a0
Author:Yin Zhang
Committer:Copybara-Service

Add normalized_total_op_time_ps (on default dvfs) to opstats.device_op_metrics_db, together with the total_op_time_ps, it will give us a weighted average dvfs multiplier, which can be used to calculate dvfs normalized flops utilization and so on. - The aggregated dvfs multiplier will be shown in roofline page top as part of the device info, and used for device spec normalization. - The agg dvfs multiplier will also be used a an identifier if dvfs normalization control knobs should be displayed on UI or not. (show the knob with a valid multiplier, which is >0 and <1) PiperOrigin-RevId: 817431887

Commit:a154dd9
Author:Yin Zhang
Committer:Copybara-Service

Removed the uncapp flops utilization UI controller, and always use the raw uncapped flops by default on the UI. PiperOrigin-RevId: 805146752

Commit:df0a416
Author:Yin Zhang
Committer:Copybara-Service

Add dvfs time scale multiplier processing logic for roofline model. PiperOrigin-RevId: 805986876

Commit:54704f0
Author:Yin Zhang
Committer:Copybara-Service

Removed the uncapp flops utilization UI controller, and always use the raw uncapped flops by default on the UI. PiperOrigin-RevId: 805146752

Commit:4c370f6
Author:Yin Zhang
Committer:Copybara-Service

Add aggregated dvfs time scale multiplier to opstats.device_op_metrics_db - Note we assumes only core 0 has this info, so MetricsDb combiner only write it once from a src db that has a valid multiplier. - this aggregated dvfs factor will be shown in roofline page top as part of the device info, and used for device spec normalization. - it will also be used a an identifier if dvfs normalization control knobs should be displayed on UI or not. (show the knob with a valid multiplier, which is >0 and <1) PiperOrigin-RevId: 817431887

Commit:4d291b3
Author:Yin Zhang
Committer:Copybara-Service

No-op Changes. Add a `time_scale_multiplier` metadata in xplane and corresponding `normalized_time_ps` in OpMetrics proto. PiperOrigin-RevId: 814487519

Commit:a81f63e
Author:Charles Alaras
Committer:Copybara-Service

Allow `resource_id` to be 64 bits PiperOrigin-RevId: 811486066

Commit:06b9fb5
Author:Yin Zhang
Committer:Copybara-Service

No-op Changes. Add a `time_scale_multiplier` metadata in xplane and corresponding `normalized_time_ps` in OpMetrics proto. PiperOrigin-RevId: 794174377

Commit:77e7419
Author:Profiler Team
Committer:Copybara-Service

Fix typo in comment PiperOrigin-RevId: 809107812

Commit:1382786
Author:Profiler Team
Committer:Copybara-Service

Only use root nodes in computing the current source metrics. PiperOrigin-RevId: 808825812

Commit:43092e0
Author:Profiler Team
Committer:Copybara-Service

Only use root notes in computing the current source metrics. PiperOrigin-RevId: 808241860

Commit:0a943bf
Author:Profiler Team
Committer:Copybara-Service

Fix typo in comment PiperOrigin-RevId: 808204183

Commit:2a2ff2f
Author:Clive Verghese
Committer:Copybara-Service

Add support to extract custom_call metadata from hlo_ops PiperOrigin-RevId: 807906945

Commit:8f8487a
Author:Clive Verghese
Committer:Copybara-Service

Add support to extract custom_call metadata from hlo_ops PiperOrigin-RevId: 805939855

Commit:9b49225
Author:Yin Zhang
Committer:Copybara-Service

No-op Changes. Add a `time_scale_multiplier` metadata in xplane and corresponding `normalized_time_ps` in OpMetrics proto. PiperOrigin-RevId: 794174377

Commit:8d718d4
Author:Clive Verghese
Committer:Copybara-Service

Add support to extract custom_call metadata from hlo_ops PiperOrigin-RevId: 805939855

Commit:dc1d132
Author:Clive Verghese
Committer:Copybara-Service

Add support for Viewing custom call text in Graph Viewer. PiperOrigin-RevId: 805970858

Commit:db22907
Author:Profiler Team
Committer:Copybara-Service

Show the metrics. PiperOrigin-RevId: 783937622

Commit:bf0babd
Author:Subham Soni
Committer:Copybara-Service

Introduce gRPC worker service for distributed profile processing PiperOrigin-RevId: 799038615

Commit:9c8601f
Author:Yin Zhang
Committer:Copybara-Service

Add generic input pipeline op processing support and add traceme ops from xplane to op_stats.host_op_metrics_db PiperOrigin-RevId: 798351303

Commit:12f7261
Author:Yin Zhang
Committer:Copybara-Service

Add generic input pipeline op processing support and add traceme ops from xplane to op_stats.host_op_metrics_db PiperOrigin-RevId: 795264700

Commit:2f3700f
Author:Profiler Team
Committer:Copybara-Service

Add flops_utilization to source_stats and updated some of the comments. PiperOrigin-RevId: 796606455

Commit:0356981
Author:Profiler Team
Committer:Copybara-Service

Show the metrics. PiperOrigin-RevId: 783937622

Commit:1ad146e
Author:Profiler Team
Committer:Copybara-Service

No third party file is changed in this CL PiperOrigin-RevId: 795257850

Commit:93776e8
Author:Profiler Team
Committer:Copybara-Service

Add flops_utilization to source_stats and updated some of the comments. PiperOrigin-RevId: 795257851

Commit:6fd093c
Author:Profiler Team
Committer:Copybara-Service

No third party file is changed in this CL PiperOrigin-RevId: 795257850

Commit:35056a5
Author:Profiler Team
Committer:Copybara-Service

Add flops_utilization to source_stats PiperOrigin-RevId: 795257851

Commit:89edddc
Author:Yin Zhang
Committer:Copybara-Service

Add generic input pipeline op processing support and add traceme ops from xplane to op_stats.host_op_metrics_db PiperOrigin-RevId: 795264700

Commit:6af23e0
Author:Yin Zhang
Committer:Copybara-Service

Add generic input pipeline op processing support and add traceme ops from xplane to op_stats.host_op_metrics_db PiperOrigin-RevId: 787000349

Commit:002bdd2
Author:Subham Soni
Committer:Copybara-Service

Introduce gRPC worker service for distributed profile processing PiperOrigin-RevId: 793750511

Commit:372830d
Author:Profiler Team
Committer:Copybara-Service

Implement prefix trie and persist it as leveldb table. It would be used to enable trace event search for leveldb backend. PiperOrigin-RevId: 794014351

Commit:ed19e42
Author:Profiler Team
Committer:Copybara-Service

Frontend changes to support all trace events search for leveldb backend and changes to support backward compatibility for older profiles. PiperOrigin-RevId: 793552642

Commit:c30c7d1
Author:Profiler Team
Committer:Copybara-Service

Support trace events prefix name search in leveldb backend. PiperOrigin-RevId: 791786254

Commit:c3c2163
Author:Profiler Team
Committer:Copybara-Service

Support trace events prefix name search in leveldb backend. PiperOrigin-RevId: 791786254

Commit:c6aa1a3
Author:Profiler Team
Committer:Copybara-Service

Create and Persist trace events prefix trie as leveldb sstable file. PiperOrigin-RevId: 791552031

Commit:20953f7
Author:Profiler Team
Committer:Copybara-Service

Implement prefix trie and persist it as leveldb table. It would be used to enable trace event search for leveldb backend. PiperOrigin-RevId: 790650289

Commit:a6ab3f5
Author:Bryan Massoth
Committer:Copybara-Service

Visualize custom-call kernel metadata in OpProfile and TraceViewer. PiperOrigin-RevId: 789478587

Commit:9e590c6
Author:Bryan Massoth
Committer:Copybara-Service

Visualize custom-call kernel metadata in OpProfile and TraceViewer. PiperOrigin-RevId: 782102451

Commit:234de63
Author:Bryan Massoth
Committer:Copybara-Service

Visualize custom-call kernel metadata in OpProfile and TraceViewer. PiperOrigin-RevId: 782102451

Commit:0e6a3a5
Author:Yin Zhang
Committer:Copybara-Service

Show pipeline analysis with new processing logic, while maintaining backward compatibility PiperOrigin-RevId: 787327716

Commit:20ed79f
Author:Yin Zhang
Committer:Copybara-Service

Add generic input pipeline processing into host op metrics db in op stats PiperOrigin-RevId: 787000349

Commit:bc290d3
Author:Mudit Gokhale
Committer:Copybara-Service

Proto changes to optionally show the uncapped flops utilization PiperOrigin-RevId: 787875176