These 81 commits are when the Protocol Buffers files have changed:
| Commit: | 56b8c4d | |
|---|---|---|
| Author: | Clive Verghese | |
| Committer: | Copybara-Service | |
Add ModuleTracker to determine if it's a training workload. PiperOrigin-RevId: 756694797
| Commit: | 7ab216a | |
|---|---|---|
| Author: | Jiya Zhang | |
| Committer: | Copybara-Service | |
Display Power Metrics data for 1s window PiperOrigin-RevId: 755904905
The documentation is generated from this commit.
| Commit: | 1ddb2da | |
|---|---|---|
| Author: | Jiya Zhang | |
| Committer: | Copybara-Service | |
Separate Power SPI Sampler per core/die PiperOrigin-RevId: 755016512
The documentation is generated from this commit.
| Commit: | 598e731 | |
|---|---|---|
| Author: | Jiya Zhang | |
| Committer: | Copybara-Service | |
Display Power Metrics data for 1s window PiperOrigin-RevId: 754062563
The documentation is generated from this commit.
| Commit: | cb63e56 | |
|---|---|---|
| Author: | Yin Zhang | |
| Committer: | Copybara-Service | |
Populate model flops and normalized flops in TfStats Record. No-op in framework op stats UI, since the python converter doesn't include this data yet. PiperOrigin-RevId: 752837254
| Commit: | d90f13f | |
|---|---|---|
| Author: | Yin Zhang | |
| Committer: | Copybara-Service | |
Populate model flops and normalized flops in TfStats Record. No-op in framework op stats UI, since the python converter doesn't include this data yet. PiperOrigin-RevId: 749940975
| Commit: | 6b68dc5 | |
|---|---|---|
| Author: | Yin Zhang | |
| Committer: | Copybara-Service | |
Populate model flops and normalized flops in TfStats Record. No-op in framework op stats UI, since the python converter doesn't include this data yet. PiperOrigin-RevId: 749940975
| Commit: | 9c96e05 | |
|---|---|---|
| Author: | Yin Zhang | |
| Committer: | Copybara-Service | |
Populate model flops and normalized flops in TfStats Record. No-op in framework op stats UI, since the python converter doesn't include this data yet. PiperOrigin-RevId: 749940975
| Commit: | af80600 | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Show source info for Memory Viewer Page. PiperOrigin-RevId: 750858340
| Commit: | 163df09 | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Rollback of Show source info for Memory Viewer Page. PiperOrigin-RevId: 750824459
| Commit: | e67843b | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Show source info for Memory Viewer Page. PiperOrigin-RevId: 750777802
| Commit: | 0e55949 | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Show source info in Memory Viewer Page. PiperOrigin-RevId: 747742567
| Commit: | 061d9cb | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Fold onto Memory Viewer Page 2 PiperOrigin-RevId: 750614207
| Commit: | 1b3f2e6 | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Show source info in Memory Viewer Page. PiperOrigin-RevId: 749948441
| Commit: | 3815eb1 | |
|---|---|---|
| Author: | Yin Zhang | |
| Committer: | Copybara-Service | |
Populate model flops and normalized flops in TfStats Record. No-op in framework op stats UI, since the python converter doesn't include this data yet. PiperOrigin-RevId: 749940975
| Commit: | b9adffc | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Show source info in Memory Viewer Page. PiperOrigin-RevId: 749948441
| Commit: | d5493de | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Show source info in Memory Viewer Page. PiperOrigin-RevId: 747742567
| Commit: | 4d7e255 | |
|---|---|---|
| Author: | Matt Hurd | |
| Committer: | Copybara-Service | |
Remove Tensorflow usage in xprof/convert The most notable changed files are: convert/op_profile_builder.cc plugin/tensorboard_plugin_profile/protobuf/tensorflow_datatypes.proto utils/tensorflow_utils.cc utils/tensorflow_utils.h Notably, this relies on a much simpler implementation of top_n that should be sufficient for our usecase. TF's top_n is designed to be most efficient for when elements are pushed in one at a time, whereas in this case we already have the full set beforehand. This also copies out logic relating to identifying TF datatypes. This is used specifically for the Memory Profile page, for translating a proto into a string to inform the user of which datatype the op used. This type shouldn't change often, and it doesn't feel worth it to pull in Tensorflow solely for an enum -> string conversion. PiperOrigin-RevId: 749914518
| Commit: | 23bc883 | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Show source info in Roofline Model Page. PiperOrigin-RevId: 749177972
| Commit: | 6391b9b | |
|---|---|---|
| Author: | Matt Hurd | |
| Committer: | Copybara-Service | |
Remove Tensorflow usage in xprof/convert The most notable changed files are: convert/op_profile_builder.cc plugin/tensorboard_plugin_profile/protobuf/tensorflow_datatypes.proto utils/tensorflow_utils.cc utils/tensorflow_utils.h Notably, this relies on a much simpler implementation of top_n that should be sufficient for our usecase. TF's top_n is designed to be most efficient for when elements are pushed in one at a time, whereas in this case we already have the full set beforehand. This also copies out logic relating to identifying TF datatypes. This is used specifically for the Memory Profile page, for translating a proto into a string to inform the user of which datatype the op used. This type shouldn't change often, and it doesn't feel worth it to pull in Tensorflow solely for an enum -> string conversion. PiperOrigin-RevId: 748822688
| Commit: | 284abbb | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Show source info in Memory Viewer Page. PiperOrigin-RevId: 747742567
| Commit: | 5655b5d | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Show source info in HLO Op Stats Page. PiperOrigin-RevId: 749135617
| Commit: | ab02e3a | |
|---|---|---|
| Author: | Matt Hurd | |
| Committer: | Copybara-Service | |
Remove Tensorflow Dependency from XProf This removes the circular dependency created during this migration. As a result, we need to import both xla and tsl manually. We keep them synced at head, which mimics the same behavior we had with Tensorflow. There is one feature that we currently depend on Tensorflow for, tf_op cost analysis. For now, this feature will be disabled. PiperOrigin-RevId: 748822690
| Commit: | aa6f717 | |
|---|---|---|
| Author: | Matt Hurd | |
| Committer: | Copybara-Service | |
Remove Tensorflow usage in xprof/convert PiperOrigin-RevId: 748822688
| Commit: | 49a18ba | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Show source info in HLO Op Stats Page. PiperOrigin-RevId: 746593285
| Commit: | a5b7bfa | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Show source info in HLO Op Stats Page. PiperOrigin-RevId: 745324929
| Commit: | 2d8fbf2 | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Make source location and stack frame available to the front end in HLO Op Profile page. PiperOrigin-RevId: 748376948
| Commit: | 2211ea1 | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Temporary for test PiperOrigin-RevId: 747898827
| Commit: | dd824ef | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Show source info in Roofline Model Page. PiperOrigin-RevId: 746208699
| Commit: | c39fee2 | |
|---|---|---|
| Author: | Yin Zhang | |
| Committer: | Copybara-Service | |
Display both raw and normalized FLOPs rate in op detail section to avoid confusion. PiperOrigin-RevId: 746650515
| Commit: | 22d0e8e | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Show source info in HLO Op Stats Page. PiperOrigin-RevId: 746593285
| Commit: | 2736a9e | |
|---|---|---|
| Author: | Matt Hurd | |
| Committer: | Copybara-Service | |
Standardize XProf capitalization PiperOrigin-RevId: 746209774
| Commit: | 334e31f | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Show source info in HLO Op Stats Page. PiperOrigin-RevId: 745324929
| Commit: | 70d689c | |
|---|---|---|
| Author: | Matt Hurd | |
| Committer: | Copybara-Service | |
Migrate some protos from core/profiler into gh/tensorflow/profiler As part of an ongoing push to improve colocation of code, this PR moves the remaining protobufs from code/profiler/protobuf into gh/tensorflow/profiler temporarily in the plugin/tensorboard_plugin_profile/protobuf directory. The protobuf will be moved into the `xprof` subdirectory in a subsequent PR to standardize referencing. Left behind are `public` imports, so existing uses of these protobufs will not be impacted. At some point, it is possible that these protobufs will be moved into xla/tsl, in which case they will see changed namespaces which will break old paths. That will only be done once all usages have been migrated. PiperOrigin-RevId: 740420919
| Commit: | a42fa73 | |
|---|---|---|
| Author: | Matt Hurd | |
| Committer: | Copybara-Service | |
Move plugin/tensorboard_plugin_profile/protobuf into xprof/protobuf This simplifies paths and prevents Tensorflow from having to reach into the plugin. PiperOrigin-RevId: 736357202
| Commit: | 22fff9c | |
|---|---|---|
| Author: | Bryan Massoth | |
| Committer: | Copybara-Service | |
Open source TPU-specific input pipeline analysis. PiperOrigin-RevId: 722815891
| Commit: | 4e43881 | |
|---|---|---|
| Author: | Bryan Massoth | |
| Committer: | Copybara-Service | |
Add max infeed time core name to InputPipelineAnalysis. Add max infeed table conversion in python. PiperOrigin-RevId: 718656107
| Commit: | 9df3236 | |
|---|---|---|
| Author: | Yin Zhang | |
| Committer: | Copybara-Service | |
Create Roofline Model tool in Tensorboard Plugin Profiler PiperOrigin-RevId: 706595406
| Commit: | 1e8ea23 | |
|---|---|---|
| Author: | Bryan Massoth | |
| Committer: | Copybara-Service | |
Migrate InputPipelineAnalysis data models to open source. PiperOrigin-RevId: 704876217
| Commit: | 9d73b55 | |
|---|---|---|
| Author: | Clive Verghese | |
| Committer: | Copybara-Service | |
Add OverviewInferenceLatency to OverviewPage. PiperOrigin-RevId: 703911736
| Commit: | 1fb7827 | |
|---|---|---|
| Author: | Clive Verghese | |
| Committer: | Copybara-Service | |
Enable sampling for inference profile and expose them in inference profile tool. PiperOrigin-RevId: 703734086
| Commit: | 50bd717 | |
|---|---|---|
| Author: | Clive Verghese | |
| Committer: | Copybara-Service | |
Add InferenceStats to Gviz conversion. PiperOrigin-RevId: 703623605
| Commit: | d729e1b | |
|---|---|---|
| Author: | Yin Zhang | |
| Committer: | Copybara-Service | |
Create Hlo Stats Tool PiperOrigin-RevId: 702925544
| Commit: | 7ef7a3f | |
|---|---|---|
| Author: | Yin Zhang | |
| Committer: | Copybara-Service | |
Create OpStatsToRooflineModel, in preparation of Roofline Model creation PiperOrigin-RevId: 698292881
| Commit: | 94b92ef | |
|---|---|---|
| Author: | Yin Zhang | |
| Committer: | Copybara-Service | |
Create op_metircs_to_record to deal with Roofline Analysis PiperOrigin-RevId: 700149568
| Commit: | 9218164 | |
|---|---|---|
| Author: | Feng Wang | |
| Committer: | Copybara-Service | |
add some internal changes PiperOrigin-RevId: 623547261
| Commit: | 541ecc4 | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Internal change only. Please ignore. PiperOrigin-RevId: 607525873
| Commit: | f8f8e6d | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Internal Change. Not visible in OSS. PiperOrigin-RevId: 574202870
| Commit: | fcdff62 | |
|---|---|---|
| Author: | Clive Verghese | |
| Committer: | Copybara-Service | |
Fix host stall calculation for megascale stats. PiperOrigin-RevId: 572311423
| Commit: | c424c50 | |
|---|---|---|
| Author: | Clive Verghese | |
| Committer: | Copybara-Service | |
Add host analysis to TPU timeline. PiperOrigin-RevId: 570139622
| Commit: | 6413bdc | |
|---|---|---|
| Author: | Clive Verghese | |
| Committer: | Copybara-Service | |
Add detailed breakdow for stall duration in the analysis. PiperOrigin-RevId: 561768588
| Commit: | 9258563 | |
|---|---|---|
| Author: | Jie Sun | |
| Committer: | Copybara-Service | |
power metric specific proto PiperOrigin-RevId: 561091977
| Commit: | 4bfdd0a | |
|---|---|---|
| Author: | Surbhi Jain | |
| Committer: | Copybara-Service | |
Add a converter from dcn_slack_analysis.proto to GViz DataTable format. PiperOrigin-RevId: 559508558
| Commit: | 8c6cddc | |
|---|---|---|
| Author: | Clive Verghese | |
| Committer: | Copybara-Service | |
Depend on @org_tensorflow PiperOrigin-RevId: 558185318
This commit does not contain any .proto files.
| Commit: | 91df35b | |
|---|---|---|
| Author: | Feng Wang | |
| Committer: | Copybara-Service | |
Add is_training as run environment in overview page PiperOrigin-RevId: 545994511
| Commit: | 2b96925 | |
|---|---|---|
| Author: | Jie Sun | |
| Committer: | Copybara-Service | |
add a tag to indicate which source this InputPipelineAnalysisResult is from. PiperOrigin-RevId: 513621717
| Commit: | d9309cd | |
|---|---|---|
| Author: | Jose Baiocchi | |
| Committer: | Copybara-Service | |
Remove per_core_batch_size from protos PiperOrigin-RevId: 446485977
| Commit: | 89ebf8a | |
|---|---|---|
| Author: | Jose Baiocchi | |
| Committer: | Copybara-Service | |
Add device duty cycle to overview page analysis PiperOrigin-RevId: 444669418
| Commit: | 3f037d0 | |
|---|---|---|
| Author: | Jiho Choi | |
| Committer: | Copybara-Service | |
Fix the x axis labels in the overview page to use the user-provided step names if available. PiperOrigin-RevId: 364948558
| Commit: | 44be97c | |
|---|---|---|
| Author: | Yi Situ | |
| Committer: | Copybara-Service | |
Added GPU occupancy % to GPU kernel stats tool. PiperOrigin-RevId: 346618066
| Commit: | 4cb9e4f | |
|---|---|---|
| Author: | Jiho Choi | |
| Committer: | Copybara-Service | |
Add the latency of the bottleneck iterator. PiperOrigin-RevId: 342359843
| Commit: | f535c46 | |
|---|---|---|
| Author: | Jiho Choi | |
| Committer: | Copybara-Service | |
Show multiple bottlenecks. PiperOrigin-RevId: 342200525
| Commit: | 2117c20 | |
|---|---|---|
| Author: | Jiho Choi | |
| Committer: | Copybara-Service | |
Add Python converter for CombinedTfDataStats. PiperOrigin-RevId: 338075490
| Commit: | fcdead4 | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
[Profiler] Separate device collective communication time in the GPU step-time breakdown. PiperOrigin-RevId: 332884401
| Commit: | 345ebc2 | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Add performance analysis for TPU outside compilation. PiperOrigin-RevId: 327492744
| Commit: | 7e4dcc1 | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Add device_type to TfStatsDatabase. PiperOrigin-RevId: 326113527
| Commit: | f856b3b | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Calculate TensorCore utilization PiperOrigin-RevId: 325532659
| Commit: | cbd2b4d | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Add TensorCore utilization to overview. PiperOrigin-RevId: 324108255
| Commit: | 2d1b223 | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
[Profiler] Add more metrics. PiperOrigin-RevId: 323112988
| Commit: | eadd23f | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
Add TensorCore eligibility to overview. PiperOrigin-RevId: 322669191
| Commit: | 88db2f6 | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
[Profiler] Add eager-mode related stats and advices to the Overview Page. PiperOrigin-RevId: 317742833
| Commit: | dbae3dd | |
|---|---|---|
| Author: | Qiumin Xu | |
| Committer: | Copybara-Service | |
Consolidate error and warning message population. 1. Add a diagnostic message which contains error, warning and info for diagnosing profiling anomalies. Replace individual error and warning fields by the diagnostic message. 2. Add unified PopulateStepDiagnositics, PopulateOverviewDiagnositics utilities in diagnostics.cc to be used by all tool converters. 3. Add unifid GenerateDiagnosticDatatable in TfStatsProcessor for all child tools. Add a similar generate_diagnostics_table for python converters. PiperOrigin-RevId: 315356051
| Commit: | 2e0c082 | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
[Profiler] Explicitly stores the input percentage in the input-analysis proto. PiperOrigin-RevId: 314408625
| Commit: | 440ec55 | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
[Profiler] Add optimization advice for reducing the host-to-TPU data transfer time. PiperOrigin-RevId: 312388184
| Commit: | a87f107 | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | Copybara-Service | |
[Profiler] Add optimization advices for tf-function. PiperOrigin-RevId: 310957738
| Commit: | f9e8236 | |
|---|---|---|
| Author: | Jiho Choi | |
| Committer: | Copybara-Service | |
Add the execution mode column in the TF Stats tool's table. PiperOrigin-RevId: 307449781
| Commit: | 35521f0 | |
|---|---|---|
| Author: | Qiumin Xu | |
| Committer: | Copybara-Service | |
Populate error message to input pipeline analyzer tool. PiperOrigin-RevId: 307122698
| Commit: | 26cf2bd | |
|---|---|---|
| Author: | Profiler Team | |
| Committer: | YoungDuke Koh | |
Project import generated by Copybara. PiperOrigin-RevId: 305813438
| Commit: | 6de449b | |
|---|---|---|
| Author: | Young Duke Koh | |
| Committer: | YoungDuke Koh | |
Project import generated by Copybara PiperOrigin-RevId: 269516932
This commit does not contain any .proto files.
| Commit: | 7adf211 | |
|---|---|---|
| Author: | Young Duke Koh | |
Add kernet stats proto code and update trace viewer
| Commit: | 8fe6f16 | |
|---|---|---|
| Author: | Young Duke Koh | |
Add initial code