These 59 commits are when the Protocol Buffers files have changed:
| Commit: | 2527431 | |
|---|---|---|
| Author: | Harsh Himmatbhai Vaghasiya | |
| Committer: | GitHub | |
feat(metrics): Add V3 background segmentation metrics to media backend via protobuf (#3240) - Add video processor pipeline metrics (frame rate, per-processor latency) via protobuf signaling - Add CDN processor performance metrics (segmentation duration, effect render, CPU usage) via observer - Add metric dimensions for processor name, model type, and delegate type - Add numeric initialization metrics (asset loading time, compatibility, processor creation status) - Extend SignalingProtocol.proto with metric type enums 114-128 and dimension types 3-5 - Simplify BackgroundSegmentationInitializationMetrics to numeric-only interface for protobuf compatibility - Remove per-frame reportProcessorError in favor of aggregated CDN errorCount - Rewrite BackgroundSegmentationMetrics.test.ts for new interface - Add new tests to BackgroundSegmentationVideoFrameProcessor.test.ts - Add proper assertions to StatsCollector tests
| Commit: | 3d8486c | |
|---|---|---|
| Author: | Harsh Himmatbhai Vaghasiya | |
| Committer: | Harsh Himmatbhai Vaghasiya | |
feat(metrics): Add V3 background segmentation metrics to media backend via protobuf - Add video processor pipeline metrics (frame rate, per-processor latency) via protobuf signaling - Add CDN processor performance metrics (segmentation duration, effect render, CPU usage) via observer - Add metric dimensions for processor name, model type, and delegate type - Add numeric initialization metrics (asset loading time, compatibility, processor creation status) - Extend SignalingProtocol.proto with metric type enums 114-128 and dimension types 3-5 - Simplify BackgroundSegmentationInitializationMetrics to numeric-only interface for protobuf compatibility - Remove per-frame reportProcessorError in favor of aggregated CDN errorCount - Rewrite BackgroundSegmentationMetrics.test.ts for new interface - Add new tests to BackgroundSegmentationVideoFrameProcessor.test.ts - Add proper assertions to StatsCollector tests
| Commit: | 37c4519 | |
|---|---|---|
| Author: | Harsh Himmatbhai Vaghasiya | |
feat(metrics): Add V3 background segmentation metrics to media backend via protobuf - Add video processor pipeline metrics (frame rate, per-processor latency) via protobuf signaling - Add CDN processor performance metrics (segmentation duration, effect render, CPU usage) via observer - Add metric dimensions for processor name, model type, and delegate type - Add numeric initialization metrics (asset loading time, compatibility, processor creation status) - Extend SignalingProtocol.proto with metric type enums 114-128 and dimension types 3-5 - Simplify BackgroundSegmentationMetricReport to numeric-only interface for protobuf compatibility - Remove per-frame reportProcessorError in favor of aggregated CDN errorCount - Rewrite BackgroundSegmentationMetrics.test.ts for new interface - Add new tests to BackgroundSegmentationVideoFrameProcessor.test.ts - Add proper assertions to StatsCollector tests
| Commit: | 91fd9a9 | |
|---|---|---|
| Author: | Henry Smith | |
| Committer: | GitHub | |
feat(metrics): Report CPU state via Compute Pressure API (#3230) Add a CPU_PRESSURE_STATE SdkMetric (=113) and a ComputePressureMonitor that wraps the browser PressureObserver. The monitor returns the raw pressure state string; StatsCollector owns the wire encoding (nominal=0, fair=1, serious=2, critical=3) and appends the latest sample to each global metric frame. The class is internal — added to barrelize.js ignoredTypes alongside StatsCollector.
| Commit: | b3fe90e | |
|---|---|---|
| Author: | Henry Smith | |
| Committer: | GitHub | |
Add meeting session timing tracking and signaling (#3168)
| Commit: | 2df262f | |
|---|---|---|
| Author: | Henry Smith | |
| Committer: | GitHub | |
Refactored Encoded Transform management into it's own component for better support of non-redundant audio transforms (#3131)
| Commit: | 0b9752e | |
|---|---|---|
| Author: | Henry Smith | |
| Committer: | GitHub | |
Utilize getHighEntropyValues for browser minor versions and other metadata (#3134)
| Commit: | e7d0b52 | |
|---|---|---|
| Author: | Shi Su | |
| Committer: | Shi Su | |
Revert "Initial commit" This reverts commit 4f3e0788a54f3aa78cd871b26deb471ab18750e4.
| Commit: | cf226eb | |
|---|---|---|
| Author: | Shi Su | |
| Committer: | Shi Su | |
Initial commit
| Commit: | c7aa416 | |
|---|---|---|
| Author: | Henry Smith | |
| Committer: | Shi Su | |
Changes
| Commit: | 55eb4ca | |
|---|---|---|
| Author: | Shi Su | |
| Committer: | GitHub | |
Add render and capture resolution in stream metric reports (#3040)
The documentation is generated from this commit.
| Commit: | 0f002d7 | |
|---|---|---|
| Author: | Henry Smith | |
| Committer: | Henry Smith | |
save
| Commit: | 4f3e078 | |
|---|---|---|
| Author: | Shi Su | |
Initial commit
| Commit: | 543871c | |
|---|---|---|
| Author: | Henry Smith | |
| Committer: | Henry Smith | |
Changes
| Commit: | ad8f79c | |
|---|---|---|
| Author: | Shi Su | |
| Committer: | GitHub | |
Downgrade video codec when encoding CPU usage is high or encoder fail (#2860) --------- Co-authored-by: Shi Su <shisuss@amazon.com>
| Commit: | d6487f4 | |
|---|---|---|
| Author: | Henry Smith | |
| Committer: | GitHub | |
Add support for H.264 profiles besides Constrained Baseline Profile (#2830)
| Commit: | 3afd784 | |
|---|---|---|
| Author: | Henry Smith | |
| Committer: | GitHub | |
Add high resolution meeting features and additional codecs (#2812) * Add high resolution meeting features and additional codecs Co-authored-by: Shi Su <shisuss@amazon.com> Co-authored-by: David Wang <davidwj@amazon.com> Co-authored-by: Xiang Li <rixiang@amazon.com> Co-authored-by: Henry Smith <hensmi@amazon.com> --------- Co-authored-by: Shi Su <shisuss@amazon.com> Co-authored-by: David Wang <davidwj@amazon.com> Co-authored-by: Xiang Li <rixiang@amazon.com> Co-authored-by: Henry Smith <hensmi@amazon.com>
| Commit: | 939dff1 | |
|---|---|---|
| Author: | Shi Su | |
| Committer: | GitHub | |
Send a few additional metrics to backend (#2750) Co-authored-by: Shi Su <shisuss@amazon.com>
| Commit: | 72c7a64 | |
|---|---|---|
| Author: | pracheth | |
| Committer: | GitHub | |
Support sending and receiving redundant audio data to help reduce the effects of packet loss on audio quality. (#2745) Support sending and receiving redundant audio data to help reduce the effects of packet loss on audio quality.
| Commit: | 20f2e1a | |
|---|---|---|
| Author: | Shi Su | |
| Committer: | GitHub | |
Receive notification messages from server and print received messages to console (#2731) Co-authored-by: Shi Su <shisuss@amazon.com>
| Commit: | 4f1a7cb | |
|---|---|---|
| Author: | hungsinh | |
| Committer: | GitHub | |
Add audioUpstreamLevel and audioDownstreamLevel to ClientReportMetric (#2723) * add RTC Speaker/Mic Audio Level in the proto file * Add audioUpstreamLevel + audioDownstreamLevel to the ClientMetricReport * Add docs
| Commit: | 24a0c7a | |
|---|---|---|
| Author: | Henry Smith | |
| Committer: | GitHub | |
Add client side APIs and implementation for server side remote video quality adaption (#2680)
| Commit: | 6e944c8 | |
|---|---|---|
| Author: | Henry Smith | |
Add support for negotiating and forwarding abs-capture-time
| Commit: | 5799946 | |
|---|---|---|
| Author: | AMAN GUPTA | |
| Committer: | GitHub | |
Pass Client UTC Offset inside join message over signalling channel (#2618) * Pass Client UTC Offset inside join message over signalling channel * Address comments of revision 1 * Address comments of revision 2
| Commit: | 7d8f24a | |
|---|---|---|
| Author: | Henry Smith | |
| Committer: | GitHub | |
Add flag to MeetingSessionConfiguration to disable periodic keyframe requests to content sender (#2558)
| Commit: | 19e0a1e | |
|---|---|---|
| Author: | Shi Su | |
| Committer: | Manasi Surve | |
Add encoder/decoder is hardware metric and stream metric dimension (#2429) This change is to follow the protobuf changes in backend including 1. Add metric type of whether encoder/decoder implementation name is in hardware. 2. Add a dimension field for stream metric frame. 3. Rename VIDEO_AVERAGE_ENCODE_MS to VIDEO_ENCODE_MS to make it consistent with VIDEO_DECODE_MS.
| Commit: | 5cdfbc9 | |
|---|---|---|
| Author: | Shi Su | |
| Committer: | GitHub | |
Add encoder/decoder is hardware metric and stream metric dimension (#2429) This change is to follow the protobuf changes in backend including 1. Add metric type of whether encoder/decoder implementation name is in hardware. 2. Add a dimension field for stream metric frame. 3. Rename VIDEO_AVERAGE_ENCODE_MS to VIDEO_ENCODE_MS to make it consistent with VIDEO_DECODE_MS.
| Commit: | faa38db | |
|---|---|---|
| Author: | Henry Smith | |
| Committer: | GitHub | |
Add client side APIs and implementation for server side network adaption (#2294)
| Commit: | e526e89 | |
|---|---|---|
| Author: | Henry Smith | |
| Committer: | GitHub | |
Add support for configuring video send codec (#2292)
| Commit: | b84a8b6 | |
|---|---|---|
| Author: | Henry Smith | |
| Committer: | GitHub | |
Add ability to promote to Primary meeting from replica, add demo features and guides to showcase replicated meeting APIs (#2111)
| Commit: | d66db20 | |
|---|---|---|
| Author: | Henry Smith | |
| Committer: | GitHub | |
Add ability to promote to Primary meeting from replica, add demo features and guides to showcase replicated meeting APIs (#2107)
| Commit: | 6dc26ff | |
|---|---|---|
| Author: | Chitesh Tewani | |
| Committer: | GitHub | |
Add support for Transcribe's automatic language detection for Live Transcription API (#2087) * Add automatic language identification support from Amazon Transcribe for live transcription * Update Transcript models for automatic language detection and fix demo app UI rendering of Live Transcription Config for mobile browsers (#2082) * Upgrade AWS JS SDK to v2.1088.0 * Remove AWS JS SDK upgrade from integ js/app and /js Co-authored-by: Akash Priyadarshi <91693061+akashuc@users.noreply.github.com> Co-authored-by: Chitesh Tewani <ctewani@amazon.com>
| Commit: | 4aa8c56 | |
|---|---|---|
| Author: | Akash Priyadarshi | |
| Committer: | GitHub | |
Update Transcript models for automatic language detection and fix demo app UI rendering of Live Transcription Config for mobile browsers (#2082) * Fix to support mobile browser event not bubbling issue * Fix naming of languageIdentification field and mark languageIdentifications as optional * Update CHANGELOG * Remove changelog entries and fix build * Fix function name * Fix unit test * Add extra check for languageIdentification being null * Remove redundant check * Fix coverage * Fix formatting * Fix formatting * Update ChangeLog Co-authored-by: Chitesh Tewani <chiteshtewani@gmail.com> Co-authored-by: Chitesh Tewani <ctewani@amazon.com>
| Commit: | 4b92d96 | |
|---|---|---|
| Author: | Chitesh Tewani | |
| Committer: | GitHub | |
Add support for Transcribe's automatic language detection (#2025) * Add language identification in Live Transcription in demo app * Add models for Language Identification * Update protobuf models for language identification * automatic language identification changes * automatic language identification changes * Add unit test cases for language identification models * Fix German language options and no word separator for specific languages identified * Add doc string for TranscriptLanguageWithScore model * Update unit test and address comments * Add entry in Changelog * Add JavaScript API docs * Fix formatting * Fix formatting * Fix formatting * Split unit test for encoding and decoding transcript event Co-authored-by: Chitesh Tewani <ctewani@amazon.com> Co-authored-by: Akash Priyadarshi <akashpri@amazon.com>
| Commit: | 681396a | |
|---|---|---|
| Author: | Chitesh Tewani | |
Merge remote-tracking branch 'origin' into transcribe-language-detection
| Commit: | 7bee66a | |
|---|---|---|
| Author: | akshap | |
| Committer: | GitHub | |
Adding text compression support to compress SDP messages. (#2053) * Adding text compression support to compress SDP messages. Co-authored-by: akshap <akshap@amazon.com>
| Commit: | cd65140 | |
|---|---|---|
| Author: | akshap | |
| Committer: | GitHub | |
Add compression support when sending and receiving sdp messages. (#2035) * Adding text compression support to compress SDP messages. Co-authored-by: akshap <akshap@amazon.com>
| Commit: | 85442e1 | |
|---|---|---|
| Author: | Chitesh Tewani | |
| Committer: | Chitesh Tewani | |
Merge branch 'main' into transcribe-language-detection
| Commit: | f03a7d9 | |
|---|---|---|
| Author: | Trung Le | |
| Committer: | GitHub | |
Remove safari 12 and plan B support (#2045) * Remove Plan B support * Fix unit tests
| Commit: | 787beb5 | |
|---|---|---|
| Author: | Chitesh Tewani | |
Update protobuf models for language identification
| Commit: | e69b54a | |
|---|---|---|
| Author: | Chitesh Tewani | |
Add models for Language Identification
| Commit: | a823e7b | |
|---|---|---|
| Author: | akshap | |
| Committer: | GitHub | |
Decouple the video send limit and the video receive limit (#1863) * Decouple the video send limit and the video recieve limit * Addressing coding style comments. * [Bug Fix] Removing the areChosenVideoSource flag and usning video resources. * Update the documentation for some of the apis to be more helpful. * Ran a build release. * Ran a build release. * Updating the signalingclientjoin.html docs * update naming from api to API * update naming from api to API Co-authored-by: akshap <akshap@amazon.com> Co-authored-by: Trung Le <58827450+ltrung@users.noreply.github.com>
| Commit: | e821386 | |
|---|---|---|
| Author: | Akash Priyadarshi | |
| Committer: | GitHub | |
Transcribe data model update Introducing support to new features including PII content identification and redaction, partial results stabilization, and custom language models for Amazon Transcribe and PHI content identification for Amazon Transcribe Medical
| Commit: | a49c578 | |
|---|---|---|
| Author: | bijimm | |
| Committer: | GitHub | |
Renamed appversionname and appversioncode (#1689) * Renamed appversionname and appversioncode * Changelog fix * Fixup Co-authored-by: Trung Le <58827450+ltrung@users.noreply.github.com>
| Commit: | 4e02209 | |
|---|---|---|
| Author: | Henry Smith | |
| Committer: | GitHub | |
Add support for skipping SDP renegotiation for simulcast stream switches (#1541)
| Commit: | 33ad828 | |
|---|---|---|
| Author: | Haifeng Xu | |
| Committer: | GitHub | |
Add live transcription APIs and demo app implementation (#1485) * Add live transcription APIs and demo app implementation
| Commit: | 3700c74 | |
|---|---|---|
| Author: | Lu Dai | |
| Committer: | GitHub | |
Expose audio and video webrtc metrics in client metric report (#1251) * Expose video metrics in clientMetricReport and update meeting demo * Filter out NaN value in vidoe metric report * Remove direction metric in video metric report
| Commit: | 197b84a | |
|---|---|---|
| Author: | Xuan He | |
| Committer: | Xuan He | |
Update signaling protocol
| Commit: | c49babc | |
|---|---|---|
| Author: | Richard Newman | |
| Committer: | Richard Newman | |
Rewrite copyright headers.
| Commit: | 09cc3ee | |
|---|---|---|
| Author: | Dylon Dickinson | |
| Committer: | GitHub | |
Route audio session id to server. (#774) * Route audio session id to server. Fixes bug when leave event was sometimes seen in place of drop when reconnecting. * Remove obsolete travis pr check script
| Commit: | 1d36ab2 | |
|---|---|---|
| Author: | Andrew Burnson | |
| Committer: | Trung Le | |
Use credentials sent via signaling connection JOIN_ACK
| Commit: | 14ac257 | |
|---|---|---|
| Author: | Xuan He | |
| Committer: | Xuan He | |
Update SignalingProtocol and use sdk version in JoinFrame
| Commit: | 867778d | |
|---|---|---|
| Author: | Andrew Burnson | |
| Committer: | Andrew Burnson | |
Update signaling protocol
| Commit: | 2fd1027 | |
|---|---|---|
| Author: | Kyu Simm | |
| Committer: | Trung Le | |
Add data message APIs
| Commit: | 7290854 | |
|---|---|---|
| Author: | Toby DiPasquale | |
| Committer: | Andrew Burnson | |
Enable send-side bandiwdth estimation This changeset enables the use of send-side bandwidth estimation for faster reaction to changing network conditions for media publishers.
| Commit: | c34f1d4 | |
|---|---|---|
| Author: | Andrew Burnson | |
| Committer: | Trung Le | |
Update protocol and plumb through external user id
| Commit: | ec7a335 | |
|---|---|---|
| Author: | Xuan He | |
| Committer: | Andrew Burnson | |
Add BITRATES to protocol to handle SdkBitrateFrame
| Commit: | fd3e449 | |
|---|---|---|
| Author: | Andrew Burnson | |
Update to latest SDK protobuf
| Commit: | 1f5c251 | |
|---|---|---|
| Author: | Andrew Burnson | |
Add web platform