These 71 commits are when the Protocol Buffers files have changed:
| Commit: | a66a364 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Enable checkpoint updates. PiperOrigin-RevId: 739875581 Change-Id: I7738ba9803e8a9fb86f995a0402c435c9d37bced
The documentation is generated from this commit.
| Commit: | 1f75fe0 | |
|---|---|---|
| Author: | Wenhao Jia | |
| Committer: | Copybara-Service | |
Add 4x8x16 and clean up the to_chip_topology function (sort and add missing items). PiperOrigin-RevId: 729272822 Change-Id: Ie1af0e03072e0e4fd0bd3d545a2d0014db5bd624
| Commit: | 4914cc0 | |
|---|---|---|
| Author: | Jiewen Tan | |
| Committer: | Copybara-Service | |
Patch Sax TPU v6e support PiperOrigin-RevId: 696682732 Change-Id: Ide6ae851d74faff85c43ea85571a0759e4f46db2
| Commit: | 62de359 | |
|---|---|---|
| Author: | Eric Salo | |
| Committer: | Copybara-Service | |
internal change PiperOrigin-RevId: 693403475 Change-Id: I48666fc094d42ab7a93f3f8ab5be8864bba93b42
| Commit: | 26afd33 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Internal change. PiperOrigin-RevId: 692087501 Change-Id: If811e32305c0c89d516cb51203021d4b838ef8ff
| Commit: | 5b61e5e | |
|---|---|---|
| Author: | Yanping Huang | |
| Committer: | Copybara-Service | |
Add vm.token_to_video API to SAX. PiperOrigin-RevId: 660534687 Change-Id: I3fce0a302aac8d822b8e4b292ba8382542311df5
| Commit: | 76a6ca6 | |
|---|---|---|
| Author: | Yanping Huang | |
| Committer: | Copybara-Service | |
Adds a new "video_to_token" api to sax. PiperOrigin-RevId: 657254357 Change-Id: I924df899ccef3c043f2417754e56e94d1b2db425
| Commit: | 84a0eb6 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Allow more topologies in sax. PiperOrigin-RevId: 655638619 Change-Id: I2bffe330719ada60f3ecd246cfcb2b1797794d20
| Commit: | 4951adc | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Internal changes on export. PiperOrigin-RevId: 644781789 Change-Id: I93620d5c4af506ac38d134b2dbd022c261d8a2a4
| Commit: | bac0f81 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
allows servers to report # of active pending requests back to admin to display on the status page. PiperOrigin-RevId: 640170180 Change-Id: I6665f31d16bf1fb441425e950c0c66028ce5a6a3
| Commit: | c740dbf | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Add new RPC endpoint for waking up Sax dormant model server. PiperOrigin-RevId: 638030914 Change-Id: Ibb338a2e4382819273968561f68635c4165a17c1
| Commit: | 7db8e6e | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Surface modelet server dormant status on go/sax/<user> page. PiperOrigin-RevId: 635514108 Change-Id: I800c35b02380d1451096e21df437488ff7669054
| Commit: | 77beea1 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Teach modelet server to reject `LmService` incoming request if it's in dormant state, and also report stats in `GetStatus` Rpc. PiperOrigin-RevId: 634466870 Change-Id: Ic1b6f3e0857dbf9061c5f62f906b8753ee234a74
| Commit: | 06db5c2 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Add new message `ModeletServerStatus` for modeling modelet server status and embed it in `GetStatusResponse`. PiperOrigin-RevId: 630450317 Change-Id: I5c36476bbeb2bbfabc5077b77442f5566a066828
| Commit: | bada26a | |
|---|---|---|
| Author: | Andy Ly | |
| Committer: | Copybara-Service | |
Add Multimodal Embed client and server stubs. PiperOrigin-RevId: 626241979 Change-Id: Id5b841e647b5a9d0efb2c0dc62251f0781b9d6f7
| Commit: | 500901a | |
|---|---|---|
| Author: | Andy Ly | |
| Committer: | Copybara-Service | |
Add audio tokens field to DataItem. PiperOrigin-RevId: 619669207 Change-Id: I4fbb732d504c778bbf018aafea923f225d946467
| Commit: | d5195d5 | |
|---|---|---|
| Author: | Andy Ly | |
| Committer: | Copybara-Service | |
Add image embedding field to DataItem. PiperOrigin-RevId: 619276005 Change-Id: I19a17e2ef114c575cf37249e7a8e69fdaa8d479c
| Commit: | ca6d2f8 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Supports tag based constraints. Since tags are passed through overrides, relaxes the sax model server requirement for override value to be JSON values. PiperOrigin-RevId: 618922624 Change-Id: I2baf97d82cfafcaa50c33fa56e6e2a32082e8058
| Commit: | 01c50db | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Expand vision_service proto to optionally return a mask for each detected bounding box. PiperOrigin-RevId: 614974636 Change-Id: I48800d189893551777bbecba29d41494e4a1c936
| Commit: | 7230aea | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Internal changes PiperOrigin-RevId: 607094074 Change-Id: Ifac1c4b4cb5cc1f5f361ce172178c7767333b36e
| Commit: | 2ac57ee | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Display server basic op stats. PiperOrigin-RevId: 606770754 Change-Id: I812818d805ac49594403bc615550b8b60f7396b2
| Commit: | 8a12a12 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Fix for the SAX build. PiperOrigin-RevId: 601174193 Change-Id: Id74785202923e8a9f9fecf1c4a8fc59728d9fd23
| Commit: | 19476ac | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Adding Vertex Prediction container wrapper for SAX. PiperOrigin-RevId: 600867604 Change-Id: I2d9153fbbd6a694190f8f3c8e756ae4ee7cf0703
| Commit: | e9b6416 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Adding L4 to the list of supported accelerators. PiperOrigin-RevId: 600860650 Change-Id: I636b9a5167922dc91d6ca388ade72296ebdc56ae
| Commit: | 332c3a6 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Add data_addr field to JoinedModelServer. If it's specified, the client will use data_addr to connect the server, instead of using addr. The change is useful when ModeletService is not exported on the same port as the inference service. PiperOrigin-RevId: 588461583 Change-Id: I31e2988669bdcd089e6c3d3bd4764045cee9fc23
| Commit: | 6ce5b07 | |
|---|---|---|
| Author: | Wenhao Jia | |
| Committer: | Copybara-Service | |
Deprecate modelet addresses in List responses and add num_active_replicas. PiperOrigin-RevId: 581459169 Change-Id: I3498b5a2b579a4f358bae75d3f32a0e6c3355c7c
| Commit: | e3bc48f | |
|---|---|---|
| Author: | Wenhao Jia | |
| Committer: | Copybara-Service | |
Deprecate modelet addresses in List responses and add num_active_replicas. PiperOrigin-RevId: 581413218 Change-Id: I163f995322d2f43fbb70623ac8ef2cef820b8aae
| Commit: | b2d7e77 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
create java_proto_library for the common_proto PiperOrigin-RevId: 580182569 Change-Id: I70f3abaf21555ddb93a046b85126244fc404b5c0
| Commit: | 0e9144e | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Expose method stats shown on modelet home pages via RPC. PiperOrigin-RevId: 579334620 Change-Id: Ib67dba42a1c0bd3d2981c1ac04516f9cfd9250a9
| Commit: | d40a863 | |
|---|---|---|
| Author: | Faizan Muhammad | |
| Committer: | Copybara-Service | |
Support video in Sax request PiperOrigin-RevId: 579301216 Change-Id: Ib017e0bbbc221fdf1b96f5094207d840f4f4d517
| Commit: | dde398f | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Return num_replicas_by_servable_model_path in Admin.Stats. This counts the maximum number of replicas that can be used to serve a servable model path. Clients can use this field to calculate their expected serving capacity. PiperOrigin-RevId: 579106599 Change-Id: I34535da164d7729054d02bc08f606013312f67bc
| Commit: | c9e9e02 | |
|---|---|---|
| Author: | Weicheng Kuo | |
| Committer: | Copybara-Service | |
Add SAX Detection API for box inputs as a list of structs with center x, center y, width, and height fields. PiperOrigin-RevId: 578344976 Change-Id: I1368330b7a2346a2b66b0c4bc51cde1414b36047
| Commit: | a64334d | |
|---|---|---|
| Author: | Wenhao Jia | |
| Committer: | Copybara-Service | |
Add Cloud TPU v5e as a chip type. PiperOrigin-RevId: 574286786 Change-Id: I4d2b75dda17cd037fb7d3d1a789993d364f2625e
| Commit: | 59cad7f | |
|---|---|---|
| Author: | Jinoo Baek | |
| Committer: | Copybara-Service | |
Score function support for multi modal model. PiperOrigin-RevId: 565465852 Change-Id: I6fceb22501116cfabef16c75284f0729f6137192
| Commit: | 7cf1751 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Extends multimodal serving proto with a field for audio. PiperOrigin-RevId: 560173402 Change-Id: I635bcca26ff960f9112267561a31bc007ec3efb4
| Commit: | 54fba9e | |
|---|---|---|
| Author: | Wenhao Jia | |
| Committer: | Copybara-Service | |
Fix Sax OSS build issues. PiperOrigin-RevId: 559919170 Change-Id: Ieaef46064fbaf55e606f6ab4c677f987ce0b21c6
| Commit: | da457cc | |
|---|---|---|
| Author: | Andy Ly | |
| Committer: | Copybara-Service | |
Decouple Multimodal Generate request proto from RPC request by separating extra inputs out. Add more unit tests for Sax clients calling Multimodal Generate. PiperOrigin-RevId: 558973239 Change-Id: I73182f2e9764746a02fe33febdf934869df6a9ab
| Commit: | fe1d6b4 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Add a Kotlin gRPC BUILD target to SAX LM PiperOrigin-RevId: 558279480 Change-Id: I9bf4a6c9934dcb4faa58e85ac03b1cb2da6c0b40
| Commit: | 440cbfc | |
|---|---|---|
| Author: | Andy Ly | |
| Committer: | Copybara-Service | |
Rename MultimodalIdList and MultimodalDataItem to IdList and DataItem. PiperOrigin-RevId: 555651405 Change-Id: I37527a69cb81c4d0d961426ffb1e561aa826ae50
| Commit: | fc8e97f | |
|---|---|---|
| Author: | Andy Ly | |
| Committer: | Copybara-Service | |
Add Multimodal proto interface for Multimodal model. PiperOrigin-RevId: 552486367 Change-Id: I028332c5fc92037c128d04de145ae5310e352250
| Commit: | 6614482 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Add Multimodal proto interface for Multimodal model. PiperOrigin-RevId: 551600527 Change-Id: I423a7dcf28437c2ce340f82629b331f6f8f9c897
| Commit: | dcde0bb | |
|---|---|---|
| Author: | Andy Ly | |
| Committer: | Copybara-Service | |
Add Multimodal proto interface for Multimodal model. PiperOrigin-RevId: 551530820 Change-Id: Id23ef57bf193490db30cc00b16a957fdc4ad84c8
| Commit: | c6d4ef6 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Minor fixes to the usage documentation PiperOrigin-RevId: 546037002 Change-Id: If25dbd90a1a8c66d100bb6891a649deed14b665a
| Commit: | b1c1c0f | |
|---|---|---|
| Author: | Frederick Liu | |
| Committer: | Copybara-Service | |
[saxml] Add string type to extra inputs proto. PiperOrigin-RevId: 546003683 Change-Id: I7494027df58661d5b4b1699c2382395a1422d6d5
| Commit: | ee7de4e | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Add H100 to sax utils PiperOrigin-RevId: 545778451 Change-Id: I8d45a2d398c4e5e6ab9cdae86869fa00c49b4d4c
| Commit: | 3a2daa0 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Add deployment UUID to Sax Models state We need it to distinguish different model deployments (from publish to unpublish). PiperOrigin-RevId: 541564565 Change-Id: Ib2278f44fd8444bfdc7e3215f914899c2e42299f
| Commit: | 6341d6a | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Propogate acl changes from admin to servers. PiperOrigin-RevId: 538987363 Change-Id: I62de0e50aebf6f76b88a8bfcc10088028678f7e1
| Commit: | 95243a8 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Allow returning multiple scores via SAX GenerateStreamResponse PiperOrigin-RevId: 538505835 Change-Id: I50ef2474603e7bfd900840ecc67ba810a597801d
| Commit: | 2b58385 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Dynamically specify config overrides from saxutil publish on the command line. PiperOrigin-RevId: 534281641 Change-Id: Ide59334f1358ee8effc8aeb7283dc20d5b40f19f
| Commit: | 14b39c0 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Adds image-to-image sax API PiperOrigin-RevId: 532213459 Change-Id: I08028eac67ce6597c54f18ac4cdf60f27545814d
| Commit: | cd38e6c | |
|---|---|---|
| Author: | Andy Ly | |
| Committer: | Copybara-Service | |
Add sax client and server support for lm.Gradient. This adds support for the previously added Gradient function to saxutil, cc/go/py clients and model server instances. PiperOrigin-RevId: 528911326 Change-Id: I3f8820c471febc63a0615a56274ab514f58baafc
| Commit: | 79e61b0 | |
|---|---|---|
| Author: | Wenhao Jia | |
| Committer: | Copybara-Service | |
Update dependencies and improve README.md. PiperOrigin-RevId: 527712328 Change-Id: I8216be3897930379995bb3dc9b4fadb8d349dcda
| Commit: | e1da0e1 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
SAX interface for image editing models like ControlNet and InstructPix2Pix. PiperOrigin-RevId: 526166252 Change-Id: Iea9712b231bab4481fc18a0491593616dc56acae
| Commit: | 393bed6 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Allow SAX to use 2x4 topologies. PiperOrigin-RevId: 525613063 Change-Id: I0dcf524ab98f802d2dbe7b5e0b0c7d701b6d28ea
| Commit: | 2bf2228 | |
|---|---|---|
| Author: | Wenhao Jia | |
| Committer: | Copybara-Service | |
Implement admin.WaitForReady using waitable.Waitable. PiperOrigin-RevId: 524888332 Change-Id: I92a2e61e521a18853e5539003f1592fc689f9a7c
| Commit: | c255f26 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Add an option to export sax models with a fixed random seed. PiperOrigin-RevId: 516885375 Change-Id: I0d6b3f0c1716b822c736d03563531a2991539e58
| Commit: | d975353 | |
|---|---|---|
| Author: | Haitang Hu | |
| Committer: | Copybara-Service | |
Enable multi-method exporting in SAX for the same model. PiperOrigin-RevId: 513747604 Change-Id: I5a2918a7d917b978cbcea124a479addbe738d930
| Commit: | 2a14384 | |
|---|---|---|
| Author: | Chang Lan | |
| Committer: | Copybara-Service | |
Refactor custom service to use bytes to bytes interface PiperOrigin-RevId: 512681296 Change-Id: I48a69f11c27a00e5fce1ac60178bd6d46e9b31d2
| Commit: | 1689ab3 | |
|---|---|---|
| Author: | Chang Lan | |
| Committer: | Copybara-Service | |
Use bytes to bytes interface in custom service PiperOrigin-RevId: 512249991 Change-Id: I7cfc5a2159b0c7b23ebca9da62f6971a331e945d
| Commit: | 02ab637 | |
|---|---|---|
| Author: | Chang Lan | |
| Committer: | Copybara-Service | |
Use bytes to bytes interface in custom service PiperOrigin-RevId: 512133264 Change-Id: I17d10a55bc2edb54adcb9a82a9fefdf425e0dc91
| Commit: | 439d150 | |
|---|---|---|
| Author: | Yanping Huang | |
| Committer: | Copybara-Service | |
Add stats rpc call to admin PiperOrigin-RevId: 511973184 Change-Id: Ibcfaf5cf2227051c2ca90db52eb3f03fc6ff15e2
| Commit: | 39b4b90 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Updates comment in `sax.server.lm.ScoreRequest` definition. PiperOrigin-RevId: 506923722 Change-Id: I7f1af3d3e909ba61c4fc644aed32a0699a250d4f
| Commit: | 2c4ae3a | |
|---|---|---|
| Author: | Wenhao Jia | |
| Committer: | Copybara-Service | |
Remove the deprecated FindLoc method. PiperOrigin-RevId: 506521967 Change-Id: I80ed6f1b9f04cddf7ef2e10da1815a7fe70e391d
| Commit: | bd40ae2 | |
|---|---|---|
| Author: | Frederick Liu | |
| Committer: | Copybara-Service | |
[sax] Rename TensorInputs to Tensor since it can also be used in response. PiperOrigin-RevId: 504601479 Change-Id: Ia25a0e51317f53963dca4eea8b3e30ce8ef5eb31
| Commit: | 526d112 | |
|---|---|---|
| Author: | Frederick Liu | |
| Committer: | Copybara-Service | |
[sax] Add tensor support for extra inputs. PiperOrigin-RevId: 500622705 Change-Id: Icdf28bd2ab5471dba7b2bc783a984b4683e3a1d3
| Commit: | 4efd771 | |
|---|---|---|
| Author: | Wenhao Jia | |
| Committer: | Copybara-Service | |
Make streaming proto changes. PiperOrigin-RevId: 497306490 Change-Id: I21a9033e9428bd99dc2e9a537c1ae57f34da00ae
| Commit: | 7782cfd | |
|---|---|---|
| Author: | Wenhao Jia | |
| Committer: | Copybara-Service | |
Make adjustments to the debug address on admin status pages. PiperOrigin-RevId: 497235871 Change-Id: I6edd9056881f1b458f326115bfae57c758a46598
| Commit: | 20f7385 | |
|---|---|---|
| Author: | Wenhao Jia | |
| Committer: | Copybara-Service | |
Send an HTTP debug port when a model server joins a cell, so the admin status pages can show correct links. PiperOrigin-RevId: 497081806 Change-Id: Ida1191364dce74c2f9646049fba1d2c5335e049c
| Commit: | 594cc1d | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Copybara-Service | |
Add an option save checkpoint with saxutil. PiperOrigin-RevId: 495485189 Change-Id: I2695ff64207e6df8fcd6f781ed522e3c59f35838
| Commit: | 603b7aa | |
|---|---|---|
| Author: | Chang Lan | |
| Committer: | Copybara-Service | |
Enable streaming in model server PiperOrigin-RevId: 495227158 Change-Id: I879d3b873aafd42bd62a19c7f2544032415e7a2f
| Commit: | 41b3a32 | |
|---|---|---|
| Author: | Sax Authors | |
| Committer: | Wenhao Jia | |
Internal change PiperOrigin-RevId: 493645843 Change-Id: Ia219a8048771636f7bbd0c25b464fd9055607de5