These 7 commits are when the Protocol Buffers files have changed:
| Commit: | 070c02f | |
|---|---|---|
| Author: | Vincent-syr | |
| Committer: | JieXin Liang | |
[release] llm_v2 1. refactor architecture 2. support feature paged attention 3. support feature automatic prefix cache 4. support huggingface tokenizer 5. add more robust support
The documentation is generated from this commit.
| Commit: | 126bd5b | |
|---|---|---|
| Author: | alcanderian | |
[release] llm_v2
The documentation is generated from this commit.
| Commit: | 2b75060 | |
|---|---|---|
| Author: | ouguoyu | |
| Committer: | GY | |
[misc] move grpc related to src/serving/grpc
| Commit: | 440b1a7 | |
|---|---|---|
| Author: | Vincent-syr | |
| Committer: | GY | |
[feature] revise service rsp to batch rsp
| Commit: | 052d3d8 | |
|---|---|---|
| Author: | Vincent-syr | |
| Committer: | GY | |
[feature] sever support token in & out
| Commit: | aeb87e6 | |
|---|---|---|
| Author: | Vincent-syr | |
| Committer: | JieXin Liang | |
[feature] add early_stopping option
| Commit: | 4bfb948 | |
|---|---|---|
| Author: | openppl-public | |
| Committer: | openppl-public | |
initial import