Proto commits in alibaba/fluss

These 86 commits are when the Protocol Buffers files have changed:

Commit:400e132
Author:Anton Borisov
Committer:Anton Borisov

[FIP-40] Adapt imported fluss-rust to the monorepo (proto, CI, docs, release)

Commit:89eafb9
Author:Anton Borisov

[FIP-40] Import fluss-rust under fluss-rust/ with preserved history

Commit:e2a4403
Author:Liurnly
Committer:GitHub

[server] Support adding aggregation columns (#3459)

Commit:49849f7
Author:Pengcheng Huang
Committer:GitHub

[rust] Sync Fluss 1.x proto definitions and ApiKey registry (#628) - Update fluss_api.proto with all 1.x message types (ACLs, KV snapshots, producer offsets, cluster config, rebalance, server tags, etc.) - Add optional fields: rack, remote_data_dir, leader_epoch, agg_mode, etc. - Register 24 new ApiKey variants (1023-1064) in api_key.rs - Update build.rs prost bytes config for new proto fields - Add None defaults in convert.rs and partition.rs - Update pre-existing message wrappers that reference renamed proto fields / ApiKey variants so the crate still builds: * create_partition.rs: ignore_if_exists -> ignore_if_not_exists * get_latest_lake_snapshot.rs: ApiKey::GetLatestLakeSnapshot -> GetLakeSnapshot * list_databases.rs: populate new include_summary field * lookup.rs: PbLookupReqForBucket.key -> keys; new LookupRequest fields Co-authored-by: warmbupt <warmbupt@gmail.com> Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>

Commit:96a63d5
Author:Yang Wang
Committer:GitHub

[rpc][server][client] add ListRemoteLogManifests and ListKvSnapshots RPCs for orphan cleanup (#3480)

Commit:ad51d97
Author:yunhong
Committer:GitHub

[server] Add Cluster Health API implementation (#3400)

Commit:e274bd1
Author:Hongshun Wang
Committer:GitHub

[rust] Support API_VERSION in rust client. (#531) * [rust] Support API_VERSION in rust client * remove useless write_version_type and read_version_type which is same as java client does. * Add test about kv_format_v2. * return apiKey.highestSupportedVersion as default. * check whether server type mismatch. * add test about unknown server type

Commit:01c13e8
Author:yunhong
Committer:GitHub

[kv] Support elect standby replicas for primary key table (#2829)

Commit:01c9a22
Author:Anton Borisov
Committer:GitHub

[rust] lookup decoding schema id (#517)

Commit:7b4d711
Author:Anton Borisov
Committer:GitHub

feat: [rust] prefix lookup support (#500) * [rust] prefix lookup support * fix fmt * address comments * address comments * Address comments 2

Commit:c615e27
Author:Giannis Polyzos
Committer:GitHub

[common] Introduce RPC Layer for KV Scan (#2976)

Commit:3d8df9f
Author:Yang Wang
Committer:GitHub

[server] Add server-side filter execution and client-side integration (#2951)

Commit:8957671
Author:Anton Borisov
Committer:GitHub

feat: [TASK-315] Proto + RPC for LimitScan (#472)

Commit:05b6f66
Author:Liebing
Committer:GitHub

[server] Extend metadata models to support per-table/partition remote data directory (#2763)

Commit:14f0f12
Author:Liebing
Committer:GitHub

[server] Support alter database comment and custom properties (#1172)

Commit:ac21483
Author:Giannis Polyzos
Committer:GitHub

[common] Support Protobuf and RPC for Predicates (#2502)

Commit:ce67b9f
Author:Anton Borisov
Committer:GitHub

feat: introduce idempotent writes (#404)

Commit:f7fa971
Author:Junbo Wang
Committer:GitHub

[lake/tiering] Add per-table monitoring metrics for Lake Tiering (#2454)

Commit:1f4ff05
Author:Anton Borisov
Committer:GitHub

feat: support sasl/plain auth (#375)

Commit:d6fd1f1
Author:Jark Wu
Committer:Jark Wu

[kv] Support COUNT(*) pushdown for primary key tables and introduce GetTableStats RPC (#2651)

Commit:3015f6b
Author:Hongshun Wang
Committer:Jark Wu

[client] Thrown exception if ServerType mismatch. (#2606)

Commit:422d422
Author:Jark Wu
Committer:Jark Wu

[kv] Support COUNT(*) pushdown for primary key tables and introduce GetTableStats RPC (#2651)

Commit:fad97df
Author:Hongshun Wang
Committer:GitHub

[client] Thrown exception if ServerType mismatch. (#2606)

Commit:417c220
Author:yuxia Luo
Committer:Jark Wu

[paimon] Fix union read paimon dv table issue (#2326)

Commit:5a4374a
Author:yuxia Luo
Committer:GitHub

[paimon] Fix union read paimon dv table issue (#2326)

Commit:6e7fc26
Author:yunhong
Committer:Jark Wu

[kv] Support kv snapshot lease (#2179)

Commit:0cee383
Author:yunhong
Committer:GitHub

[kv] Support kv snapshot lease (#2179)

Commit:6655bdc
Author:Hongshun Wang
Committer:GitHub

[client] Support list database summaries (#2515)

Commit:bdb44c7
Author:yunhong
Committer:GitHub

[server] Fix rebalance may cause remote file deleted error (#2570) * [server] Fix rebalance may cause remote file deleted error * address jark's comments * improve * change to set offline immediately after set to immigration started --------- Co-authored-by: Jark Wu <jark@apache.org>

Commit:ec5078e
Author:Junbo Wang
Committer:Jark Wu

[kv] Implement lookup with insertIfNotExists on tablet server (#2485)

Commit:2671af6
Author:Yang Wang
Committer:GitHub

[kv] Return log end offset in UpsertResult and DeleteResult for exactly-once semantics (#2530)

Commit:1e84897
Author:Yang Wang
Committer:GitHub

[kv] Add OVERWRITE MergeMode support for undo recovery in aggregation tables (#2492)

Commit:81e3f3a
Author:Yang Wang
Committer:GitHub

[kv] Add Producer Offset Snapshot for Exactly-Once semantics (#2434)

Commit:62db319
Author:yuxia Luo
Committer:GitHub

[lake] Tiering service support commit by time (#2185)

Commit:d695cb8
Author:Keith Lee
Committer:GitHub

feat: Implement Admin APIs for partitioning (#208)

Commit:eda19e2
Author:Anton Borisov
Committer:GitHub

feat: introduce priority queue for downloading remote segments (#187)

Commit:f519ad9
Author:yuxia Luo
Committer:GitHub

feat: introduce KvWriteBatch and PutKvRequest (#176)

Commit:93048ed
Author:Andrea Bozzo
Committer:GitHub

feat: introduce lookup support for primary key tables (#159)

Commit:7addc72
Author:yunhong
Committer:GitHub

[server] Support generate and execute reblance plan (#1452)

Commit:a316c3d
Author:yuxia Luo
Committer:GitHub

[lake] Record a file path storing log offsets in lake snapshot property (#2223)

Commit:6868157
Author:yunhong
Committer:GitHub

[server] Introduce new rebalance API (#1380) Co-authored-by: Jark Wu <jark@apache.org>

Commit:e585d1f
Author:yuxia Luo
Committer:GitHub

chore: Improve error (#77)

Commit:746f948
Author:AlexZhao
Committer:GitHub

feat: support s3 as remote segment (#93) --------- Co-authored-by: luoyuxia <luoyuxia@alumni.sjtu.edu.cn>

Commit:f26312f
Author:yuxia Luo
Committer:GitHub

[lake] Use remote file to store lake snapshot offsets to reduce the size of zookeeper node (#2037)

Commit:72b10bb
Author:yunhong
Committer:GitHub

[common] Remove TableInfo from Cluster (#2068)

Commit:07721fe
Author:Jark Wu
Committer:Jark Wu

[server][client] Improve the design and performance of ADD COLUMN operation 1. Make lookup requests async. 2. Introduce ServerProjectionCache to share ProjectionInfo in TabletServer level. 3. Revert FlinkAsFlussRow changes, and introduce PaddingRow for the padding null columns for schema changes. 4. Make PutKv zero-copy to persist kv records. 5. Rename SchemaMetadataManager to ServerSchemaCache and use TableId instead of TablePath to track schemas which is safer. 6. Revert source related changes to still include the projectedFieldIndexes parameter.

Commit:ea2d61c
Author:Hongshun Wang
Committer:Jark Wu

[server][client] Support Schema Evolution (ADD COLUMN LAST) in Fluss and connector (#2010)

Commit:a2cc54d
Author:naivedogger
Committer:GitHub

[feat] Create Python bindings for table writing and reading (#9) --------- Co-authored-by: luoyuxia <luoyuxia@alumni.sjtu.edu.cn>

Commit:8c4004c
Author:Hongshun Wang
Committer:GitHub

[FIP-12] Support dynamic cluster config to enable lakehouse (#1567)

The documentation is generated from this commit.

Commit:e7d92ce
Author:Yang Guo
Committer:GitHub

[server] Rename RPC AlterTablePropertiesRequest to AlterTableRequest for future extensibility (#1766)

Commit:4345663
Author:Jark Wu
Committer:Jark Wu

[server] Use unified batch-concurrent implementation for ZooKeeper operations and remove redundant code This commit replaces all single-operation async calls with a unified batch-concurrent implementation. This eliminates the need to maintain three separate code paths (batch concurrent, single async, and sync), significantly reducing code duplication in ZooKeeperClient. Going forward, all sync ZooKeeper operations will be replaced by the batch-concurrent approach, which improves coordinator performance through better I/O utilization and reduced latency. Additionally, the `cacheOnly` flag has been removed from the current metadata request. Support for cache-only semantics will be reintroduced in a future `MetadataRequestV2` with a cleaner design.

Commit:32d50b8
Author:ocean.wy
Committer:Jark Wu

[server] server process metadata request in async mode (#1463)

Commit:68ce225
Author:Jark Wu
Committer:GitHub

[server] Improve the implementation of ALTER TABLE (#1760)

Commit:9df7b72
Author:Yang Guo
Committer:GitHub

[server] Support alter table properties (#1625)

Commit:79d9dbb
Author:yunhong
Committer:GitHub

[server] TabletServer support controlled shutdown (#1159)

Commit:ece2fe3
Author:Liebing
Committer:GitHub

[lake] Lake tiering service report the max timestamp of fluss record (#1700)

Commit:e6d877b
Author:Yang Wang
Committer:GitHub

[protogen] Fix infinite recursion in RecordsFieldFinder (#1282)

Commit:69b0ead
Author:naivedogger
Committer:GitHub

[feat] Add more functions to the Rust client Admin (#5)

Commit:f32db76
Author:Hongshun Wang
Committer:Hongshun Wang

[FIP-12] Add dynamic config and enable lakehouse dynamically.

Commit:f83b32c
Author:yuxia Luo
Committer:GitHub

[feat] Support basic write & read (#2)

Commit:bb0e12b
Author:Jark Wu
Committer:Jark Wu

[infra] Update project package name to org.apache.fluss Co-authored-by: benjobs <benjobs@apache.org>

Commit:db12388
Author:Jark Wu
Committer:Jark Wu

[infra] Update project package name to org.apache.fluss Co-authored-by: benjobs <benjobs@apache.org>

Commit:420194a
Author:Jark Wu
Committer:GitHub

[client] RemoteLogDownloader supports download log files in parallel and in priority (#1579)

Commit:dfe2176
Author:luoyuxia
Committer:Hongshun Wang

support enable lake dynamically

Commit:f82d103
Author:Hongshun Wang
Committer:Hongshun Wang

[FIP-12] add dynamic config to enable lakehouse.

Commit:d2dc98f
Author:yuxia Luo
Committer:GitHub

[lake] Store partition name in lake snapshot property (#1485)

Commit:bb7fbc2
Author:Jark Wu
Committer:GitHub

[license] Update source files with Apache boilerplate headers (#1147)

Commit:a74cdc1
Author:CaoZhen
Committer:GitHub

[server] Support list partititions by partition spec (#897)

Commit:4383783
Author:Leonard Xu
Committer:GitHub

[lake/flink] Introduce TieringSource and TieringSourceEnumerator (#1020)

Commit:51333a0
Author:yunhong
Committer:GitHub

[server] UpdateMetadata RPC should update tablePath and physicalTablePath cache (#890)

Commit:8cacbca
Author:yunhong
Committer:GitHub

[server] Support generating rack aware bucket assignment when creating table (#786)

Commit:06418f8
Author:Yang Guo
Committer:Jark Wu

[server] authorize InitWriter RPC with table path parameters

Commit:1389b9d
Author:yuxia Luo
Committer:GitHub

[lake/rpc] Add HeartBeat RPC in Servers for Tiering Services This closes #863.

Commit:5573ae3
Author:Hongshun Wang
Committer:GitHub

[server] Fluss support ACL authorization (#588) Co-authored-by: Jark Wu <jark@apache.org>

Commit:4784b91
Author:Hongshun Wang
Committer:GitHub

[server/client] Introduce authenticate in Fluss. (#577) Co-authored-by: Jark Wu <jark@apache.org>

Commit:157d252
Author:Hongshun Wang
Committer:GitHub

[server] Add multiple endpoint listener for fluss server (#531)

Commit:9eed014
Author:Jark Wu
Committer:Jark Wu

[license] Update License Copyright year

Commit:81dcf4f
Author:Jark Wu
Committer:GitHub

[client] Use partition spec in listPartitions (#546)

Commit:9c684b6
Author:Jark Wu

[hotfix] Add NOTICE in FlussApi.proto for future proto3 upgrade

Commit:6c38e4e
Author:Nicholas Jiang
Committer:GitHub

[rpc] Remove describeLakeStorage RPC to get lake catalog from table properties (#503)

Commit:599e247
Author:yunhong
Committer:Jark Wu

[server] Support addPartition and dropPartition (#351)

Commit:852d4a0
Author:Jark Wu
Committer:GitHub

[client] Refactor Table API (#341)

Commit:290d4a6
Author:Hongshun Wang
Committer:GitHub

[clients] Add created_time and modified_time to database and table metadata (#289)

Commit:37b7903
Author:yunhong
Committer:GitHub

[server] Support wait a while before answering the log fetch request (#233) This can reduce a lot of frequent FetchLogRequest when the traffic of a topic is very low. This closes #199

Commit:8b14329
Author:yunhong
Committer:Jark Wu

[kv] Support PrefixLookup for primary key table (#222) This closes #65

Commit:a1280c6
Author:Jark Wu
Committer:Jark Wu

initial commit