Proto commits in alibaba/fluss

These 99 commits are when the Protocol Buffers files have changed:

2026-09-16

[client] Add Admin API to describe buckets (#4029) * [client] Add Admin API to describe buckets * [client] fix test failure in flink2 module * [client] refine code impl according to review comments * [client] Complete describe buckets metadata semantics * [test] Avoid Mockito in ZooKeeper response handling tests

2026-09-14

[client] Support specifying rack when adding/removing server tags in Admin API (#2890) * [client] Support specifying rack when adding/removing server tags in Admin API * address yunhong's comments # Conflicts: # fluss-client/src/main/java/org/apache/fluss/client/admin/FlussAdmin.java # fluss-server/src/main/java/org/apache/fluss/server/coordinator/CoordinatorEventProcessor.java * fix rust client * fix format

2026-09-12

[server][client] Support per-partition bucket count for partitioned tables (#3908) Allow changing the default bucket count of a partitioned table for newly created partitions. Existing partitions retain their original bucket counts without requiring data redistribution. - Add a distribution-change API with versioned ALTER_TABLE RPC support. - Persist per-partition bucket counts and atomically backfill legacy partitions when advancing the table's bucket-count epoch. - Route requests using per-partition metadata and reject invalid bucket routing with INVALID_BUCKET_ROUTING, requiring metadata refresh and request reconstruction. - Adapt Java clients, Flink and Spark readers, and lake tiering to handle partitions with different bucket counts. - Propagate bucket-count changes to Paimon while preserving existing partition layouts. - Add rescaling and compatibility tests the new semantics. Closes #3907.

2026-09-03

[client][server][paimon] Complete historical partition writes (#4120) Route writes for expired partitions through internal historical targets while preserving original partition metadata across PUT_KV and PRODUCE_LOG. Tier historical KV and log records back to their original Paimon partitions, fail writes to confirmed missing targets, and safely clean fully tiered historical KV overlays with leader-epoch and offset guards.

[server] Restore KV minRetainOffset on follower restart (#4060)

2026-09-02

[server][rpc] Return ISR and bucket epoch in bucket metadata (#3785)

2026-08-26

[server] Support primary-key writes to historical partitions in server (#4001)

2026-08-24

[rust] Check in generated protobuf code and drop protoc requirement

2026-08-17

[rust] Wire the scan filter through to the log fetcher (#3971) Adds `TableScan::filter`, which encodes the predicate against the full row type and sends it with the schema id on every fetch request. A response now advances the bucket offset past `filtered_end_offset`, whether the server emptied the fetch or only pruned its tail, and the proto comment claiming those two fields are mutually exclusive is corrected to match the server.

2026-08-10

[server] Support RemoteLogManifest to handle overlap RemoteLogSegments (#3822)

2026-08-04

[lookup] Support historical partition lookup for lake tables (#3630)

2026-07-31

[server][client] Add cooperative KV backpressure based on RocksDB L0 (#3463)

2026-07-23

[client] Add log read preference for remote-first fetch (#3606) * [client] Add log read preference for remote-first fetch * rust fix * add e2e * Potential fix for pull request finding Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * fallback to local * fix * not leader gate * wait util all tiered --------- Co-authored-by: zhangjunfan <zhangjunfan@qiyi.com> Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

2026-07-04

[FIP-40] Adapt imported fluss-rust to the monorepo (proto, CI, docs, release)

[FIP-40] Import fluss-rust under fluss-rust/ with preserved history

2026-07-03

[server] Support adding aggregation columns (#3459)

2026-06-19

[rust] Sync Fluss 1.x proto definitions and ApiKey registry (#628) - Update fluss_api.proto with all 1.x message types (ACLs, KV snapshots, producer offsets, cluster config, rebalance, server tags, etc.) - Add optional fields: rack, remote_data_dir, leader_epoch, agg_mode, etc. - Register 24 new ApiKey variants (1023-1064) in api_key.rs - Update build.rs prost bytes config for new proto fields - Add None defaults in convert.rs and partition.rs - Update pre-existing message wrappers that reference renamed proto fields / ApiKey variants so the crate still builds: * create_partition.rs: ignore_if_exists -> ignore_if_not_exists * get_latest_lake_snapshot.rs: ApiKey::GetLatestLakeSnapshot -> GetLakeSnapshot * list_databases.rs: populate new include_summary field * lookup.rs: PbLookupReqForBucket.key -> keys; new LookupRequest fields Co-authored-by: warmbupt <warmbupt@gmail.com> Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>

2026-06-14

[rpc][server][client] add ListRemoteLogManifests and ListKvSnapshots RPCs for orphan cleanup (#3480)

2026-06-10

[server] Add Cluster Health API implementation (#3400)

2026-05-09

[rust] Support API_VERSION in rust client. (#531) * [rust] Support API_VERSION in rust client * remove useless write_version_type and read_version_type which is same as java client does. * Add test about kv_format_v2. * return apiKey.highestSupportedVersion as default. * check whether server type mismatch. * add test about unknown server type

2026-05-05

[kv] Support elect standby replicas for primary key table (#2829)

2026-05-03

[rust] lookup decoding schema id (#517)

2026-04-19

feat: [rust] prefix lookup support (#500) * [rust] prefix lookup support * fix fmt * address comments * address comments * Address comments 2

2026-04-18

[common] Introduce RPC Layer for KV Scan (#2976)

2026-04-08

[server] Add server-side filter execution and client-side integration (#2951)

2026-04-01

feat: [TASK-315] Proto + RPC for LimitScan (#472)

2026-03-24

[server] Extend metadata models to support per-table/partition remote data directory (#2763)

2026-03-19

[server] Support alter database comment and custom properties (#1172)

2026-03-16

[common] Support Protobuf and RPC for Predicates (#2502)

2026-03-15

feat: introduce idempotent writes (#404)

2026-03-13

[lake/tiering] Add per-table monitoring metrics for Lake Tiering (#2454)

2026-02-28

feat: support sasl/plain auth (#375)

2026-02-12

[kv] Support COUNT(*) pushdown for primary key tables and introduce GetTableStats RPC (#2651)

[client] Thrown exception if ServerType mismatch. (#2606)

[kv] Support COUNT(*) pushdown for primary key tables and introduce GetTableStats RPC (#2651)

2026-02-11

[client] Thrown exception if ServerType mismatch. (#2606)

2026-02-10

[paimon] Fix union read paimon dv table issue (#2326)

[paimon] Fix union read paimon dv table issue (#2326)

[kv] Support kv snapshot lease (#2179)

2026-02-09

[kv] Support kv snapshot lease (#2179)

2026-02-05

[client] Support list database summaries (#2515)

[server] Fix rebalance may cause remote file deleted error (#2570) * [server] Fix rebalance may cause remote file deleted error * address jark's comments * improve * change to set offline immediately after set to immigration started --------- Co-authored-by: Jark Wu <jark@apache.org>

2026-02-03

[kv] Implement lookup with insertIfNotExists on tablet server (#2485)

2026-02-01

[kv] Return log end offset in UpsertResult and DeleteResult for exactly-once semantics (#2530)

2026-01-30

[kv] Add OVERWRITE MergeMode support for undo recovery in aggregation tables (#2492)

2026-01-27

[kv] Add Producer Offset Snapshot for Exactly-Once semantics (#2434)

[lake] Tiering service support commit by time (#2185)

2026-01-25

feat: Implement Admin APIs for partitioning (#208)

feat: introduce priority queue for downloading remote segments (#187)

2026-01-18

feat: introduce KvWriteBatch and PutKvRequest (#176)

2026-01-17

feat: introduce lookup support for primary key tables (#159)

2026-01-08

[server] Support generate and execute reblance plan (#1452)

2025-12-31

[lake] Record a file path storing log offsets in lake snapshot property (#2223)

2025-12-28

[server] Introduce new rebalance API (#1380) Co-authored-by: Jark Wu <jark@apache.org>

2025-12-20

chore: Improve error (#77)

feat: support s3 as remote segment (#93) --------- Co-authored-by: luoyuxia <luoyuxia@alumni.sjtu.edu.cn>

2025-12-18

[lake] Use remote file to store lake snapshot offsets to reduce the size of zookeeper node (#2037)

2025-12-16

[common] Remove TableInfo from Cluster (#2068)

2025-12-02

[server][client] Improve the design and performance of ADD COLUMN operation 1. Make lookup requests async. 2. Introduce ServerProjectionCache to share ProjectionInfo in TabletServer level. 3. Revert FlinkAsFlussRow changes, and introduce PaddingRow for the padding null columns for schema changes. 4. Make PutKv zero-copy to persist kv records. 5. Rename SchemaMetadataManager to ServerSchemaCache and use TableId instead of TablePath to track schemas which is safer. 6. Revert source related changes to still include the projectedFieldIndexes parameter.

[server][client] Support Schema Evolution (ADD COLUMN LAST) in Fluss and connector (#2010)

2025-10-16

[feat] Create Python bindings for table writing and reading (#9) --------- Co-authored-by: luoyuxia <luoyuxia@alumni.sjtu.edu.cn>

2025-10-11

[FIP-12] Support dynamic cluster config to enable lakehouse (#1567)

The documentation is generated from this commit.

2025-10-05

[server] Rename RPC AlterTablePropertiesRequest to AlterTableRequest for future extensibility (#1766)

2025-09-26

[server] Use unified batch-concurrent implementation for ZooKeeper operations and remove redundant code This commit replaces all single-operation async calls with a unified batch-concurrent implementation. This eliminates the need to maintain three separate code paths (batch concurrent, single async, and sync), significantly reducing code duplication in ZooKeeperClient. Going forward, all sync ZooKeeper operations will be replaced by the batch-concurrent approach, which improves coordinator performance through better I/O utilization and reduced latency. Additionally, the `cacheOnly` flag has been removed from the current metadata request. Support for cache-only semantics will be reintroduced in a future `MetadataRequestV2` with a cleaner design.

[server] server process metadata request in async mode (#1463)

[server] Improve the implementation of ALTER TABLE (#1760)

2025-09-24

[server] Support alter table properties (#1625)

2025-09-21

[server] TabletServer support controlled shutdown (#1159)

2025-09-17

[lake] Lake tiering service report the max timestamp of fluss record (#1700)

2025-09-14

[protogen] Fix infinite recursion in RecordsFieldFinder (#1282)

2025-09-11

[feat] Add more functions to the Rust client Admin (#5)

2025-08-28

[FIP-12] Add dynamic config and enable lakehouse dynamically.

2025-08-26

[feat] Support basic write & read (#2)

2025-08-25

[infra] Update project package name to org.apache.fluss Co-authored-by: benjobs <benjobs@apache.org>

[infra] Update project package name to org.apache.fluss Co-authored-by: benjobs <benjobs@apache.org>

[client] RemoteLogDownloader supports download log files in parallel and in priority (#1579)

2025-08-19

support enable lake dynamically

[FIP-12] add dynamic config to enable lakehouse.

2025-08-12

[lake] Store partition name in lake snapshot property (#1485)

2025-06-18

[license] Update source files with Apache boilerplate headers (#1147)

2025-06-13

[server] Support list partititions by partition spec (#897)

2025-06-10

[lake/flink] Introduce TieringSource and TieringSourceEnumerator (#1020)

2025-06-03

[server] UpdateMetadata RPC should update tablePath and physicalTablePath cache (#890)

2025-06-02

[server] Support generating rack aware bucket assignment when creating table (#786)

[server] authorize InitWriter RPC with table path parameters

2025-05-28

[lake/rpc] Add HeartBeat RPC in Servers for Tiering Services This closes #863.

2025-04-25

[server] Fluss support ACL authorization (#588) Co-authored-by: Jark Wu <jark@apache.org>

2025-04-18

[server/client] Introduce authenticate in Fluss. (#577) Co-authored-by: Jark Wu <jark@apache.org>

2025-03-21

[server] Add multiple endpoint listener for fluss server (#531)

2025-03-08

[license] Update License Copyright year

[client] Use partition spec in listPartitions (#546)

2025-03-06

[hotfix] Add NOTICE in FlussApi.proto for future proto3 upgrade

2025-03-03

[rpc] Remove describeLakeStorage RPC to get lake catalog from table properties (#503)

2025-03-01

[server] Support addPartition and dropPartition (#351)

2025-02-06

[client] Refactor Table API (#341)

2025-01-18

[clients] Add created_time and modified_time to database and table metadata (#289)

2025-01-05

[server] Support wait a while before answering the log fetch request (#233) This can reduce a lot of frequent FetchLogRequest when the traffic of a topic is very low. This closes #199

2025-01-03

[kv] Support PrefixLookup for primary key table (#222) This closes #65

2024-11-25

initial commit