These 86 commits are when the Protocol Buffers files have changed:
| Commit: | 400e132 | |
|---|---|---|
| Author: | Anton Borisov | |
| Committer: | Anton Borisov | |
[FIP-40] Adapt imported fluss-rust to the monorepo (proto, CI, docs, release)
| Commit: | 89eafb9 | |
|---|---|---|
| Author: | Anton Borisov | |
[FIP-40] Import fluss-rust under fluss-rust/ with preserved history
| Commit: | e2a4403 | |
|---|---|---|
| Author: | Liurnly | |
| Committer: | GitHub | |
[server] Support adding aggregation columns (#3459)
| Commit: | 49849f7 | |
|---|---|---|
| Author: | Pengcheng Huang | |
| Committer: | GitHub | |
[rust] Sync Fluss 1.x proto definitions and ApiKey registry (#628) - Update fluss_api.proto with all 1.x message types (ACLs, KV snapshots, producer offsets, cluster config, rebalance, server tags, etc.) - Add optional fields: rack, remote_data_dir, leader_epoch, agg_mode, etc. - Register 24 new ApiKey variants (1023-1064) in api_key.rs - Update build.rs prost bytes config for new proto fields - Add None defaults in convert.rs and partition.rs - Update pre-existing message wrappers that reference renamed proto fields / ApiKey variants so the crate still builds: * create_partition.rs: ignore_if_exists -> ignore_if_not_exists * get_latest_lake_snapshot.rs: ApiKey::GetLatestLakeSnapshot -> GetLakeSnapshot * list_databases.rs: populate new include_summary field * lookup.rs: PbLookupReqForBucket.key -> keys; new LookupRequest fields Co-authored-by: warmbupt <warmbupt@gmail.com> Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
| Commit: | 96a63d5 | |
|---|---|---|
| Author: | Yang Wang | |
| Committer: | GitHub | |
[rpc][server][client] add ListRemoteLogManifests and ListKvSnapshots RPCs for orphan cleanup (#3480)
| Commit: | ad51d97 | |
|---|---|---|
| Author: | yunhong | |
| Committer: | GitHub | |
[server] Add Cluster Health API implementation (#3400)
| Commit: | e274bd1 | |
|---|---|---|
| Author: | Hongshun Wang | |
| Committer: | GitHub | |
[rust] Support API_VERSION in rust client. (#531) * [rust] Support API_VERSION in rust client * remove useless write_version_type and read_version_type which is same as java client does. * Add test about kv_format_v2. * return apiKey.highestSupportedVersion as default. * check whether server type mismatch. * add test about unknown server type
| Commit: | 01c13e8 | |
|---|---|---|
| Author: | yunhong | |
| Committer: | GitHub | |
[kv] Support elect standby replicas for primary key table (#2829)
| Commit: | 01c9a22 | |
|---|---|---|
| Author: | Anton Borisov | |
| Committer: | GitHub | |
[rust] lookup decoding schema id (#517)
| Commit: | 7b4d711 | |
|---|---|---|
| Author: | Anton Borisov | |
| Committer: | GitHub | |
feat: [rust] prefix lookup support (#500) * [rust] prefix lookup support * fix fmt * address comments * address comments * Address comments 2
| Commit: | c615e27 | |
|---|---|---|
| Author: | Giannis Polyzos | |
| Committer: | GitHub | |
[common] Introduce RPC Layer for KV Scan (#2976)
| Commit: | 3d8df9f | |
|---|---|---|
| Author: | Yang Wang | |
| Committer: | GitHub | |
[server] Add server-side filter execution and client-side integration (#2951)
| Commit: | 8957671 | |
|---|---|---|
| Author: | Anton Borisov | |
| Committer: | GitHub | |
feat: [TASK-315] Proto + RPC for LimitScan (#472)
| Commit: | 05b6f66 | |
|---|---|---|
| Author: | Liebing | |
| Committer: | GitHub | |
[server] Extend metadata models to support per-table/partition remote data directory (#2763)
| Commit: | 14f0f12 | |
|---|---|---|
| Author: | Liebing | |
| Committer: | GitHub | |
[server] Support alter database comment and custom properties (#1172)
| Commit: | ac21483 | |
|---|---|---|
| Author: | Giannis Polyzos | |
| Committer: | GitHub | |
[common] Support Protobuf and RPC for Predicates (#2502)
| Commit: | ce67b9f | |
|---|---|---|
| Author: | Anton Borisov | |
| Committer: | GitHub | |
feat: introduce idempotent writes (#404)
| Commit: | f7fa971 | |
|---|---|---|
| Author: | Junbo Wang | |
| Committer: | GitHub | |
[lake/tiering] Add per-table monitoring metrics for Lake Tiering (#2454)
| Commit: | 1f4ff05 | |
|---|---|---|
| Author: | Anton Borisov | |
| Committer: | GitHub | |
feat: support sasl/plain auth (#375)
| Commit: | d6fd1f1 | |
|---|---|---|
| Author: | Jark Wu | |
| Committer: | Jark Wu | |
[kv] Support COUNT(*) pushdown for primary key tables and introduce GetTableStats RPC (#2651)
| Commit: | 3015f6b | |
|---|---|---|
| Author: | Hongshun Wang | |
| Committer: | Jark Wu | |
[client] Thrown exception if ServerType mismatch. (#2606)
| Commit: | 422d422 | |
|---|---|---|
| Author: | Jark Wu | |
| Committer: | Jark Wu | |
[kv] Support COUNT(*) pushdown for primary key tables and introduce GetTableStats RPC (#2651)
| Commit: | fad97df | |
|---|---|---|
| Author: | Hongshun Wang | |
| Committer: | GitHub | |
[client] Thrown exception if ServerType mismatch. (#2606)
| Commit: | 417c220 | |
|---|---|---|
| Author: | yuxia Luo | |
| Committer: | Jark Wu | |
[paimon] Fix union read paimon dv table issue (#2326)
| Commit: | 5a4374a | |
|---|---|---|
| Author: | yuxia Luo | |
| Committer: | GitHub | |
[paimon] Fix union read paimon dv table issue (#2326)
| Commit: | 6e7fc26 | |
|---|---|---|
| Author: | yunhong | |
| Committer: | Jark Wu | |
[kv] Support kv snapshot lease (#2179)
| Commit: | 0cee383 | |
|---|---|---|
| Author: | yunhong | |
| Committer: | GitHub | |
[kv] Support kv snapshot lease (#2179)
| Commit: | 6655bdc | |
|---|---|---|
| Author: | Hongshun Wang | |
| Committer: | GitHub | |
[client] Support list database summaries (#2515)
| Commit: | bdb44c7 | |
|---|---|---|
| Author: | yunhong | |
| Committer: | GitHub | |
[server] Fix rebalance may cause remote file deleted error (#2570) * [server] Fix rebalance may cause remote file deleted error * address jark's comments * improve * change to set offline immediately after set to immigration started --------- Co-authored-by: Jark Wu <jark@apache.org>
| Commit: | ec5078e | |
|---|---|---|
| Author: | Junbo Wang | |
| Committer: | Jark Wu | |
[kv] Implement lookup with insertIfNotExists on tablet server (#2485)
| Commit: | 2671af6 | |
|---|---|---|
| Author: | Yang Wang | |
| Committer: | GitHub | |
[kv] Return log end offset in UpsertResult and DeleteResult for exactly-once semantics (#2530)
| Commit: | 1e84897 | |
|---|---|---|
| Author: | Yang Wang | |
| Committer: | GitHub | |
[kv] Add OVERWRITE MergeMode support for undo recovery in aggregation tables (#2492)
| Commit: | 81e3f3a | |
|---|---|---|
| Author: | Yang Wang | |
| Committer: | GitHub | |
[kv] Add Producer Offset Snapshot for Exactly-Once semantics (#2434)
| Commit: | 62db319 | |
|---|---|---|
| Author: | yuxia Luo | |
| Committer: | GitHub | |
[lake] Tiering service support commit by time (#2185)
| Commit: | d695cb8 | |
|---|---|---|
| Author: | Keith Lee | |
| Committer: | GitHub | |
feat: Implement Admin APIs for partitioning (#208)
| Commit: | eda19e2 | |
|---|---|---|
| Author: | Anton Borisov | |
| Committer: | GitHub | |
feat: introduce priority queue for downloading remote segments (#187)
| Commit: | f519ad9 | |
|---|---|---|
| Author: | yuxia Luo | |
| Committer: | GitHub | |
feat: introduce KvWriteBatch and PutKvRequest (#176)
| Commit: | 93048ed | |
|---|---|---|
| Author: | Andrea Bozzo | |
| Committer: | GitHub | |
feat: introduce lookup support for primary key tables (#159)
| Commit: | 7addc72 | |
|---|---|---|
| Author: | yunhong | |
| Committer: | GitHub | |
[server] Support generate and execute reblance plan (#1452)
| Commit: | a316c3d | |
|---|---|---|
| Author: | yuxia Luo | |
| Committer: | GitHub | |
[lake] Record a file path storing log offsets in lake snapshot property (#2223)
| Commit: | 6868157 | |
|---|---|---|
| Author: | yunhong | |
| Committer: | GitHub | |
[server] Introduce new rebalance API (#1380) Co-authored-by: Jark Wu <jark@apache.org>
| Commit: | e585d1f | |
|---|---|---|
| Author: | yuxia Luo | |
| Committer: | GitHub | |
chore: Improve error (#77)
| Commit: | 746f948 | |
|---|---|---|
| Author: | AlexZhao | |
| Committer: | GitHub | |
feat: support s3 as remote segment (#93) --------- Co-authored-by: luoyuxia <luoyuxia@alumni.sjtu.edu.cn>
| Commit: | f26312f | |
|---|---|---|
| Author: | yuxia Luo | |
| Committer: | GitHub | |
[lake] Use remote file to store lake snapshot offsets to reduce the size of zookeeper node (#2037)
| Commit: | 72b10bb | |
|---|---|---|
| Author: | yunhong | |
| Committer: | GitHub | |
[common] Remove TableInfo from Cluster (#2068)
| Commit: | 07721fe | |
|---|---|---|
| Author: | Jark Wu | |
| Committer: | Jark Wu | |
[server][client] Improve the design and performance of ADD COLUMN operation 1. Make lookup requests async. 2. Introduce ServerProjectionCache to share ProjectionInfo in TabletServer level. 3. Revert FlinkAsFlussRow changes, and introduce PaddingRow for the padding null columns for schema changes. 4. Make PutKv zero-copy to persist kv records. 5. Rename SchemaMetadataManager to ServerSchemaCache and use TableId instead of TablePath to track schemas which is safer. 6. Revert source related changes to still include the projectedFieldIndexes parameter.
| Commit: | ea2d61c | |
|---|---|---|
| Author: | Hongshun Wang | |
| Committer: | Jark Wu | |
[server][client] Support Schema Evolution (ADD COLUMN LAST) in Fluss and connector (#2010)
| Commit: | a2cc54d | |
|---|---|---|
| Author: | naivedogger | |
| Committer: | GitHub | |
[feat] Create Python bindings for table writing and reading (#9) --------- Co-authored-by: luoyuxia <luoyuxia@alumni.sjtu.edu.cn>
| Commit: | 8c4004c | |
|---|---|---|
| Author: | Hongshun Wang | |
| Committer: | GitHub | |
[FIP-12] Support dynamic cluster config to enable lakehouse (#1567)
The documentation is generated from this commit.
| Commit: | e7d92ce | |
|---|---|---|
| Author: | Yang Guo | |
| Committer: | GitHub | |
[server] Rename RPC AlterTablePropertiesRequest to AlterTableRequest for future extensibility (#1766)
| Commit: | 4345663 | |
|---|---|---|
| Author: | Jark Wu | |
| Committer: | Jark Wu | |
[server] Use unified batch-concurrent implementation for ZooKeeper operations and remove redundant code This commit replaces all single-operation async calls with a unified batch-concurrent implementation. This eliminates the need to maintain three separate code paths (batch concurrent, single async, and sync), significantly reducing code duplication in ZooKeeperClient. Going forward, all sync ZooKeeper operations will be replaced by the batch-concurrent approach, which improves coordinator performance through better I/O utilization and reduced latency. Additionally, the `cacheOnly` flag has been removed from the current metadata request. Support for cache-only semantics will be reintroduced in a future `MetadataRequestV2` with a cleaner design.
| Commit: | 32d50b8 | |
|---|---|---|
| Author: | ocean.wy | |
| Committer: | Jark Wu | |
[server] server process metadata request in async mode (#1463)
| Commit: | 68ce225 | |
|---|---|---|
| Author: | Jark Wu | |
| Committer: | GitHub | |
[server] Improve the implementation of ALTER TABLE (#1760)
| Commit: | 9df7b72 | |
|---|---|---|
| Author: | Yang Guo | |
| Committer: | GitHub | |
[server] Support alter table properties (#1625)
| Commit: | 79d9dbb | |
|---|---|---|
| Author: | yunhong | |
| Committer: | GitHub | |
[server] TabletServer support controlled shutdown (#1159)
| Commit: | ece2fe3 | |
|---|---|---|
| Author: | Liebing | |
| Committer: | GitHub | |
[lake] Lake tiering service report the max timestamp of fluss record (#1700)
| Commit: | e6d877b | |
|---|---|---|
| Author: | Yang Wang | |
| Committer: | GitHub | |
[protogen] Fix infinite recursion in RecordsFieldFinder (#1282)
| Commit: | 69b0ead | |
|---|---|---|
| Author: | naivedogger | |
| Committer: | GitHub | |
[feat] Add more functions to the Rust client Admin (#5)
| Commit: | f32db76 | |
|---|---|---|
| Author: | Hongshun Wang | |
| Committer: | Hongshun Wang | |
[FIP-12] Add dynamic config and enable lakehouse dynamically.
| Commit: | f83b32c | |
|---|---|---|
| Author: | yuxia Luo | |
| Committer: | GitHub | |
[feat] Support basic write & read (#2)
| Commit: | bb0e12b | |
|---|---|---|
| Author: | Jark Wu | |
| Committer: | Jark Wu | |
[infra] Update project package name to org.apache.fluss Co-authored-by: benjobs <benjobs@apache.org>
| Commit: | db12388 | |
|---|---|---|
| Author: | Jark Wu | |
| Committer: | Jark Wu | |
[infra] Update project package name to org.apache.fluss Co-authored-by: benjobs <benjobs@apache.org>
| Commit: | 420194a | |
|---|---|---|
| Author: | Jark Wu | |
| Committer: | GitHub | |
[client] RemoteLogDownloader supports download log files in parallel and in priority (#1579)
| Commit: | dfe2176 | |
|---|---|---|
| Author: | luoyuxia | |
| Committer: | Hongshun Wang | |
support enable lake dynamically
| Commit: | f82d103 | |
|---|---|---|
| Author: | Hongshun Wang | |
| Committer: | Hongshun Wang | |
[FIP-12] add dynamic config to enable lakehouse.
| Commit: | d2dc98f | |
|---|---|---|
| Author: | yuxia Luo | |
| Committer: | GitHub | |
[lake] Store partition name in lake snapshot property (#1485)
| Commit: | bb7fbc2 | |
|---|---|---|
| Author: | Jark Wu | |
| Committer: | GitHub | |
[license] Update source files with Apache boilerplate headers (#1147)
| Commit: | a74cdc1 | |
|---|---|---|
| Author: | CaoZhen | |
| Committer: | GitHub | |
[server] Support list partititions by partition spec (#897)
| Commit: | 4383783 | |
|---|---|---|
| Author: | Leonard Xu | |
| Committer: | GitHub | |
[lake/flink] Introduce TieringSource and TieringSourceEnumerator (#1020)
| Commit: | 51333a0 | |
|---|---|---|
| Author: | yunhong | |
| Committer: | GitHub | |
[server] UpdateMetadata RPC should update tablePath and physicalTablePath cache (#890)
| Commit: | 8cacbca | |
|---|---|---|
| Author: | yunhong | |
| Committer: | GitHub | |
[server] Support generating rack aware bucket assignment when creating table (#786)
| Commit: | 06418f8 | |
|---|---|---|
| Author: | Yang Guo | |
| Committer: | Jark Wu | |
[server] authorize InitWriter RPC with table path parameters
| Commit: | 1389b9d | |
|---|---|---|
| Author: | yuxia Luo | |
| Committer: | GitHub | |
[lake/rpc] Add HeartBeat RPC in Servers for Tiering Services This closes #863.
| Commit: | 5573ae3 | |
|---|---|---|
| Author: | Hongshun Wang | |
| Committer: | GitHub | |
[server] Fluss support ACL authorization (#588) Co-authored-by: Jark Wu <jark@apache.org>
| Commit: | 4784b91 | |
|---|---|---|
| Author: | Hongshun Wang | |
| Committer: | GitHub | |
[server/client] Introduce authenticate in Fluss. (#577) Co-authored-by: Jark Wu <jark@apache.org>
| Commit: | 157d252 | |
|---|---|---|
| Author: | Hongshun Wang | |
| Committer: | GitHub | |
[server] Add multiple endpoint listener for fluss server (#531)
| Commit: | 9eed014 | |
|---|---|---|
| Author: | Jark Wu | |
| Committer: | Jark Wu | |
[license] Update License Copyright year
| Commit: | 81dcf4f | |
|---|---|---|
| Author: | Jark Wu | |
| Committer: | GitHub | |
[client] Use partition spec in listPartitions (#546)
| Commit: | 9c684b6 | |
|---|---|---|
| Author: | Jark Wu | |
[hotfix] Add NOTICE in FlussApi.proto for future proto3 upgrade
| Commit: | 6c38e4e | |
|---|---|---|
| Author: | Nicholas Jiang | |
| Committer: | GitHub | |
[rpc] Remove describeLakeStorage RPC to get lake catalog from table properties (#503)
| Commit: | 599e247 | |
|---|---|---|
| Author: | yunhong | |
| Committer: | Jark Wu | |
[server] Support addPartition and dropPartition (#351)
| Commit: | 852d4a0 | |
|---|---|---|
| Author: | Jark Wu | |
| Committer: | GitHub | |
[client] Refactor Table API (#341)
| Commit: | 290d4a6 | |
|---|---|---|
| Author: | Hongshun Wang | |
| Committer: | GitHub | |
[clients] Add created_time and modified_time to database and table metadata (#289)
| Commit: | 37b7903 | |
|---|---|---|
| Author: | yunhong | |
| Committer: | GitHub | |
[server] Support wait a while before answering the log fetch request (#233) This can reduce a lot of frequent FetchLogRequest when the traffic of a topic is very low. This closes #199
| Commit: | 8b14329 | |
|---|---|---|
| Author: | yunhong | |
| Committer: | Jark Wu | |
[kv] Support PrefixLookup for primary key table (#222) This closes #65
| Commit: | a1280c6 | |
|---|---|---|
| Author: | Jark Wu | |
| Committer: | Jark Wu | |
initial commit