Proto commits in lakesoul-io/LakeSoul

These 9 commits are when the Protocol Buffers files have changed:

Commit:d058215
Author:mag1c1an1
Committer:GitHub

[Build] Foundation plumbing for 4.0.0: build-info crate, proto rename, unified versioning (#825) * chore: add buildinfo and use new version Co-Authored-By: glm-5.2 <noreply@zhipuai.cn> Signed-off-by: mag1cian <mag1cian@icloud.com> * fix: jar version in python ci Signed-off-by: mag1cian <mag1cian@icloud.com> --------- Signed-off-by: mag1cian <mag1cian@icloud.com> Co-authored-by: glm-5.2 <noreply@zhipuai.cn>

Commit:1a46381
Author:mag1c1an1
Committer:GitHub

[Metadata] Use Arrow IPC metadata schema (#800) * vortex: use projection pushdown Signed-off-by: mag1cian <mag1cian@icloud.com> * metadata: schema use arrow ipc Signed-off-by: mag1cian <mag1cian@icloud.com> * [Rust] Fix metadata branch clippy Implement the new DataFusion MemoryPool requirements for LoggedMemoryPool and remove a redundant as_ref in a test assertion. Co-Authored-By: Codex <noreply@openai.com> Signed-off-by: mag1cian <mag1cian@icloud.com> --------- Signed-off-by: mag1cian <mag1cian@icloud.com> Co-authored-by: Codex <noreply@openai.com>

Commit:10bae98
Author:du
Committer:GitHub

[Spark] Implement new compaction strategy (#585) * new compaction Signed-off-by: fphantam <dongf@dmetasoul.com> * remove debug info and change some params Signed-off-by: fphantam <dongf@dmetasoul.com> * remove debug code Signed-off-by: fphantam <dongf@dmetasoul.com> * new compaction Signed-off-by: fphantam <dongf@dmetasoul.com> * add License Signed-off-by: fphantam <dongf@dmetasoul.com> * not use DynamicBucket if table hashBucketNum not change in new compaction task Signed-off-by: fphantam <dongf@dmetasoul.com> * remove useless code Signed-off-by: fphantam <dongf@dmetasoul.com> * fix new compaction bug Signed-off-by: fphantam <dongf@dmetasoul.com> * add CompressDataFileInfo for midle file info Signed-off-by: fphantam <dongf@dmetasoul.com> --------- Signed-off-by: fphantam <dongf@dmetasoul.com>

The documentation is generated from this commit.

Commit:e15c8e7
Author:Ceng
Committer:GitHub

[Flink] add arrow datastream source (#496) * add lakesoul arrow source Signed-off-by: zenghua <huazeng@dmetasoul.com> * fix flink writer path Signed-off-by: zenghua <huazeng@dmetasoul.com> * support inferring schema Signed-off-by: zenghua <huazeng@dmetasoul.com> * tmp commit Signed-off-by: zenghua <huazeng@dmetasoul.com> * fix regression test Signed-off-by: zenghua <huazeng@dmetasoul.com> * fix reading tail recordbatch Signed-off-by: zenghua <huazeng@dmetasoul.com> * fix stup dao sql Signed-off-by: zenghua <huazeng@dmetasoul.com> * fix dynamic schema Signed-off-by: zenghua <huazeng@dmetasoul.com> * optimize imports Signed-off-by: zenghua <huazeng@dmetasoul.com> * split DataFileInfo with file_cols Signed-off-by: zenghua <huazeng@dmetasoul.com> * optimize import Signed-off-by: zenghua <huazeng@dmetasoul.com> * rebase on main Signed-off-by: zenghua <huazeng@dmetasoul.com> * fix regresion test Signed-off-by: zenghua <huazeng@dmetasoul.com> * fix regresion test Signed-off-by: zenghua <huazeng@dmetasoul.com> --------- Signed-off-by: zenghua <huazeng@dmetasoul.com> Co-authored-by: zenghua <huazeng@dmetasoul.com>

Commit:ba75914
Author:zenghua
Committer:zenghua

well define DataFileOp Signed-off-by: zenghua <huazeng@dmetasoul.com>

Commit:8749d2e
Author:Ceng
Committer:GitHub

merge native-io and native-metadata modules (#318) Signed-off-by: zenghua <huazeng@dmetasoul.com> Co-authored-by: zenghua <huazeng@dmetasoul.com>

Commit:cc285cc
Author:Ceng
Committer:GitHub

[Native-Metadata] Rust implementation of DAO layer (#294) * POC of native-metadata-jni Signed-off-by: zenghua <huazeng@dmetasoul.com> * Native DAO Signed-off-by: zenghua <huazeng@dmetasoul.com> * fix git action for native-metadata Signed-off-by: zenghua <huazeng@dmetasoul.com> * cleanup code Signed-off-by: zenghua <huazeng@dmetasoul.com> * fix after rebase main Signed-off-by: zenghua <huazeng@dmetasoul.com> --------- Signed-off-by: zenghua <huazeng@dmetasoul.com> Co-authored-by: zenghua <huazeng@dmetasoul.com>

Commit:8f3778b
Author:Xu Chen
Committer:GitHub

[Project] add/change spdx header to all files (#278) Signed-off-by: chenxu <chenxu@dmetasoul.com> Co-authored-by: chenxu <chenxu@dmetasoul.com>

Commit:83bd0df
Author:Ceng
Committer:GitHub

[Metadata] refractor metadata entity with protobuf code-gen (#276) * refractor metadata entity with protobuf Signed-off-by: zenghua <huazeng@dmetasoul.com> * add git action setup protoc Signed-off-by: zenghua <huazeng@dmetasoul.com> * bugfix for regression test Signed-off-by: zenghua <huazeng@dmetasoul.com> * Delete lakesoul-common/src/main/java/com/dmetasoul/lakesoul/meta/entity directory * add entity comments && fix compile option Signed-off-by: zenghua <huazeng@dmetasoul.com> --------- Signed-off-by: zenghua <huazeng@dmetasoul.com> Co-authored-by: zenghua <huazeng@dmetasoul.com>