Proto commits in andygrove/how-query-engines-work

These 66 commits are when the Protocol Buffers files have changed:

2021-04-10

rename package again

The documentation is generated from this commit.

rename package again

Rename packages from org.ballistacompute to io.andygrove

2021-01-27

Remove non-JVM components

2021-01-26

Implement serde for physical operator ProjectionExec (#430) Fixes #426

2021-01-24

Remove CountDistinct aggregate function (#417)

Refactor LogicalPlan protobuf (#415)

2021-01-23

Add documentation for TPC-H benchmarks (#401) * Add documentation for TPC-H benchmarks * Add support for Date32 data type so we can make progress with benchmarks * add --release flag in README * Use benchmarks for integration testing * Update dev docs

2021-01-21

Updated JVM protobuf definitions (#387) * Updated protobuf schema. Added generated code to the gradle source set of the protobuf module. Implemented join logical plan node. * Removed some line noise from protobuf build.gradle.kts Removed unused import from Expressions.kt

Update serde code to support null literal values (#386)

2021-01-19

Implement serdes for LogicalExprNode: Negative, InList, Wildcard (#389) Fixes #388

2021-01-18

Implement serdes for LogicalExprNode: Between, Case, Cast, Sort (#380)

2021-01-17

Implement serde code for logical expressions "Not, IsNull, IsNotNull" (#379)

2021-01-16

Logical plan node serde implementation (#359) * Added SortNode to ballista.proto. Added SortNode to LogicalExprNode. Added SortNode to from_proto and to_proto files. * Added round trip test for SortNode protobuf serialization * Added serde implementation for repartition, empty relation, create external table, and explain logical plan nodes. Moved protobuf roundtrip tests for LogicalPlan to src/serde/logical_plan/mod.rs. Changed build script to only run after ballista.proto has been changed. * Added serde implementation for repartition, empty relation, create external table, and explain logical plan nodes. Moved protobuf roundtrip tests for LogicalPlan to src/serde/logical_plan/mod.rs. Changed build script to only run after ballista.proto has been changed. * Fixed lints in from_proto.rs

2021-01-13

Implemented Serde for SortNode (#357) * Added SortNode to ballista.proto. Added SortNode to LogicalExprNode. Added SortNode to from_proto and to_proto files. * Added round trip test for SortNode protobuf serialization

2021-01-10

Refactor crates and fix build issues (#338) This PR aims to fix the github actions and get a minimal ballista crate building again against latest Arrow. The create contains WIP code for serializing logical and physical plans to protobuf format.

2021-01-09

new ballista-proto crate

2020-08-19

Branch 0.4 rebased (#323) * bump version * Migrate to latest arrow (#268) * Migrate to latest arrow (with sqlparser:0.6.1) (#292) * Fixed clippy errors. * Fixed test. * Clippy * Fixed error in kotlin. Co-authored-by: Andy Grove <andygrove73@gmail.com>

2020-08-08

[Rust] Remove async from ColumnBatchIter (#319)

[Rust] Minor improvements to ParquetScanExec (#318)

2020-07-30

Implement context settings for CSV and Parquet readers (#287)

2020-07-29

Respect schema and projection parameters from client (#286)

2020-07-22

[Rust] Partial TPC-H Query 1 works (#246)

2020-07-20

[Rust] Add TPC-H client (#242)

2020-07-15

Remove archived poc (#220)

2020-07-14

Fixes for recent changes in arrow, plus keep proto in sync (#217)

Improve etcd support (#211)

2020-07-12

Fix partitioning bugs in distributed hash aggregate queries (#206)

sync protos

Distributed execution really works (#204)

Distributed execution (#203)

2020-07-11

Executor refactor (#200)

2020-07-10

[Rust] Implement protobuf serde for physical plan and tasks (#198)

2020-07-05

Implement basic scheduler to create Job (DAG of stages) from a physical query plan (#179)

2020-05-24

[Rust] Remove logical plan (#151)

2020-05-06

Rust workspace (#138)

2020-04-21

add proto to rust project

save

2020-04-18

save

2020-04-15

[Rust] DataFrame API (#106)

2020-04-11

[Protobuf] Fix inconsistency in logical plan (#104)

[JVM] Rust client can now execute queries against Spark executor (#103)

2020-03-21

Example is code complete (#87)

2020-03-14

Save

2020-03-13

Start implementing protobuf serde in Rust code (#78)

Rough out Kotlin logical plan to protobuf serde (#77)

2020-02-27

Rust meetup demo feb 2020 (#76)

2020-02-15

start implementing translation from kotlin plan to protobuf

remove dupe protobuf file

Save

save

2020-02-11

add proto

Prepare for PoC #2 (#75)

2019-07-14

return csv results

2019-07-13

debugging

Save

2019-07-09

save

rough out aggregate support, clean up example code

2019-07-05

save

2019-07-04

save

move client to example

can send and receive query plan

rename request and response

rename service

add sample logical plan and expr messages

skeleton server