Proto commits in apache/arrow-rs

These 17 commits are when the Protocol Buffers files have changed:

2024-08-01

Upgrade protobuf definitions to flightsql 17.0 (#6133) (#6169) * Update FlightSql.proto to version 17.0 Adds new message CommandStatementIngest and removes `experimental` from other messages. * Regenerate flight sql protocol This upgrades the file to version 17.0 of the protobuf definition. Co-authored-by: Douglas Anderson <djanderson@users.noreply.github.com>

The documentation is generated from this commit.

2024-03-26

Implement FlightSQL spec change to support stateless prepared statements (#5433) * feat: stateless FlightSQL prepared statements * update protobuf and improve legacy behavior * Update arrow-flight/src/sql/server.rs Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> * make DoPutPreparedStatenentResult mandatory * update DoPutPreparedStatementResult docs to match arrow repo * update comment about legacy server behavior in DoPut --------- Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>

2024-02-22

Update Flight proto: PollFlightInfo & expiration time (#5413)

2023-05-23

feat: update flight-sql to latest specs (#4250) * feat: update flight-sql to latest specs * fix: pr feedback

2022-09-03

Update flight definitions including backwards-incompatible change to GetSchema (#2586) * update flight doc and code * fix cliyyp * backward compatibility for schema result * fix lint * Update arrow/src/ipc/convert.rs Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com> * Update arrow/src/ipc/convert.rs Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com> Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>

2022-03-11

Implement basic FlightSQL Server (#1386) * init impl flight sql server mod Change-Id: I108b2468b078470bb8b6f95c031035cc09227986 * update according to comments Change-Id: Ibb381e105041b38e6402850a2338403f802568ec * fix ci error Change-Id: I9485e510f1a960b6e094e559c3679434f8474ec1 * format code Change-Id: I7ef4ade3acc81ccf5df088c866d41b538cf6f4f2 * fix clippy issue Change-Id: I35d108ef43f2c2245444cfd5ea82da00b4f694f9 * add more test Change-Id: Ic159cea2c76b017e183d2946e2d24e6fd1f9b4c1 * improve error handling Change-Id: I709c16613092fd42ccff827eed3e3ad3f28368e2 * delete unnecessary Sync Change-Id: I03ed0f69ddb1203ecd75982815fa72eca4d81160 * add flight_sql_server example Change-Id: Ia35d697aaac3c72feba9c3aaf380ee3930484c48 * get rid of type annotation in unpack Change-Id: I6006702d424ac6595f58c66057df267c4fd24476 * fix comments Change-Id: I740d3d4e5aabbb56219291381e6a6db6506eca28 * add feature flight-sql Change-Id: I223cf76be10ff379fcc9000c730d99c9773c7c3d * delete all-features flag as packed_simd_2 no supported Change-Id: I50915b85b2f806bac5cd3207623e3f4e0e1974a1 * add feature flag for example Change-Id: I562efcfa89a606b8061d2715ca1b6775e2a952a9 * fix do_put and do_action API Change-Id: I80bef8c2b0a713a87c43487708ae721f5f8f9da9 * format code Change-Id: Ie664a5fca965759dbba59ad9e34fc6e33150ddbf * rename feature Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> * rename to flight-sql-experimental Change-Id: I4de4fe3768b0316e69ba6798406310632933d25d Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>

2020-11-28

ARROW-10542: [C#][Flight] Add beginning on flight code for net core I closed the previous PR and opened this one, since the original one did not use InternalsVisibleTo and required a version bump on the Apache.Arrow project from netstandard1.3 to netstandard1.5. This adds basic support for both a flight server and a flight client for Net Core. Sorry for the massive PR, but I wanted to have some basic functionality in place with atleast some tests that use the put and get flow before creating a PR. I hope that this PR can help create some discussion on how the interfaces should look etc, and if this looks like an accetable interface for flight in net core. It tries to mimic as much as possible the original gRPC net core interface, but mapping the classes from the network protocol to the C# classes. This implementation uses InternalsVisibleTo, to hinder a bump of .netstandard version from 1.3 to 1.5. So the Apache.Arrow project still uses netstandard1.3. All flight code is in a seperate project Apache.Arrow.Flight This also required changing build version from 2.2 to 3.0 The code does not include: * Handshake - the reason is that AspNetCore contains features already for authentication/authorization for gRPC. Can be added later ofcourse. * DoExchange - I feel that more feedback/discussion is required before DoExchange can be implemented. Note: **This has been fixed** Sourcelink did not work when using grpc.tools to have code compilation in the build step. So I had to generate the grpc code manually for sourcelink to work. This means that there are alot of extra code in this PR that are auto generated. cc: @eerhardt Looks like you are the most active for C#, would be great to get some feedback if this is similar to how you would implement it, or if major changes are required I am ofcourse up for that as well. Closes #8694 from Ulimo/master Lead-authored-by: Östman Alexander <alexander.ostman@sweco.se> Co-authored-by: Ulimo <alexander.ostman@hotmail.com> Signed-off-by: Eric Erhardt <eric.erhardt@microsoft.com>

2020-09-25

ARROW-8601: [Go][Flight] Implementations Flight RPC server and client Built out from https://github.com/apache/arrow/pull/6731 with some inspiration from the existing Reader/Writer and the C++ Flight implementation. Still need to build out the tests some more, but would like to get opinions and thoughts on what I've got so far as I continue to build it out. Closes #8175 from zeroshade/zeroshade/go/flight Authored-by: Matthew Topol <mtopol@factset.com> Signed-off-by: Wes McKinney <wesm@apache.org>

2020-03-31

ARROW-8294: [Flight] Add DoExchange to Flight.proto This is the proposed addition of the DoExchange endpoint to Flight for the mailing list discussion. Closes #6686 from lidavidm/doexchange-format Authored-by: David Li <li.davidm96@gmail.com> Signed-off-by: Wes McKinney <wesm+git@apache.org>

2019-08-31

ARROW-6094: [FlightRPC] Add Flight RPC method getFlightSchema coupled with proposal in https://docs.google.com/document/d/1zLdFYikk3owbKpHvJrARLMlmYpi-Ef6OJy7H90MqViA/edit?usp=sharing can be merged once that proposal is approved Closes #4980 from rymurr/ARROW-6094 and squashes the following commits: f1660b9b2 <Ryan Murray> address code review 4e13616a8 <Antoine Pitrou> Fix lint 0eb712ded <Ryan Murray> changes as per code review: f61779bed <Ryan Murray> address code review 28eac3c48 <Ryan Murray> changes as per mailing list suggestions 6a4741e01 <Ryan Murray> ARROW-6094: add flight rpc method getFlightSchema Lead-authored-by: Ryan Murray <rymurr@dremio.com> Co-authored-by: Ryan Murray <rymurr@gmail.com> Co-authored-by: Antoine Pitrou <antoine@python.org> Signed-off-by: Micah Kornfield <emkornfield@gmail.com>

2019-06-26

ARROW-4626: [Flight] Add application-defined metadata to DoGet/DoPut Also covers [ARROW-4627](https://issues.apache.org/jira/browse/ARROW-4627). This is quite an enormous change, if preferred, I can do my best to try and separate changes. Author: David Li <li.davidm96@gmail.com> Closes #4282 from lihalite/arrow-4626-application-metadata and squashes the following commits: 6f1cd8db7 <David Li> Rework interface for accessing server-sent metadata during DoPut 8fd99cd9b <David Li> Inline CompletableFuture in Flight acceptPut 4cebc543a <David Li> Mark flaky Flight test c551d8527 <David Li> Fix new CheckStyle violations 85e21699c <David Li> Fix Flight integration tests using metadata eff22393c <David Li> Use FlightStreamChunk in Flight/C++ 72c2a3fa0 <David Li> Try to always close FlightStream after acceptPut 1718d9b42 <David Li> Make FlightStream cancellable from acceptPut 7ac44df79 <David Li> Make Netty version consistent with gRPC 1225b67af <David Li> Use ArrowBuf instead of byte for Flight metadata ccfef2d1e <David Li> Disable Flight cancellation tests in CI 0484c333c <David Li> Pass Flight context to ListActions in Python b0f71d967 <David Li> Replace ARROW_EXPORT with ARROW_FLIGHT_EXPORT fdaa76e99 <David Li> Add client-side cancelation of DoGet operations b4dbc445e <David Li> Enable non-nested dictionary batches in Flight integration tests f7631a2fd <David Li> Add basic Arrow Flight docs a8ac27fb3 <David Li> Implement application metadata in Flight 86f4789ab <David Li> Add application metadata field to FlightData message

2019-05-22

ARROW-4651: [Flight] Use URIs instead of host/port pair I haven't changed the client/server construction interfaces to really take advantage of this. I would rather follow up with creating builders instead, as proposed, as that would be cleaner than special-casing the logic in the current constructors. Author: David Li <li.davidm96@gmail.com> Closes #4047 from lihalite/flight-uris and squashes the following commits: 870f6ebb8 <David Li> Add more builder options for Java Flight servers 5c127631b <David Li> Make Python Flight bindings more complete 675acc9bc <David Li> Introduce builder for C++ Flight servers 474419667 <David Li> Use builder for Flight server in Java 460442cea <David Li> Use URIs for Flight locations

2019-04-17

ARROW-5091: [Flight] Rename FlightGetInfo message to FlightInfo Author: Antoine Pitrou <antoine@python.org> Closes #4143 from pitrou/ARROW-5091-rename-flightgetinfo and squashes the following commits: 1663cdbc0 <Antoine Pitrou> ARROW-5091: Rename FlightGetInfo message to FlightInfo

2019-02-28

ARROW-4692: [Flight] Explain sidecar in a bit more detail Author: Micah Kornfield <emkornfield@gmail.com> Author: emkornfield <emkornfield@gmail.com> Closes #3767 from emkornfield/flight_doc and squashes the following commits: 98d97f78a <emkornfield> address review feedback 441a963d2 <Micah Kornfield> ARROW-4692: Explain sidecar in a bit more detail

2019-02-15

ARROW-4474: Use signed integers in FlightInfo payload size fields Author: David Li <li.davidm96@gmail.com> Closes #3555 from lihalite/arrow-4474 and squashes the following commits: 36ed4df3 <David Li> Use signed integers in FlightInfo payload size fields

2018-11-16

ARROW-3821: [Format/Documentation]: Fix typos and grammar issues in Flight.proto comments When reading the Flight.proto comments, I found some typos and grammar issue. This PR is simple fix to the comments. Author: m.wang <m.wang@alibaba-inc.com> Closes #2965 from wangmiao1981/typo and squashes the following commits: ac6db4b0 <m.wang> fix typo and grammar of Flight.proto

2018-09-20

ARROW-3146: [C++] Prototype Flight RPC client and server implementations This is a partial C++ implementation of the Flight RPC system initially proposed by Jacques in ARROW-249. As in Java, I had to dig into gRPC and Protocol Buffers internals to ensure that * On write, memory is only copied once into the outgoing gRPC buffer * On read, no memory is copied The way that I tricked gRPC into circumventing the built-in protobuf serde paths might look a bit hacky, but after digging around in the library a bunch I've convinced myself that it's the best and perhaps only way to accomplish this. Luckily, the message that's being serialized/deserialized is pretty opaque to the rest of the gRPC system, and it's controlled by the `SerializationTraits<T>` class. So you can take a gRPC stream reader and make it create any kind of type you want, even if the input data is a protocol buffer. Some things that won't be addressed in this patch, as scope is too large: * gRPC build toolchain issues (this is rather complex, I will create follow-up issues) * Security / encryption, and authentication issues. I have only implemented an insecure server * Integration with Travis CI * Python bindings API is preliminary and I expect to be the subject of iteration to make general and fast over the next several months. Author: Wes McKinney <wesm+git@apache.org> Closes #2547 from wesm/flight-cpp-prototype and squashes the following commits: 64bcdea43 <Wes McKinney> Initial Arrow Flight C++ implementation