Proto commits in chrislusf/gleam

These 55 commits are when the Protocol Buffers files have changed:

Commit:07ca01d
Author:Chris Lu

format changes

The documentation is generated from this commit.

Commit:20db0de
Author:Chris Lu

add step description

Commit:f74a259
Author:Shijiang Wei
Committer:Shijiang Wei

set Driver.StopTime when driver process is killed before job finishes If the driver process is killed before the job finishes, the `Driver.StopTime` will be unassigned. The `Duration` field on the UI will keep growing. Signed-off-by: Shijiang Wei <mountkin@gmail.com>

Commit:c6c6224
Author:zhaoyunyang

add Union Action for Datasets

Commit:c9a1cc8
Author:Chris Lu

add cleaning up after each flow execution fix https://github.com/chrislusf/gleam/issues/58

Commit:419478b
Author:Chris Lu

mapper reducer send stats to gleam executor

Commit:7aebf99
Author:Chris Lu

renaming

Commit:a0b3dd4
Author:Chris Lu

adding flow name, improve master ui

Commit:e103318
Author:Chris Lu

add name to each step

Commit:f943ad4
Author:Chris Lu

pure go mapper/reducer now reports stats to agent

Commit:85212e7
Author:Chris Lu

temp commit before ready

Commit:4e8a289
Author:Chris Lu

add new cassandra plugin, removing old adpter system

Commit:bd36f76
Author:Chris Lu

move time to nanoseconds

Commit:d5c89c8
Author:Chris Lu

pass step id and task id to executor to track stats

Commit:c4033d7
Author:Chris Lu

collect execution stat for each task

Commit:70e8328
Author:Chris Lu

[job status] adjust colors, add back start/end points, auto width, collect start/stop time

Commit:c50629e
Author:Chris Lu

[job status] displaying step groups with multiple sources

Commit:ae7d3d7
Author:Chris Lu

WIP adding task group to job status

Commit:af369d8
Author:Chris Lu

master receives driver's flow status updates

Commit:c48f98c
Author:Chris Lu

sql: support offset, fix logic for limit

Commit:11c76eb
Author:Chris Lu

add distinct() function

Commit:f02044a
Author:Chris Lu

push files to agents directly

Commit:d907676
Author:Chris Lu

better formatted progress when interrupted

Commit:8445a29
Author:Chris Lu

driver collect execution status

Commit:63eaec9
Author:Chris Lu

refactor pb message definition

Commit:4ea00fe
Author:Chris Lu

add pulse to avoid "connection reset by peer"

Commit:10c241e
Author:Chris Lu

remove LocalStatusRequest, StopRequest

Commit:8bce2d7
Author:Chris Lu

move execution and delete datasetshard to gRpc

Commit:4d4b183
Author:Chris Lu

refactoring to merge the protobuf definitions

Commit:d49f7bf
Author:Chris Lu

rename protobuf file names

Commit:4709918
Author:Chris Lu

adjust package location

Commit:5673a20
Author:Chris Lu

change to gRPC to work with master

Commit:7a54c1c
Author:Chris Lu

robust processing with OnDisk() option 1. retry on failed executions 2. only start execution when on disk inputs are ready 3. add errors when processing data

Commit:d18effa
Author:Chris Lu

add OnDisk() API

Commit:b75f2f1
Author:Chris Lu

hint for on disk data store

Commit:068495c
Author:Chris Lu

profiling executors

Commit:433dd17
Author:Chris Lu

change all sorting to use *SortOption

Commit:28cc88c
Author:Chris Lu

add cassandra and new plugin mechanism

Commit:1eac8ad
Author:Chris Lu

rename and move cmd package to msg

Commit:6c16461
Author:Chris Lu

add ScatterPartitions instruction

Commit:77e68af
Author:Chris Lu

dynamic set dataset memory mode

Commit:1a9a7a3
Author:Chris Lu

simplifying input output locations

Commit:faef9ff
Author:Chris Lu

add distributed support for HashJoin()

Commit:05e8ebf
Author:Chris Lu

add round robin execution

Commit:ee41f1c
Author:Chris Lu

added Top(n) and Take(n)

Commit:952150c
Author:Chris Lu

add csv support, RoundRobin()

Commit:0d230bb
Author:Chris Lu

add SortBy()

Commit:2cf8349
Author:Chris Lu

add selective multiple key fields also add tf-idf example

Commit:e9475d5
Author:Chris Lu

add counter for readers for efficient in memory channels

Commit:c59da29
Author:Chris Lu

wow, working in distributed mode!

Commit:1025252
Author:Chris Lu

working in progress, adding distributed execution now it blocks when executing instructionset. the first line of data is read from the source netchan, but did not pass into the second instruction

Commit:8fad790
Author:Chris Lu

migrated distributed execution code from glow not working at all. just compiles fine.

Commit:f80aaf3
Author:Chris Lu

implement go executions on distributed executors

Commit:16c51e9
Author:Chris Lu

add netchan

Commit:206dced
Author:Chris Lu

moved distributed processing logic from glow change SaveTextTo() to Fprintf()