These 55 commits are when the Protocol Buffers files have changed:
Commit: | 07ca01d | |
---|---|---|
Author: | Chris Lu |
format changes
The documentation is generated from this commit.
Commit: | 20db0de | |
---|---|---|
Author: | Chris Lu |
add step description
Commit: | f74a259 | |
---|---|---|
Author: | Shijiang Wei | |
Committer: | Shijiang Wei |
set Driver.StopTime when driver process is killed before job finishes If the driver process is killed before the job finishes, the `Driver.StopTime` will be unassigned. The `Duration` field on the UI will keep growing. Signed-off-by: Shijiang Wei <mountkin@gmail.com>
Commit: | c6c6224 | |
---|---|---|
Author: | zhaoyunyang |
add Union Action for Datasets
Commit: | c9a1cc8 | |
---|---|---|
Author: | Chris Lu |
add cleaning up after each flow execution fix https://github.com/chrislusf/gleam/issues/58
Commit: | 419478b | |
---|---|---|
Author: | Chris Lu |
mapper reducer send stats to gleam executor
Commit: | 7aebf99 | |
---|---|---|
Author: | Chris Lu |
renaming
Commit: | a0b3dd4 | |
---|---|---|
Author: | Chris Lu |
adding flow name, improve master ui
Commit: | e103318 | |
---|---|---|
Author: | Chris Lu |
add name to each step
Commit: | f943ad4 | |
---|---|---|
Author: | Chris Lu |
pure go mapper/reducer now reports stats to agent
Commit: | 85212e7 | |
---|---|---|
Author: | Chris Lu |
temp commit before ready
Commit: | 4e8a289 | |
---|---|---|
Author: | Chris Lu |
add new cassandra plugin, removing old adpter system
Commit: | bd36f76 | |
---|---|---|
Author: | Chris Lu |
move time to nanoseconds
Commit: | d5c89c8 | |
---|---|---|
Author: | Chris Lu |
pass step id and task id to executor to track stats
Commit: | c4033d7 | |
---|---|---|
Author: | Chris Lu |
collect execution stat for each task
Commit: | 70e8328 | |
---|---|---|
Author: | Chris Lu |
[job status] adjust colors, add back start/end points, auto width, collect start/stop time
Commit: | c50629e | |
---|---|---|
Author: | Chris Lu |
[job status] displaying step groups with multiple sources
Commit: | ae7d3d7 | |
---|---|---|
Author: | Chris Lu |
WIP adding task group to job status
Commit: | af369d8 | |
---|---|---|
Author: | Chris Lu |
master receives driver's flow status updates
Commit: | c48f98c | |
---|---|---|
Author: | Chris Lu |
sql: support offset, fix logic for limit
Commit: | 11c76eb | |
---|---|---|
Author: | Chris Lu |
add distinct() function
Commit: | f02044a | |
---|---|---|
Author: | Chris Lu |
push files to agents directly
Commit: | d907676 | |
---|---|---|
Author: | Chris Lu |
better formatted progress when interrupted
Commit: | 8445a29 | |
---|---|---|
Author: | Chris Lu |
driver collect execution status
Commit: | 63eaec9 | |
---|---|---|
Author: | Chris Lu |
refactor pb message definition
Commit: | 4ea00fe | |
---|---|---|
Author: | Chris Lu |
add pulse to avoid "connection reset by peer"
Commit: | 10c241e | |
---|---|---|
Author: | Chris Lu |
remove LocalStatusRequest, StopRequest
Commit: | 8bce2d7 | |
---|---|---|
Author: | Chris Lu |
move execution and delete datasetshard to gRpc
Commit: | 4d4b183 | |
---|---|---|
Author: | Chris Lu |
refactoring to merge the protobuf definitions
Commit: | d49f7bf | |
---|---|---|
Author: | Chris Lu |
rename protobuf file names
Commit: | 4709918 | |
---|---|---|
Author: | Chris Lu |
adjust package location
Commit: | 5673a20 | |
---|---|---|
Author: | Chris Lu |
change to gRPC to work with master
Commit: | 7a54c1c | |
---|---|---|
Author: | Chris Lu |
robust processing with OnDisk() option 1. retry on failed executions 2. only start execution when on disk inputs are ready 3. add errors when processing data
Commit: | d18effa | |
---|---|---|
Author: | Chris Lu |
add OnDisk() API
Commit: | b75f2f1 | |
---|---|---|
Author: | Chris Lu |
hint for on disk data store
Commit: | 068495c | |
---|---|---|
Author: | Chris Lu |
profiling executors
Commit: | 433dd17 | |
---|---|---|
Author: | Chris Lu |
change all sorting to use *SortOption
Commit: | 28cc88c | |
---|---|---|
Author: | Chris Lu |
add cassandra and new plugin mechanism
Commit: | 1eac8ad | |
---|---|---|
Author: | Chris Lu |
rename and move cmd package to msg
Commit: | 6c16461 | |
---|---|---|
Author: | Chris Lu |
add ScatterPartitions instruction
Commit: | 77e68af | |
---|---|---|
Author: | Chris Lu |
dynamic set dataset memory mode
Commit: | 1a9a7a3 | |
---|---|---|
Author: | Chris Lu |
simplifying input output locations
Commit: | faef9ff | |
---|---|---|
Author: | Chris Lu |
add distributed support for HashJoin()
Commit: | 05e8ebf | |
---|---|---|
Author: | Chris Lu |
add round robin execution
Commit: | ee41f1c | |
---|---|---|
Author: | Chris Lu |
added Top(n) and Take(n)
Commit: | 952150c | |
---|---|---|
Author: | Chris Lu |
add csv support, RoundRobin()
Commit: | 0d230bb | |
---|---|---|
Author: | Chris Lu |
add SortBy()
Commit: | 2cf8349 | |
---|---|---|
Author: | Chris Lu |
add selective multiple key fields also add tf-idf example
Commit: | e9475d5 | |
---|---|---|
Author: | Chris Lu |
add counter for readers for efficient in memory channels
Commit: | c59da29 | |
---|---|---|
Author: | Chris Lu |
wow, working in distributed mode!
Commit: | 1025252 | |
---|---|---|
Author: | Chris Lu |
working in progress, adding distributed execution now it blocks when executing instructionset. the first line of data is read from the source netchan, but did not pass into the second instruction
Commit: | 8fad790 | |
---|---|---|
Author: | Chris Lu |
migrated distributed execution code from glow not working at all. just compiles fine.
Commit: | f80aaf3 | |
---|---|---|
Author: | Chris Lu |
implement go executions on distributed executors
Commit: | 16c51e9 | |
---|---|---|
Author: | Chris Lu |
add netchan
Commit: | 206dced | |
---|---|---|
Author: | Chris Lu |
moved distributed processing logic from glow change SaveTextTo() to Fprintf()