These 55 commits are when the Protocol Buffers files have changed:
| Commit: | 07ca01d | |
|---|---|---|
| Author: | Chris Lu | |
format changes
The documentation is generated from this commit.
| Commit: | 20db0de | |
|---|---|---|
| Author: | Chris Lu | |
add step description
| Commit: | f74a259 | |
|---|---|---|
| Author: | Shijiang Wei | |
| Committer: | Shijiang Wei | |
set Driver.StopTime when driver process is killed before job finishes If the driver process is killed before the job finishes, the `Driver.StopTime` will be unassigned. The `Duration` field on the UI will keep growing. Signed-off-by: Shijiang Wei <mountkin@gmail.com>
| Commit: | c6c6224 | |
|---|---|---|
| Author: | zhaoyunyang | |
add Union Action for Datasets
| Commit: | c9a1cc8 | |
|---|---|---|
| Author: | Chris Lu | |
add cleaning up after each flow execution fix https://github.com/chrislusf/gleam/issues/58
| Commit: | 419478b | |
|---|---|---|
| Author: | Chris Lu | |
mapper reducer send stats to gleam executor
| Commit: | 7aebf99 | |
|---|---|---|
| Author: | Chris Lu | |
renaming
| Commit: | a0b3dd4 | |
|---|---|---|
| Author: | Chris Lu | |
adding flow name, improve master ui
| Commit: | e103318 | |
|---|---|---|
| Author: | Chris Lu | |
add name to each step
| Commit: | f943ad4 | |
|---|---|---|
| Author: | Chris Lu | |
pure go mapper/reducer now reports stats to agent
| Commit: | 85212e7 | |
|---|---|---|
| Author: | Chris Lu | |
temp commit before ready
| Commit: | 4e8a289 | |
|---|---|---|
| Author: | Chris Lu | |
add new cassandra plugin, removing old adpter system
| Commit: | bd36f76 | |
|---|---|---|
| Author: | Chris Lu | |
move time to nanoseconds
| Commit: | d5c89c8 | |
|---|---|---|
| Author: | Chris Lu | |
pass step id and task id to executor to track stats
| Commit: | c4033d7 | |
|---|---|---|
| Author: | Chris Lu | |
collect execution stat for each task
| Commit: | 70e8328 | |
|---|---|---|
| Author: | Chris Lu | |
[job status] adjust colors, add back start/end points, auto width, collect start/stop time
| Commit: | c50629e | |
|---|---|---|
| Author: | Chris Lu | |
[job status] displaying step groups with multiple sources
| Commit: | ae7d3d7 | |
|---|---|---|
| Author: | Chris Lu | |
WIP adding task group to job status
| Commit: | af369d8 | |
|---|---|---|
| Author: | Chris Lu | |
master receives driver's flow status updates
| Commit: | c48f98c | |
|---|---|---|
| Author: | Chris Lu | |
sql: support offset, fix logic for limit
| Commit: | 11c76eb | |
|---|---|---|
| Author: | Chris Lu | |
add distinct() function
| Commit: | f02044a | |
|---|---|---|
| Author: | Chris Lu | |
push files to agents directly
| Commit: | d907676 | |
|---|---|---|
| Author: | Chris Lu | |
better formatted progress when interrupted
| Commit: | 8445a29 | |
|---|---|---|
| Author: | Chris Lu | |
driver collect execution status
| Commit: | 63eaec9 | |
|---|---|---|
| Author: | Chris Lu | |
refactor pb message definition
| Commit: | 4ea00fe | |
|---|---|---|
| Author: | Chris Lu | |
add pulse to avoid "connection reset by peer"
| Commit: | 10c241e | |
|---|---|---|
| Author: | Chris Lu | |
remove LocalStatusRequest, StopRequest
| Commit: | 8bce2d7 | |
|---|---|---|
| Author: | Chris Lu | |
move execution and delete datasetshard to gRpc
| Commit: | 4d4b183 | |
|---|---|---|
| Author: | Chris Lu | |
refactoring to merge the protobuf definitions
| Commit: | d49f7bf | |
|---|---|---|
| Author: | Chris Lu | |
rename protobuf file names
| Commit: | 4709918 | |
|---|---|---|
| Author: | Chris Lu | |
adjust package location
| Commit: | 5673a20 | |
|---|---|---|
| Author: | Chris Lu | |
change to gRPC to work with master
| Commit: | 7a54c1c | |
|---|---|---|
| Author: | Chris Lu | |
robust processing with OnDisk() option 1. retry on failed executions 2. only start execution when on disk inputs are ready 3. add errors when processing data
| Commit: | d18effa | |
|---|---|---|
| Author: | Chris Lu | |
add OnDisk() API
| Commit: | b75f2f1 | |
|---|---|---|
| Author: | Chris Lu | |
hint for on disk data store
| Commit: | 068495c | |
|---|---|---|
| Author: | Chris Lu | |
profiling executors
| Commit: | 433dd17 | |
|---|---|---|
| Author: | Chris Lu | |
change all sorting to use *SortOption
| Commit: | 28cc88c | |
|---|---|---|
| Author: | Chris Lu | |
add cassandra and new plugin mechanism
| Commit: | 1eac8ad | |
|---|---|---|
| Author: | Chris Lu | |
rename and move cmd package to msg
| Commit: | 6c16461 | |
|---|---|---|
| Author: | Chris Lu | |
add ScatterPartitions instruction
| Commit: | 77e68af | |
|---|---|---|
| Author: | Chris Lu | |
dynamic set dataset memory mode
| Commit: | 1a9a7a3 | |
|---|---|---|
| Author: | Chris Lu | |
simplifying input output locations
| Commit: | faef9ff | |
|---|---|---|
| Author: | Chris Lu | |
add distributed support for HashJoin()
| Commit: | 05e8ebf | |
|---|---|---|
| Author: | Chris Lu | |
add round robin execution
| Commit: | ee41f1c | |
|---|---|---|
| Author: | Chris Lu | |
added Top(n) and Take(n)
| Commit: | 952150c | |
|---|---|---|
| Author: | Chris Lu | |
add csv support, RoundRobin()
| Commit: | 0d230bb | |
|---|---|---|
| Author: | Chris Lu | |
add SortBy()
| Commit: | 2cf8349 | |
|---|---|---|
| Author: | Chris Lu | |
add selective multiple key fields also add tf-idf example
| Commit: | e9475d5 | |
|---|---|---|
| Author: | Chris Lu | |
add counter for readers for efficient in memory channels
| Commit: | c59da29 | |
|---|---|---|
| Author: | Chris Lu | |
wow, working in distributed mode!
| Commit: | 1025252 | |
|---|---|---|
| Author: | Chris Lu | |
working in progress, adding distributed execution now it blocks when executing instructionset. the first line of data is read from the source netchan, but did not pass into the second instruction
| Commit: | 8fad790 | |
|---|---|---|
| Author: | Chris Lu | |
migrated distributed execution code from glow not working at all. just compiles fine.
| Commit: | f80aaf3 | |
|---|---|---|
| Author: | Chris Lu | |
implement go executions on distributed executors
| Commit: | 16c51e9 | |
|---|---|---|
| Author: | Chris Lu | |
add netchan
| Commit: | 206dced | |
|---|---|---|
| Author: | Chris Lu | |
moved distributed processing logic from glow change SaveTextTo() to Fprintf()