These 76 commits are when the Protocol Buffers files have changed:
| Commit: | 3249312 | |
|---|---|---|
| Author: | Kai-Zhang | |
Add query tool to get minion log Change-Id: I87ee6381e67c804ad8429b8e7445d808452ef1d2
The documentation is generated from this commit.
| Commit: | 7418bbf | |
|---|---|---|
| Author: | Kai-Zhang | |
Add counters function
| Commit: | f721a64 | |
|---|---|---|
| Author: | Kai-Zhang | |
Add user defined environment variable
| Commit: | f1949be | |
|---|---|---|
| Author: | Kai-Zhang | |
Move proto directory
| Commit: | 88eb430 | |
|---|---|---|
| Author: | Kai-Zhang | |
Remove priority setting
| Commit: | c3e8d35 | |
|---|---|---|
| Author: | Kai-Zhang | |
Fix compile error of new galaxy related code
| Commit: | 58b2e6e | |
|---|---|---|
| Author: | Kai-Zhang | |
Implement functions in executor
| Commit: | 895a74f | |
|---|---|---|
| Author: | Kai-Zhang | |
Change proto name to meet with docs
| Commit: | 71bdb0f | |
|---|---|---|
| Author: | fxsjy | |
support cmdenv
| Commit: | 9682d91 | |
|---|---|---|
| Author: | fxsjy | |
new feature: mapred.compress.output=true
| Commit: | 3bb98b6 | |
|---|---|---|
| Author: | fxsjy | |
new feature: support combiner
| Commit: | e4a72a5 | |
|---|---|---|
| Author: | fxsjy | |
1)support compressed input; 2) use new galaxy sdk
| Commit: | 3c9ab44 | |
|---|---|---|
| Author: | fxsjy | |
allow ignoring certain number of failure tasks
| Commit: | c12e60f | |
|---|---|---|
| Author: | Kai-Zhang | |
Adjust sdk interface
| Commit: | 97ed6dc | |
|---|---|---|
| Author: | Kai-Zhang | |
Add load/dump to galaxy handler
| Commit: | 9d3527c | |
|---|---|---|
| Author: | Kai-Zhang | |
Create temp dir in different grus
| Commit: | 0a9f8c4 | |
|---|---|---|
| Author: | Kai-Zhang | |
Finish data persistence of master
| Commit: | 85b353a | |
|---|---|---|
| Author: | Kai-Zhang | |
Add load/dump to job tracker
| Commit: | f11ef1b | |
|---|---|---|
| Author: | Kai-Zhang | |
Add Dump function to Gru, use new proto type to define serial message
| Commit: | 21c045e | |
|---|---|---|
| Author: | Kai-Zhang | |
Update kill in gru, jobtracker and correct some functions in master_impl
| Commit: | c33f244 | |
|---|---|---|
| Author: | fxsjy | |
bug fix: job counter really works
| Commit: | a81e255 | |
|---|---|---|
| Author: | fxsjy | |
collect job counters
| Commit: | 6423627 | |
|---|---|---|
| Author: | Kai-Zhang | |
Implement dag scheduler
| Commit: | 4fd1884 | |
|---|---|---|
| Author: | Kai-Zhang | |
Modify request/response protocol for node support
| Commit: | 3299a5f | |
|---|---|---|
| Author: | Kai-Zhang | |
Use new JobDescriptor in galaxy handler
| Commit: | c86338b | |
|---|---|---|
| Author: | fxsjy | |
show error logs to users when job fail
| Commit: | e137d6f | |
|---|---|---|
| Author: | Kai-Zhang | |
Update proto for job descriptor
| Commit: | d10a0c5 | |
|---|---|---|
| Author: | Kai-Zhang | |
Support split size as an option
| Commit: | dd2a406 | |
|---|---|---|
| Author: | fxsjy | |
support SuffixMultipleTextOutput
| Commit: | a2fa33b | |
|---|---|---|
| Author: | fxsjy | |
1) user can see job start_time & finish time; 2) improve job persistence
| Commit: | 5e402c8 | |
|---|---|---|
| Author: | Kai-Zhang | |
Make job state persisted
| Commit: | bcef9d6 | |
|---|---|---|
| Author: | Kai-Zhang | |
Make retry times an option for client
| Commit: | 6c91ead | |
|---|---|---|
| Author: | Kai-Zhang | |
Backup input list to accelerate recovery
| Commit: | 36c4223 | |
|---|---|---|
| Author: | Kai-Zhang | |
Add recovery for master implement
| Commit: | d01c104 | |
|---|---|---|
| Author: | Kai-Zhang | |
Add time info in ShowJob
| Commit: | 2ab7a15 | |
|---|---|---|
| Author: | Kai-Zhang | |
Use suspend and nomore to control the capacity of minion
| Commit: | 89a29ad | |
|---|---|---|
| Author: | Kai-Zhang | |
Add support for n-line and speculative execution
| Commit: | 2aadc0d | |
|---|---|---|
| Author: | fxsjy | |
minion support nline input format
| Commit: | 033cdb7 | |
|---|---|---|
| Author: | fxsjy | |
add errros report for job debugging
| Commit: | 7a90fac | |
|---|---|---|
| Author: | fxsjy | |
some refactory of bistreaming
| Commit: | 8fdc35d | |
|---|---|---|
| Author: | fxsjy | |
bug fix: beyond array bound
| Commit: | b1e638c | |
|---|---|---|
| Author: | Kai-Zhang | |
Add -a option to client and fix bugs when input is invalid
| Commit: | 6bbcbcc | |
|---|---|---|
| Author: | Kai-Zhang | |
Fix tasks info display in client
| Commit: | 4a1a5a9 | |
|---|---|---|
| Author: | fxsjy | |
support sequencefile and bistreaming
| Commit: | 704c306 | |
|---|---|---|
| Author: | fxsjy | |
make dfs info configure-able
| Commit: | 724dc39 | |
|---|---|---|
| Author: | Kai-Zhang | |
Take map reduce job into consideration
| Commit: | 24249af | |
|---|---|---|
| Author: | fxsjy | |
report work_mode to master
| Commit: | 317f86d | |
|---|---|---|
| Author: | fxsjy | |
report endpoint when call finishtask
| Commit: | 8a87f19 | |
|---|---|---|
| Author: | fxsjy | |
minion support query && cancel
| Commit: | 07350ad | |
|---|---|---|
| Author: | fxsjy | |
some work about map partition
| Commit: | 9bdb40b | |
|---|---|---|
| Author: | fxsjy | |
add inputreader
| Commit: | 9ad449e | |
|---|---|---|
| Author: | fxsjy | |
merge conflict
| Commit: | 7ebdd71 | |
|---|---|---|
| Author: | fxsjy | |
refactory of shuffle
| Commit: | e55de90 | |
|---|---|---|
| Author: | Kai-Zhang | |
Fix compile error
| Commit: | ae772c5 | |
|---|---|---|
| Author: | Kai-Zhang | |
Merge branch 'master' of https://github.com/fxsjy/shuttle
| Commit: | ed1497a | |
|---|---|---|
| Author: | Kai-Zhang | |
Manage statistic
| Commit: | 5bb2a71 | |
|---|---|---|
| Author: | fxsjy | |
shuttle sdk skeleton
| Commit: | 9a52dff | |
|---|---|---|
| Author: | fxsjy | |
bug fix of sf_tool
| Commit: | 6867cd8 | |
|---|---|---|
| Author: | fxsjy | |
fix protobuf conflict with galaxy
| Commit: | 5b6e254 | |
|---|---|---|
| Author: | fxsjy | |
MergeFileReader done.
| Commit: | c8e8543 | |
|---|---|---|
| Author: | fxsjy | |
sortfile done
| Commit: | 500d470 | |
|---|---|---|
| Author: | fxsjy | |
bug fix
| Commit: | b5a77d2 | |
|---|---|---|
| Author: | fxsjy | |
sort file writer, seems work well
| Commit: | 343953e | |
|---|---|---|
| Author: | fxsjy | |
sort file
| Commit: | 46d1023 | |
|---|---|---|
| Author: | fxsjy | |
minion executors
| Commit: | c96d47c | |
|---|---|---|
| Author: | Kai-Zhang | |
Merge branch 'master' of https://github.com/fxsjy/shuttle Conflicts: proto/shuttle.proto
| Commit: | f1e8dc2 | |
|---|---|---|
| Author: | Kai-Zhang | |
Implement client interface in master
| Commit: | 8174468 | |
|---|---|---|
| Author: | fxsjy | |
minion basic logic
| Commit: | 985fb6b | |
|---|---|---|
| Author: | Kai-Zhang | |
Modify assign task request
| Commit: | 2ede2bd | |
|---|---|---|
| Author: | fxsjy | |
tab to spaces
| Commit: | c9f221d | |
|---|---|---|
| Author: | fxsjy | |
proto finished
| Commit: | 3a70a7a | |
|---|---|---|
| Author: | Kai-Zhang | |
Merge branch 'master' of https://github.com/fxsjy/shuttle Conflicts: master/master_impl.cc master/master_impl.h minion/minion_impl.cc minion/minion_impl.h proto/minion.proto
| Commit: | eaa8d7a | |
|---|---|---|
| Author: | Kai-Zhang | |
Modify minion proto and build the skeleton of proto server
| Commit: | 3d69afc | |
|---|---|---|
| Author: | fxsjy | |
move directory
| Commit: | 9c5d759 | |
|---|---|---|
| Author: | fxsjy | |
proto
| Commit: | 7dba334 | |
|---|---|---|
| Author: | fxsjy | |
first commit