Proto commits in gaia-pipeline/gaia

These 13 commits are when the Protocol Buffers files have changed:

2020-02-14

Docker support for pipeline runs (#201) * First implementation * More work done on the worker docker run implementation part * Docker pipeline runs should now also work on remote worker * More work on gaia worker docker pipeline execution * Almost working * Almost working * Work work * Fully working now * Fixed tests * Fixed tests * Renamed docker worker struct to make linter happy * Fixed wrong comment * Added a few tests * Implemented frontend docker part * Fixed tests * Fixed other test * Added more unit tests * Fix image pull bug * Optimized global loop. Added tests * Fix agent tests * Fix sub goroutine test failure

The documentation is generated from this commit.

2019-09-04

Worker builds binary in case the binary doesn't match the worker arch (#200) * Initial try to build binary by worker. * A little bit of refactoring. * Cleaning up the errorous binary. * A different approach. * Creating an api which the worker can call to get information about the pipeline repo. * Skeleton of the api * Added more logic. * Using the name instead * Moar info * Added correct error display. * RPC endpoint. * Changed impl to gRPC * Fixed wording and nil panic * Using the ID instead. * Cannot save pipeline run * GitPull the repo... * Handling error * It works! * Agent test build failure. * linter * Trying out createpipeline again. * Extracting rebuilding of binary. * Linting fix * mergin... * Fixed version of protoc-gen-go * Create the skeleton for the sha pair work * The skeleton is there. Daughter woke up I will have to continue this a bit later. * Small adjustments. * Added metadata uniqueid to shapair. * Using pipelinID as string. * Working on checking if there was a record or not. * Fixed condition. * Added re-try of the failed operation after the binary has been rebuilt. * Fixed the test. * Added test and nil check for private key. * Deleting it for now... And then I will try to fix that. * Removed gosdk. * Added a basic test case for the re-builder. * Added test for the pipeline rebuilder. * Some more coverage. * TODO: Fix whatever is adding an extra run to the update workflow. It is probably the exec error test. * Fixed the test which was causing problems. * Passed test. * Added moar coverage for the worker. * Added coverage to sha pair methods. * Shifted the sha storing process into bolt db. * Added tests and fixed bucket names. * Changed to PipelineID instead of UniqueID which was unique per run instead of per pipeline. * Fixed comments. * Renamed uniqueID field to pipelineid so it does not get accidentally mistaken for pipeline.UniqueID

2019-06-25

Distributed execution via worker (#166) * First tests * A bit more work on the register api * Implemented registration process * little work * Removed trash from last merge conflict * Growing * Implemented load of client tls certificates * Some more work * Added new parameters * Tested worker registration process and fixed several bugs * WIP server grpc implementation * WIP memdb implementation * More work on memdb implementation * Added memdb to modules * More work done on getwork * Implemented binary streaming for pipeline binaries * More work done * Work work work * Implemented updatework function * Finalizing for first test * More work done * Massive work done. Refactored tons of stuff. Pray that it will not break something :-O * Implemented logs shipping * More work done and some testing * IT WORKS LOL * More bug fixing * Implemented authentication and deregister function * Implemented backend worker tags * More work on the frontend * Implemented status view of workers. Added worker permissions. Implemented automatic primary instance work scheduling when workers are busy. * Added worker data fetch * Implemented deregister process and some bug fixing * Implemented reset of worker secret. Implemented ignored specialized vault keys * Implemented pipeline worker tags. WIP backend testing * Implemented automatic worker status transission and a few more status checks * Added worker registration test and fixed a few tests * Fixed most tests * Upgraded circleci * Fixed last failing tests * circle ci * Fixed data race * fixed * fixed * Linter fixes * fix * fix tests * Fixed * Fixed * Added more workers handler tests * Fixed concurrent tests * Added memdb service test * Fixed failing test * Worked on tests * Added missing error check * Fixed racy test * More work on tests * fixed wrong fixtures path * Added more test * Added server worker tests * Fixed small test issues * More work on tests * Fixed small issues * Increased waiting time * Racy test fix * growing * fix * fix * Added missing piece * Added worker tags to UI. Added option to prevent work being scheduled on primary. * Improved test coverage * Added negative tags to allow users to remove automatically detected tags. Added tags info to overview view. Fixed add tags bug. * Removed prettify cpp tag since it might lead to confusion

2019-01-07

Make Gaia go modules compatible (#146) * Make Gaia go modules compatible. * Am I doing this right? * Instead of running make get everywhere, have a dependency setup job. * Huh. * Trying go mod download instead of go get. * Fixed value. * Updated gaia image go version. * Added new circleci image * Upgrade to go 1.11.4 * Changes hash for new go version. * Change version to 1.11.4

This commit does not contain any .proto files.

2018-08-18

Automatically update pipelines github webhook (#48) * POC: Implement handling of push event. * Some additional comments. * Working hook creation. * Added go-github dependency. * Working hook creation through a UI provided github token. * introduced vault and push build. only thing remaining is triggerring the build. * to be continued. * First unit test for signature checking. * Fixed test. * Merged master and fixed hook test. * Clearing the certificate service as well. * Unit testing createGithubWebhook * A bunch of more tests. * Even moer coverage. * A little bit more coverage. * Fixed the password generation issue. Now it is in the right place. Also fixed the url it was sending. * Fixed tests and correct creation of secret so github accepts it. * Addressed comments. * dep ensure again

Removed unused dependencies (#80)

2018-08-12

DependsOn job dependency management (#67) * DependsOn implemented * Fixed comments/review points * Added tests for workload and a slight fix of select. * Added another test. Done. * 100% coverage for workload. * Fixed typo.

2018-06-28

Updated dependencies related to protobuf files

2018-06-27

Added dep as dependency management tool. Fixed uuid upstream breaking change

2018-03-06

Proto for Jobs changed. ID is now hash.

WIP job scheduling process

Added args parameter to proto file. Args are accessible via the sdk. Added first part of bolt implementation as storage layer

Added first proto file layout. Added first implementation of golang sdk layout. Implemented plugin system