Proto commits in dcos/metronome

These 33 commits are when the Protocol Buffers files have changed:

Commit:407b430
Author:Karsten Jeschkies
Committer:GitHub

Define dependencies on job spec. (#379) Summary: This patch introduces the `dependencies` field to job specs. Job specs cannot define dependencies on parents. JIRA issues: DCOS_OSS-5971

The documentation is generated from this commit.

Commit:b46cd62
Author:Tim Harper
Committer:GitHub

Add networking support to Metronome (#366) Also add scalafix and remove unused imports Bump UsiTestUtils to 0.1.39 JIRA Issues: MARATHON-8727

Commit:7a5db8d
Author:Matthias Eichstedt
Committer:Matthias Eichstedt

Support docker pull config for UCR JIRA issues: COPS-5329

Commit:5452acc
Author:Matthias Eichstedt
Committer:Matthias Eichstedt

Introducing customizable JobRuns Summary: Metronome now allows to override environment variables and add placement constraints for manually triggered JobRuns. This added functionality allows you to treat a JobSpec as a template, and trigger customized invocations based on this template. For example, you can now use a single generic JobSpec that processes data, and invoke a JobRun pointing to a specific bucket. Or, you could invoke a JobRun on a specific agent. Either way, you don't need to create individual JobSpecs and delete them once they're no longer needed. JIRA Issues: n/a

Commit:305d717
Author:Alena Varkockova
Committer:Ken Sipe

Add taskids into history (#337) * Add taskids into history * Fix

Commit:59aa9d3
Author:Alena Varkockova

Add taskids into history

Commit:5053847
Author:Nikita Melkozerov
Committer:Ken Sipe

Job Schema to App Def Mapping for GPUs (#301) Summary: added support for GPUs when we create an app definition. Zookeeper serialization and http API marshalling are also updated. Jira Issues: DCOS_OSS-4443

Commit:f7d8291
Author:Nikita Melkozerov

Job Schema to App Def Mapping for GPUs Summary: added support for GPUs when we create an app definition. Zookeeper serialization and http API marshalling are also updated. Jira Issues: DCOS_OSS-4443

Commit:a7b483e
Author:Ken Sipe
Committer:GitHub

Job Schema Design for GPU (#300) * adding schema for GPU support in metronome * must be a whole number

Commit:3009d22
Author:Nikita Melkozerov
Committer:Ken Sipe

Job Schema to App Def Mapping for File Based Secrets (#295) Summary: added support for File Based Secrets when we create an app definition. Zookeeper serialization and http API marshalling are also updated. Jira Issues: DCOS_OSS-4448

Commit:c6bc404
Author:Nikita Melkozerov

Job Schema to App Def Mapping for File Based Secrets Summary: added support for File Based Secrets when we create an app definition. Zookeeper serialization and http API marshalling are also updated. Jira Issues: DCOS_OSS-4448

Commit:2119a17
Author:Nikita Melkozerov
Committer:Ken Sipe

Map UCR Changes to App Def (#290) * adding in ucr. only partially there and broken compilation * Map UCR Changes to App Def Summary: added support for UCR when we create an app definition. Zookeeper serialization and http API marshalling are also updated. Jira Issues: https://jira.mesosphere.com/browse/DCOS_OSS-4437 * small refactoring * minor wording

Commit:6f569ff
Author:Ken Sipe

adding in ucr. only partially there and broken compilation

Commit:c32a502
Author:Tim Harper
Committer:Ken Sipe

Replace EQ operator with IS (#287) * Replace EQ operator with IS We replace the EQ operator with IS to better match Marathon's constraint API. Change is done in a backwards compatible way such that: * Posting an EQ constraint gets converted to an IS constraint, automatically * Upgrading from a prior version of metronome with a JobSpec transparently converts to IS * Valueless IS makes no sense (as does LIKE and UNLIKE) and continues to have no effect, as valueless EQ did. JIRA Issues: DCOS_OSS-4464 * changelog * Improve grammar * fixing Some(x) == x issue for test results

Commit:d15445c
Author:Ken Sipe

changing to the decided model for job ucr schema

Commit:4e9f763
Author:Ken Sipe

protobuf update for runtime

Commit:8c3940f
Author:Ken Sipe
Committer:GitHub

Allow Docker Params for Job Runs Master (#229) * starting params priv ability on docker Pass the docker params to Marathon when launching a task * added examples and documentation * Edit the docs based on Ivan't comments

Commit:9f0a59c
Author:Ken Sipe
Committer:GitHub

Allow Docker Params for Job Runs BP (#226) * added examples and documentation * starting params priv ability on docker Pass the docker params to Marathon when launching a task * Edit the docs based on Ivan't comments

Commit:b4ed439
Author:Ken Sipe
Committer:GitHub

Allow Docker Params for Job Runs (#225) * starting params priv ability on docker Pass the docker params to Marathon when launching a task * added examples and documentation * Edit the docs based on Ivan't comments

Commit:e1bb2d7
Author:Ken Sipe

added the schema for linxu caps along with the metronome proto changes

Commit:534eae8
Author:Ken Sipe
Committer:GitHub

Secrets with Older Metrics (#221) * Support secrets in Metronome (#216) Description: propagation of secrets & serialization tests JIRA issues: METRONOME-246 * removing shadowed unused import * updated secret validations, rolled back marshalling test and bumped version number for si testing

Commit:0659f67
Author:Nikita Melkozerov
Committer:Ken Sipe

Support secrets in Metronome (#216) * Support secrets in Metronome Description: propagation of secrets & serialization tests JIRA issues: METRONOME-246 * more tests * changes after the review

Commit:97b8be1
Author:Ken Sipe
Committer:GitHub

Support FORBID Concurrency Policy (Option 2) (#182) * working version of forbid * adding forbid test * option 2 without blocking code between actors * removed deadcode and updates based PR feedback * refactored startingdeadline out as it is part of the now passed schedulespec for job runs * cleaning up some todo notes * adding tests for forbid and cleaning up based on PR review * adding tests of v0 and v1 endpts and actor behavior for forbid concurrency * a little code cleanup in fixture

Commit:b4f767b
Author:Alena Varkockova
Committer:Ken Sipe

Implement start deadline (#164) * Implement start deadline METRONOME-191 * Call schedule method * added cancellable to deadline scheduler. the formatting changes are due to our toolchain. * Changes by CR * Move startingdeadline to JobRun * Add a test verifying the starting deadline * Add more tests * Improve how we deal with negative starting deadline * Fix failing tests * Fixed by code review * fixes after a rebase

Commit:a1cd20f
Author:Ken Sipe
Committer:Alena Varkockova

Update to protocol buffers version 3.3.0 (#162) Summary: Updating protocol buffers to the same version as we use in Marathon would actually ease the setup needed for the development team. Also the install script is changed in a way that it does not compile protoc anymore, it uses pre-compiled binaries distributed by Google with every release. JIRA issues: METRONOME-188

Commit:8dd1aa3
Author:Ken Sipe
Committer:GitHub

Adding Force Pull Image (#158) * adding ability to send taskKillGracePeriod to marathon libs from metronome * Add killTaskGracePeriod to marshaller tests * cased protobuf type correctly. Added protobuf to runspec conversion * going with preferred protobuf naming guide. thanks alenkacz * adding forcePullImage to metronome * grammer change * removing flaky test * adding tests for new docker parameter * Serialize and deserialize dockerspec in API layer * fixes from PR review * making code comment more clear

Commit:78ade87
Author:Ken Sipe
Committer:GitHub

Add taskKillGracePeriod (#156) * adding ability to send taskKillGracePeriod to marathon libs from metronome * Add killTaskGracePeriod to marshaller tests * cased protobuf type correctly. Added protobuf to runspec conversion * going with preferred protobuf naming guide. thanks alenkacz * Test on the JobExecutor level * Test that kill period is passed through JSON * code formatting update to test

Commit:5934964
Author:Matthias Veit
Committer:Matthias Eichstedt

Make properties consistent (#43) Make property naming (more) consistent. finishedAt->completedAt state->status

Commit:38c895d
Author:Matthias Eichstedt
Committer:Matthias Veit

JobRunExecutor initialization (#35) * * Implemented JobRunExecutor initialization * Added ReconciliationActor * Adjustments for changed JobHistory proto

Commit:0f65e1a
Author:Gastón Kleiman
Committer:Matthias Eichstedt

Add ZK repositories (#28) Add ZK Persistence.

Commit:e2215d3
Author:Gastón Kleiman
Committer:Matthias Veit

Add Persistance to Proto and some minor model changes (#14) Model changes: - Made "JobSpec#description" optional. - Added "JobStatus.jobSpecId" - Renamed "ConstraintSpec#op" to "ConstraintSpec#operator" and introduced a new "Operator" type. - Introduce a new "Mode" type and use it for "Volume#mode" instead of a Mesos proto class. - Made all constant objects that have to be provided by users upper case. - Adopted a consistent way to define enums.

Commit:f686a0e
Author:Gastón Kleiman
Committer:Matthias Veit

Move protos to the jobs project (#11)

Commit:d479d79
Author:Gastón Kleiman
Committer:Matthias Veit

WIP: Add protos (#6) * WIP: Add protos * Use sbt-protobuf * Rename Artifact.URI to Artifact.URL * Add unknown values to all enums * Remove protos README.md * Sort proto enum values