Proto commits in cylc/cylc-flow

These 56 commits are when the Protocol Buffers files have changed:

Commit:bc1b460
Author:Oliver Sanders
Committer:GitHub

schema: add first-parent descendants (#6610) * Add the linearised first-parent hierarchy below a family as a field on GraphQL `Family` objects.

The documentation is generated from this commit.

Commit:5b2b180
Author:Tim Pillinger
Committer:GitHub

Skip Mode (#6039) Implement Skip Mode * Add `[runtime][<namespace>]run mode` and `[runtime][<namespace>][skip]`. * Spin run mode functionality into separate modules. * Run sim mode check with every main loop - we don't know if any tasks are in sim mode from the scheduler, but it doesn't cost much to check if none are. * Implemented separate job "submission" pathway switching. * Implemented skip mode, including output control logic. * Add a linter and a validation check for tasks in nonlive modes, and for combinations of outputs * Enabled setting outputs as if task ran in skip mode using `cylc set --out skip`. * Testing for the above. * Allow cylc set --out=skip,optional_output * Prevent cleanup from attempting to remote clean platforms skip and simulation --------- Co-authored-by: Oliver Sanders <oliver.sanders@metoffice.gov.uk> Co-authored-by: Ronnie Dutta <61982285+MetRonnie@users.noreply.github.com> Co-authored-by: Hilary James Oliver <hilary.j.oliver@gmail.com>

Commit:63a6a37
Author:Ronnie Dutta
Committer:David Sutherland

Type annotations & generate protobuf type stubs

Commit:e09c31f
Author:Oliver Sanders
Committer:Oliver Sanders

optional outputs extension * Implement optional output extension proposal. * Closes https://github.com/cylc/cylc-flow/issues/5640 * Add a user-configurable completion expression. * Automatically define a default when not specified. * Change completion rules for the expire output. * Expose the completion expression to the data store * Add the completion expression to the protobuf and GraphQL schemas. * Make the completion expression visible to the data store. * Display the completion status in "cylc show". Co-authored-by: Hilary James Oliver <hilary.j.oliver@gmail.com>

Commit:0dbed44
Author:Oliver Sanders

Merge remote-tracking branch 'upstream/master' into HEAD

Commit:5726dda
Author:David Sutherland
Committer:David Sutherland

nEdgeDistance API field

Commit:c3fb497
Author:David Sutherland
Committer:David Sutherland

graph depth API args

Commit:6977987
Author:David Sutherland
Committer:David Sutherland

window depth finder

Commit:653317f
Author:Oliver Sanders
Committer:GitHub

graphql: remove extraLogs field (#5672) Remove residual code leftover from the obsolete `extra log files` runtime configuration option.

Commit:8079006
Author:Ronnie Dutta

Merge branch 'master' into 8.1.x-deconflict

Commit:46d40ec
Author:David Sutherland

empty totals update

Commit:e6f584c
Author:Hilary Oliver
Committer:Hilary James Oliver

Convert old clock triggers to wall_clock xtriggers.

Commit:67623dc
Author:David Sutherland
Committer:David Sutherland

add runtime fields/deltas to def, proxy, jobs

Commit:3f4cc4d
Author:David Sutherland
Committer:David Sutherland

stringify runtime float lists

Commit:fb3d632
Author:David Sutherland
Committer:David Sutherland

runtime dict to ordered array

Commit:5ddb696
Author:Hilary James Oliver
Committer:Hilary James Oliver

Basic --wait triggers.

Commit:69e9515
Author:Hilary James Oliver
Committer:Hilary James Oliver

Integer flow labels.

Commit:6782900
Author:Hilary James Oliver
Committer:Hilary James Oliver

Removed task proxy "latest message".

Commit:40f135f
Author:Hilary James Oliver

Merge branch 'master' into pflag-refactor

Commit:5e6ebe3
Author:David Sutherland
Committer:Hilary James Oliver

add installed/pruned workflow status/flag

Commit:9d27dcc
Author:Hilary James Oliver
Committer:Hilary James Oliver

Merge branch 'master' into pflag-refactor

Commit:84e360f
Author:Hilary James Oliver
Committer:Hilary James Oliver

Post SOD refactor of task queueing etc.

Commit:ff94ee2
Author:Hilary James Oliver

Squashed commit: "suite" to "workflow" everywhere.

Commit:bc41d91
Author:Oliver Sanders
Committer:Oliver Sanders

host -> platform

Commit:c20824f
Author:David Sutherland
Committer:David Sutherland

latest state change tasks

Commit:48b9f95
Author:David Sutherland
Committer:David Sutherland

Update protobuf version 3.15.*

Commit:c20e8cd
Author:Hilary James Oliver
Committer:Hilary James Oliver

Remove queued state, and centralize queue logic.

Commit:b5ae5ae
Author:Oliver Sanders

mypy

Commit:ed5873f
Author:Oliver Sanders
Committer:Oliver Sanders

task owner: remove remains of obsolete functionality

Commit:892c395
Author:David Sutherland
Committer:David Sutherland

workflow field deltas

Commit:a582f22
Author:David Sutherland
Committer:David Sutherland

event driven task state, output, prereq, and trigger deltas

Commit:accf98a
Author:Ronnie Dutta
Committer:Ronnie Dutta

Wider rename of batch system -> job runner, pt 3 Deprecate batch_sys event handler templates %(batch_sys_job_id)s -> %(job_id)s %(batch_sys_name)s -> %(job_runner_name)s

Commit:9bf2547
Author:Hilary James Oliver
Committer:Hilary James Oliver

Minor post-platforms fix.

Commit:a90c24f
Author:David Sutherland
Committer:David Sutherland

Commands migrated to GraphQL endpoint

Commit:b8a7efe
Author:Hilary James Oliver
Committer:GitHub

Merge pull request #3798 from MetRonnie/param-env-tmpl Deprecate [runtime][X][parameter environment templates]

Commit:6219260
Author:Ronnie Dutta
Committer:Ronnie Dutta

Deprecate [runtime][X][parameter environment templates] Handle upgrade by prepending contents of [parameter environment templates] to [environment]

Commit:cde8720
Author:David Sutherland
Committer:David Sutherland

family state totals

Commit:e0e356a
Author:Hilary James Oliver
Committer:GitHub

Merge pull request #3515 from hjoliver/spawn-on-demand Task proxy spawn on demand.

Commit:6f555c7
Author:David Sutherland

add protobuf field number warning

Commit:edf61d3
Author:Hilary James Oliver
Committer:Hilary James Oliver

Spawn on demand Spawn on demand: test changes. Unify the two trigger commands... Restored cylc-remove tests. Tweak comments and style. Test search tweaks. Regenerated data_messages_pb2.py Revert spurious change. Fix new scan test for SoD. Simplify loop. Simplify loop more. Address review feedback. Spawn on specific outputs. Style fixes. Change spawn method name. Change a var name. Add TODO comment. Refactor a loop. Revert log level change. Remove unnecessary list use. Treat expired like succeeded. Don't keep held finished tasks. Clearer warning message. Updated comments. Don't remove held waiting tasks. Fix test for recent logging change. Add a shellcheck disable directive. Update comments. Remove unused code. Tidy spawning methods. Update task_states table on finished task removal. Also handle stop tasks in task pool not scheduler. Fix tests for latest SoD tweaks. Tidy task removal. Fix recent. Test fixes. Final suicide check pre stall check. Account for ext triggers in housekeeping. Temporarily remove reflow test. Fix style and unit tests. Restore abort on task failure. Shell style fix. Complete event-driven housekeeping. Merging flow IDs. CLI option to disable log timestamps. Also disable task message timestamps. Add new reflow command. flow label pruning... No need for parents-finished and housekeeping! Add a comment. Fix tests. Revert parent-held child-held change. Side affect: a single held parent out of multiple parents will do it. Speed up and deflake a test. Fix tests. Fix unit test. Tidy some code changes. Remove edit-run. more ... Fix check for truncated sequences. Address BK feedback. Functional test for bounded sequences. Fix error in ref test regex. Graph parents not needed. Fix tests. cylc dump print flow label Don't need task proxy startup adjustment. Code tidy. Fix recent error. Fix tests

Commit:bd64b5d
Author:David Sutherland
Committer:David Sutherland

Add null stripping GraphQL args (client decides). Nested deltas, delta-store resolving.

Commit:519bbab
Author:David Sutherland
Committer:David Sutherland

Cylc GraphQL backend & grouped deltas

Commit:adfe353
Author:David Sutherland
Committer:David Sutherland

delta added/updated split

Commit:6162208
Author:David Sutherland
Committer:David Sutherland

protobuf 3.12 optional fields pre-release

Commit:2ae7089
Author:Hilary James Oliver

Belated Happy New Year 2020.

Commit:1f281e3
Author:David Sutherland
Committer:David Sutherland

API version, module names, record changes

Commit:45094dd
Author:David Sutherland
Committer:David Sutherland

reload handling, publisher scan output, and more tests

Commit:6b8108a
Author:David Sutherland
Committer:David Sutherland

delta apply & publish

Commit:91bd2cf
Author:David Sutherland
Committer:David Sutherland

first parent fixed, ancestors added

Commit:7d2f06c
Author:David Sutherland
Committer:David Sutherland

job messages added

Commit:a2b1061
Author:David Sutherland
Committer:David Sutherland

Node edges field, data reform & BaseResolvers

Commit:7b74a09
Author:David Sutherland
Committer:David Sutherland

isHeld addition

Commit:1aa395a
Author:David Sutherland
Committer:David Sutherland

Incremental data-store generation Unit tests added Sorting query arg ID delimiter var Functional tests added checksum to stamp re-intialise data-store on reload Use external id with store keys graph sort bug fix

Commit:a5fb411
Author:Oliver Sanders
Committer:Oliver Sanders

separate suite status and status message * consolidate stop_mode values into suite_status * consolidate get_suite_status methods into suite_status * consolidate states into enumerations

Commit:2efac18
Author:David Sutherland
Committer:David Sutherland

Ghost nodes, update granulise, UIS import ready

Commit:22c14ac
Author:David Sutherland
Committer:David Sutherland

First functional state