Proto commits in hatchet-dev/hatchet

These commits are when the Protocol Buffers files have changed: (only the last 100 relevant commits are shown)

2025-05-09

fix: rm event filter from v0 defn

feat: proto field for expression

fix: revert cel event filtering

task pre

feat: retry count and improved logger

2025-05-08

feat: proto field for expression

fix: rm event filter from v0 defn

feat: add prio to push event request

2025-05-07

Feat: Write events into OLAP tables (#1634) * feat: query for event creation * feat: olap impl * feat: wire up the olap event write * feat: goroutine? * feat: start wiring up inserts to triggers * fix: no `RETURNING` * fix: hack * fix: inner join * feat: attempt 2 * fix: return errors * chore: lint * fix: diff * feat: add new partitions * fix: eof * fix: write external ids into table * chore: gen * fix: wiring * fix: event deduping * fix: insert in bulk * fix: bug * refactor: return type of trigger * fix: unnest ids * fix: unnest tenant ids * fix: run ids in bulk insert * feat: two bulk inserts, one tx * fix: cruft * fix: bug * Update pkg/repository/v1/olap.go Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * fix: rework to avoid n^2 loop * fix: transaction timeout * fix: lint * fix: use error * fix: rm penultimate version * fix: rm penultimate test part ii * Feat: CEL-based filtering of events (#1676) * feat: add optional expression to workflow trigger event ref * feat: proto field for expression * feat: write and parse the expression * feat: wire up through put workflow ver request * feat: query * fix: naming * fix: cleanup * fix: rebase * Update pkg/repository/v1/trigger.go Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * fix: skip workflow on cel eval failure * fix: zero value * fix: cel evaluator * fix: usage * fix: naming + type * fix: rm event filter from v0 defn * feat: tests + fix typing * fix: usage * fix: construct input * feat: always write events --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

fix: rm event filter from v0 defn

feat: wire up through put workflow ver request

feat: proto field for expression

2025-05-06

feat: wire up through put workflow ver request

feat: proto field for expression

2025-05-05

feat: proto field for expression

feat: wire up through put workflow ver request

feat: wire up through put workflow ver request

feat: proto field for expression

2025-04-23

feat: sync getter for run output

2025-04-17

Fe overhaul details (#1552) * simple trigger * populated * feat:trigger modal * clear * Update frontend/app/src/next/hooks/use-runs.tsx Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * wip activity log * merged logs * wip * wip * search box * fudge sort * wip improved worker sheet * wip * chore: improve error on dispatcher (#1538) * fix: empty billing context (#1553) * fix: empty * precommit * hotfix: priority nil pointer (#1555) * hotfix: priority on schedule workflow (#1556) * hotfix: priority on schedule workflow * fix: build * build * lint * build --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: abelanger5 <belanger@sas.upenn.edu>

The documentation is generated from this commit.

2025-04-15

hotfix: priority on schedule workflow (#1556) * hotfix: priority on schedule workflow * fix: build

The documentation is generated from this commit.

2025-04-14

feat: multiple workflow concurrency keys (#1511) * feat: multiple workflow concurrency keys * [Python]: Allow multiple workflow-level concurrency keys (#1512) * chore: generate * feat: multi concurrency * chore: version * feat: example + test * fix: expand tests * Feat ts multiple wf concurrency (#1522) * feat: multiple concurrency * release: 1.2.0 * fix: merge * fix: concurrency defn * fix: ts multiple concurrency backwards compat (#1531) * fix * gen * chore: lint --------- Co-authored-by: mrkaye97 <mrkaye97@gmail.com> --------- Co-authored-by: Gabe Ruttner <gabriel.ruttner@gmail.com> * chore: ver * chore: gen * chore: versions * fix: manually rename migration * fix: patch ver --------- Co-authored-by: mrkaye97 <mrkaye97@gmail.com> Co-authored-by: Gabe Ruttner <gabriel.ruttner@gmail.com>

Feat: Priority (#1513) * feat: initial work wiring up priorities * fix: add default to default prio in the db * feat: wire priority through api on wf creation * feat: extend python test * feat: priority for scheduled workflows * feat: wire priority through python api * feat: more wiring priority through the api * feat: I think it works? * feat: e2e test for priority * it works! * feat: expand tests for default priorities * feat: e2e scheduling test * fix: skip broken test for now * fix: lint * feat: add priority columns to cron and schedule ref tables * feat: update inserts to include prio * feat: wire up more apis * feat: more wiring * feat: wire up more rest api fields * chore: cruft * fix: more wiring * fix: lint * chore: gen + wire up priorities * fix: retries * fix: try changing fixture scope * chore: bump version again * feat: send priority with action payload * fix: generate script * Feat priority ts (#1518) * feat: initial work wiring up priorities * fix: add default to default prio in the db * feat: wire priority through api on wf creation * feat: extend python test * feat: priority for scheduled workflows * feat: wire priority through python api * feat: more wiring priority through the api * feat: I think it works? * feat: e2e test for priority * it works! * feat: expand tests for default priorities * feat: e2e scheduling test * chore: minor version for priority * fix: skip broken test for now * fix: lint * feat: add priority columns to cron and schedule ref tables * feat: update inserts to include prio * feat: wire up more apis * feat: more wiring * feat: wire up more rest api fields * chore: cruft * fix: more wiring * fix: lint * chore: gen + wire up priorities * fix: increase timeout * fix: retries * fix: try changing fixture scope * chore: generate * fix: set schedule priority * feat: priority * fix: move priority to wf * release: 1.2.0 * rm log * fix: import * fix: add priority to step --------- Co-authored-by: mrkaye97 <mrkaye97@gmail.com> * fix: add dummy runs to priority test to prevent race conditions * fix: non-breaking field * fix: gen * feat: initial pass at docs * feat: priority in go sdk * feat: initial work on go example * fix: doc examples * fix: proofread * chore: version * feat: go sdk * fix: lint * fix: declarations and add back RunAsChild * fix: child workflows * fix: namespace * fix: faster child workflows * fix: sticky * add back run as child --------- Co-authored-by: Gabe Ruttner <gabriel.ruttner@gmail.com> Co-authored-by: Alexander Belanger <alexander@hatchet.run>

2025-04-09

feat: multiple workflow concurrency keys

2025-04-01

Feat: Non-Retryable Exceptions (#1456) * feat: add boolean flag to proto * feat: initial wiring up priorities and non-retryables * fix: query * fix: cruft comment * fix: rm priority changes * feat: python side * feat: tests for non-retrying workflows * feat: expand tests * chore: generate ts * feat: add name prop to wf * feat(go-sdk): non retryable error * feat: start implementing ts * cleanup: simplify to raising a specific error * fix: simplify ts * feat: ts examples * feat: ver * feat: docs * fix: tests + linters --------- Co-authored-by: Alexander Belanger <alexander@hatchet.run>

2025-03-24

feat(v1): new gRPC API endpoints (#1367) * wip: api contracts * feat: implement put workflow version endpoint * add support for match existing data, get scaffolding in place for additional triggers * create additional matches * feat: durable sleep, user event matching * update protos * fix: working poc of user events, durable sleep * add migration * fix: migration column * feat: durable event listener * fix: skip overrides * fix: input -> output

2025-03-23

feat: durable event listener

2025-03-21

update protos

2025-03-19

feat: implement put workflow version endpoint

2025-03-18

wip: api contracts

2025-03-11

feat: v1 engine (#1318)

2025-03-04

feat: trigger handler on rest api

2025-03-03

feat: retries with exponential backoff

2025-02-27

feat: initial replay

2025-02-26

feat: cancellations

2025-02-20

fix: remove submodule

feat: add sdks

2025-01-29

feat: add retry count param (#1236)

2024-12-18

feat: `CANCEL_NEWEST` strategy and make cancel in progress more reliable (#1127)

2024-11-21

feat: exponential backoff (#1062) * initial migration * feat: exp backoff, fix linting * fix utc issue and cleanup

2024-11-01

Feat scheduled improvements (#992) * wip: stub schedule page * wip: stub list * fix: 2025 bug... * feat: wip cron list * feat: addl meta * feat: expose metadata column * feat: sort and created at * cron to recurring * scheduled: with statuses * fix: links * feat: expose schedule ids * feat: delete run * fix: remove search * feat: filterable scheduled * fix: remove broken features * chore: lint * rm metadata for now * chore: lint * chore: recurring to cron job * fix: review comments * fix: populator

2024-10-29

Merge branch 'main' into feat--scheduled-improvements

2024-10-28

Feat sdk runtime (#942) * feat: runtime signature * feat: add sdk runtime to worker model * feat: post runtime * feat: expose sdk version on worker * feat: go inf * chore: gen * chore: migrations and generation * fix: simpler runtime * feat: hatchet sdk ver * fix: rm debug line

2024-10-24

feat: expose schedule ids

feat: addl meta

2024-10-15

feat: improved sdk ack (#931) * feat: add step run event reasons * feat: ack * fix: remove rejected reason * fix: merge * fix: correct buffer * fix: consistent message * chore: rm todo

2024-10-14

Feat bulk workflows (#940) Adds support for inserting workflows in bulk via the API and an optional buffered insert on the engine.

2024-10-04

merge

2024-09-26

feat: dynamic rate limits (#904) * wip: step run expressions on rate limits * feat: dynamic rate limits * chore: v0.47.0 * chore: address changes from PR review * fix: improved error handling * address pr review * better error messages for step run cels, remove debug logs * fix: hash --------- Co-authored-by: gabriel ruttner <gabriel.ruttner@gmail.com>

2024-09-23

feat: bulk inserts of events (#887) * progress commit of bulk inserts * in_flight: Add changes to metering finish the bulk insert * remove an attempt to overide enforce limits * merge in PR fixes * update docs to add in an additional section in the User guide to describe pushing single events and pushing multiple events * run lint fix --------- Co-authored-by: Sean Reilly <sean@hatchet.run>

2024-09-19

feat: expression-based concurrency keys (#889) * feat: expression-based concurrency keys * fix: build * fix: typos * fix: gen * fix: migration * fix: remove print statements * fix: reassignment bugs, retries on closed transport, pr review

2024-08-26

feat: expose priority queue (#814) * feat: workflow default priority * feat: write priority on run * feat: propagate to queue * chore: squash migrations * chore: generate

2024-08-21

Fix webhook healthcheck race (#797) * fix: race * fix: partition no rows * chore: move to workers tab * feat: redirect empty worker path to all * chore: add worker type and webhook id * fix: upsert webhook worker * fix: update by webhookId * fix: only stub on create * feat: url on worker * chore: migration version * fix: move * fix: upsert * fix: upert * chore: fix migration * fix: migrations * chore: generate

2024-07-29

feat: stream by addl meta (#751) * feat: prop schedule and run * wip * fix: filter wfrid * feat: hangup * chore: rm debug log * chore: func name * fix: cancelled payload * fix: load * fix: cleanup the cahce * fix: single proto * fix: key -> val * chore: case * chore: rm dead code * chore: rm dead code * feat: go and docs * fix: docs

feat: add workflow kind to workflow versions (#750) * feat: support workflow kinds * chore: generate

2024-07-26

feat: expose additional fields on assigned action (#738)

2024-07-22

feat: sticky workers (#695) * wip * wip: functional query * feat: expose affinity config * feat: add weight to proto * feat: upsert affinity state on worker start * fix: linting * feat: add upsert proto * feat: upsert handler * feat: revise model * fix: labels * feat: functional desired worker * wip: ui * feat: add state to step run events * fix: filter empty keys * fix: labels as badges * feat: empty state and descriptive text * chore: add todo * chore: whitespace * chore: cleanup * chore: cleanup * chore: fix hash * chore: squash migrations * fix: fair worker assignment * fix: remaining slots on valid desired workers * wip: sticky * fix: count slots * chore: rm log line * feat: expose sticky config * wip: sticky dag * feat: expose desired worker id to trigger * feat: trigger on desired worker * feat: typescript docs * feat: sticky python * feat: py sticky children * wip: py affinity * serverless note * feat: complete python examples * linting * fix: doc link * chore: rm debug log * fix: simplify list labels * fix: typo

2024-06-07

feat: expose retry count (#524) * feat: expose retry count * feat: expose retry count go * docs: accessing retry count * fix: import * fix: tests * fix: docs formatting --------- Co-authored-by: Alexander Belanger <alexander@hatchet.run> Co-authored-by: abelanger5 <belanger@sas.upenn.edu>

2024-05-22

fix: optional

wip: retry delay

2024-05-16

Merge remote-tracking branch 'origin/main' into webhooks

feat: refresh timeout (#495) * feat: show timeout on step run * feat: refresh timeout * fix: increment timeout from last time * feat: add step run event for timeout refresh * chore: generate * feat: add refreshing timeouts docs section * chore: linting * feat: go client * chore: generate * chore: generate * fix: test context * chore: generate * fix: rm txn * fix: validator * chore: lint --------- Co-authored-by: Alexander Belanger <alexander@hatchet.run>

chore(pre-commit): lint whitespace (#494) Adds a whitespace linter to the pre-commit hook to ensure consistent formatting. It also enables linting of other SQL files such as for SQLc queries.

2024-05-15

feat: add retry count to assigned action

2024-05-14

Merge remote-tracking branch 'origin/main'

feat: client releasable slots (#476) * feat: add release slot proto * feat: add semaphore release state and methods * feat: go sdk and example * docs: manual slot release * chore: linting * fix: broken test * fix: unlink step run on manual release * feat: release slot event * fix: test * fix: revert e2e test changes * chore: remove debug line * fix: place step run query in same tx * fix: change migration release version --------- Co-authored-by: Alexander Belanger <belanger@sas.upenn.edu>

2024-05-10

Merge remote-tracking branch 'origin/main'

2024-05-08

Feat add rate limit durations (#466) * feat: add day, week, month, year durations * feat: add options to client

2024-05-06

Merge remote-tracking branch 'origin/main'

feat: event and workflow run metadata (#446) Adds additional user-defined metadata to events and workflow runs.

add jobs which always run on failure (#445) * (wip) prisma schema * feat: on-failure steps * chore: address changes from PR review * chore: bump migration number

2024-05-01

webhook workers

webhook init

2024-04-19

feat: multi-workflow runs listener on a single endpoint * new api-contract for workflow run events * feat: initial implementation for new subscribe listener * fix: sync issues and send workflow runs immediately * refactor: add context to all engine db queries, fix deadlocking query * fix: use new ctx for deleting dispatcher and ticker * add cancellation reasons * fix: docs linting --------- Co-authored-by: gabriel ruttner <gabriel.ruttner@gmail.com>

2024-04-10

fix(workflow): remove workflow timeout in favor of step timeout (#366)

2024-04-02

feat(py-sdk): add support for `put_workflow` extending from base workflow (#329) * feat(py-sdk): add put_workflow method and extend from base class * feat: add cron_input to create workflow API

feat: add cron_input to create workflow API

feat(engine): initial rate-limiting engine implementation (#324) * feat(engine): initial rate-limiting engine implementation * fixes and implement go sdk rate limiting

2024-04-01

feat: streaming events (#309) * feat: add stream event model * docs: how to work with db models * feat: put stream event * chore: rm comments * feat: add stream resource type * feat: enqueue stream event * fix: contracts * feat: protos * chore: set properties correctly for typing * fix: stream example * chore: rm old example * fix: async on * fix: bytea type * fix: worker * feat: put stream data * feat: stream type * fix: correct queue * feat: streaming payloads * fix: cleanup * fix: validation * feat: example file streaming * chore: rm unused query * fix: tenant check and read only consumer * fix: check tenant-steprun relation * Update prisma/schema.prisma Co-authored-by: abelanger5 <belanger@sas.upenn.edu> * chore: generate protos * chore: rename migration * release: 0.20.0 * feat(go-sdk): implement streaming in go --------- Co-authored-by: gabriel ruttner <gabe@hatchet.run> Co-authored-by: abelanger5 <belanger@sas.upenn.edu>

feat: new listen strategy with worker-side heartbeats (#308)

2024-03-29

feat: contracts for spawn/join feature (#290) * feat: contracts for spawn/join feature * add parent step run ids to model * add parent ids to schedule request

feat(engine/api): implementation of child/parent workflow runs (#292)

2024-03-21

refactor: separate api and engine repositories, change ticker logic (#281) * refactor: separate api and engine repositories, change ticker logic * fix: nil error blocks * fix: run migration on load test * fix: generate db package in load test * fix: test.yml * fix: add pnpm to load test * fix: don't lock CTEs with columns that don't get updated * fix: update heartbeat for worker every 4 seconds, not 5 * chore: remove dead code * chore: update python sdk * chore: add back telemetry attributes

2024-03-01

feat: logging from step run executions (#217) * fix: job cancellations with shared ctx * fix: found the bug * fix: all job runs were getting cancelled * feat: support logging from executions * fix: place logging in background * add back split screen

2024-02-29

feat: add array to type (#210) * feat: add array to type * feat: add rest of data to context * fix: tests * feat: workflowRunId in TS context --------- Co-authored-by: Alexander Belanger <belanger@sas.upenn.edu>

2024-02-28

feat: configurable scheduling timeouts (#204) * feat: configurable scheduling timeouts * fix: remove validator for now

2024-02-26

feat: support `maxRuns` parameter on workers (#195) * feat: round robin queueing * feat: configurable max runs per worker * fix: address PR review * docs for max runs and group round robin

feat: round robin queueing (#194)

2024-02-16

feat: add retries to the engine and SDKs (#171) This PR adds support for retrying failed step runs against the engine and SDKs. This was tested up to 30 retries per step run, with both failure and success at the 30th step run. Each SDK now has a `retries` configurable param for steps when declaring a workflow.

2024-02-14

feat: github app integration (#163) * feat: github app integration * chore: proto * fix: migrate instead of push * fix: db migrate -> migrate * fix: migrate again * remove skip-generate * add back generate * setup pnpm

2024-02-13

feat: dashboard playground ui (#162) * hotfix: add repository for npm publish * release(py-sdk): bump version * chore: ignore venv * feat(dashboard): collapsible sidebar * fix: hangup workflow listener when workflow run finishes (#161) * wip: class based listener pattern * fix: workflow run listener hangups * fix: hang up workflow listener on finished * fix: case for current workflow run * address review comments * bump version --------- Co-authored-by: g <gabriel.ruttner@gmail.com> * wip: focus state and flat playground * fix: focus state * feat: unify state * wip: playground state * cleanup: rm logging * fix: default output * cleanup: rm deadcode * feat: can replay individual steps * feat: icon tabs * feat: sticky output * cleanup: linting --------- Co-authored-by: abelanger5 <belanger@sas.upenn.edu>

2024-02-09

fix: hangup workflow listener when workflow run finishes (#161) * wip: class based listener pattern * fix: workflow run listener hangups * fix: hang up workflow listener on finished * fix: case for current workflow run * address review comments * bump version --------- Co-authored-by: g <gabriel.ruttner@gmail.com>

feat(wip): add overrides data and input schema to database

feat: add custom user data to each step (#156) * feat: (wip) bundle rest API in typescript client * chore: add generated files * chore: pnpm lock file * extract tenant id from token subject * feat: add custom user data to context * docs: generated with typedoc

2024-02-02

feat: manual triggers and give clients a hook into step run events (#141) * feat: pubsub for clients, more qol stuff * fix: generate sqlc files * chore: linting and comments

2024-01-30

feat: concurrency groups (#135) * first pass at moving controllers around * feat: concurrency limits for strategy CANCEL_IN_PROGRESS * fix: linting * chore: bump python sdk version

2024-01-29

feat: concurrency limits for strategy CANCEL_IN_PROGRESS

2024-01-26

feat(security): multiple encryption options, API tokens, easier setup (#125) * (wip) encryption * feat: api tokens * chore: add api token generation command * fix: e2e tests * chore: set timeout for e2e job * fix: e2e tests, remove client-side certs * chore: address PR review comments * fix: token tests * chore: address review comments and fix tests

2024-01-16

feat: dag-style execution (#108) * feat: dag-style execution * docs: update to reflect new context * ensure no cycles * remove example cycle * linting * lint and small fixes * update deferred rollback * last rollback handling * unset max issues * fix requeue edge case

2024-01-12

feat: support passing inputs to scheduled workflows (#104) * fix: usage of RegisterAction * make registered actions callable * chore: update yaml example * docs: register action documented * feat: support input to scheduled workflows * add worker * add client * docs: add input to schedule workflow * chore: generate with updated protoc * chore: sqlc generate