Proto commits in littlehorse-enterprises/littlehorse

These commits are when the Protocol Buffers files have changed: (only the last 100 relevant commits are shown)

2025-05-10

feat(proto): Make `InlineStructDef.fields` a Map to prevent duplicate field names

2025-05-09

feat(server): Add PutStructDef MetadataCommand and StructDef Getable to proto

2025-05-08

feat(proto): Add description to PutStructDefRequest and creation time to StructDef

feat(proto): Add `STRUCT_DEF` GetableClassEnum

feat(proto): Add StructDef protobuf messages

2025-05-07

feat(server): implements output topic metadata management (#1500) Allows PutTenantRequest to save the output topic configuration. TODO: - handle kafka topic creation if LHS_SHOULD_CREATE_TOPICS == true - Construct models for the output topic records - Intercept and send the records in the ProcessorExecutionContext

The documentation is generated from this commit.

2025-05-06

feat(server): adds output topic proto (#1495)

feat: enable strong typing on external events (#1412) Refactors our typing system, separating `VariableDef.type` and `VariableDef.masked_value` into a common `TypeDefinition` message that can represent any type on the server without being tied to a Variable. Adds strong return value typing to ExternalEvents using the new typing system. Also adds versioning behind the scenes to ExternalEventDefIds. Versioning on ExternalEventDefs is currently disabled; they default to 0 and are never incremented in the server. --------- Co-authored-by: Jacob Snarr <jacobsnarr@gmail.com>

2025-05-05

Merge branch 'master' into feat/ext-evt-typing

2025-05-02

merge master

2025-04-18

feat(server): Gracefully handle deserialization errors on ReportTaskRuns (#1286) This PR catches VariableValueModel deserialization errors on JSON_OBJ and JSON_ARR and sets the TaskAttempt status to `TASK_OUTPUT_SERDE_ERROR`. This solves the issue of tasks 'timing out' when a deserialization error occurs, which didn't provide users with a meaningful error message as to what went wrong.

2025-04-16

on second thought we tryna make this fully compatible. Co-authored-by: Jacob Snarr <jacobsnarr@gmail.com>

wip

2025-04-13

delay some renamings until after proto gets fixed later

2025-04-10

server code now compiles and validates external event types

finalizes protobuf structure: - Creates a ReturnType, which is a wrapper around TypeDefinition allowing for void-like returns. - Backs out of renaming VariableType as that should be done in a separate PR - Gets the SDK-java to compile properly

2025-04-07

Merge branch 'master' into metrics

2025-04-06

okay edu and jacob this is ready for review

2025-03-31

draft: refactor proto for external event typing

2025-03-30

temp: starts refactoring nodeoutput mutation to no longer do its thing

2025-03-27

Merge branch 'master' into fix/forward-task-run-report-on-serde-error

2025-03-19

fix(server): handles idempotency for external events (#1363)

wip [ci skip]

2025-03-10

wip [ci skip]

2025-02-26

Support multiple windows for a metric spec

2025-02-25

Merge branch 'master' into metrics

refactors

fix(canary): add grpc code status to canary metrics (#1324) Co-authored-by: Eduwer Camacaro <eduwer@littlehorse.io>

2025-02-20

wip [ci skip]

latency metric

2025-02-19

adds more update types to the output topic proto

2025-02-18

refactor

2025-02-17

list metric run

2025-02-14

repartition command: metrics

build repartition commands

2025-02-12

refactor(proto): Rename TaskStatus `TASK_OUTPUT_SERIALIZING_ERROR`

punctuator

2025-02-11

repartition command

2025-02-10

wip

2025-02-09

feat(server): introduces the output topic - Creates protos for WfRunEntity, TaskRunResult, and WorkflowEvent notifications - Creates proto for PutTenantRequest to configure whether Output Topic is enabled - Does not implement anything.

2025-02-06

refactor

2025-01-30

wip

2025-01-24

save metric config

2025-01-21

fix(standalone): update docker standalone image versions (#1261) Co-authored-by: Mijail Rondon <mijail@littlehorse.io>

perf(server): avoid rocksdb range scan on deletewfrun (#1259) - Intelligently remember which NodeRun's and TaskRun's and variables there were - No range scans over prefix - Journal externalEventId's since we can't guess them

2025-01-16

fix(canary): add new aggregator to ensure consistency (#1248)

2025-01-06

chore: move from littlehorse.dev to littlehorse.io/docs/server (#1224) - Remove the docs directory - Remove GH Action to publish documentation - Change all url references from .dev to .io/docs/server

2024-12-20

refactor(sdk-dotnet): change csharp proto namespace (#1218)

2024-12-17

fix: remove server id and data plane id from canary (#1209)

feat(canary): add mandatory config metronome.server.dataplane.id (#1205) Co-authored-by: Saul Piña <saul@littlehorse.io>

2024-12-16

fix: prometheus metrics exporter, add new mandatory field server.id to metronome (#1200) Co-authored-by: Mijail Rondon <mijail@littlehorse.io>

2024-12-14

feat: add extra tags to metronome beats (#1195) Co-authored-by: Mijail Rondon <mijail@littlehorse.io>

2024-12-10

feat(server): Add source NodeRunId field to WorkflowEvent object (#1175) Enables users to trace down the source NodeRun for any given WorkflowEvent by indexing the `node_run_id` field.

2024-12-05

fix(server): Pass UserTask UserId and UserGroup details to WorkerContext (#1178)

2024-12-02

feat(server): allow casting var assns

2024-11-26

refactor(server): standardize on variableassignment for mutations (#1164) - Deprecates the literal_value and node_output options of VariableMutation.rhs_value - Updates sdk-java to only use the VariableAssignment field - Renames VariableMutation.source_variable to VariableMutation.rhs_assignment Co-authored-by: Hazim Arafa <hazimoarafa@gmail.com>

2024-11-25

feat(server): allow in-line expression for complex variable assignments (#1076) - Adds the `Expression` option to `VariableAssignmentModel` - Adds more semantic "declareInt()" and "declareDouble()" etc methods to WorkflowThread in java - Adds LHExpression class which represents the `Expression` to the Java workflowThreadSDK - Fixes bugs with the VariableValueModel - Implements changes only in Java SDK, not yet in python or Go

feat(server): Add `RPC GetPrincipal` (#1157)

2024-11-13

feat(server,clients): allow users to pass nodeoutput into task (#1125) - Fixes #1119 - adds a NodeOutputReference option to the oneof in VariableAssignment - fetches old node outputs from the server side - allows passing `NodeOutput` into variable mutations and tasks --------- Co-authored-by: Eduwer Camacaro <eduwerc@gmail.com>

2024-11-01

feat(server): Initialize default Tenant and anonymous Principal at startup (#1073) Initializes the default Tenant and the anonymous Principal in the metadata store. Also adds an InitializationLog to the store, which carries important server state data from initialization time.

2024-10-18

fix: Fulfill missing `WorkflowEvent`s functionality (#1061) Adds missing documentation, dashboard support, lhctl commands, and metadata management services for the `WorkflowEvent`s and `WorkflowEventDef`s feature.

2024-10-04

feat(server): allow a threadrun to wait for condition (#1046) - Includes docs and e2e test - Missing python and Go SDK - Missing dashboard

feat(server): Add `RPC GetWorkflowEvent` (#1041)

2024-10-02

fix(server): Require global permissions for cluster scoped-resources (#1032) Restrict Principals with per-tenant ACLs from accessing cluster-scoped resources (tenants, principals) at both the service level (PutPrincipal) and the RequestAuthorizer level

2024-09-27

now it compiles

feat(server): schemas adr protobuf

2024-08-23

refactor(sdk-go): Independent Go Modules for lhctl and sdk-go (#957) Distribute lhctl and sdk-go across various Go modules, enabling clients to select the appropriate Go module for import.

2024-08-19

feat(server): automatically infer listener from request (#953) - Removes the LHW_SERVER_CONNECT listener configuration - Removes the listener_name field from the RegisterTaskWorkerRequest - Refactors KafkaStreamsServerImpl into LHServer and LHServerListener - Infers the listener that the client connected to automatically.

feat(server): Masked variable values Adds the ability to mask variable values to both workflow run variables and task node outputs

2024-08-16

chore(proto): renames ExternalEventRun to ExternalEventNodeRun (#951)

feat(server): adds rpc to save user task progress (#946) - Adds `rpc SaveUserTaskRunProgress` - Sets the `results` field of a `UserTaskRun` - Does NOT reset any timers for reassignment. - Adds a `UTESaved` event to the `events` field of the `UserTaskRun` Co-Authored-By: Jacob Snarr <jacobsnarr@gmail.com>

feat(server): Schedule WfRun executions This PR include new public rpcs and internal commands in order to support scheduling WfRun based in a cron expression. The date for the execution is calculated base on a command time because we want to support down time scenarios.

2024-08-05

doc: rewrite concepts section (#934) * Enforce that every page in the /docs/concepts/ on our site corresponds to a MetadataGetable or a GlobalGetable. * Makes it easier to find info about how to build workflows in the /docs/developer-guide/ rather than having to look both in developer guide and /docs/concepts * Makes pipeline fail if broken achor or markdown links are found * Removes LH for Kubernetes (Formerly LH Platform) docs as they are not for our open-source library. --------- Co-authored-by: Snarr <jacobsnarr@gmail.com>

2024-07-23

fix(server): Update `SearchExternalEvent` RPC schema to match other RPCs (#923) Updates `SearchExternalEvent` RPC schema to match pattern set with other Search RPCs, where you can optionally search with a `bookmark`, a `limit`, an `earliestStart` and `latestStart`. Includes required search field `ExternalEventDefId` which will search for ExternalEvents belonging to a specific ExternalEventDef by name. Throws gRPC INVALID_ARGUMENT error when required search field is not provided. Includes optional `IsClaimed` argument that narrows the search down to only ExternalEvents that have been claimed or not. Updates documentation and dashboard to match schema.

2024-07-13

fix(server): Delete TaskWorkerGroups after deleting TaskDef (#894)

2024-07-11

gets a start

start: TODO: amend this commit message

2024-06-18

chore(sdk-js): add global imports (#879) * chore(proto): use buf.build to generate sdk-js compiled proto * chore(dashboard): import protobuf types from package root * fix(compile-proto): update proto path * fix(sdk-js): export module proto * chore(proto): fix compile-proto

feat(server): rpc rescue threadRun (#883) Allows rescuing a failed ThreadRun.

2024-06-04

feat(server): Add `rpc SearchPrincipal` (#855) * Add rpc SearchPrincipal to service.proto * compile proto * Add SearchPrincipalRequest Model and Reply * Change created_at filter to be optional, outside principal criteria * compile proto * Refactor timestamp and tenantId filters * Add search [principal] command to CLI * Add search [principal] command to CLI * Spotless apply * Add long message and flag descriptions to CLI command * Update earliest start and latest start flags * Update "tenant" to "tenantId" for consistency * compile proto files * Fix isAdmin flag and add descriptive comments * Bump Cobra version, add comments, require flags on Search Principal * Remove redundant else * Throw LHSerdeError on invalid bookmark --------- Co-authored-by: Eduwer Camacaro <eduwerc@gmail.com>

2024-05-29

fix(server): AsyncWaiters sends a response back to the waiting internal server (#838)

2024-05-27

feat(server): allow principal deletion #818 (#832) - Adds 'rpc DeletePrincipal' - Fixes bug in the OAuthServerAuthorizer which incorrectly uses userName() on tokens from machine clients

2024-05-20

feat(server): Adds rpc GetTenant (#819)

2024-05-14

Feature/list task worker group (#800) This PR adds the ability to get a specific worker group. Also, it adds a new acl for the TaskWorkerGroup resource

Adds lots of wfspec proto docs (#799) * Documents wf_spec.proto and acls.proto

2024-05-13

Docs/protobuf docs on site (#795) - Adds `protoc-gen-doc` in the `compile-proto.sh` script - Adds the protobuf and grpc autogenerated documentation to our docs website - Upgrades Docusaurus to v3 for our docs website

2024-04-29

feat(nodeRun): paginate list nodeRun (#772) * feat(nodeRun): paginate list nodeRun * refactor(nodeRun): use thread-run-number flag

2024-04-18

Add persistence to the metronome (#758)

2024-04-12

599 throw exception on cancelled user task runs (#754) This PR adds the ability to both cancel a user task after a deadline on assignment or arrival and handle user task cancellation as a business exception. - Now, clients can define a workflow spec that catch a EXCEPTION when a user task run gets canceled via rpc or scheduled action. In case there is no exception name defined for the user task node, it will be treated as a technical ERROR, for the WfSpec needs to define an exception for the user task cancellation. - Current versions allows cancel a user task run via rpc, but some use cases require cancel an specific user task run after it was created or assigned - Now it is possible to cancel a user task via RPC with the following method:

2024-04-11

feat(canary): improve metrics (#757)

2024-04-10

692 search available tenants (#750) Search Available Tenants (#692) Adds Search Tenant gRPC endpoint. Enables gRPC endpoint in lhctl. Updates Proto schema with respective definitions used in new endpoint. Adds exception that gets thrown whenever a principal tries to assign tenant resources as perTenantACLs. Adds test methods that provide Tenant ACLs. Co-authored-by: Eduwer Camacaro <eduwerc@gmail.com>

2024-03-25

feat(python/retries): Add exponential retires (#737)

2024-03-22

731 dynamic taskdef execution (#733) - Adds protobuf for dynamic task execution and implements golang sdk - Adds to python SDK - Adds dynamic tasks to java sdk - Adds e2e for dynamic taskDef execution - Implements dynamic tasks on server

2024-03-16

700 add variable values to exceptions (#714) Implements #700. This commit enables users to send an `EXCEPTION` with `content` using the `LHTaskException`, and fixes a few bugs where we drop the content. It adds a test to ensure that you can use the content as the `INPUT` variable.

2024-03-11

Feat/606 retry backoff policy (#707) Allows specifying an exponential backoff policy for retries. Implements issue #606

fix: ExternalEventDef now uses ExternalEventDefId, not name (#710)

2024-03-06

Feature: Workflow Events (#696) Initial implementation of WorkflowEvent's as per #689 . Adds the following: * `WorkflowEventDef` and `WorkflowEvent` getable objects * a `THROW_EVENT` Sub-Node * the `rpc AwaitWorkflowEvent` which waits for a `WfRun` to throw a `WorkflowEvent` This allows for somewhat synchronous processing of a `WfRun`. --------- Co-authored-by: Eduwer Camacaro <eduwerc@gmail.com>

2024-02-27

Define canary topics name (#691)

2024-02-26

Fix NodeRun LifeCycle (#665) Resolves GitHub Issues #503 and #656. Much more detail on those tickets.

2024-02-20

Chores: minor changes (#672) * chore: minor refactors * feat: add executed time to canary proto * chore: scripts improvements