Default package

Get desktop application:
View/edit binary Protocol Buffers messages

A periodic reporting of the functions being executed by each executor, and how many resources each function is consuming.

• repeated ExecutorStatistics.FunctionStatistics functions = 1

  The list of functions on which statistics are being reported in this message.

• repeated ExecutorStatistics.DagStatistics dags = 2

  The list of DAGs on which statistics are being reported in this message.

Statistics regarding an entire DAG request, including call frequency, arrival rates, and end-to-end runtime.

Used in: ExecutorStatistics

• string name = 1

  The name of the DAG for which statistics are reported.

• repeated double runtimes = 2

  A list of how long each request to this DAG took to run (end-to-end, including the schedule).

• repeated double interarrival = 3

  A list of the interval between the arrival times of each sequential pair of request.

• uint32 call_count = 4

  The number of calls to this DAG received by a scheduler.

Statistics regarding an individual function -- specifically, call frequency and aggregated runtime.

Used in: ExecutorStatistics

• string name = 1

  The name of the function being tracked.

• uint32 call_count = 2

  The number of calls this function received.

• repeated double runtime = 3

  A list of how long each request to this function took to run.

An enum representing the types of resources this executor thread has access to. Currently, we only support CPUs and GPUs.

Used in: ThreadStatus

• CPU = 0

  The default ExecutorType for all threads, which says that this executor thread only has a CPU available.

• GPU = 1

  Indicates that this executor thread has access to a GPU.

A message sent by the scheduler to tell an executor thread to pin a function locally.

• string name = 1

  The name of the function to pin.

• string response_address = 2

  The address to which the executor should accept or reject the pin request.

• bool batching = 3

  Whethher or not this function supports batching.

An update shared between schedulers about what DAGs they are aware of and what functions are being run by what executors.

• repeated string dags = 1

  A list of the names of DAGs that have been registered with this scheduler.

• repeated SchedulerStatus.FunctionLocation function_locations = 2

  A list of function location information that this scheduler is aware of.

The location of an individual function, along with the IP address and thread ID it's running on.

Used in: SchedulerStatus

• string name = 1

  The name of the function.

• string ip = 2

  The IP address at which it is running.

• uint32 tid = 3

  The ID of the thread on which it is running.

A status update sent from executors to schedulers, giving the schedulers useful information about what resources are available in the system.

• string ip = 1

  The IP address of the executor sending the update.

• uint32 tid = 2

  The thread ID of the scheduler sending the update.

• repeated string functions = 3

  The list of function(s) that are pinned on this executor.

• double utilization = 4

  The average utilization of this executor over the last epoch -- this is used to avoid sending work to executors that are overloaded.

• bool running = 5

  The status of this executor -- if this is set to false, it means the executor is clearing its queues and leaving the system, and the schedulers should no longer send it any work.

• ExecutorType type = 6

  The type of resources this executor has access to (see ExecutorType definition for more details).