package node_service

Get desktop application:
View/edit binary Protocol Buffers messages

• rpc SendPrompt (PromptRequest, Tensor)

  node_service.proto:6

  message PromptRequest

  node_service.proto:22

  • optional Shard shard = 1

  • string prompt = 2

  • optional string request_id = 3

  • optional InferenceState inference_state = 4

• rpc SendTensor (TensorRequest, Tensor)

  node_service.proto:7

  message TensorRequest

  node_service.proto:29

  • optional Shard shard = 1

  • optional Tensor tensor = 2

  • optional string request_id = 3

  • optional InferenceState inference_state = 4

• rpc SendExample (ExampleRequest, Loss)

  node_service.proto:8

  message ExampleRequest

  node_service.proto:36

  • optional Shard shard = 1

  • optional Tensor example = 2

  • optional Tensor target = 3

  • optional Tensor length = 4

  • bool train = 5

  • optional string request_id = 6

  message Loss

  node_service.proto:45

  • float loss = 1

  • optional Tensor grads = 2

• rpc CollectTopology (CollectTopologyRequest, Topology)

  node_service.proto:9

  message CollectTopologyRequest

  node_service.proto:66

  • repeated string visited = 1

  • int32 max_depth = 2

  message Topology

  node_service.proto:71

  • map<string, DeviceCapabilities> nodes = 1

  • map<string, PeerConnections> peer_graph = 2

• rpc SendResult (SendResultRequest, Empty)

  node_service.proto:10

  message SendResultRequest

  node_service.proto:98

  • string request_id = 1

  • repeated int32 result = 2

  • optional Tensor tensor = 3

  • bool is_finished = 4

• rpc SendOpaqueStatus (SendOpaqueStatusRequest, Empty)

  node_service.proto:11

  message SendOpaqueStatusRequest

  node_service.proto:105

  • string request_id = 1

  • string status = 2

• rpc HealthCheck (HealthCheckRequest, HealthCheckResponse)

  node_service.proto:12

  message HealthCheckRequest

  node_service.proto:110

  (message has no fields)

  message HealthCheckResponse

  node_service.proto:112

  • bool is_healthy = 1

Used in: Topology

• string model = 1

• string chip = 2

• int32 memory = 3

• optional DeviceFlops flops = 4

Used in: DeviceCapabilities

• double fp32 = 1

• double fp16 = 2

• double int8 = 3

Used as response type in: NodeService.SendOpaqueStatus, NodeService.SendResult

(message has no fields)

Used in: PromptRequest, TensorRequest

• map<string, Tensor> tensor_data = 1

• map<string, TensorList> tensor_list_data = 2

• string other_data_json = 3

Used in: PeerConnections

• string to_id = 1

• optional string description = 2

Used in: Topology

• repeated PeerConnection connections = 1

Used in: ExampleRequest, PromptRequest, TensorRequest

• string model_id = 1

• int32 start_layer = 2

• int32 end_layer = 3

• int32 n_layers = 4

Used as response type in: NodeService.SendPrompt, NodeService.SendTensor

Used as field type in: ExampleRequest, InferenceState, Loss, SendResultRequest, TensorList, TensorRequest

• bytes tensor_data = 1

• repeated int32 shape = 2

• string dtype = 3

Used in: InferenceState

• repeated Tensor tensors = 1