package llm_perf

Get desktop application:
View/edit binary Protocol Buffers messages

• rpc CompleteInference (InferenceRequest, InferenceResponse)

  server.proto:54

  1 request -> 1 response

• rpc StreamingInference (InferenceRequest, stream InferenceResponse)

  server.proto:56

  1 request -> m response

Used in: Value

• repeated bytes values = 1

Containers to hold repeated fundamental values.

Used in: Value

• repeated double values = 1

Used as request type in: Inference.CompleteInference, Inference.StreamingInference

• string req_id = 1

• map<string, Value> inputs = 2

Used as response type in: Inference.CompleteInference, Inference.StreamingInference

• string req_id = 1

• map<string, Value> outputs = 2

Used in: Value

• repeated int64 values = 1

Used in: Value

• repeated string values = 1

Used in: Value

• map<string, Value> fields = 1

  Unordered map of dynamically typed values.

Container for non-sequential data.

Used in: InferenceRequest, InferenceResponse, Struct

• oneof kind

  • FloatList float_list = 1

  • Int64List int64_list = 2

  • BytesList bytes_list = 3

  • float float_ = 4

  • int64 int64_ = 5

  • bytes bytes_ = 6

  • StringList string_list = 7

  • string string_ = 8

  • Struct struct_ = 9