package tensorflow.serving

Get desktop application:
View/edit binary Protocol Buffers messages

open source marker; do not remove PredictionService provides access to machine-learned models loaded by model_servers.

• rpc Classify (ClassificationRequest, ClassificationResponse)

  prediction_service.proto:16

  Classify.

  message ClassificationRequest

  classification.proto:34

  • optional ModelSpec model_spec = 1

    Model Specification.

  • optional Input input = 2

    Input data.

  message ClassificationResponse

  classification.proto:42

  • optional ClassificationResult result = 1

    Result of the classification.

• rpc GetModelMetadata (GetModelMetadataRequest, GetModelMetadataResponse)

  prediction_service.proto:25

  GetModelMetadata - provides access to metadata for loaded models.

  message GetModelMetadataRequest

  get_model_metadata.proto:15

  • optional ModelSpec model_spec = 1

    Model Specification indicating which model we are querying for metadata.

  • repeated string metadata_field = 2

    Metadata fields to get. Currently supported: "signature_def".

  message GetModelMetadataResponse

  get_model_metadata.proto:22

  • optional ModelSpec model_spec = 1

    Model Specification indicating which model this metadata belongs to.

  • map<string, google.protobuf.Any> metadata = 2

    Map of metadata field name to metadata field. The options for metadata field name are listed in GetModelMetadataRequest. Currently supported: "signature_def".

• rpc Predict (PredictRequest, PredictResponse)

  prediction_service.proto:22

  Predict -- provides access to loaded TensorFlow model.

  message PredictRequest

  predict.proto:12

  PredictRequest specifies which TensorFlow model to run, as well as how inputs are mapped to tensors and how outputs are filtered before returning to user.

  • optional ModelSpec model_spec = 1

    Model Specification.

  • map<string, TensorProto> inputs = 2

    Input tensors. Names of input tensor are alias names. The mapping from aliases to real input tensor names is expected to be stored as named generic signature under the key "inputs" in the model export. Each alias listed in a generic signature named "inputs" should be provided exactly once in order to run the prediction.

  • repeated string output_filter = 3

    Output filter. Names specified are alias names. The mapping from aliases to real output tensor names is expected to be stored as named generic signature under the key "outputs" in the model export. Only tensors specified here will be run/fetched and returned, with the exception that when none is specified, all tensors specified in the named signature will be run/fetched and returned.

  message PredictResponse

  predict.proto:35

  Response for PredictRequest on successful run.

  • map<string, TensorProto> outputs = 1

    Output tensors.

• rpc Regress (RegressionRequest, RegressionResponse)

  prediction_service.proto:19

  Regress.

  message RegressionRequest

  regression.proto:25

  • optional ModelSpec model_spec = 1

    Model Specification.

  • optional Input input = 2

    Input data.

  message RegressionResponse

  regression.proto:33

  • optional RegressionResult result = 1

A single class.

Used in: Classifications

• string label = 1

  Label or name of the class.

• float score = 2

  Score for this class (e.g., the probability the item belongs to this class).

For tensorflow.Example this will contain one result. For tensorflow.InferenceExample this will contain one result for each InferenceExample::features and in the same order as the features.

Used in: ClassificationResponse

• repeated Classifications classifications = 1

List of classes for a single item (tensorflow.Example or tensorflow.InferenceExample.features).

Used in: ClassificationResult

• repeated Class classes = 1

Specifies one or more fully independent input Examples. See examples at: https://github.com/tensorflow/tensorflow/blob/master/tensorflow/core/example/example.proto

Used in: Input

• repeated Example examples = 1

Specifies one or more independent input Examples, with a common context Example. The common use case for context is to cleanly and optimally specify some features that are common across multiple examples. See example below with a search query as the context and multiple restaurants to perform some inference on. context: { feature: { key : "query" value: { bytes_list: { value: [ "pizza" ] } } } } examples: { feature: { key : "cuisine" value: { bytes_list: { value: [ "Pizzeria" ] } } } } examples: { feature: { key : "cuisine" value: { bytes_list: { value: [ "Taqueria" ] } } } } Implementations of ExampleListWithContext merge the context Example into each of the Examples. Note that feature keys must not be duplicated between the Examples and context Example, or the behavior is undefined. See also: tensorflow/core/example/example.proto https://developers.google.com/protocol-buffers/docs/proto3#maps

Used in: Input

• repeated Example examples = 1

• optional Example context = 2

Used in: ClassificationRequest, RegressionRequest

• oneof kind

  • ExampleList example_list = 1

  • ExampleListWithContext example_list_with_context = 2

Metadata for an inference request such as the model name and version.

Used in: ClassificationRequest, GetModelMetadataRequest, GetModelMetadataResponse, PredictRequest, RegressionRequest

• string name = 1

  Required servable name.

• optional google.protobuf.Int64Value version = 2

  Optional version. If unspecified, will use the latest (numerical) version. Typically not needed unless coordinating across multiple models that were co-trained and/or have inter-dependencies on the versions used at inference time.

• string signature_name = 3

  A named signature to evaluate. If unspecified, the default signature will be used. Note that only MultiInference will initially support this.

Regression result for a single item (tensorflow.Example or tensorflow.InferenceExample.features).

Used in: RegressionResult

• float value = 1

For tensorflow.Example this will contain one result. For tensorflow.InferenceExample this will contain one result for each InferenceExample::features.

Used in: RegressionResponse

• repeated Regression regressions = 1

Message returned for "signature_def" field.

• map<string, SignatureDef> signature_def = 1