package tensorflow.serving

Get desktop application:
View/edit binary Protocol Buffers messages

open source marker; do not remove PredictionService provides access to machine-learned models loaded by model_servers.

• rpc Predict (PredictRequest, PredictResponse)

  prediction_service.proto:14

  Predict -- provides access to loaded TensorFlow model.

  message PredictRequest

  predict.proto:13

  PredictRequest specifies which TensorFlow model to run, as well as how inputs are mapped to tensors and how outputs are filtered before returning to user.

  • optional ModelSpec model_spec = 1

    Model Specification. If version is not specified, will use the latest (numerical) version.

  • map<string, TensorProto> inputs = 2

    Input tensors. Names of input tensor are alias names. The mapping from aliases to real input tensor names is stored in the SavedModel export as a prediction SignatureDef under the 'inputs' field.

  • repeated string output_filter = 3

    Output filter. Names specified are alias names. The mapping from aliases to real output tensor names is stored in the SavedModel export as a prediction SignatureDef under the 'outputs' field. Only tensors specified here will be run/fetched and returned, with the exception that when none is specified, all tensors specified in the named signature will be run/fetched and returned.

  message PredictResponse

  predict.proto:38

  Response for PredictRequest on successful run.

  • optional ModelSpec model_spec = 2

    Effective Model Specification used to process PredictRequest.

  • map<string, TensorProto> outputs = 1

    Output tensors.

Metadata for an inference request such as the model name and version.

Used in: PredictRequest, PredictResponse

• string name = 1

  Required servable name.

• oneof version_choice

  Optional choice of which version of the model to use. Recommended to be left unset in the common case. Should be specified only when there is a strong version consistency requirement. When left unspecified, the system will serve the best available version. This is typically the latest version, though during version transitions, notably when serving on a fleet of instances, may be either the previous or new version.

  • google.protobuf.Int64Value version = 2

    Use this specific version number.

  • string version_label = 4

    Use the version associated with the given label.

• string signature_name = 3

  A named signature to evaluate. If unspecified, the default signature will be used.