package tensorflow.data.experimental

Get desktop application:
View/edit binary Protocol Buffers messages

Configuration for a tf.data service DispatchServer.

• int64 port = 1

  The port for the dispatcher to bind to. A value of 0 indicates that the dispatcher may bind to any available port.

• string protocol = 2

  The protocol for the dispatcher to use when connecting to workers.

• string work_dir = 3

  A work directory to use for storing dispatcher state, and for recovering during restarts. The empty string indicates not to use any work directory.

• bool fault_tolerant_mode = 4

  Whether to run in fault tolerant mode, where dispatcher state is saved across restarts. Requires that `work_dir` is nonempty.

• int64 job_gc_check_interval_ms = 5

  How often the dispatcher should scan through to delete old and unused jobs.

• int64 job_gc_timeout_ms = 6

  How long a job needs to be unused before it becomes a candidate for garbage collection.

This stores the metadata information present in each snapshot record.

• string graph_hash = 1

  Stores the fingerprint of the graph that describes the dataset that is snapshotted.

• string run_id = 2

  Run ID that this snapshot corresponds to.

• int64 creation_timestamp = 3

  Time when we started creating this snapshot.

• int64 version = 4

  Version of the snapshot data file format.

• repeated DataType dtype = 5

  A list of tensor dtype corresponding to each element of the snapshot.

• int64 num_elements = 6

  The number of elements in the snapshot.

• bool finalized = 1000

Each SnapshotRecord represents one batch of pre-processed input data. A batch consists of a list of tensors that we encode as TensorProtos. This message doesn't store the structure of the batch.

• repeated TensorProto tensor = 1

Metadata for all the tensors in a Snapshot Record.

• repeated TensorMetadata tensor_metadata = 1

Metadata for a single tensor in the Snapshot Record.

Used in: SnapshotTensorMetadata

• optional TensorShapeProto tensor_shape = 2

• int64 tensor_size_bytes = 3

  Number of uncompressed bytes used to store the tensor representation.

Configuration for a tf.data service WorkerServer.

• int64 port = 1

  The port for the worker to bind to. A value of 0 indicates that the worker may bind to any available port.

• string protocol = 2

  The protocol for the worker to use when connecting to the dispatcher.

• string dispatcher_address = 3

  The address of the dispatcher to register with.

• string worker_address = 4

  The address of the worker server. The substring "%port%", if specified, will be replaced with the worker's bound port. This is useful when the port is set to `0`.

• int64 heartbeat_interval_ms = 5

  How often the worker should heartbeat to the master.

• int64 dispatcher_timeout_ms = 6

  How long to retry requests to the dispatcher before giving up and reporting an error.