package tensorflow.contrib.mpi_collectives

Get desktop application:
View/edit binary Protocol Buffers messages

An MPIRequest is a message sent from a rank greater than zero to the coordinator (rank zero), informing the coordinator of an operation that the rank wants to do and the tensor that it wants to apply the operation to.

• int32 request_rank = 1

  The request rank is necessary to create a consistent ordering of results, for example in the allgather where the order of outputs should be sorted by rank.

• MPIRequest.RequestType request_type = 2

• DataType tensor_type = 3

• string tensor_name = 4

• optional TensorShapeProto tensor_shape = 5

Used in: MPIRequest

• ALLREDUCE = 0

• ALLGATHER = 1

An MPIResponse is a message sent from the coordinator (rank zero) to a rank greater than zero, informing the rank of an operation should be performed now. If the operation requested would result in an error (for example, due to a type or shape mismatch), then the MPIResponse can contain an error and an error message instead. Finally, an MPIResponse can be a DONE message (if there are no more tensors to reduce on this tick of the background loop) or SHUTDOWN if all MPI processes should shut down.

• MPIResponse.ResponseType response_type = 1

  Empty if the type is DONE or SHUTDOWN.

• string tensor_name = 2

• string error_message = 3

  Empty unless response_type is ERROR.

Used in: MPIResponse

• ALLREDUCE = 0

• ALLGATHER = 1

• ERROR = 2

• DONE = 3

• SHUTDOWN = 4