package rss.common

Get desktop application:
View/edit binary Protocol Buffers messages

• rpc getShuffleServerList (google.protobuf.Empty, GetShuffleServerListResponse)

  Rss.proto:380

  Get Shuffle Server list

  message GetShuffleServerListResponse

  Rss.proto:436

  • repeated ShuffleServerId servers = 1

• rpc getShuffleServerNum (google.protobuf.Empty, GetShuffleServerNumResponse)

  Rss.proto:383

  Count Shuffle Server number

  message GetShuffleServerNumResponse

  Rss.proto:440

  • int32 num = 1

• rpc getShuffleAssignments (GetShuffleServerRequest, GetShuffleAssignmentsResponse)

  Rss.proto:386

  Ask for suitable Shuffle Servers with partitions

  message GetShuffleServerRequest

  Rss.proto:444

  • string clientHost = 1

  • string clientPort = 2

  • string clientProperty = 3

  • string applicationId = 4

  • int32 shuffleId = 5

  • int32 partitionNum = 6

  • int32 partitionNumPerRange = 7

  • int32 dataReplica = 8

  • repeated string requireTags = 9

  • int32 assignmentShuffleServerNumber = 10

  • int32 estimateTaskConcurrency = 11

  • repeated string faultyServerIds = 12

  message GetShuffleAssignmentsResponse

  Rss.proto:466

  • StatusCode status = 1

  • repeated PartitionRangeAssignment assignments = 2

  • string retMsg = 3

• rpc heartbeat (ShuffleServerHeartBeatRequest, ShuffleServerHeartBeatResponse)

  Rss.proto:389

  Heartbeat between Shuffle Server and Coordinator Server

  message ShuffleServerHeartBeatRequest

  Rss.proto:295

  • optional ShuffleServerId serverId = 1

  • int64 usedMemory = 2

  • int64 preAllocatedMemory = 3

  • int64 availableMemory = 4

  • int32 eventNumInFlush = 5

  • repeated string tags = 6

  • optional google.protobuf.BoolValue isHealthy = 7

  • optional ServerStatus status = 8

  • map<string, StorageInfo> storageInfo = 21

    mount point to storage info mapping.

  • optional string version = 22

  • optional string gitCommitId = 23

  • optional int64 startTimeMs = 24

  • repeated ApplicationInfo applicationInfo = 25

  • map<string, string> displayMetrics = 26

  message ShuffleServerHeartBeatResponse

  Rss.proto:312

  • StatusCode status = 1

  • string retMsg = 2

• rpc getShuffleDataStorageInfo (google.protobuf.Empty, GetShuffleDataStorageInfoResponse)

  Rss.proto:392

  Get the global configuration of this Rss-cluster, i.e., data storage info

  message GetShuffleDataStorageInfoResponse

  Rss.proto:484

  • string storage = 1

  • string storagePath = 2

  • string storagePattern = 3

• rpc checkServiceAvailable (google.protobuf.Empty, CheckServiceAvailableResponse)

  Rss.proto:393

  message CheckServiceAvailableResponse

  Rss.proto:490

  • StatusCode status = 1

  • bool available = 2

• rpc appHeartbeat (AppHeartBeatRequest, AppHeartBeatResponse)

  Rss.proto:396

  Heartbeat between Shuffle Application and Coordinator Server

• rpc reportClientOperation (ReportShuffleClientOpRequest, ReportShuffleClientOpResponse)

  Rss.proto:399

  Report a client operation's result to coordinator server

  message ReportShuffleClientOpRequest

  Rss.proto:472

  • string clientHost = 1

  • int32 clientPort = 2

  • optional ShuffleServerId server = 3

  • string operation = 4

  message ReportShuffleClientOpResponse

  Rss.proto:479

  • StatusCode status = 1

  • string retMsg = 2

• rpc registerApplicationInfo (ApplicationInfoRequest, ApplicationInfoResponse)

  Rss.proto:402

  Report a application info to Coordinator Server

  message ApplicationInfoRequest

  Rss.proto:424

  • string appId = 1

  • string user = 2

  • optional string version = 3

  • optional string gitCommitId = 4

  message ApplicationInfoResponse

  Rss.proto:431

  • StatusCode status = 1

  • string retMsg = 2

• rpc accessCluster (AccessClusterRequest, AccessClusterResponse)

  Rss.proto:405

  Access to the remote shuffle service cluster

  message AccessClusterRequest

  Rss.proto:495

  • string accessId = 1

  • repeated string tags = 2

  • map<string, string> extraProperties = 3

  • string user = 4

  message AccessClusterResponse

  Rss.proto:502

  • StatusCode status = 1

  • string retMsg = 2

  • string uuid = 3

• rpc fetchClientConf (google.protobuf.Empty, FetchClientConfResponse)

  Rss.proto:408

  Get basic client conf from coordinator

• rpc fetchClientConfV2 (FetchClientConfRequest, FetchClientConfResponse)

  Rss.proto:409

  message FetchClientConfRequest

  Rss.proto:508

  • string user = 1

  • map<string, string> properties = 2

    * For the potential extension for customize delegation shuffle manager. You could put more internal properties in customize delegation shuffle manager, and then it could be as metadata in your own customize ClientConfApplyStrategy.

• rpc fetchRemoteStorage (FetchRemoteStorageRequest, FetchRemoteStorageResponse)

  Rss.proto:412

  Get remote storage from coordinator

  message FetchRemoteStorageRequest

  Rss.proto:529

  • string appId = 1

  message FetchRemoteStorageResponse

  Rss.proto:543

  • StatusCode status = 1

  • optional RemoteStorage remoteStorage = 2

ShuffleManager service lives inside of compute-engine's application master, which handles rss shuffle specific logic per application.

• rpc reportShuffleFetchFailure (ReportShuffleFetchFailureRequest, ReportShuffleFetchFailureResponse)

  Rss.proto:571

  message ReportShuffleFetchFailureRequest

  Rss.proto:629

  • string appId = 1

    appId normally should be omitted, it's used to avoid wrongly request issued from remaining executors of another app which accidentally has the same shuffle manager port with this app.

  • int32 shuffleId = 2

  • int32 stageAttemptId = 3

  • int32 partitionId = 4

  • string exception = 5

    todo: report ShuffleServerId if needed ShuffleServerId serverId = 6;

  message ReportShuffleFetchFailureResponse

  Rss.proto:641

  • StatusCode status = 1

  • bool reSubmitWholeStage = 2

  • string msg = 3

• rpc getPartitionToShufflerServerWithStageRetry (PartitionToShuffleServerRequest, ReassignOnStageRetryResponse)

  Rss.proto:573

  Gets the mapping between partitions and ShuffleServer from the ShuffleManager server on Stage Retry.

  message ReassignOnStageRetryResponse

  Rss.proto:654

  • StatusCode status = 1

  • string msg = 2

  • optional StageAttemptShuffleHandleInfo shuffleHandleInfo = 3

• rpc getPartitionToShufflerServerWithBlockRetry (PartitionToShuffleServerRequest, ReassignOnBlockSendFailureResponse)

  Rss.proto:575

  Gets the mapping between partitions and ShuffleServer from the ShuffleManager server on Block Retry.

• rpc reportShuffleWriteFailure (ReportShuffleWriteFailureRequest, ReportShuffleWriteFailureResponse)

  Rss.proto:577

  Report write failures to ShuffleManager

  message ReportShuffleWriteFailureRequest

  Rss.proto:697

  • string appId = 1

  • int32 shuffleId = 2

  • int32 stageAttemptId = 3

  • int32 stageAttemptNumber = 4

  • repeated ShuffleServerId shuffleServerIds = 5

  • string exception = 6

  message ReportShuffleWriteFailureResponse

  Rss.proto:706

  • StatusCode status = 1

  • bool reSubmitWholeStage = 2

  • string msg = 3

• rpc reassignOnBlockSendFailure (RssReassignOnBlockSendFailureRequest, ReassignOnBlockSendFailureResponse)

  Rss.proto:579

  Reassign on block send failure that occurs in writer

  message RssReassignOnBlockSendFailureRequest

  Rss.proto:712

  • int32 shuffleId = 1

  • map<int32, ReceivingFailureServers> failurePartitionToServerIds = 2

  • int64 taskAttemptId = 3

  • int32 stageId = 4

  • int32 stageAttemptNumber = 5

  • string executorId = 6

  • optional bool partitionSplit = 7

• rpc reportShuffleResult (ReportShuffleResultRequest, ReportShuffleResultResponse)

  Rss.proto:580

• rpc getShuffleResult (GetShuffleResultRequest, GetShuffleResultResponse)

  Rss.proto:581

• rpc getShuffleResultForMultiPart (GetShuffleResultForMultiPartRequest, GetShuffleResultForMultiPartResponse)

  Rss.proto:582

• rpc reportShuffleWriteMetric (ReportShuffleWriteMetricRequest, ReportShuffleWriteMetricResponse)

  Rss.proto:584

  report task shuffle metrics

  message ReportShuffleWriteMetricRequest

  Rss.proto:588

  • int32 shuffleId = 1

  • int32 stageId = 2

  • int64 taskId = 3

  • map<string, ShuffleWriteMetric> metrics = 4

  message ReportShuffleWriteMetricResponse

  Rss.proto:614

  • StatusCode status = 1

• rpc reportShuffleReadMetric (ReportShuffleReadMetricRequest, ReportShuffleReadMetricResponse)

  Rss.proto:585

  message ReportShuffleReadMetricRequest

  Rss.proto:618

  • int32 shuffleId = 1

  • int32 stageId = 2

  • int64 taskId = 3

  • map<string, ShuffleReadMetric> metrics = 4

  message ReportShuffleReadMetricResponse

  Rss.proto:625

  • StatusCode status = 1

• rpc registerShuffle (ShuffleRegisterRequest, ShuffleRegisterResponse)

  Rss.proto:27

  message ShuffleRegisterRequest

  Rss.proto:194

  • string appId = 1

  • int32 shuffleId = 2

  • repeated ShufflePartitionRange partitionRanges = 3

  • optional RemoteStorage remoteStorage = 4

  • string user = 5

  • DataDistribution shuffleDataDistribution = 6

  • int32 maxConcurrencyPerPartitionToWrite = 7

  • optional MergeContext mergeContext = 8

  • map<string, string> properties = 9

  message ShuffleRegisterResponse

  Rss.proto:221

  • StatusCode status = 1

  • string retMsg = 2

• rpc unregisterShuffle (ShuffleUnregisterRequest, ShuffleUnregisterResponse)

  Rss.proto:28

  message ShuffleUnregisterRequest

  Rss.proto:211

  • string appId = 1

  • int32 shuffleId = 2

  message ShuffleUnregisterResponse

  Rss.proto:216

  • StatusCode status = 1

  • string retMsg = 2

• rpc unregisterShuffleByAppId (ShuffleUnregisterByAppIdRequest, ShuffleUnregisterByAppIdResponse)

  Rss.proto:29

  message ShuffleUnregisterByAppIdRequest

  Rss.proto:226

  • string appId = 1

  message ShuffleUnregisterByAppIdResponse

  Rss.proto:230

  • StatusCode status = 1

  • string retMsg = 2

• rpc sendShuffleData (SendShuffleDataRequest, SendShuffleDataResponse)

  Rss.proto:30

  message SendShuffleDataRequest

  Rss.proto:235

  • string appId = 1

  • int32 shuffleId = 2

  • int64 requireBufferId = 3

  • repeated ShuffleData shuffleData = 4

  • int64 timestamp = 5

  • int32 stageAttemptNumber = 6

  message SendShuffleDataResponse

  Rss.proto:244

  • StatusCode status = 1

  • string retMsg = 2

• rpc getLocalShuffleIndex (GetLocalShuffleIndexRequest, GetLocalShuffleIndexResponse)

  Rss.proto:31

  message GetLocalShuffleIndexRequest

  Rss.proto:115

  • string appId = 1

  • int32 shuffleId = 2

  • int32 partitionId = 3

  • int32 partitionNumPerRange = 4

  • int32 partitionNum = 5

  message GetLocalShuffleIndexResponse

  Rss.proto:123

  • bytes indexData = 1

  • StatusCode status = 2

  • string retMsg = 3

  • int64 dataFileLen = 4

  • repeated int32 storageIds = 5

• rpc getLocalShuffleData (GetLocalShuffleDataRequest, GetLocalShuffleDataResponse)

  Rss.proto:32

  message GetLocalShuffleDataRequest

  Rss.proto:80

  • string appId = 1

  • int32 shuffleId = 2

  • int32 partitionId = 3

  • int32 partitionNumPerRange = 4

  • int32 partitionNum = 5

  • int64 offset = 6

  • int32 length = 7

  • int64 timestamp = 8

  • int32 storageId = 9

  message GetLocalShuffleDataResponse

  Rss.proto:92

  • bytes data = 1

  • StatusCode status = 2

  • string retMsg = 3

• rpc getMemoryShuffleData (GetMemoryShuffleDataRequest, GetMemoryShuffleDataResponse)

  Rss.proto:33

  message GetMemoryShuffleDataRequest

  Rss.proto:98

  • string appId = 1

  • int32 shuffleId = 2

  • int32 partitionId = 3

  • int64 lastBlockId = 4

  • int32 readBufferSize = 5

  • int64 timestamp = 6

  • optional bytes serializedExpectedTaskIdsBitmap = 7

  message GetMemoryShuffleDataResponse

  Rss.proto:108

  • repeated ShuffleDataBlockSegment shuffleDataBlockSegments = 1

  • bytes data = 2

  • StatusCode status = 3

  • string retMsg = 4

• rpc commitShuffleTask (ShuffleCommitRequest, ShuffleCommitResponse)

  Rss.proto:34

  message ShuffleCommitRequest

  Rss.proto:263

  • string appId = 1

  • int32 shuffleId = 2

  message ShuffleCommitResponse

  Rss.proto:268

  • int32 commitCount = 1

  • StatusCode status = 2

  • string retMsg = 3

• rpc reportShuffleResult (ReportShuffleResultRequest, ReportShuffleResultResponse)

  Rss.proto:35

• rpc getShuffleResult (GetShuffleResultRequest, GetShuffleResultResponse)

  Rss.proto:36

• rpc getShuffleResultForMultiPart (GetShuffleResultForMultiPartRequest, GetShuffleResultForMultiPartResponse)

  Rss.proto:37

• rpc finishShuffle (FinishShuffleRequest, FinishShuffleResponse)

  Rss.proto:38

  message FinishShuffleRequest

  Rss.proto:45

  • string appId = 1

  • int32 shuffleId = 2

  message FinishShuffleResponse

  Rss.proto:50

  • StatusCode status = 1

  • string retMsg = 2

• rpc requireBuffer (RequireBufferRequest, RequireBufferResponse)

  Rss.proto:39

  message RequireBufferRequest

  Rss.proto:55

  • int32 requireSize = 1

  • string appId = 2

  • int32 shuffleId = 3

  • repeated int32 partitionIds = 4

  • repeated int32 partitionRequireSizes = 5

  message RequireBufferResponse

  Rss.proto:63

  • int64 requireBufferId = 1

  • StatusCode status = 2

  • string retMsg = 3

  • repeated int32 needSplitPartitionIds = 4

    need split partitions

• rpc appHeartbeat (AppHeartBeatRequest, AppHeartBeatResponse)

  Rss.proto:40

• rpc startSortMerge (StartSortMergeRequest, StartSortMergeResponse)

  Rss.proto:41

  message StartSortMergeRequest

  Rss.proto:737

  • string appId = 1

  • int32 shuffleId = 2

  • int32 partitionId = 3

  • bytes uniqueBlocksBitmap = 4

  message StartSortMergeResponse

  Rss.proto:744

  • StatusCode status = 1

  • string retMsg = 2

• rpc getSortedShuffleData (GetSortedShuffleDataRequest, GetSortedShuffleDataResponse)

  Rss.proto:42

  message GetSortedShuffleDataRequest

  Rss.proto:749

  • string appId = 1

  • int32 shuffleId = 2

  • int32 partitionId = 3

  • int64 mergedBlockId = 4

  • int64 timestamp = 5

  message GetSortedShuffleDataResponse

  Rss.proto:757

  • bytes data = 1

  • StatusCode status = 2

  • string retMsg = 3

  • int64 nextBlockId = 4

  • int32 mState = 5

• rpc decommission (DecommissionRequest, DecommissionResponse)

  Rss.proto:549

  message DecommissionRequest

  Rss.proto:553

  (message has no fields)

  message DecommissionResponse

  Rss.proto:556

  • StatusCode status = 1

  • string retMsg = 2

• rpc cancelDecommission (CancelDecommissionRequest, CancelDecommissionResponse)

  Rss.proto:550

  message CancelDecommissionRequest

  Rss.proto:561

  (message has no fields)

  message CancelDecommissionResponse

  Rss.proto:564

  • StatusCode status = 1

  • string retMsg = 2

Used as request type in: CoordinatorServer.appHeartbeat, ShuffleServer.appHeartbeat

• string appId = 1

Used as response type in: CoordinatorServer.appHeartbeat, ShuffleServer.appHeartbeat

• StatusCode status = 1

• string retMsg = 2

Used in: ShuffleServerHeartBeatRequest

• string appId = 1

• int64 partitionNum = 2

• int64 memorySize = 3

• int64 localFileNum = 4

• int64 localTotalSize = 5

• int64 hadoopFileNum = 6

• int64 hadoopTotalSize = 7

• int64 totalSize = 8

Used in: GetShuffleResultForMultiPartRequest, GetShuffleResultRequest

• int32 sequenceNoBits = 1

• int32 partitionIdBits = 2

• int32 taskAttemptIdBits = 3

Used in: FetchClientConfResponse

• string key = 1

• string value = 2

Used in: ShuffleRegisterRequest

• NORMAL = 0

• LOCAL_ORDER = 1

Used as response type in: CoordinatorServer.fetchClientConf, CoordinatorServer.fetchClientConfV2

• StatusCode status = 1

• string retMsg = 2

• repeated ClientConfItem clientConf = 3

Used as request type in: ShuffleManager.getShuffleResultForMultiPart, ShuffleServer.getShuffleResultForMultiPart

• string appId = 1

• int32 shuffleId = 2

• repeated int32 partitions = 3

• optional BlockIdLayout blockIdLayout = 4

Used as response type in: ShuffleManager.getShuffleResultForMultiPart, ShuffleServer.getShuffleResultForMultiPart

• StatusCode status = 1

• string retMsg = 2

• bytes serializedBitmap = 3

Used as request type in: ShuffleManager.getShuffleResult, ShuffleServer.getShuffleResult

• string appId = 1

• int32 shuffleId = 2

• int32 partitionId = 3

• optional BlockIdLayout blockIdLayout = 4

Used as response type in: ShuffleManager.getShuffleResult, ShuffleServer.getShuffleResult

• StatusCode status = 1

• string retMsg = 2

• bytes serializedBitmap = 3

Used in: ShuffleRegisterRequest

• string keyClass = 1

• string valueClass = 2

• string comparatorClass = 3

• int32 mergedBlockSize = 4

• string mergeClassLoader = 5

Used in: ReassignOnBlockSendFailureResponse, StageAttemptShuffleHandleInfo

• int32 shuffleId = 1

• map<int32, PartitionReplicaServers> partitionToServers = 2

• optional RemoteStorageInfo remoteStorageInfo = 3

• map<string, ReplacementServers> excludedServerToReplacements = 4

• repeated int32 splitPartitionId = 5

• PartitionSplitMode partitionSplitMode = 6

Used in: GetShuffleAssignmentsResponse

• int32 startPartition = 1

• int32 endPartition = 2

• repeated ShuffleServerId server = 3

  replica

Used in: MutableShuffleHandleInfo

• map<int32, ReplicaServersItem> replicaServers = 1

Used in: MutableShuffleHandleInfo

• PIPELINE = 0

• LOAD_BALANCE = 1

Used in: ReportShuffleResultRequest

• int32 partitionId = 1

• repeated int64 blockIds = 2

Used as request type in: ShuffleManager.getPartitionToShufflerServerWithBlockRetry, ShuffleManager.getPartitionToShufflerServerWithStageRetry

• int32 stageAttemptId = 1

• int32 stageAttemptNumber = 2

• int32 shuffleId = 3

• bool isWritePhase = 4

Used as response type in: ShuffleManager.getPartitionToShufflerServerWithBlockRetry, ShuffleManager.reassignOnBlockSendFailure

• StatusCode status = 1

• string msg = 2

• optional MutableShuffleHandleInfo handle = 3

Used in: ReceivingFailureServers

• string serverId = 1

• StatusCode statusCode = 2

Used in: RssReassignOnBlockSendFailureRequest

• repeated ReceivingFailureServer server = 1

Used in: FetchRemoteStorageResponse, ShuffleRegisterRequest

• string path = 1

• repeated RemoteStorageConfItem remoteStorageConf = 2

Used in: RemoteStorage

• string key = 1

• string value = 2

Used in: MutableShuffleHandleInfo

• string path = 1

• map<string, string> confItems = 2

Used in: MutableShuffleHandleInfo

• repeated ShuffleServerId serverId = 1

Used in: PartitionReplicaServers

• repeated ShuffleServerId serverId = 1

Used as request type in: ShuffleManager.reportShuffleResult, ShuffleServer.reportShuffleResult

• string appId = 1

• int32 shuffleId = 2

• int64 taskAttemptId = 3

• int32 bitmapNum = 4

• repeated PartitionToBlockIds partitionToBlockIds = 5

Used as response type in: ShuffleManager.reportShuffleResult, ShuffleServer.reportShuffleResult

• StatusCode status = 1

• string retMsg = 2

Used in: ShuffleServerHeartBeatRequest

• ACTIVE = 0

• DECOMMISSIONING = 1

• DECOMMISSIONED = 2

• LOST = 3

• UNHEALTHY = 4

• EXCLUDED = 5

  todo: more status, such as UPGRADING

Used in: ShuffleData

• int64 blockId = 1

• int32 length = 2

• int32 uncompressLength = 3

• int64 crc = 4

• bytes data = 5

• int64 taskAttemptId = 6

Used in: SendShuffleDataRequest

• int32 partitionId = 1

• repeated ShuffleBlock block = 2

Used in: GetMemoryShuffleDataResponse

• int64 blockId = 1

• int64 offset = 2

• int32 length = 3

• int32 uncompressLength = 4

• int64 crc = 5

• int64 taskAttemptId = 6

Used in: ShuffleRegisterRequest

• int32 start = 1

• int32 end = 2

Used in: ReportShuffleReadMetricRequest

• int64 durationMillis = 1

• int64 byteSize = 2

• int64 memoryDurationMillis = 3

• int64 memoryByteSize = 4

• int64 localfileDurationMillis = 5

• int64 localfileByteSize = 6

• int64 hadoopDurationMillis = 7

• int64 hadoopByteSize = 8

Used in: GetShuffleServerListResponse, PartitionRangeAssignment, ReplacementServers, ReplicaServersItem, ReportShuffleClientOpRequest, ReportShuffleWriteFailureRequest, ShuffleServerHeartBeatRequest

• string id = 1

• string ip = 2

• int32 port = 3

• int32 netty_port = 4

• int32 jetty_port = 5

• StatusCode status = 1

• string retMsg = 2

Used in: ReportShuffleWriteMetricRequest

• int64 durationMillis = 1

• int64 byteSize = 2

Used in: ReassignOnStageRetryResponse

• repeated MutableShuffleHandleInfo historyMutableShuffleHandleInfo = 1

• optional MutableShuffleHandleInfo currentMutableShuffleHandleInfo = 2

* Status code to identify the status of response

Used in: AccessClusterResponse, AppHeartBeatResponse, ApplicationInfoResponse, CancelDecommissionResponse, CheckServiceAvailableResponse, DecommissionResponse, FetchClientConfResponse, FetchRemoteStorageResponse, FinishShuffleResponse, GetLocalShuffleDataResponse, GetLocalShuffleIndexResponse, GetMemoryShuffleDataResponse, GetShuffleAssignmentsResponse, GetShuffleResultForMultiPartResponse, GetShuffleResultResponse, GetSortedShuffleDataResponse, ReassignOnBlockSendFailureResponse, ReassignOnStageRetryResponse, ReceivingFailureServer, ReportShuffleClientOpResponse, ReportShuffleFetchFailureResponse, ReportShuffleReadMetricResponse, ReportShuffleResultResponse, ReportShuffleWriteFailureResponse, ReportShuffleWriteMetricResponse, RequireBufferResponse, SendShuffleDataResponse, ShuffleCommitResponse, ShuffleRegisterResponse, ShuffleServerHeartBeatResponse, ShuffleServerResult, ShuffleUnregisterByAppIdResponse, ShuffleUnregisterResponse, StartSortMergeResponse

• SUCCESS = 0

• DOUBLE_REGISTER = 1

• NO_BUFFER = 2

• INVALID_STORAGE = 3

• NO_REGISTER = 4

• NO_PARTITION = 5

• INTERNAL_ERROR = 6

• TIMEOUT = 7

• ACCESS_DENIED = 8

• INVALID_REQUEST = 9

• NO_BUFFER_FOR_HUGE_PARTITION = 10

• STAGE_RETRY_IGNORE = 11

• EXCEED_HUGE_PARTITION_HARD_LIMIT = 12

• APP_NOT_FOUND = 13

• INTERNAL_NOT_RETRY_ERROR = 14

  add more status

Used in: ShuffleServerHeartBeatRequest

• string mountPoint = 1

• StorageInfo.StorageMedia storageMedia = 2

• int64 capacity = 3

• int64 usedBytes = 4

• int64 writingSpeed1M = 5

  writing speed of last minute

• int64 writingSpeed5M = 6

  writing speed of last 5 minutes

• int64 writingSpeed1H = 7

  writing speed of last hour

• int64 numOfWritingFailures = 8

  number of writing failures since start up.

• StorageInfo.StorageStatus status = 9

Used in: StorageInfo

• STORAGE_TYPE_UNKNOWN = 0

• HDD = 1

• SSD = 2

• HDFS = 3

• OBJECT_STORE = 4

  possible other types, such as cloud-ssd.

Used in: StorageInfo

• STORAGE_STATUS_UNKNOWN = 0

• NORMAL = 1

• UNHEALTHY = 2

• OVERUSED = 3

  indicate current disk/storage is overused.