package stream

Get desktop application:
View/edit binary Protocol Buffers messages

• rpc previewRowsData (PreviewRowsDataCriteria, PreviewRowsDataResponse)

  preview-datax-records.proto:13

  同虚拟机下主进程查询执行进程执行结果通过此方法

  message PreviewRowsDataCriteria

  preview-datax-records.proto:18

  • string dataXName = 1

  • string tableName = 2

  • bool next = 3

  • repeated OffsetColValGrpc orderByCols = 4

    主键值，如果是首次查询，可以不设置该值

  • uint32 pageSize = 5

  message PreviewRowsDataResponse

  preview-datax-records.proto:29

  • map<string, HeaderColGrpc> columnHeader = 1

  • repeated Record records = 2

  • repeated OffsetColValGrpc headerCursor = 3

  • repeated OffsetColValGrpc tailerCursor = 4

• rpc Append (LoggingEvent, Empty)

  logger-appender.proto:14

  分布式环境下，写日志

  message LoggingEvent

  logger-appender.proto:19

  • map<string, string> headers = 1

  • string body = 2

  • LoggingEvent.Level level = 3

• rpc RegisterMonitorEvent (stream PMonotorTarget, stream PExecuteState)

  log-collector.proto:13

  订阅日志信息

  message PMonotorTarget

  log-collector.proto:58

  • string collection = 1

  • uint32 taskid = 2

  • PExecuteState.LogType logtype = 3

  message PExecuteState

  log-collector.proto:73

  • PExecuteState.InfoType infoType = 1

  • PExecuteState.LogType logType = 2

  • string msg = 3

  • string from = 4

  • uint64 jobId = 5

  • uint64 taskId = 6

  • string serviceName = 7

  • string execState = 8

  • uint64 time = 9

  • string component = 10

• rpc BuildPhraseStatus (PBuildPhaseStatusParam, stream PPhaseStatusCollection)

  log-collector.proto:16

  订阅全量/DataFlow构建过程中各阶段执行的状态信息

• rpc InitTask (PPhaseStatusCollection, Empty)

  log-collector.proto:19

  分布式环境下，启动一个同步任务先需要向assemble节点注册所有子任务

• rpc LoadPhaseStatus (PBuildPhaseStatusParam, PPhaseStatusCollection)

  log-collector.proto:24

  * 取得最近一次成功的同步任务状态

Used in: PreviewRowsDataResponse

• uint32 index = 1

• bool blob = 2

Used in: LoggingEvent

• INFO = 0

  说明是空对象

• WARNING = 1

• ERROR = 2

用于卡定DataX数据预览，翻页的偏移指针

Used in: PreviewRowsDataCriteria, PreviewRowsDataResponse

• string colKey = 1

• string val = 2

• bool numericJdbcType = 3

Used in: PPhaseStatusCollection

• map<string, BuildSharedPhaseStatus> nodeBuildStatus = 1

Used as request type in: LogCollector.BuildPhraseStatus, LogCollector.LoadPhaseStatus

• uint64 taskid = 1

Used in: PPhaseStatusCollection

• map<string, TableDumpStatus> tablesDump = 1

Used in: PExecuteState

• INFO = 0

• WARN = 1

• ERROR = 2

• FATAL = 3

Used in: PExecuteState, PMonotorTarget

• INCR_DEPLOY_STATUS_CHANGE = 0

  部署状态变化

• MQ_TAGS_STATUS = 1

  近一段时间内增量监听的topic下各个tag的多少值

• FULL = 2

  全量构建

• INCR = 3

  增量构建

• INCR_SEND = 4

  增量记录详细发送

Used in: PPhaseStatusCollection

• map<string, NodeBackflowStatus> nodesStatus = 1

Used in: PPhaseStatusCollection

• map<string, JoinTaskStatus> taskStatus = 1

Used as request type in: LogCollector.InitTask

Used as response type in: LogCollector.BuildPhraseStatus, LogCollector.LoadPhaseStatus

• optional PDumpPhaseStatus dumpPhase = 1

• optional PJoinPhaseStatus joinPhase = 2

• optional PBuildPhaseStatus buildPhase = 3

• optional PIndexBackFlowPhaseStatus indexBackFlowPhaseStatus = 4

• uint32 taskId = 5

由于record 中colVals中的元素可以为空，单grpc规定repeated传输的原属不能为空，所以需要一个StringValue对象来作占位用

repeated .google.protobuf.StringValue colVals = 1;

Used in: PreviewRowsDataResponse

• repeated StringValue colVals = 1

Used in: Record

• string val = 1

• bool nil = 2