package openmldb.datasync

Get desktop application:
View/edit binary Protocol Buffers messages

• rpc AddSyncTask (AddSyncTaskRequest, GeneralResponse)

  data_sync.proto:111

  TODO(hw): GetTaskInfo in runtime

• rpc CreateSyncTask (CreateSyncTaskRequest, GeneralResponse)

  data_sync.proto:116

  message CreateSyncTaskRequest

  data_sync.proto:61

  • optional string db = 1

  • optional string name = 2

  • optional SyncMode mode = 3

    3 modes

  • optional uint64 start_ts = 4

    mode 1 INCREMENTAL_BY_TIMESTAMP start ts

  • optional string dest = 5

    offline path

• rpc DelelteSyncTask (DeleteSyncTaskRequest, GeneralResponse)

  data_sync.proto:117

  message DeleteSyncTaskRequest

  data_sync.proto:70

  only one sync task per table

  • optional string db = 1

  • optional string name = 2

• rpc TaskStatus (TaskStatusRequest, TaskStatusResponse)

  data_sync.proto:118

  message TaskStatusRequest

  data_sync.proto:75

  • optional bool clear_all = 1

  message TaskStatusResponse

  data_sync.proto:87

  • optional GeneralResponse response = 1

  • repeated Task task = 2

    all tid-pid tasks

  • repeated string readableInfo = 3

• rpc SendData (SendDataRequest, SendDataResponse)

  data_sync.proto:119

  message SendDataRequest

  data_sync.proto:94

  • optional uint32 tid = 1

  • optional uint32 pid = 2

  • optional SyncPoint start_point = 3

    The start point of this data

  • optional uint64 count = 4

    the row count in attachment

  • optional string token = 5

  • optional bool finished = 6

    if mode 0 and data collector meet the binlog end，tell SyncTool

  • optional SyncPoint next_point = 7

    The NEXT point of this partition, to let SyncTool know the next start point

  message SendDataResponse

  data_sync.proto:105

  • required GeneralResponse response = 1

  • optional bool delete_task = 2

    TODO(hw): delete task here. No extra delete task way.

Used as request type in: DataCollector.AddSyncTask

Used as field type in: Task

• optional uint32 tid = 1

• optional uint32 pid = 2

• optional SyncMode mode = 3

  3 modes

• optional uint64 start_ts = 4

  mode 1 INCREMENTAL_BY_TIMESTAMP start ts

• optional SyncPoint sync_point = 5

  DataCollector should read data from this point, include it

• optional string tablet_endpoint = 6

  the tablet server connect to

• optional string des_endpoint = 7

  SyncTool address(which SendData to), may be worker

• optional string token = 8

  token, DataCollector sends data with it, SyncTool will check it

• optional string dest = 9

  offline path for sync tool persistency, data collector won't use it

Used as response type in: DataCollector.AddSyncTask, SyncTool.CreateSyncTask, SyncTool.DelelteSyncTask

Used as field type in: SendDataResponse, TaskStatusResponse

• optional int32 code = 1

• optional string msg = 2

Used in: AddSyncTaskRequest, CreateSyncTaskRequest

• kFull = 0

• kIncrementalByTimestamp = 1

• kFullAndContinuous = 2

Used in: AddSyncTaskRequest, SendDataRequest

• required SyncType type = 1

• optional string pk = 2

• optional uint64 ts = 3

• optional uint64 offset = 4

Used in: SyncPoint

• kSNAPSHOT = 0

• kBINLOG = 1

used as backup data

Used in: TaskStatusResponse

• optional AddSyncTaskRequest progress = 1

• optional string data_collector = 2

• optional uint64 count = 3

• optional string status = 4