package com.github.tjake.jlama.net

Get desktop application:
View/edit binary Protocol Buffers messages

This is the main service, which is used to generate tokens via a coorindator

• rpc register (RegisterRequest, RegisterResponse)

  JlamaService.proto:60

  message RegisterResponse

  JlamaService.proto:41

  • string hostname = 1

  • int32 peerPort = 2

  • int32 modelShard = 3

  • int32 numModelShards = 4

  • int32 layerShard = 5

  • int32 numLayerShards = 6

  • int32 workerOrd = 7

• rpc discover (RegisterRequest, PeerInfo)

  JlamaService.proto:61

  message PeerInfo

  JlamaService.proto:51

  • bytes workerid = 1

  • string hostname = 2

  • int32 peerPort = 3

  • bool isCoordinator = 4

    Means worker terminates the ring and sends to coordinator

• rpc generate (stream GenerateRequest, stream GenerateResponse)

  JlamaService.proto:62

  message GenerateRequest

  JlamaService.proto:19

  Due to streaming nature of the service, the workers send this message to indicate they are ready to generate Or to indicate they are done with the previous token

  • bytes workerid = 1

  • bytes session = 2

  • bytes tensor = 3

  message GenerateResponse

  JlamaService.proto:26

  This kicks off a token to be generated

  • bytes session = 1

  • int32 startPosition = 2

  • repeated int32 tokens = 3

• rpc combine (stream CombineRequest, stream CombineResponse)

  JlamaService.proto:63

  message CombineRequest

  JlamaService.proto:5

  • bytes workerid = 1

  • bytes uuid = 2

  • int32 modelShard = 3

  • int32 layerShard = 4

  • repeated bytes tensor = 5

  message CombineResponse

  JlamaService.proto:13

  • repeated bytes tensor = 1

This is the ring service, which is used to allow workers to communicate with each other

• rpc pass (stream PassRecord, stream Empty)

  JlamaService.proto:86

  message PassRecord

  JlamaService.proto:74

  • bytes session = 1

  • int32 startPosition = 2

  • int32 batchSize = 3

  • bytes tensor = 4

  message Empty

  JlamaService.proto:81

  (message has no fields)

* Register a worker with the server

Used as request type in: JlamaService.discover, JlamaService.register

• bytes workerid = 1

• string hostname = 2

• int32 peerPort = 3

* Workers register with their corresponding members of the ring

• int32 modelShard = 1

• int32 layerShard = 3