package handtracking

Get desktop application:
View/edit binary Protocol Buffers messages

The hand tracking service definition.

• rpc StreamHandUpdates (HandUpdate, stream HandUpdate)

  handtracking.proto:45

  message HandUpdate

  handtracking.proto:37

  The overall hand update message, including data for both hands

  • optional Hand left_hand = 1

  • optional Hand right_hand = 2

  • optional Matrix4x4 Head = 3

The hand tracking information, including the full 4x4 matrix for the wrist and the skeleton

Used in: HandUpdate

• optional Matrix4x4 wristMatrix = 1

  4x4 matrix for the wrist position and orientation

• optional Skeleton skeleton = 2

  The hand's skeleton

Acknowledgement message for hand updates

• string message = 1

Represents a 4x4 transformation matrix for a joint

Used in: Hand, HandUpdate, Skeleton

• float m00 = 1

• float m01 = 2

• float m02 = 3

• float m03 = 4

• float m10 = 5

• float m11 = 6

• float m12 = 7

• float m13 = 8

• float m20 = 9

• float m21 = 10

• float m22 = 11

• float m23 = 12

• float m30 = 13

• float m31 = 14

• float m32 = 15

• float m33 = 16

The skeleton of a hand, comprising multiple 4x4 matrices (one per joint)

Used in: Hand

• repeated Matrix4x4 jointMatrices = 1

  Array of 4x4 matrices, expecting 24 per hand based on your structure