package segmentation

Get desktop application:
View/edit binary Protocol Buffers messages

Features for oversegmented regions.

(message has no fields)

(message has no fields)

Generic RegionFeatures. Add specific feature descriptors via extensions.

Used in: SegmentationDesc

• required fixed32 id = 1

  corresponding region id.

SegmentationDescription

• repeated SegmentationDesc.Region2D region = 2

  Stores the per-frame over-segmentation.

• repeated SegmentationDesc.HierarchyLevel hierarchy = 3

  Always present at the first frame of a chunk-set.

• optional int32 frame_width = 4

  General video information.

• optional int32 frame_height = 5

• optional int32 chunk_size = 6

  Number of frames in this chunk, i.e. number of frames hierarchy was computed for.

• optional int32 overlap_start = 7

  First frame in overlap. Although we compute hierarchy for the whole chunk, the Region2D for the overlap are not output by this but by the next chunk.

• optional int32 chunk_id = 8

  Unique id per chunk.

• optional int32 hierarchy_frame_idx = 9

  Corresponding hierarchy frame, first one by default, i.e. denotes the frame index where the hierarchy for this chunk is stored. Indexed w.r.t. the beginning of the video, not the beginning of the chunk.

• repeated RegionFeatures features = 10

  This might be only present in some protobuffers as it is saved for spatio temporal descriptors.

• optional SegmentationDesc.VectorMesh vector_mesh = 11

  Stores mesh coordinates for the whole frame.

• optional SegmentationDesc.Connectedness connectedness = 12

  Spatial connectedness of oversegmentation.

• optional bool rasterization_removed = 13

  Indicates if rasterization was removed. In this case vector_mesh is always present.

Used in: HierarchyLevel

• required int32 id = 1

• required int32 size = 2

• repeated int32 neighbor_id = 3

• optional int32 parent_id = 4

• repeated int32 child_id = 5

  List of child ids - references to previous level. Empty for leafs (oversegmentation).

• optional int32 start_frame = 6

  Begin and end in time of this Region3D.

• optional int32 end_frame = 7

Specifies the connectedness of the underlying 2D frame segmentation.

Used in: SegmentationDesc

• N4_CONNECT = 1

• N8_CONNECT = 2

Represents the compound region's (hierarchy) for a whole chunk of video (usually only for the very first frame of a chunk). Note: Local w.r.t. the chunk, not global for the video. Use: BuildGlobalHierarchy (from segment_util.h) to combine multiple HierarchyLevel's into one global one.

Used in: SegmentationDesc

• repeated CompoundRegion region = 2

Used in: Vectorization

• repeated int32 coord_idx = 1

  Maps to index in VectorMesh, i.e. x coordinate of N'th point is storred at coord_idx[N] and y coordinate at coord_idx[N] + 1.

• optional bool hole = 2

Used in: Region2D

• repeated Rasterization.ScanInterval scan_inter = 1

  In case of holes, this can be empty!

Always lexicographically ordered by (y, x).

Used in: Rasterization

• required int32 y = 1

• required int32 left_x = 2

• required int32 right_x = 3

Used in: SegmentationDesc

• required int32 id = 1

• optional Rasterization raster = 3

• optional ShapeMoments shape_moments = 5

• optional Vectorization vectorization = 6

Used in: Region2D

• optional float size = 1

• optional float mean_x = 2

• optional float mean_y = 3

• optional float moment_xx = 4

• optional float moment_xy = 5

• optional float moment_yy = 6

Used in: SegmentationDesc

• repeated float coord = 1

  Packs x,y coordinates, i.e. point N is saved at positions 2*N and 2*N+1

Used in: Region2D

• repeated Polygon polygon = 1

(message has no fields)