package google.cloud.aiplatform.v1beta1.schema

Get desktop application:
View/edit binary Protocol Buffers messages

An entry of mapping between color and AnnotationSpec. The mapping is used in segmentation mask.

Used in: ImageSegmentationAnnotation.MaskAnnotation

• optional type.Color color = 1

  The color of the AnnotationSpec in a segmentation mask.

• string display_name = 2

  The display name of the AnnotationSpec represented by the color in the segmentation mask.

• string id = 3

  The ID of the AnnotationSpec represented by the color in the segmentation mask.

Annotation details specific to image object detection.

• string annotation_spec_id = 1

  The resource Id of the AnnotationSpec that this Annotation pertains to.

• string display_name = 2

  The display name of the AnnotationSpec that this Annotation pertains to.

• double x_min = 3

  The leftmost coordinate of the bounding box.

• double x_max = 4

  The rightmost coordinate of the bounding box.

• double y_min = 5

  The topmost coordinate of the bounding box.

• double y_max = 6

  The bottommost coordinate of the bounding box.

Annotation details specific to image classification.

• string annotation_spec_id = 1

  The resource Id of the AnnotationSpec that this Annotation pertains to.

• string display_name = 2

  The display name of the AnnotationSpec that this Annotation pertains to.

Payload of Image DataItem.

• string gcs_uri = 1

  Required. Google Cloud Storage URI points to the original image in user's bucket. The image is up to 30MB in size.

• string mime_type = 2

  Output only. The mime type of the content of the image. Only the images in below listed mime types are supported. - image/jpeg - image/gif - image/png - image/webp - image/bmp - image/tiff - image/vnd.microsoft.icon

The metadata of Datasets that contain Image DataItems.

• string data_item_schema_uri = 1

  Points to a YAML file stored on Google Cloud Storage describing payload of the Image DataItems that belong to this Dataset.

• string gcs_bucket = 2

  Google Cloud Storage Bucket name that contains the blob data of this Dataset.

Annotation details specific to image segmentation.

• oneof annotation

  • ImageSegmentationAnnotation.MaskAnnotation mask_annotation = 3

    Mask based segmentation annotation. Only one mask annotation can exist for one image.

  • ImageSegmentationAnnotation.PolygonAnnotation polygon_annotation = 4

    Polygon annotation.

  • ImageSegmentationAnnotation.PolylineAnnotation polyline_annotation = 5

    Polyline annotation.

The mask based segmentation annotation.

Used in: ImageSegmentationAnnotation

• string mask_gcs_uri = 1

  Google Cloud Storage URI that points to the mask image. The image must be in PNG format. It must have the same size as the DataItem's image. Each pixel in the image mask represents the AnnotationSpec which the pixel in the image DataItem belong to. Each color is mapped to one AnnotationSpec based on annotation_spec_colors.

• repeated AnnotationSpecColor annotation_spec_colors = 2

  The mapping between color and AnnotationSpec for this Annotation.

Represents a polygon in image.

Used in: ImageSegmentationAnnotation

• repeated Vertex vertexes = 1

  The vertexes are connected one by one and the last vertex is connected to the first one to represent a polygon.

• string annotation_spec_id = 2

  The resource Id of the AnnotationSpec that this Annotation pertains to.

• string display_name = 3

  The display name of the AnnotationSpec that this Annotation pertains to.

Represents a polyline in image.

Used in: ImageSegmentationAnnotation

• repeated Vertex vertexes = 1

  The vertexes are connected one by one and the last vertex in not connected to the first one.

• string annotation_spec_id = 2

  The resource Id of the AnnotationSpec that this Annotation pertains to.

• string display_name = 3

  The display name of the AnnotationSpec that this Annotation pertains to.

Represents a line of JSONL in the batch prediction output file.

• oneof input

  Some identifier from the input so that the prediction can be mapped back to the input instance.

  • protobuf.Struct instance = 1

    User's input instance. Struct is used here instead of Any so that JsonFormat does not append an extra "@type" field when we convert the proto to JSON.

  • string key = 2

    Optional user-provided key from the input instance.

• optional protobuf.Value prediction = 3

  The prediction result. Value is used here instead of Any so that JsonFormat does not append an extra "@type" field when we convert the proto to JSON and so we can represent array of objects. Do not set error if this is set.

• optional PredictionResult.Error error = 4

  The error result. Do not set prediction if this is set.

Used in: PredictionResult

• rpc.Code status = 1

  Error status. This will be serialized into the enum name e.g. "NOT_FOUND".

• string message = 2

  Error message with additional details.

The metadata of Datasets that contain tables data.

• optional TablesDatasetMetadata.InputConfig input_config = 1

Used in: InputConfig

• string uri = 1

  The URI of a BigQuery table. e.g. bq://projectId.bqDatasetId.bqTableId

Used in: InputConfig

• repeated string uri = 1

  Cloud Storage URI of one or more files. Only CSV files are supported. The first line of the CSV file is used as the header. If there are multiple files, the header is the first line of the lexicographically first file, the other files must either contain the exact same header or omit the header.

The tables Dataset's data source. The Dataset doesn't store the data directly, but only pointer(s) to its data.

Used in: TablesDatasetMetadata

• oneof source

  • GcsSource gcs_source = 1

  • BigQuerySource bigquery_source = 2

Annotation details specific to text classification.

• string annotation_spec_id = 1

  The resource Id of the AnnotationSpec that this Annotation pertains to.

• string display_name = 2

  The display name of the AnnotationSpec that this Annotation pertains to.

Payload of Text DataItem.

• string gcs_uri = 1

  Output only. Google Cloud Storage URI points to the original text in user's bucket. The text file is up to 10MB in size.

The metadata of Datasets that contain Text DataItems.

• string data_item_schema_uri = 1

  Points to a YAML file stored on Google Cloud Storage describing payload of the Text DataItems that belong to this Dataset.

• string gcs_bucket = 2

  Google Cloud Storage Bucket name that contains the blob data of this Dataset.

Annotation details specific to text extraction.

• optional TextSegment text_segment = 1

  The segment of the text content.

• string annotation_spec_id = 2

  The resource Id of the AnnotationSpec that this Annotation pertains to.

• string display_name = 3

  The display name of the AnnotationSpec that this Annotation pertains to.

The text segment inside of DataItem.

Used in: TextExtractionAnnotation

• uint64 start_offset = 1

  Zero-based character index of the first character of the text segment (counting characters from the beginning of the text).

• uint64 end_offset = 2

  Zero-based character index of the first character past the end of the text segment (counting character from the beginning of the text). The character at the end_offset is NOT included in the text segment.

• string content = 3

  The text content in the segment for output only.

Annotation details specific to text sentiment.

• int32 sentiment = 1

  The sentiment score for text.

• int32 sentiment_max = 2

  The sentiment max score for text.

• string annotation_spec_id = 3

  The resource Id of the AnnotationSpec that this Annotation pertains to.

• string display_name = 4

  The display name of the AnnotationSpec that this Annotation pertains to.

A time period inside of a DataItem that has a time dimension (e.g. video).

Used in: VideoActionRecognitionAnnotation, VideoClassificationAnnotation

• optional protobuf.Duration start_time_offset = 1

  Start of the time segment (inclusive), represented as the duration since the start of the DataItem.

• optional protobuf.Duration end_time_offset = 2

  End of the time segment (exclusive), represented as the duration since the start of the DataItem.

The metadata of Datasets that contain time series data.

• optional TimeSeriesDatasetMetadata.InputConfig input_config = 1

• string time_series_identifier_column = 2

  The column name of the time series identifier column that identifies the time series.

• string time_column = 3

  The column name of the time column that identifies time order in the time series.

Used in: InputConfig

• string uri = 1

  The URI of a BigQuery table.

Used in: InputConfig

• repeated string uri = 1

  Cloud Storage URI of one or more files. Only CSV files are supported. The first line of the CSV file is used as the header. If there are multiple files, the header is the first line of the lexicographically first file, the other files must either contain the exact same header or omit the header.

The time series Dataset's data source. The Dataset doesn't store the data directly, but only pointer(s) to its data.

Used in: TimeSeriesDatasetMetadata

• oneof source

  • GcsSource gcs_source = 1

  • BigQuerySource bigquery_source = 2

A vertex represents a 2D point in the image. NOTE: the normalized vertex coordinates are relative to the original image and range from 0 to 1.

Used in: ImageSegmentationAnnotation.PolygonAnnotation, ImageSegmentationAnnotation.PolylineAnnotation

• double x = 1

  X coordinate.

• double y = 2

  Y coordinate.

Annotation details specific to video action recognition.

• optional TimeSegment time_segment = 1

  This Annotation applies to the time period represented by the TimeSegment. If it's not set, the Annotation applies to the whole video.

• string annotation_spec_id = 2

  The resource Id of the AnnotationSpec that this Annotation pertains to.

• string display_name = 3

  The display name of the AnnotationSpec that this Annotation pertains to.

Annotation details specific to video classification.

• optional TimeSegment time_segment = 1

  This Annotation applies to the time period represented by the TimeSegment. If it's not set, the Annotation applies to the whole video.

• string annotation_spec_id = 2

  The resource Id of the AnnotationSpec that this Annotation pertains to.

• string display_name = 3

  The display name of the AnnotationSpec that this Annotation pertains to.

Payload of Video DataItem.

• string gcs_uri = 1

  Required. Google Cloud Storage URI points to the original video in user's bucket. The video is up to 50 GB in size and up to 3 hour in duration.

• string mime_type = 2

  Output only. The mime type of the content of the video. Only the videos in below listed mime types are supported. Supported mime_type: - video/mp4 - video/avi - video/quicktime

The metadata of Datasets that contain Video DataItems.

• string data_item_schema_uri = 1

  Points to a YAML file stored on Google Cloud Storage describing payload of the Video DataItems that belong to this Dataset.

• string gcs_bucket = 2

  Google Cloud Storage Bucket name that contains the blob data of this Dataset.

Annotation details specific to video object tracking.

• optional protobuf.Duration time_offset = 1

  A time (frame) of a video to which this annotation pertains. Represented as the duration since the video's start.

• double x_min = 2

  The leftmost coordinate of the bounding box.

• double x_max = 3

  The rightmost coordinate of the bounding box.

• double y_min = 4

  The topmost coordinate of the bounding box.

• double y_max = 5

  The bottommost coordinate of the bounding box.

• int64 instance_id = 6

  The instance of the object, expressed as a positive integer. Used to track the same object across different frames.

• string annotation_spec_id = 7

  The resource Id of the AnnotationSpec that this Annotation pertains to.

• string display_name = 8

  The display name of the AnnotationSpec that this Annotation pertains to.