package google.events.cloud.datafusion.v1

Get desktop application:
View/edit binary Protocol Buffers messages

Identifies Data Fusion accelerators for an instance.

Used in: Instance

• Accelerator.AcceleratorType accelerator_type = 1

  The type of an accelator for a CDF instance.

• Accelerator.State state = 2

  The state of the accelerator.

Each type represents an Accelerator (Add-On) supported by Cloud Data Fusion service.

Used in: Accelerator

• ACCELERATOR_TYPE_UNSPECIFIED = 0

  Default value, if unspecified.

• CDC = 1

  Change Data Capture accelerator for CDF.

• HEALTHCARE = 2

  Cloud Healthcare accelerator for CDF. This accelerator is to enable Cloud Healthcare specific CDF plugins developed by Healthcare team.

• CCAI_INSIGHTS = 3

  Contact Center AI Insights This accelerator is used to enable import and export pipelines custom built to streamline CCAI Insights processing.

Different values possible for the state of an accelerator.

Used in: Accelerator

• STATE_UNSPECIFIED = 0

  Default value, do not use.

• ENABLED = 1

  Indicates that the accelerator is enabled and available to use.

• DISABLED = 2

  Indicates that the accelerator is disabled and not available to use.

• UNKNOWN = 3

  Indicates that accelerator state is currently unknown. Requests for enable, disable could be retried while in this state.

The crypto key configuration. This field is used by the Customer-managed encryption keys (CMEK) feature.

Used in: Instance

• string key_reference = 1

  The name of the key which is used to encrypt/decrypt customer data. For key in Cloud KMS, the key should be in the format of `projects/*/locations/*/keyRings/*/cryptoKeys/*`.

DNS peering configuration. These configurations are used to create DNS peering with the customer Cloud DNS.

Used in: DnsPeeringEventData

• string name = 1

  Required. The resource name of the dns peering zone. Format: projects/{project}/locations/{location}/instances/{instance}/dnsPeerings/{dns_peering}

• string domain = 2

  Required. The dns name suffix of the zone.

• string description = 3

  Optional. Optional description of the dns zone.

• string target_project = 4

  Optional. Optional target project to which dns peering should happen.

• string target_network = 5

  Optional. Optional target network to which dns peering should happen.

The CloudEvent raised when a DnsPeering is created.

• optional DnsPeeringEventData data = 1

  The data associated with the event.

The CloudEvent raised when a DnsPeering is deleted.

• optional DnsPeeringEventData data = 1

  The data associated with the event.

The data within all DnsPeering events.

Used in: DnsPeeringCreatedEvent, DnsPeeringDeletedEvent

• optional DnsPeering payload = 1

  Optional. The DnsPeering event payload. Unset for deletion events.

Confirguration of PubSubEventWriter.

Used in: Instance

• bool enabled = 1

  Required. Option to enable Event Publishing.

• string topic = 2

  Required. The resource name of the Pub/Sub topic. Format: projects/{project_id}/topics/{topic_id}

Represents a Data Fusion instance.

Used in: InstanceEventData

• string name = 1

  Output only. The name of this instance is in the form of projects/{project}/locations/{location}/instances/{instance}.

• string description = 2

  A description of this instance.

• Instance.Type type = 3

  Required. Instance type.

• bool enable_stackdriver_logging = 4

  Option to enable Stackdriver Logging.

• bool enable_stackdriver_monitoring = 5

  Option to enable Stackdriver Monitoring.

• bool private_instance = 6

  Specifies whether the Data Fusion instance should be private. If set to true, all Data Fusion nodes will have private IP addresses and will not be able to access the public internet.

• optional NetworkConfig network_config = 7

  Network configuration options. These are required when a private Data Fusion instance is to be created.

• map<string, string> labels = 8

  The resource labels for instance to use to annotate any related underlying resources such as Compute Engine VMs. The character '=' is not allowed to be used within the labels.

• map<string, string> options = 9

  Map of additional options used to configure the behavior of Data Fusion instance.

• optional protobuf.Timestamp create_time = 10

  Output only. The time the instance was created.

• optional protobuf.Timestamp update_time = 11

  Output only. The time the instance was last updated.

• Instance.State state = 12

  Output only. The current state of this Data Fusion instance.

• string state_message = 13

  Output only. Additional information about the current state of this Data Fusion instance if available.

• string service_endpoint = 14

  Output only. Endpoint on which the Data Fusion UI is accessible.

• string zone = 15

  Name of the zone in which the Data Fusion instance will be created. Only DEVELOPER instances use this field.

• string version = 16

  Current version of the Data Fusion. Only specifiable in Update.

• string service_account = 17

  Output only. Deprecated. Use tenant_project_id instead to extract the tenant project ID.

• string display_name = 18

  Display name for an instance.

• repeated Version available_version = 19

  Available versions that the instance can be upgraded to using UpdateInstanceRequest.

• string api_endpoint = 20

  Output only. Endpoint on which the REST APIs is accessible.

• string gcs_bucket = 21

  Output only. Cloud Storage bucket generated by Data Fusion in the customer project.

• repeated Accelerator accelerators = 22

  List of accelerators enabled for this CDF instance.

• string p4_service_account = 23

  Output only. P4 service account for the customer project.

• string tenant_project_id = 24

  Output only. The name of the tenant project.

• string dataproc_service_account = 25

  User-managed service account to set on Dataproc when Cloud Data Fusion creates Dataproc to run data processing pipelines. This allows users to have fine-grained access control on Dataproc's accesses to cloud resources.

• bool enable_rbac = 27

  Option to enable granular role-based access control.

• optional CryptoKeyConfig crypto_key_config = 28

  The crypto key configuration. This field is used by the Customer-Managed Encryption Keys (CMEK) feature.

• repeated Instance.DisabledReason disabled_reason = 29

  Output only. If the instance state is DISABLED, the reason for disabling the instance.

• optional EventPublishConfig event_publish_config = 30

  Option to enable and pass metadata for event publishing.

• bool enable_zone_separation = 31

  Option to enable granular zone separation.

The reason for disabling the instance if the state is DISABLED.

Used in: Instance

• DISABLED_REASON_UNSPECIFIED = 0

  This is an unknown reason for disabling.

• KMS_KEY_ISSUE = 1

  The KMS key used by the instance is either revoked or denied access to

Represents the state of a Data Fusion instance

Used in: Instance

• STATE_UNSPECIFIED = 0

  Instance does not have a state yet

• CREATING = 1

  Instance is being created

• ACTIVE = 2

  Instance is active and ready for requests. This corresponds to 'RUNNING' in datafusion.v1beta1.

• FAILED = 3

  Instance creation failed

• DELETING = 4

  Instance is being deleted

• UPGRADING = 5

  Instance is being upgraded

• RESTARTING = 6

  Instance is being restarted

• UPDATING = 7

  Instance is being updated on customer request

• AUTO_UPDATING = 8

  Instance is being auto-updated

• AUTO_UPGRADING = 9

  Instance is being auto-upgraded

• DISABLED = 10

  Instance is disabled

Represents the type of Data Fusion instance. Each type is configured with the default settings for processing and memory.

Used in: Instance

• TYPE_UNSPECIFIED = 0

  No type specified. The instance creation will fail.

• BASIC = 1

  Basic Data Fusion instance. In Basic type, the user will be able to create data pipelines using point and click UI. However, there are certain limitations, such as fewer number of concurrent pipelines, no support for streaming pipelines, etc.

• ENTERPRISE = 2

  Enterprise Data Fusion instance. In Enterprise type, the user will have all features available, such as support for streaming pipelines, higher number of concurrent pipelines, etc.

• DEVELOPER = 3

  Developer Data Fusion instance. In Developer type, the user will have all features available but with restrictive capabilities. This is to help enterprises design and develop their data ingestion and integration pipelines at low cost.

The CloudEvent raised when an Instance is created.

• optional InstanceEventData data = 1

  The data associated with the event.

The CloudEvent raised when an Instance is deleted.

• optional InstanceEventData data = 1

  The data associated with the event.

The data within all Instance events.

Used in: InstanceCreatedEvent, InstanceDeletedEvent, InstanceUpdatedEvent

• optional Instance payload = 1

  Optional. The Instance event payload. Unset for deletion events.

The CloudEvent raised when an Instance is updated.

• optional InstanceEventData data = 1

  The data associated with the event.

Network configuration for a Data Fusion instance. These configurations are used for peering with the customer network. Configurations are optional when a public Data Fusion instance is to be created. However, providing these configurations allows several benefits, such as reduced network latency while accessing the customer resources from managed Data Fusion instance nodes, as well as access to the customer on-prem resources.

Used in: Instance

• string network = 1

  Name of the network in the customer project with which the Tenant Project will be peered for executing pipelines. In case of shared VPC where the network resides in another host project the network should specified in the form of projects/{host-project-id}/global/networks/{network}

• string ip_allocation = 2

  The IP range in CIDR notation to use for the managed Data Fusion instance nodes. This range must not overlap with any other ranges used in the customer network.

The Data Fusion version. This proto message stores information about certain Data Fusion version, which is used for Data Fusion version upgrade.

Used in: Instance

• string version_number = 1

  The version number of the Data Fusion instance, such as '6.0.1.0'.

• bool default_version = 2

  Whether this is currently the default version for Cloud Data Fusion

• repeated string available_features = 3

  Represents a list of available feature names for a given version.

• Version.Type type = 4

  Type represents the release availability of the version

Each type represents the release availability of a CDF version

Used in: Version

• TYPE_UNSPECIFIED = 0

  Version does not have availability yet

• TYPE_PREVIEW = 1

  Version is under development and not considered stable

• TYPE_GENERAL_AVAILABILITY = 2

  Version is available for public use