package feast.core

Get desktop application:
View/edit binary Protocol Buffers messages

Used in: StreamFeatureViewSpec

• string column = 1

• string function = 2

• optional google.protobuf.Duration time_window = 3

• optional google.protobuf.Duration slide_interval = 4

Defines a Data Source that can be used source Feature data Next available id: 28

Used as response type in: registry.RegistryServer.GetDataSource

Used as field type in: DataSourceList, FeatureTableSpec, FeatureViewProjection, FeatureViewSpec, OnDemandSource, Registry, StreamFeatureViewSpec, registry.ApplyDataSourceRequest, registry.ListDataSourcesResponse

• string name = 20

  Unique name of data source within the project

• string project = 21

  Name of Feast project that this data source belongs to.

• string description = 23

• map<string, string> tags = 24

• string owner = 25

• DataSource.SourceType type = 1

• map<string, string> field_mapping = 2

  Defines mapping between fields in the sourced data and fields in parent FeatureTable.

• string timestamp_field = 3

  Must specify event timestamp column name

• string date_partition_column = 4

  (Optional) Specify partition column useful for file sources

• string created_timestamp_column = 5

  Must specify creation timestamp column name

• string data_source_class_type = 17

  This is an internal field that is represents the python class for the data source object a proto object represents. This should be set by feast, and not by users. The field is used primarily by custom data sources and is mandatory for them to set. Feast may set it for first party sources as well.

• optional DataSource batch_source = 26

  Optional batch source for streaming sources for historical features and materialization.

• optional DataSource.SourceMeta meta = 50

• oneof options

  DataSource options.

  • DataSource.FileOptions file_options = 11

  • DataSource.BigQueryOptions bigquery_options = 12

  • DataSource.KafkaOptions kafka_options = 13

  • DataSource.KinesisOptions kinesis_options = 14

  • DataSource.RedshiftOptions redshift_options = 15

  • DataSource.RequestDataOptions request_data_options = 18

  • DataSource.CustomSourceOptions custom_options = 16

  • DataSource.SnowflakeOptions snowflake_options = 19

  • DataSource.PushOptions push_options = 22

  • DataSource.SparkOptions spark_options = 27

  • DataSource.TrinoOptions trino_options = 30

  • DataSource.AthenaOptions athena_options = 35

Defines options for DataSource that sources features from a Athena Query

Used in: DataSource, SavedDatasetStorage

• string table = 1

  Athena table name

• string query = 2

  SQL query that returns a table containing feature data. Must contain an event_timestamp column, and respective entity columns

• string database = 3

  Athena database name

• string data_source = 4

  Athena schema name

Defines options for DataSource that sources features from a BigQuery Query

Used in: DataSource, SavedDatasetStorage

• string table = 1

  Full table reference in the form of [project:dataset.table]

• string query = 2

  SQL query that returns a table containing feature data. Must contain an event_timestamp column, and respective entity columns

Defines configuration for custom third-party data sources.

Used in: DataSource, SavedDatasetStorage

• bytes configuration = 1

  Serialized configuration information for the data source. The implementer of the custom data source is responsible for serializing and deserializing data from bytes

Defines options for DataSource that sources features from a file

Used in: DataSource, SavedDatasetStorage

• optional FileFormat file_format = 1

• string uri = 2

  Target URL of file to retrieve and source features from. s3://path/to/file for AWS S3 storage gs://path/to/file for GCP GCS storage file:///path/to/file for local storage

• string s3_endpoint_override = 3

  override AWS S3 storage endpoint with custom S3 endpoint

Defines options for DataSource that sources features from Kafka messages. Each message should be a Protobuf that can be decoded with the generated Java Protobuf class at the given class path

Used in: DataSource

• string kafka_bootstrap_servers = 1

  Comma separated list of Kafka bootstrap servers. Used for feature tables without a defined source host[:port]]

• string topic = 2

  Kafka topic to collect feature data from.

• optional StreamFormat message_format = 3

  Defines the stream data format encoding feature/entity data in Kafka messages.

• optional google.protobuf.Duration watermark_delay_threshold = 4

  Watermark delay threshold for stream data

Defines options for DataSource that sources features from Kinesis records. Each record should be a Protobuf that can be decoded with the generated Java Protobuf class at the given class path

Used in: DataSource

• string region = 1

  AWS region of the Kinesis stream

• string stream_name = 2

  Name of the Kinesis stream to obtain feature data from.

• optional StreamFormat record_format = 3

  Defines the data format encoding the feature/entity data in Kinesis records. Kinesis Data Sources support Avro and Proto as data formats.

Defines options for DataSource that supports pushing data to it. This allows data to be pushed to the online store on-demand, such as by stream consumers.

Used in: DataSource

(message has no fields)

Defines options for DataSource that sources features from a Redshift Query

Used in: DataSource, SavedDatasetStorage

• string table = 1

  Redshift table name

• string query = 2

  SQL query that returns a table containing feature data. Must contain an event_timestamp column, and respective entity columns

• string schema = 3

  Redshift schema name

• string database = 4

  Redshift database name

Defines options for DataSource that sources features from request data

Used in: DataSource

• map<string, types.ValueType.Enum> deprecated_schema = 2

  Mapping of feature name to type

• repeated FeatureSpecV2 schema = 3

Defines options for DataSource that sources features from a Snowflake Query

Used in: DataSource, SavedDatasetStorage

• string table = 1

  Snowflake table name

• string query = 2

  SQL query that returns a table containing feature data. Must contain an event_timestamp column, and respective entity columns

• string schema = 3

  Snowflake schema name

• string database = 4

  Snowflake schema name

Used in: DataSource

• optional google.protobuf.Timestamp earliestEventTimestamp = 1

• optional google.protobuf.Timestamp latestEventTimestamp = 2

Type of Data Source. Next available id: 12

Used in: DataSource

• INVALID = 0

• BATCH_FILE = 1

• BATCH_SNOWFLAKE = 8

• BATCH_BIGQUERY = 2

• BATCH_REDSHIFT = 5

• STREAM_KAFKA = 3

• STREAM_KINESIS = 4

• CUSTOM_SOURCE = 6

• REQUEST_SOURCE = 7

• PUSH_SOURCE = 9

• BATCH_TRINO = 10

• BATCH_SPARK = 11

• BATCH_ATHENA = 12

Defines options for DataSource that sources features from a spark table/query

Used in: DataSource, SavedDatasetStorage

• string table = 1

  Table name

• string query = 2

  Spark SQl query that returns the table, this is an alternative to `table`

• string path = 3

  Path from which spark can read the table, this is an alternative to `table`

• string file_format = 4

  Format of files at `path` (e.g. parquet, avro, etc)

• string date_partition_column_format = 5

  Date Format of date partition column (e.g. %Y-%m-%d)

Defines options for DataSource that sources features from a Trino Query

Used in: DataSource, SavedDatasetStorage

• string table = 1

  Full table reference in the form of [project:dataset.table]

• string query = 2

  SQL query that returns a table containing feature data. Must contain an event_timestamp column, and respective entity columns

• repeated DataSource datasources = 1

Represents a Datastore table

Used in: InfraObject

• string project = 1

  Feast project of the table

• string name = 2

  Name of the table

• optional google.protobuf.StringValue project_id = 3

  GCP project id

• optional google.protobuf.StringValue namespace = 4

  Datastore namespace

• optional google.protobuf.StringValue database = 5

  Firestore database

Represents a DynamoDB table

Used in: InfraObject

• string name = 1

  Name of the table

• string region = 2

  Region of the table

Used as response type in: registry.RegistryServer.GetEntity

Used as field type in: EntityList, Registry, registry.ApplyEntityRequest, registry.ListEntitiesResponse

• optional EntitySpecV2 spec = 1

  User-specified specifications of this entity.

• optional EntityMeta meta = 2

  System-populated metadata for this entity.

• repeated Entity entities = 1

Used in: Entity

• optional google.protobuf.Timestamp created_timestamp = 1

• optional google.protobuf.Timestamp last_updated_timestamp = 2

Used in: Entity

• string name = 1

  Name of the entity.

• string project = 9

  Name of Feast project that this feature table belongs to.

• types.ValueType.Enum value_type = 2

  Type of the entity.

• string description = 3

  Description of the entity.

• string join_key = 4

  Join key for the entity (i.e. name of the column the entity maps to).

• map<string, string> tags = 8

  User defined metadata

• string owner = 10

  Owner of the entity.

Used as response type in: registry.RegistryServer.GetFeatureService

Used as field type in: FeatureServiceList, Registry, registry.ApplyFeatureServiceRequest, registry.ListFeatureServicesResponse

• optional FeatureServiceSpec spec = 1

  User-specified specifications of this feature service.

• optional FeatureServiceMeta meta = 2

  System-populated metadata for this feature service.

• repeated FeatureService featureservices = 1

Used in: FeatureService

• optional google.protobuf.Timestamp created_timestamp = 1

  Time where this Feature Service is created

• optional google.protobuf.Timestamp last_updated_timestamp = 2

  Time where this Feature Service is last updated

Used in: FeatureService

• string name = 1

  Name of the Feature Service. Must be unique. Not updated.

• string project = 2

  Name of Feast project that this Feature Service belongs to.

• repeated FeatureViewProjection features = 3

  Represents a projection that's to be applied on top of the FeatureView. Contains data such as the features to use from a FeatureView.

• map<string, string> tags = 4

  User defined metadata

• string description = 5

  Description of the feature service.

• string owner = 6

  Owner of the feature service.

• optional LoggingConfig logging_config = 7

  (optional) if provided logging will be enabled for this feature service.

Used in: DataSource.RequestDataOptions, FeatureTableSpec, FeatureViewProjection, FeatureViewSpec, OnDemandFeatureViewSpec, StreamFeatureViewSpec

• string name = 1

  Name of the feature. Not updatable.

• types.ValueType.Enum value_type = 2

  Value type of the feature. Not updatable.

• map<string, string> tags = 3

  Tags for user defined metadata on a feature

• string description = 4

  Description of the feature.

• bool vector_index = 5

  Field indicating the vector will be indexed for vector similarity search

• string vector_search_metric = 6

  Metric used for vector similarity search.

• int32 vector_length = 7

  Field indicating the vector length

Used in: Registry

• optional FeatureTableSpec spec = 1

  User-specified specifications of this feature table.

• optional FeatureTableMeta meta = 2

  System-populated metadata for this feature table.

Used in: FeatureTable

• optional google.protobuf.Timestamp created_timestamp = 1

  Time where this Feature Table is created

• optional google.protobuf.Timestamp last_updated_timestamp = 2

  Time where this Feature Table is last updated

• int64 revision = 3

  Auto incrementing revision no. of this Feature Table

• string hash = 4

  Hash entities, features, batch_source and stream_source to inform JobService if jobs should be restarted should hash change

Used in: FeatureTable

• string name = 1

  Name of the feature table. Must be unique. Not updated.

• string project = 9

  Name of Feast project that this feature table belongs to.

• repeated string entities = 3

  List names of entities to associate with the Features defined in this Feature Table. Not updatable.

• repeated FeatureSpecV2 features = 4

  List of features specifications for each feature defined with this feature table.

• map<string, string> labels = 5

  User defined metadata

• optional google.protobuf.Duration max_age = 6

  Features in this feature table can only be retrieved from online serving younger than max age. Age is measured as the duration of time between the feature's event timestamp and when the feature is retrieved Feature values outside max age will be returned as unset values and indicated to end user

• optional DataSource batch_source = 7

  Batch/Offline DataSource to source batch/offline feature data. Only batch DataSource can be specified (ie source type should start with 'BATCH_')

• optional DataSource stream_source = 8

  Stream/Online DataSource to source stream/online feature data. Only stream DataSource can be specified (ie source type should start with 'STREAM_')

A feature transformation executed as a user-defined function

Used in: OnDemandFeatureViewSpec, StreamFeatureViewSpec

• oneof transformation

  • UserDefinedFunctionV2 user_defined_function = 1

  • SubstraitTransformationV2 substrait_transformation = 2

Used as response type in: registry.RegistryServer.GetFeatureView

Used as field type in: FeatureViewList, OnDemandSource, Registry, registry.AnyFeatureView, registry.ApplyFeatureViewRequest, registry.ApplyMaterializationRequest, registry.ListFeatureViewsResponse

• optional FeatureViewSpec spec = 1

  User-specified specifications of this feature view.

• optional FeatureViewMeta meta = 2

  System-populated metadata for this feature view.

• repeated FeatureView featureviews = 1

Used in: FeatureView, StreamFeatureView

• optional google.protobuf.Timestamp created_timestamp = 1

  Time where this Feature View is created

• optional google.protobuf.Timestamp last_updated_timestamp = 2

  Time where this Feature View is last updated

• repeated MaterializationInterval materialization_intervals = 3

  List of pairs (start_time, end_time) for which this feature view has been materialized.

A projection to be applied on top of a FeatureView. Contains the modifications to a FeatureView such as the features subset to use.

Used in: FeatureServiceSpec, OnDemandSource

• string feature_view_name = 1

  The feature view name

• string feature_view_name_alias = 3

  Alias for feature view name

• repeated FeatureSpecV2 feature_columns = 2

  The features of the feature view that are a part of the feature reference.

• map<string, string> join_key_map = 4

  Map for entity join_key overrides of feature data entity join_key to entity data join_key

• string timestamp_field = 5

• string date_partition_column = 6

• string created_timestamp_column = 7

• optional DataSource batch_source = 8

  Batch/Offline DataSource where this view can retrieve offline feature data.

• optional DataSource stream_source = 9

  Streaming DataSource from where this view can consume "online" feature data.

Next available id: 13 TODO(adchia): refactor common fields from this and ODFV into separate metadata proto

Used in: FeatureView

• string name = 1

  Name of the feature view. Must be unique. Not updated.

• string project = 2

  Name of Feast project that this feature view belongs to.

• repeated string entities = 3

  List of names of entities associated with this feature view.

• repeated FeatureSpecV2 features = 4

  List of specifications for each feature defined as part of this feature view.

• repeated FeatureSpecV2 entity_columns = 12

  List of specifications for each entity defined as part of this feature view.

• string description = 10

  Description of the feature view.

• map<string, string> tags = 5

  User defined metadata

• string owner = 11

  Owner of the feature view.

• optional google.protobuf.Duration ttl = 6

  Features in this feature view can only be retrieved from online serving younger than ttl. Ttl is measured as the duration of time between the feature's event timestamp and when the feature is retrieved Feature values outside ttl will be returned as unset values and indicated to end user

• optional DataSource batch_source = 7

  Batch/Offline DataSource where this view can retrieve offline feature data.

• optional DataSource stream_source = 9

  Streaming DataSource from where this view can consume "online" feature data.

• bool online = 8

  Whether these features should be served online or not This is also used to determine whether the features should be written to the online store

• bool offline = 13

  Whether these features should be written to the offline store

Defines the file format encoding the features/entity data in files

Used in: DataSource.FileOptions

• oneof format

  • FileFormat.ParquetFormat parquet_format = 1

  • FileFormat.DeltaFormat delta_format = 2

Defines options for delta data format

Used in: FileFormat

(message has no fields)

Defines options for the Parquet data format

Used in: FileFormat

(message has no fields)

Used in: ValidationReference

• bytes expectation_suite = 1

  JSON-serialized ExpectationSuite object

Used in: ValidationReference

• optional GEValidationProfiler.UserDefinedProfiler profiler = 1

Used in: GEValidationProfiler

• bytes body = 1

  The python-syntax function body (serialized by dill)

Represents a set of infrastructure objects managed by Feast

Used as response type in: registry.RegistryServer.GetInfra

Used as field type in: Registry, registry.UpdateInfraRequest

• repeated InfraObject infra_objects = 1

  List of infrastructure objects managed by Feast

Represents a single infrastructure object managed by Feast

Used in: Infra

• string infra_object_class_type = 1

  Represents the Python class for the infrastructure object

• oneof infra_object

  The infrastructure object

  • DynamoDBTable dynamodb_table = 2

  • DatastoreTable datastore_table = 3

  • SqliteTable sqlite_table = 4

  • InfraObject.CustomInfra custom_infra = 100

Allows for custom infra objects to be added

Used in: InfraObject

• bytes field = 1

Used in: FeatureServiceSpec

• float sample_rate = 1

• oneof destination

  • LoggingConfig.FileDestination file_destination = 3

  • LoggingConfig.BigQueryDestination bigquery_destination = 4

  • LoggingConfig.RedshiftDestination redshift_destination = 5

  • LoggingConfig.SnowflakeDestination snowflake_destination = 6

  • LoggingConfig.CustomDestination custom_destination = 7

  • LoggingConfig.AthenaDestination athena_destination = 8

  • LoggingConfig.CouchbaseColumnarDestination couchbase_columnar_destination = 9

Used in: LoggingConfig

• string table_name = 1

  Destination table name. data_source and database will be taken from an offline store config

Used in: LoggingConfig

• string table_ref = 1

  Full table reference in the form of [project:dataset.table]

Used in: LoggingConfig

• string database = 1

  Destination database name

• string scope = 2

  Destination scope name

• string collection = 3

  Destination collection name

Used in: LoggingConfig

• string kind = 1

• map<string, string> config = 2

Used in: LoggingConfig

• string path = 1

• string s3_endpoint_override = 2

• repeated string partition_by = 3

  column names to use for partitioning

Used in: LoggingConfig

• string table_name = 1

  Destination table name. ClusterId and database will be taken from an offline store config

Used in: LoggingConfig

• string table_name = 1

  Destination table name. Schema and database will be taken from an offline store config

Used in: FeatureViewMeta

• optional google.protobuf.Timestamp start_time = 1

• optional google.protobuf.Timestamp end_time = 2

Used as response type in: registry.RegistryServer.GetOnDemandFeatureView

Used as field type in: OnDemandFeatureViewList, Registry, registry.AnyFeatureView, registry.ApplyFeatureViewRequest, registry.ListOnDemandFeatureViewsResponse

• optional OnDemandFeatureViewSpec spec = 1

  User-specified specifications of this feature view.

• optional OnDemandFeatureViewMeta meta = 2

• repeated OnDemandFeatureView ondemandfeatureviews = 1

Used in: OnDemandFeatureView

• optional google.protobuf.Timestamp created_timestamp = 1

  Time where this Feature View is created

• optional google.protobuf.Timestamp last_updated_timestamp = 2

  Time where this Feature View is last updated

Next available id: 9

Used in: OnDemandFeatureView

• string name = 1

  Name of the feature view. Must be unique. Not updated.

• string project = 2

  Name of Feast project that this feature view belongs to.

• repeated FeatureSpecV2 features = 3

  List of features specifications for each feature defined with this feature view.

• map<string, OnDemandSource> sources = 4

  Map of sources for this feature view.

• optional UserDefinedFunction user_defined_function = 5

• optional FeatureTransformationV2 feature_transformation = 10

  Oneof with {user_defined_function, on_demand_substrait_transformation}

• string description = 6

  Description of the on demand feature view.

• map<string, string> tags = 7

  User defined metadata.

• string owner = 8

  Owner of the on demand feature view.

• string mode = 11

• bool write_to_online_store = 12

• repeated string entities = 13

  List of names of entities associated with this feature view.

• repeated FeatureSpecV2 entity_columns = 14

  List of specifications for each entity defined as part of this feature view.

• bool singleton = 15

Used in: OnDemandFeatureViewSpec

• oneof source

  • FeatureView feature_view = 1

  • FeatureViewProjection feature_view_projection = 3

  • DataSource request_data_source = 2

Used as response type in: registry.RegistryServer.GetPermission

Used as field type in: Registry, registry.ApplyPermissionRequest, registry.ListPermissionsResponse

• optional PermissionSpec spec = 1

  User-specified specifications of this permission.

• optional PermissionMeta meta = 2

  System-populated metadata for this permission.

Used in: Permission

• optional google.protobuf.Timestamp created_timestamp = 1

• optional google.protobuf.Timestamp last_updated_timestamp = 2

Used in: Permission

• string name = 1

  Name of the permission. Must be unique. Not updated.

• string project = 2

  Name of Feast project.

• repeated PermissionSpec.Type types = 3

• repeated string name_patterns = 4

• map<string, string> required_tags = 5

• repeated PermissionSpec.AuthzedAction actions = 6

  List of actions.

• optional Policy policy = 7

  the policy.

• map<string, string> tags = 8

  User defined metadata

Used in: PermissionSpec

• CREATE = 0

• DESCRIBE = 1

• UPDATE = 2

• DELETE = 3

• READ_ONLINE = 4

• READ_OFFLINE = 5

• WRITE_ONLINE = 6

• WRITE_OFFLINE = 7

Used in: PermissionSpec

• FEATURE_VIEW = 0

• ON_DEMAND_FEATURE_VIEW = 1

• BATCH_FEATURE_VIEW = 2

• STREAM_FEATURE_VIEW = 3

• ENTITY = 4

• FEATURE_SERVICE = 5

• DATA_SOURCE = 6

• VALIDATION_REFERENCE = 7

• SAVED_DATASET = 8

• PERMISSION = 9

• PROJECT = 10

Used in: PermissionSpec

• string name = 1

  Name of the policy.

• string project = 2

  Name of Feast project.

• oneof policy_type

  • RoleBasedPolicy role_based_policy = 3

Used as response type in: registry.RegistryServer.GetProject

Used as field type in: Registry, registry.ApplyProjectRequest, registry.ListProjectsResponse

• optional ProjectSpec spec = 1

  User-specified specifications of this entity.

• optional ProjectMeta meta = 2

  System-populated metadata for this entity.

Used in: Project

• optional google.protobuf.Timestamp created_timestamp = 1

  Time when the Project is created

• optional google.protobuf.Timestamp last_updated_timestamp = 2

  Time when the Project is last updated with registry changes (Apply stage)

Used in: Registry, registry.ListProjectMetadataResponse

• string project = 1

• string project_uuid = 2

Used in: Project

• string name = 1

  Name of the Project

• string description = 2

  Description of the Project

• map<string, string> tags = 3

  User defined metadata

• string owner = 4

  Owner of the Project

Next id: 18

Used as response type in: registry.RegistryServer.Proto

• repeated Entity entities = 1

• repeated FeatureTable feature_tables = 2

• repeated FeatureView feature_views = 6

• repeated DataSource data_sources = 12

• repeated OnDemandFeatureView on_demand_feature_views = 8

• repeated StreamFeatureView stream_feature_views = 14

• repeated FeatureService feature_services = 7

• repeated SavedDataset saved_datasets = 11

• repeated ValidationReference validation_references = 13

• optional Infra infra = 10

• repeated ProjectMetadata project_metadata = 15

  Tracking metadata of Feast by project

• string registry_schema_version = 3

  to support migrations; incremented when schema is changed

• string version_id = 4

  version id, random string generated on each update of the data; now used only for debugging purposes

• optional google.protobuf.Timestamp last_updated = 5

• repeated Permission permissions = 16

• repeated Project projects = 17

Used in: Policy

• repeated string roles = 1

  List of roles in this policy.

Used as response type in: registry.RegistryServer.GetSavedDataset

Used as field type in: Registry, registry.ApplySavedDatasetRequest, registry.ListSavedDatasetsResponse

• optional SavedDatasetSpec spec = 1

• optional SavedDatasetMeta meta = 2

Used in: SavedDataset

• optional google.protobuf.Timestamp created_timestamp = 1

  Time when this saved dataset is created

• optional google.protobuf.Timestamp last_updated_timestamp = 2

  Time when this saved dataset is last updated

• optional google.protobuf.Timestamp min_event_timestamp = 3

  Min timestamp in the dataset (needed for retrieval)

• optional google.protobuf.Timestamp max_event_timestamp = 4

  Max timestamp in the dataset (needed for retrieval)

Used in: SavedDataset

• string name = 1

  Name of the dataset. Must be unique since it's possible to overwrite dataset by name

• string project = 2

  Name of Feast project that this Dataset belongs to.

• repeated string features = 3

  list of feature references with format "<view name>:<feature name>"

• repeated string join_keys = 4

  entity columns + request columns from all feature views used during retrieval

• bool full_feature_names = 5

  Whether full feature names are used in stored data

• optional SavedDatasetStorage storage = 6

• string feature_service_name = 8

  Optional and only populated if generated from a feature service fetch

• map<string, string> tags = 7

  User defined metadata

Used in: SavedDatasetSpec

• oneof kind

  • DataSource.FileOptions file_storage = 4

  • DataSource.BigQueryOptions bigquery_storage = 5

  • DataSource.RedshiftOptions redshift_storage = 6

  • DataSource.SnowflakeOptions snowflake_storage = 7

  • DataSource.TrinoOptions trino_storage = 8

  • DataSource.SparkOptions spark_storage = 9

  • DataSource.CustomSourceOptions custom_storage = 10

  • DataSource.AthenaOptions athena_storage = 11

Represents a Sqlite table

Used in: InfraObject

• string path = 1

  Absolute path of the table

• string name = 2

  Name of the table

Store provides a location where Feast reads and writes feature values. Feature values will be written to the Store in the form of FeatureRow elements. The way FeatureRow is encoded and decoded when it is written to and read from the Store depends on the type of the Store.

• string name = 1

  Name of the store.

• Store.StoreType type = 2

  Type of store.

• repeated Store.Subscription subscriptions = 4

  Feature sets to subscribe to.

• oneof config

  Configuration to connect to the store. Required.

  • Store.RedisConfig redis_config = 11

  • Store.RedisClusterConfig redis_cluster_config = 14

Used in: Store

• string connection_string = 1

  List of Redis Uri for all the nodes in Redis Cluster, comma separated. Eg. host1:6379, host2:6379

• int32 initial_backoff_ms = 2

• int32 max_retries = 3

• int32 flush_frequency_seconds = 4

  Optional. How often flush data to redis

• string key_prefix = 5

  Optional. Append a prefix to the Redis Key

• bool enable_fallback = 6

  Optional. Enable fallback to another key prefix if the original key is not present. Useful for migrating key prefix without re-ingestion. Disabled by default.

• string fallback_prefix = 7

  Optional. This would be the fallback prefix to use if enable_fallback is true.

• RedisClusterConfig.ReadFrom read_from = 8

Optional. Priority of nodes when reading from cluster

Used in: RedisClusterConfig

• MASTER = 0

• MASTER_PREFERRED = 1

• REPLICA = 2

• REPLICA_PREFERRED = 3

Used in: Store

• string host = 1

• int32 port = 2

• int32 initial_backoff_ms = 3

  Optional. The number of milliseconds to wait before retrying failed Redis connection. By default, Feast uses exponential backoff policy and "initial_backoff_ms" sets the initial wait duration.

• int32 max_retries = 4

  Optional. Maximum total number of retries for connecting to Redis. Default to zero retries.

• int32 flush_frequency_seconds = 5

  Optional. How often flush data to redis

• bool ssl = 6

  Optional. Connect over SSL.

Used in: Store

• INVALID = 0

• REDIS = 1

  Redis stores a FeatureRow element as a key, value pair. The Redis data types used (https://redis.io/topics/data-types): - key: STRING - value: STRING Encodings: - key: byte array of RedisKey (refer to feast.storage.RedisKeyV2) - value: Redis hashmap

• REDIS_CLUSTER = 4

Used in: Store

• string project = 3

  Name of project that the feature sets belongs to. This can be one of - [project_name] - * If an asterisk is provided, filtering on projects will be disabled. All projects will be matched. It is NOT possible to provide an asterisk with a string in order to do pattern matching.

• string name = 1

  Name of the desired feature set. Asterisks can be used as wildcards in the name. Matching on names is only permitted if a specific project is defined. It is disallowed If the project name is set to "*" e.g. - * can be used to match all feature sets - my-feature-set* can be used to match all features prefixed by "my-feature-set" - my-feature-set-6 can be used to select a single feature set

• bool exclude = 4

  All matches with exclude enabled will be filtered out instead of added

Used as response type in: registry.RegistryServer.GetStreamFeatureView

Used as field type in: Registry, registry.AnyFeatureView, registry.ApplyFeatureViewRequest, registry.ListStreamFeatureViewsResponse

• optional StreamFeatureViewSpec spec = 1

  User-specified specifications of this feature view.

• optional FeatureViewMeta meta = 2

Next available id: 17

Used in: StreamFeatureView

• string name = 1

  Name of the feature view. Must be unique. Not updated.

• string project = 2

  Name of Feast project that this feature view belongs to.

• repeated string entities = 3

  List of names of entities associated with this feature view.

• repeated FeatureSpecV2 features = 4

  List of specifications for each feature defined as part of this feature view.

• repeated FeatureSpecV2 entity_columns = 5

  List of specifications for each entity defined as part of this feature view.

• string description = 6

  Description of the feature view.

• map<string, string> tags = 7

  User defined metadata

• string owner = 8

  Owner of the feature view.

• optional google.protobuf.Duration ttl = 9

  Features in this feature view can only be retrieved from online serving younger than ttl. Ttl is measured as the duration of time between the feature's event timestamp and when the feature is retrieved Feature values outside ttl will be returned as unset values and indicated to end user

• optional DataSource batch_source = 10

  Batch/Offline DataSource where this view can retrieve offline feature data.

• optional DataSource stream_source = 11

  Streaming DataSource from where this view can consume "online" feature data.

• bool online = 12

  Whether these features should be served online or not

• optional UserDefinedFunction user_defined_function = 13

  Serialized function that is encoded in the streamfeatureview

• string mode = 14

  Mode of execution

• repeated Aggregation aggregations = 15

  Aggregation definitions

• string timestamp_field = 16

  Timestamp field for aggregation

• optional FeatureTransformationV2 feature_transformation = 17

  Oneof with {user_defined_function, on_demand_substrait_transformation}

Defines the data format encoding features/entity data in data streams

Used in: DataSource.KafkaOptions, DataSource.KinesisOptions

• oneof format

  Specifies the data format and format specific options

  • StreamFormat.AvroFormat avro_format = 1

  • StreamFormat.ProtoFormat proto_format = 2

  • StreamFormat.JsonFormat json_format = 3

Defines options for the avro data format

Used in: StreamFormat

• string schema_json = 1

  Optional if used in a File DataSource as schema is embedded in avro file. Specifies the schema of the Avro message as JSON string.

Used in: StreamFormat

• string schema_json = 1

Defines options for the protobuf data format

Used in: StreamFormat

• string class_path = 1

  Classpath to the generated Java Protobuf class that can be used to decode Feature data from the obtained stream message

Used in: FeatureTransformationV2

• bytes substrait_plan = 1

• bytes ibis_function = 2

Serialized representation of python function.

Used in: OnDemandFeatureViewSpec, StreamFeatureViewSpec

• string name = 1

  The function name

• bytes body = 2

  The python-syntax function body (serialized by dill)

• string body_text = 3

  The string representation of the udf

Serialized representation of python function.

Used in: FeatureTransformationV2

• string name = 1

  The function name

• bytes body = 2

  The python-syntax function body (serialized by dill)

• string body_text = 3

  The string representation of the udf

Used as response type in: registry.RegistryServer.GetValidationReference

Used as field type in: Registry, registry.ApplyValidationReferenceRequest, registry.ListValidationReferencesResponse

• string name = 1

  Unique name of validation reference within the project

• string reference_dataset_name = 2

  Name of saved dataset used as reference dataset

• string project = 3

  Name of Feast project that this object source belongs to

• string description = 4

  Description of the validation reference

• map<string, string> tags = 5

  User defined metadata

• oneof profiler

  validation profiler

  • GEValidationProfiler ge_profiler = 6

• oneof cached_profile

  (optional) cached validation profile (to avoid constant recalculation)

  • GEValidationProfile ge_profile = 7