Glue
25 resource kinds. Generated from the operator's CRD schemas.
aws.konfig.io/v1alpha1
GlueBlueprint # CLOUD CONTROL · AWS::Glue::Blueprint
GlueBlueprint manages AWS::Glue::Blueprint through the AWS Cloud Control API.
kubectl get glueblueprints · example on GitHub
Example
# GlueBlueprint — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#glueblueprint
apiVersion: aws.konfig.io/v1alpha1
kind: GlueBlueprint
metadata:
name: example-glueblueprint
namespace: default
spec:
blueprintLocation: example
description: Managed by konfig-konector
name: example-glueblueprint
providerRef:
name: example-glueblueprint
region: us-east-1
tags:
- key: example
value: example
Spec
| Field | Type | Required | Description |
|---|---|---|---|
blueprintLocation | string | yes | Specifies a path in Amazon S3 where the blueprint is published. |
description | string | — | A description of the blueprint. |
name | string | yes | The name of the blueprint. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
tags | array<object> | — | The tags to be applied to this blueprint. |
tags[].key | string | yes | |
tags[].value | string | yes |
Status
| Field | Type | Required | Description |
|---|---|---|---|
arn | string | — | The Amazon Resource Name (ARN) of the blueprint. |
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
createdOn | string | — | The date and time the blueprint was registered. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastModifiedOn | string | — | The date and time the blueprint was last modified. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
parameterSpec | string | — | A JSON string that indicates the list of parameter specifications for the blueprint. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
status | enum | — | The status of the blueprint registration. Allowed: CREATING, ACTIVE, UPDATING, FAILED |
GlueCatalog # CLOUD CONTROL · AWS::Glue::Catalog
GlueCatalog manages AWS::Glue::Catalog through the AWS Cloud Control API.
kubectl get gluecatalogs · example on GitHub
Example
# GlueCatalog — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#gluecatalog
apiVersion: aws.konfig.io/v1alpha1
kind: GlueCatalog
metadata:
name: example-gluecatalog
namespace: default
spec:
allowFullTableExternalDataAccess: 'True'
catalogProperties:
customProperties:
key: value
dataLakeAccessProperties:
allowFullTableExternalDataAccess: 'True'
catalogType: example
dataLakeAccess: false
dataTransferRole: example
kmsKey: example
managedWorkgroupName: example-gluecatalog
managedWorkgroupStatus: example
redshiftDatabaseName: example-gluecatalog
createDatabaseDefaultPermissions:
- permissions:
- example
principal:
dataLakePrincipalIdentifier: example
createTableDefaultPermissions:
- permissions:
- example
principal:
dataLakePrincipalIdentifier: example
description: Managed by konfig-konector
federatedCatalog:
connectionName: example-gluecatalog
identifier: example
name: example-gluecatalog
overwriteChildResourcePermissionsWithDefault: Accept
parameters:
key: value
providerRef:
name: example-gluecatalog
region: us-east-1
tags:
- key: example
value: example
targetRedshiftCatalog:
catalogArn: arn:aws:iam::123456789012:role/example-role
Spec
| Field | Type | Required | Description |
|---|---|---|---|
allowFullTableExternalDataAccess | enum | — | Allows third-party engines to access data in Amazon S3 locations that are registered with Lake Formation. Allowed: True, False |
catalogProperties | object | — | GlueCatalogCatalogProperties is a nested property type of AWS::Glue::Catalog. |
catalogProperties.customProperties | map<string> | — | Additional key-value properties for the catalog. |
catalogProperties.dataLakeAccessProperties | object | — | GlueCatalogDataLakeAccessProperties is a nested property type of AWS::Glue::Catalog. |
catalogProperties.dataLakeAccessProperties.allowFullTableExternalDataAccess | enum | — | Allows third-party engines to access data in Amazon S3 locations that are registered with Lake Formation. Allowed: True, False |
catalogProperties.dataLakeAccessProperties.catalogType | string | — | Specifies a federated catalog type for the native catalog resource. |
catalogProperties.dataLakeAccessProperties.dataLakeAccess | boolean | — | Turns on or off data lake access for Apache Spark applications that access Amazon Redshift databases in the Data Catalog from any non-Redshift engine. |
catalogProperties.dataLakeAccessProperties.dataTransferRole | string | — | A role that will be assumed by Glue for transferring data into/out of the staging bucket during a query. |
catalogProperties.dataLakeAccessProperties.kmsKey | string | — | An encryption key that will be used for the staging bucket that will be created along with the catalog. |
catalogProperties.dataLakeAccessProperties.managedWorkgroupName | string | — | The name of the managed workgroup associated with the catalog. |
catalogProperties.dataLakeAccessProperties.managedWorkgroupStatus | string | — | The status of the managed workgroup. |
catalogProperties.dataLakeAccessProperties.redshiftDatabaseName | string | — | The name of the Redshift database. |
createDatabaseDefaultPermissions | array<object> | — | An array of PrincipalPermissions objects for default database permissions. |
createDatabaseDefaultPermissions[].permissions | array<string> | — | The permissions that are granted to the principal. |
createDatabaseDefaultPermissions[].principal | object | — | GlueCatalogDataLakePrincipal is a nested property type of AWS::Glue::Catalog. |
createDatabaseDefaultPermissions[].principal.dataLakePrincipalIdentifier | string | — | An identifier for the Lake Formation principal. |
createTableDefaultPermissions | array<object> | — | An array of PrincipalPermissions objects for default table permissions. |
createTableDefaultPermissions[].permissions | array<string> | — | The permissions that are granted to the principal. |
createTableDefaultPermissions[].principal | object | — | GlueCatalogDataLakePrincipal is a nested property type of AWS::Glue::Catalog. |
createTableDefaultPermissions[].principal.dataLakePrincipalIdentifier | string | — | An identifier for the Lake Formation principal. |
description | string | — | A description of the catalog. |
federatedCatalog | object | — | GlueCatalogFederatedCatalog is a nested property type of AWS::Glue::Catalog. |
federatedCatalog.connectionName | string | — | The name of the connection to an external data source. |
federatedCatalog.identifier | string | — | A unique identifier for the federated catalog. |
name | string | yes | The name of the catalog to create. |
overwriteChildResourcePermissionsWithDefault | enum | — | Specifies whether to overwrite child resource permissions with the default permissions. Allowed: Accept, Deny |
parameters | map<string> | — | A map of key-value pairs that define parameters and properties of the catalog. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
tags | array<object> | — | An array of key-value pairs to apply to this resource. |
tags[].key | string | yes | |
tags[].value | string | yes | |
targetRedshiftCatalog | object | — | GlueCatalogTargetRedshiftCatalog is a nested property type of AWS::Glue::Catalog. |
targetRedshiftCatalog.catalogArn | string | yes | The Amazon Resource Name (ARN) of the catalog resource. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
catalogId | string | — | The ID of the catalog. |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
createTime | integer | — | The time at which the catalog was created. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
resourceArn | string | — | The Amazon Resource Name (ARN) of the catalog. |
updateTime | integer | — | The time at which the catalog was last updated. |
GlueClassifier # CLOUD CONTROL · AWS::Glue::Classifier
GlueClassifier manages AWS::Glue::Classifier through the AWS Cloud Control API.
kubectl get glueclassifiers · example on GitHub
Example
# GlueClassifier — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#glueclassifier
apiVersion: aws.konfig.io/v1alpha1
kind: GlueClassifier
metadata:
name: example-glueclassifier
namespace: default
spec:
csvClassifier:
allowSingleColumn: false
containsCustomDatatype:
- example
containsHeader: example
customDatatypeConfigured: false
delimiter: example
disableValueTrimming: false
header:
- example
name: example-glueclassifier
quoteSymbol: example
grokClassifier:
classification: example
customPatterns: example
grokPattern: example
name: example-glueclassifier
jsonClassifier:
jsonPath: example
name: example-glueclassifier
providerRef:
name: example-glueclassifier
region: us-east-1
xmlClassifier:
classification: example
name: example-glueclassifier
rowTag: example
Spec
| Field | Type | Required | Description |
|---|---|---|---|
csvClassifier | object | — | A classifier for comma-separated values (CSV). |
csvClassifier.allowSingleColumn | boolean | — | Enables the processing of files that contain only one column. |
csvClassifier.containsCustomDatatype | array<string> | — | Indicates whether the CSV file contains custom data types. |
csvClassifier.containsHeader | string | — | Indicates whether the CSV file contains a header. |
csvClassifier.customDatatypeConfigured | boolean | — | Enables the configuration of custom data types. |
csvClassifier.delimiter | string | — | A custom symbol to denote what separates each column entry in the row. |
csvClassifier.disableValueTrimming | boolean | — | Specifies not to trim values before identifying the type of column values. |
csvClassifier.header | array<string> | — | A list of strings representing column names. |
csvClassifier.name | string | — | The name of the classifier. |
csvClassifier.quoteSymbol | string | — | A custom symbol to denote what combines content into a single column value. |
grokClassifier | object | — | A classifier that uses grok. |
grokClassifier.classification | string | yes | An identifier of the data format that the classifier matches, such as Twitter, JSON, Omniture logs, and so on. |
grokClassifier.customPatterns | string | — | Optional custom grok patterns defined by this classifier. |
grokClassifier.grokPattern | string | yes | The grok pattern applied to a data store by this classifier. |
grokClassifier.name | string | — | The name of the classifier. |
jsonClassifier | object | — | A classifier for JSON content. |
jsonClassifier.jsonPath | string | yes | A JsonPath string defining the JSON data for the classifier to classify. |
jsonClassifier.name | string | — | The name of the classifier. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
xmlClassifier | object | — | A classifier for XML content. |
xmlClassifier.classification | string | yes | An identifier of the data format that the classifier matches. |
xmlClassifier.name | string | — | The name of the classifier. |
xmlClassifier.rowTag | string | yes | The XML tag designating the element that contains each record in an XML document being parsed. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
name | string | — | One of XMLClassifier/Name, GrokClassifier/Name, JsonClassifier/Name or CsvClassifier/Name Read-only: reported by AWS after creation. |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
GlueConnection # GA
GlueConnection is the Schema for managing Glue connections.
kubectl get glueconnections · example on GitHub
Example
# GlueConnection — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#glueconnection
apiVersion: aws.konfig.io/v1alpha1
kind: GlueConnection
metadata:
name: example-glueconnection
namespace: default
spec:
connectionProperties:
key: value
connectionType: JDBC
description: Managed by konfig-konector
name: example-glueconnection
passwordSecretRef:
key: example
name: example-glueconnection
physicalConnectionRequirements:
availabilityZone: us-east-1a
securityGroupRefs:
- name: example-securitygrouprefs
subnetRef:
name: example-subnet
providerRef:
name: example-glueconnection
region: us-east-1
tags:
environment: dev
team: platform
Spec
| Field | Type | Required | Description |
|---|---|---|---|
connectionProperties | map<string> | — | ConnectionProperties are key-value pairs for the connection (HOST, PORT, USERNAME, JDBC_CONNECTION_URL, ...). |
connectionType | enum | yes | ConnectionType is the type of connection. Allowed: JDBC, KAFKA, MONGODB, NETWORK, MARKETPLACE, CUSTOM |
description | string | — | Description is a description of the connection. |
name | string | yes | Name is the name of the connection. |
passwordSecretRef | object | — | PasswordSecretRef references a Kubernetes Secret holding the value of the PASSWORD connection property. |
passwordSecretRef.key | string | yes | Key is the key within the Secret whose value to use. |
passwordSecretRef.name | string | yes | Name of the Kubernetes Secret. |
physicalConnectionRequirements | object | — | PhysicalConnectionRequirements specifies VPC placement for the connection. |
physicalConnectionRequirements.availabilityZone | string | — | AvailabilityZone is the connection's Availability Zone. |
physicalConnectionRequirements.securityGroupRefs | array<object> | — | SecurityGroupRefs reference the security groups the connection uses. |
physicalConnectionRequirements.securityGroupRefs[].id | string | — | ID is a direct AWS Security Group ID (e.g. |
physicalConnectionRequirements.securityGroupRefs[].name | string | — | Name of a SecurityGroup CR in the same namespace. |
physicalConnectionRequirements.subnetRef | object | — | SubnetRef references the subnet the connection uses. |
physicalConnectionRequirements.subnetRef.id | string | — | ID is a direct AWS Subnet ID (e.g. |
physicalConnectionRequirements.subnetRef.name | string | — | Name of a Subnet CR in the same namespace. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
tags | map<string> | — | Tags are AWS resource tags to apply at creation. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
connectionName | string | — | ConnectionName is the name of the connection in AWS. |
lastSyncTime | string | — | LastSyncTime is when the resource was last successfully reconciled. |
observedGeneration | integer | — | ObservedGeneration is the most recent .metadata.generation reconciled. |
GlueCrawler # GA
GlueCrawler is the Schema for managing Glue crawlers.
kubectl get gluecrawlers · example on GitHub
Example
# GlueCrawler — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#gluecrawler
apiVersion: aws.konfig.io/v1alpha1
kind: GlueCrawler
metadata:
name: example-gluecrawler
namespace: default
spec:
configuration: example
databaseName: example-gluecrawler
databaseRef: example
description: Managed by konfig-konector
name: example-gluecrawler
providerRef:
name: example-gluecrawler
region: us-east-1
roleRef:
name: example-role
schedule: example
schemaChangePolicy:
deleteBehavior: LOG
updateBehavior: LOG
tablePrefix: example
tags:
environment: dev
team: platform
targets:
jdbcTargets:
- connectionName: example-gluecrawler
exclusions:
- example
path: example
s3Targets:
- exclusions:
- example
path: example
Spec
| Field | Type | Required | Description |
|---|---|---|---|
configuration | string | — | Configuration is a versioned JSON configuration string for the crawler. |
databaseName | string | — | DatabaseName is the Glue database where crawl results are written. |
databaseRef | string | — | DatabaseRef is the name of a GlueDatabase CR in the same namespace. |
description | string | — | Description is a description of the crawler. |
name | string | yes | Name is the name of the crawler. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
roleRef | object | yes | RoleRef references the IAM role the crawler uses to access resources (either a managed IAMRole CR or a direct ARN). |
roleRef.arn | string | — | ARN is a direct AWS IAM role ARN. |
roleRef.name | string | — | Name of an IAMRole CR in the same namespace. |
roleRef.namespace | string | — | Namespace of the IAMRole CR. |
schedule | string | — | Schedule is a cron expression, e.g. |
schemaChangePolicy | object | — | SchemaChangePolicy sets the crawler's update and deletion behavior. |
schemaChangePolicy.deleteBehavior | enum | — | DeleteBehavior is the behavior when the crawler finds a deleted object. Allowed: LOG, DELETE_FROM_DATABASE, DEPRECATE_IN_DATABASE |
schemaChangePolicy.updateBehavior | enum | — | UpdateBehavior is the behavior when the crawler finds a changed schema. Allowed: LOG, UPDATE_IN_DATABASE |
tablePrefix | string | — | TablePrefix is the prefix for catalog tables the crawler creates. |
tags | map<string> | — | Tags are AWS resource tags to apply at creation. |
targets | object | yes | Targets is the collection of data stores to crawl. |
targets.jdbcTargets | array<object> | — | JDBCTargets specifies JDBC targets. |
targets.jdbcTargets[].connectionName | string | yes | ConnectionName is the name of the Glue connection to use. |
targets.jdbcTargets[].exclusions | array<string> | — | Exclusions is a list of glob patterns to exclude from the crawl. |
targets.jdbcTargets[].path | string | — | Path is the path of the JDBC target. |
targets.s3Targets | array<object> | — | S3Targets specifies Amazon S3 targets. |
targets.s3Targets[].exclusions | array<string> | — | Exclusions is a list of glob patterns to exclude from the crawl. |
targets.s3Targets[].path | string | yes | Path is the path to the Amazon S3 target (e.g. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
crawlerName | string | — | CrawlerName is the name of the crawler in AWS. |
lastSyncTime | string | — | LastSyncTime is when the resource was last successfully reconciled. |
observedGeneration | integer | — | ObservedGeneration is the most recent .metadata.generation reconciled. |
GlueCustomEntityType # CLOUD CONTROL · AWS::Glue::CustomEntityType
GlueCustomEntityType manages AWS::Glue::CustomEntityType through the AWS Cloud Control API.
kubectl get gluecustomentitytypes · example on GitHub
Example
# GlueCustomEntityType — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#gluecustomentitytype
apiVersion: aws.konfig.io/v1alpha1
kind: GlueCustomEntityType
metadata:
name: example-gluecustomentitytype
namespace: default
spec:
contextWords:
- example
name: example-gluecustomentitytype
providerRef:
name: example-gluecustomentitytype
region: us-east-1
regexString: example
Spec
| Field | Type | Required | Description |
|---|---|---|---|
contextWords | array<string> | — | A list of context words. |
name | string | — | The name of the custom entity type. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
regexString | string | — | A regular expression string that is used for detecting sensitive data in a custom pattern. |
tags | object | — | Tags to associate with the custom entity type. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
GlueDataCatalogEncryptionSettings # CLOUD CONTROL · AWS::Glue::DataCatalogEncryptionSettings ⚠ DESTRUCTIVE SCOPE
Caution, destructive scope: account-wide Glue Data Catalog encryption settings. Provided for completeness; do not use from application namespaces. Restrict with AWSProvider.allowedNamespaces and RBAC. GlueDataCatalogEncryptionSettings manages AWS::Glue::DataCatalogEncryptionSettings through the AWS Cloud Control API.
kubectl get gluedatacatalogencryptionsettings · example on GitHub
Example
# GlueDataCatalogEncryptionSettings — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#gluedatacatalogencryptionsettings
apiVersion: aws.konfig.io/v1alpha1
kind: GlueDataCatalogEncryptionSettings
metadata:
name: example-gluedatacatalogencryptionsettings
namespace: default
spec:
catalogId: example-id
dataCatalogEncryptionSettings:
connectionPasswordEncryption:
kmsKeyId: arn:aws:kms:us-east-1:123456789012:key/1234abcd-12ab-34cd-56ef-1234567890ab
returnConnectionPasswordEncrypted: true
encryptionAtRest:
catalogEncryptionMode: example
catalogEncryptionServiceRole: example
sseAwsKmsKeyId: arn:aws:kms:us-east-1:123456789012:key/1234abcd-12ab-34cd-56ef-1234567890ab
providerRef:
name: example-gluedatacatalogencryptionsettings
region: us-east-1
Spec
| Field | Type | Required | Description |
|---|---|---|---|
catalogId | string | yes | The ID of the Data Catalog in which the settings are created. |
dataCatalogEncryptionSettings | object | yes | GlueDataCatalogEncryptionSettingsDataCatalogEncryptionSettings is a nested property type of AWS::Glue::DataCatalogEncryptionSettings. |
dataCatalogEncryptionSettings.connectionPasswordEncryption | object | — | GlueDataCatalogEncryptionSettingsConnectionPasswordEncryption is a nested property type of AWS::Glue::DataCatalogEncryptionSettings. |
dataCatalogEncryptionSettings.connectionPasswordEncryption.kmsKeyId | string | — | An AWS KMS key that is used to encrypt the connection password. |
dataCatalogEncryptionSettings.connectionPasswordEncryption.returnConnectionPasswordEncrypted | boolean | — | When the ReturnConnectionPasswordEncrypted flag is set to 'true', passwords remain encrypted in the responses of GetConnection and GetConnections. |
dataCatalogEncryptionSettings.encryptionAtRest | object | — | GlueDataCatalogEncryptionSettingsEncryptionAtRest is a nested property type of AWS::Glue::DataCatalogEncryptionSettings. |
dataCatalogEncryptionSettings.encryptionAtRest.catalogEncryptionMode | string | — | The encryption-at-rest mode for encrypting Data Catalog data. |
dataCatalogEncryptionSettings.encryptionAtRest.catalogEncryptionServiceRole | string | — | The role that AWS Glue assumes to encrypt and decrypt the Data Catalog objects on the caller's behalf. |
dataCatalogEncryptionSettings.encryptionAtRest.sseAwsKmsKeyId | string | — | The ID of the AWS KMS key to use for encryption at rest. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
GlueDataQualityRuleset # CLOUD CONTROL · AWS::Glue::DataQualityRuleset
GlueDataQualityRuleset manages AWS::Glue::DataQualityRuleset through the AWS Cloud Control API.
kubectl get gluedataqualityrulesets · example on GitHub
Example
# GlueDataQualityRuleset — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#gluedataqualityruleset
apiVersion: aws.konfig.io/v1alpha1
kind: GlueDataQualityRuleset
metadata:
name: example-gluedataqualityruleset
namespace: default
spec:
clientToken: example
description: Managed by konfig-konector
name: example-gluedataqualityruleset
providerRef:
name: example-gluedataqualityruleset
region: us-east-1
ruleset: example
tags:
environment: dev
team: platform
targetTable:
databaseName: example-gluedataqualityruleset
tableName: example-gluedataqualityruleset
Spec
| Field | Type | Required | Description |
|---|---|---|---|
clientToken | string | — | A unique token for idempotency. |
description | string | — | A description of the data quality ruleset. |
name | string | yes | A unique name for the data quality ruleset. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
ruleset | string | — | A Data Quality Definition Language (DQDL) ruleset. |
tags | map<string> | — | A map of key-value pairs to apply to this resource. |
targetTable | object | — | An object representing an AWS Glue table. |
targetTable.databaseName | string | yes | The name of the database where the AWS Glue table exists. |
targetTable.tableName | string | yes | The name of the AWS Glue table. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
GlueDatabase # GA
GlueDatabase is the Schema for managing Glue Data Catalog databases.
kubectl get gluedatabases · example on GitHub
Example
# GlueDatabase — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#gluedatabase
apiVersion: aws.konfig.io/v1alpha1
kind: GlueDatabase
metadata:
name: example-gluedatabase
namespace: default
spec:
description: Managed by konfig-konector
locationUri: example
name: example-gluedatabase
parameters:
key: value
providerRef:
name: example-gluedatabase
region: us-east-1
tags:
environment: dev
team: platform
Spec
| Field | Type | Required | Description |
|---|---|---|---|
description | string | — | Description is a description of the database. |
locationUri | string | — | LocationURI is the location of the database (for example, an S3 path). |
name | string | yes | Name is the name of the database. |
parameters | map<string> | — | Parameters are key-value pairs that define properties of the database. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
tags | map<string> | — | Tags are AWS resource tags to apply at creation. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
databaseName | string | — | DatabaseName is the name of the database in the Glue Data Catalog. |
lastSyncTime | string | — | LastSyncTime is when the resource was last successfully reconciled. |
observedGeneration | integer | — | ObservedGeneration is the most recent .metadata.generation reconciled. |
GlueIdentityCenterConfiguration # CLOUD CONTROL · AWS::Glue::IdentityCenterConfiguration
GlueIdentityCenterConfiguration manages AWS::Glue::IdentityCenterConfiguration through the AWS Cloud Control API.
kubectl get glueidentitycenterconfigurations · example on GitHub
Example
# GlueIdentityCenterConfiguration — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#glueidentitycenterconfiguration
apiVersion: aws.konfig.io/v1alpha1
kind: GlueIdentityCenterConfiguration
metadata:
name: example-glueidentitycenterconfiguration
namespace: default
spec:
instanceArn: arn:aws:iam::123456789012:role/example-role
providerRef:
name: example-glueidentitycenterconfiguration
region: us-east-1
scopes:
- example
userBackgroundSessionsEnabled: true
Spec
| Field | Type | Required | Description |
|---|---|---|---|
instanceArn | string | yes | The IAM identity center instance arn Create-only in AWS: changing it requires replacing the resource. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
scopes | array<string> | — | The downstream scopes that Glue identity center configuration can access |
userBackgroundSessionsEnabled | boolean | — | Enable or disable user background sessions for Glue Identity Center |
Status
| Field | Type | Required | Description |
|---|---|---|---|
accountId | string | — | The identifier for the specified AWS account. |
applicationArn | string | — | The Glue IAM identity center application arn Read-only: reported by AWS after creation. |
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
GlueIntegration # CLOUD CONTROL · AWS::Glue::Integration
GlueIntegration manages AWS::Glue::Integration through the AWS Cloud Control API.
kubectl get glueintegrations · example on GitHub
Example
# GlueIntegration — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#glueintegration
apiVersion: aws.konfig.io/v1alpha1
kind: GlueIntegration
metadata:
name: example-glueintegration
namespace: default
spec:
additionalEncryptionContext:
key: value
dataFilter: example
description: Managed by konfig-konector
integrationConfig:
continuousSync: false
refreshInterval: example
sourceProperties:
key: value
integrationName: example-glueintegration
kmsKeyId: arn:aws:kms:us-east-1:123456789012:key/1234abcd-12ab-34cd-56ef-1234567890ab
providerRef:
name: example-glueintegration
region: us-east-1
sourceArn: arn:aws:iam::123456789012:role/example-role
tags:
- key: example
value: example
targetArn: arn:aws:iam::123456789012:role/example-role
Spec
| Field | Type | Required | Description |
|---|---|---|---|
additionalEncryptionContext | map<string> | — | Create-only in AWS: changing it requires replacing the resource. |
dataFilter | string | — | |
description | string | — | |
integrationConfig | object | — | Create-only in AWS: changing it requires replacing the resource. |
integrationConfig.continuousSync | boolean | — | Enables continuous synchronization for on-demand data extractions. |
integrationConfig.refreshInterval | string | — | Specifies the frequency at which CDC (Change Data Capture) pulls or incremental loads should occur. |
integrationConfig.sourceProperties | map<string> | — | |
integrationName | string | yes | The name of the integration. |
kmsKeyId | string | — | An KMS key identifier for the key to use to encrypt the integration. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
sourceArn | string | yes | The Amazon Resource Name (ARN) of the database to use as the source for replication Create-only in AWS: changing it requires replacing the resource. |
tags | array<object> | — | An array of key-value pairs to apply to this resource. |
tags[].key | string | yes | |
tags[].value | string | yes | |
targetArn | string | yes | The Amazon Resource Name (ARN) of the Glue data warehouse to use as the target for replication Create-only in AWS: changing it requires replacing the resource. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
createTime | string | — | The time (UTC) when the integration was created. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
integrationArn | string | — | The Amazon Resource Name (ARN) of the integration. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
status | string | — | The status of the integration. |
GlueIntegrationResourceProperty # CLOUD CONTROL · AWS::Glue::IntegrationResourceProperty
GlueIntegrationResourceProperty manages AWS::Glue::IntegrationResourceProperty through the AWS Cloud Control API.
kubectl get glueintegrationresourceproperties · example on GitHub
Example
# GlueIntegrationResourceProperty — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#glueintegrationresourceproperty
apiVersion: aws.konfig.io/v1alpha1
kind: GlueIntegrationResourceProperty
metadata:
name: example-glueintegrationresourceproperty
namespace: default
spec:
providerRef:
name: example-glueintegrationresourceproperty
region: us-east-1
resourceArn: arn:aws:iam::123456789012:role/example-role
sourceProcessingProperties:
roleArn: arn:aws:iam::123456789012:role/example-role
tags:
- key: example
value: example
targetProcessingProperties:
connectionName: example-glueintegrationresourceproperty
eventBusArn: arn:aws:iam::123456789012:role/example-role
kmsArn: arn:aws:iam::123456789012:role/example-role
roleArn: arn:aws:iam::123456789012:role/example-role
Spec
| Field | Type | Required | Description |
|---|---|---|---|
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
resourceArn | string | yes | The connection ARN of the source, or the database ARN of the target. |
sourceProcessingProperties | object | — | The resource properties associated with the integration source. |
sourceProcessingProperties.roleArn | string | yes | The IAM role to access the Glue connection. |
tags | array<object> | — | An array of key-value pairs to apply to this resource. |
tags[].key | string | yes | |
tags[].value | string | yes | |
targetProcessingProperties | object | — | The resource properties associated with the integration target. |
targetProcessingProperties.connectionName | string | — | The Glue network connection to configure the Glue job running in the customer VPC. |
targetProcessingProperties.eventBusArn | string | — | The ARN of an Eventbridge event bus to receive the integration status notification. |
targetProcessingProperties.kmsArn | string | — | The ARN of the KMS key used for encryption. |
targetProcessingProperties.roleArn | string | yes | The IAM role to access the Glue database. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
resourcePropertyArn | string | — | The integration resource property ARN. |
GlueJob # GA
GlueJob is the Schema for managing Glue jobs.
kubectl get gluejobs · example on GitHub
Example
# GlueJob — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#gluejob
apiVersion: aws.konfig.io/v1alpha1
kind: GlueJob
metadata:
name: example-gluejob
namespace: default
spec:
command:
name: example-gluejob
pythonVersion: '1.0'
scriptLocation: example
defaultArguments:
key: value
description: Managed by konfig-konector
glueVersion: '1.0'
maxRetries: 1
name: example-gluejob
numberOfWorkers: 1
providerRef:
name: example-gluejob
region: us-east-1
roleRef:
name: example-role
tags:
environment: dev
team: platform
timeout: 1
workerType: Standard
Spec
| Field | Type | Required | Description |
|---|---|---|---|
command | object | yes | Command specifies the code the job runs. |
command.name | string | yes | Name is the job command name: glueetl for Spark ETL, pythonshell for Python shell, gluestreaming for streaming ETL. |
command.pythonVersion | string | — | PythonVersion is the Python version for pythonshell jobs (2 or 3). |
command.scriptLocation | string | yes | ScriptLocation is the S3 path of the script that runs the job. |
defaultArguments | map<string> | — | DefaultArguments are default arguments for job runs. |
description | string | — | Description is a description of the job. |
glueVersion | string | — | GlueVersion determines the Glue runtime versions (e.g. |
maxRetries | integer | — | MaxRetries is the maximum number of retries for a failing job run. |
name | string | yes | Name is the name of the job. |
numberOfWorkers | integer | — | NumberOfWorkers is the number of workers allocated when the job runs. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
roleRef | object | yes | RoleRef references the IAM role the job uses (either a managed IAMRole CR or a direct ARN). |
roleRef.arn | string | — | ARN is a direct AWS IAM role ARN. |
roleRef.name | string | — | Name of an IAMRole CR in the same namespace. |
roleRef.namespace | string | — | Namespace of the IAMRole CR. |
tags | map<string> | — | Tags are AWS resource tags to apply at creation. |
timeout | integer | — | Timeout is the job run timeout in minutes. |
workerType | enum | — | WorkerType is the type of predefined worker allocated when the job runs. Allowed: Standard, G.1X, G.2X, G.025X, G.4X, G.8X, Z.2X |
Status
| Field | Type | Required | Description |
|---|---|---|---|
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
jobName | string | — | JobName is the name of the job in AWS. |
lastSyncTime | string | — | LastSyncTime is when the resource was last successfully reconciled. |
observedGeneration | integer | — | ObservedGeneration is the most recent .metadata.generation reconciled. |
GlueMLTransform # CLOUD CONTROL · AWS::Glue::MLTransform
GlueMLTransform manages AWS::Glue::MLTransform through the AWS Cloud Control API.
kubectl get gluemltransforms · example on GitHub
Example
# GlueMLTransform — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#gluemltransform
apiVersion: aws.konfig.io/v1alpha1
kind: GlueMLTransform
metadata:
name: example-gluemltransform
namespace: default
spec:
description: Managed by konfig-konector
glueVersion: '1.0'
inputRecordTables:
glueTables:
- connectionName: example-gluemltransform
databaseName: example-gluemltransform
tableName: example-gluemltransform
maxCapacity: 2
maxRetries: 1
name: example-gluemltransform
numberOfWorkers: 1
providerRef:
name: example-gluemltransform
region: us-east-1
role: example
tags:
environment: dev
team: platform
timeout: 300
transformEncryption:
mlUserDataEncryption:
kmsKeyId: arn:aws:kms:us-east-1:123456789012:key/1234abcd-12ab-34cd-56ef-1234567890ab
mlUserDataEncryptionMode: example
taskRunSecurityConfigurationName: example-gluemltransform
transformParameters:
findMatchesParameters:
accuracyCostTradeoff: 1
enforceProvidedLabels: false
precisionRecallTradeoff: 1
primaryKeyColumnName: example-gluemltransform
transformType: example
workerType: example
Spec
| Field | Type | Required | Description |
|---|---|---|---|
description | string | — | A user-defined, long-form description text for the machine learning transform. |
glueVersion | string | — | The version of AWS Glue this machine learning transform is compatible with. |
inputRecordTables | object | yes | A list of AWS Glue table definitions used by the transform. |
inputRecordTables.glueTables | array<object> | — | The database and table in the AWS Glue Data Catalog that is used for input or output data. |
inputRecordTables.glueTables[].catalogId | string | — | A unique identifier for the AWS Glue Data Catalog. |
inputRecordTables.glueTables[].connectionName | string | — | The name of the connection to the AWS Glue Data Catalog. |
inputRecordTables.glueTables[].databaseName | string | yes | A database name in the AWS Glue Data Catalog. |
inputRecordTables.glueTables[].tableName | string | yes | A table name in the AWS Glue Data Catalog. |
maxCapacity | number | — | The number of AWS Glue DPUs allocated to task runs for this transform. |
maxRetries | integer | — | The maximum number of times to retry after an MLTaskRun fails. |
name | string | — | A user-defined name for the machine learning transform. |
numberOfWorkers | integer | — | The number of workers of a defined workerType that are allocated when a task runs. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
role | string | yes | The name or ARN of the IAM role with the required permissions. |
tags | map<string> | — | The tags to use with this machine learning transform. |
timeout | integer | — | The timeout in minutes of the machine learning transform. |
transformEncryption | object | — | The encryption-at-rest settings of the transform. |
transformEncryption.mlUserDataEncryption | object | — | GlueMLTransformMLUserDataEncryption is a nested property type of AWS::Glue::MLTransform. |
transformEncryption.mlUserDataEncryption.kmsKeyId | string | — | The ID for the customer-provided KMS key. |
transformEncryption.mlUserDataEncryption.mlUserDataEncryptionMode | string | yes | The encryption mode applied to user data. |
transformEncryption.taskRunSecurityConfigurationName | string | — | The name of the security configuration. |
transformParameters | object | yes | The algorithm-specific parameters that are associated with the machine learning transform. |
transformParameters.findMatchesParameters | object | — | GlueMLTransformFindMatchesParameters is a nested property type of AWS::Glue::MLTransform. |
transformParameters.findMatchesParameters.accuracyCostTradeoff | number | — | The value for accuracy and cost tradeoff. |
transformParameters.findMatchesParameters.enforceProvidedLabels | boolean | — | If true, forces the output to match the provided labels. |
transformParameters.findMatchesParameters.precisionRecallTradeoff | number | — | The value for precision and recall tradeoff. |
transformParameters.findMatchesParameters.primaryKeyColumnName | string | yes | The name of a column that uniquely identifies rows in the source table. |
transformParameters.transformType | string | yes | The type of machine learning transform. |
workerType | string | — | The type of predefined worker that is allocated when a task runs. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
transformId | string | — | The unique identifier for the transform. |
GlueRegistry # CLOUD CONTROL · AWS::Glue::Registry
GlueRegistry manages AWS::Glue::Registry through the AWS Cloud Control API.
kubectl get glueregistries · example on GitHub
Example
# GlueRegistry — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#glueregistry
apiVersion: aws.konfig.io/v1alpha1
kind: GlueRegistry
metadata:
name: example-glueregistry
namespace: default
spec:
description: Managed by konfig-konector
name: example-glueregistry
providerRef:
name: example-glueregistry
region: us-east-1
tags:
- key: example
value: example
Spec
| Field | Type | Required | Description |
|---|---|---|---|
description | string | — | A description of the registry. |
name | string | yes | Name of the registry to be created of max length of 255, and may only contain letters, numbers, hyphen, underscore, dollar sign, or hash mark. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
tags | array<object> | — | List of tags to tag the Registry |
tags[].key | string | yes | |
tags[].value | string | yes |
Status
| Field | Type | Required | Description |
|---|---|---|---|
arn | string | — | Amazon Resource Name for the created Registry. |
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
GlueSchema # CLOUD CONTROL · AWS::Glue::Schema
GlueSchema manages AWS::Glue::Schema through the AWS Cloud Control API.
kubectl get glueschemas · example on GitHub
Example
# GlueSchema — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#glueschema
apiVersion: aws.konfig.io/v1alpha1
kind: GlueSchema
metadata:
name: example-glueschema
namespace: default
spec:
checkpointVersion:
isLatest: false
versionNumber: 1
compatibility: NONE
dataFormat: AVRO
description: Managed by konfig-konector
name: example-glueschema
providerRef:
name: example-glueschema
region: us-east-1
registry:
name: example-registry
schemaDefinition: example
tags:
- key: example
value: example
Spec
| Field | Type | Required | Description |
|---|---|---|---|
checkpointVersion | object | — | GlueSchemaSchemaVersion is a nested property type of AWS::Glue::Schema. |
checkpointVersion.isLatest | boolean | — | Indicates if the latest version needs to be updated. |
checkpointVersion.versionNumber | integer | — | Indicates the version number in the schema to update. |
compatibility | enum | yes | Compatibility setting for the schema. Allowed: NONE, DISABLED, BACKWARD, BACKWARD_ALL, FORWARD, FORWARD_ALL, FULL, FULL_ALL |
dataFormat | enum | yes | Data format name to use for the schema. Allowed: AVRO, JSON, PROTOBUF |
description | string | — | A description of the schema. |
name | string | yes | Name of the schema. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
registry | object | — | Create-only in AWS: changing it requires replacing the resource. |
registry.arn | string | — | Amazon Resource Name for the Registry. |
registry.name | string | — | Name of the registry in which the schema will be created. |
schemaDefinition | string | — | Definition for the initial schema version in plain-text. |
tags | array<object> | — | List of tags to tag the schema |
tags[].key | string | yes | |
tags[].value | string | yes |
Status
| Field | Type | Required | Description |
|---|---|---|---|
arn | string | — | Amazon Resource Name for the Schema. |
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
initialSchemaVersionId | string | — | Represents the version ID associated with the initial schema version. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
GlueSchemaVersion # CLOUD CONTROL · AWS::Glue::SchemaVersion
GlueSchemaVersion manages AWS::Glue::SchemaVersion through the AWS Cloud Control API.
kubectl get glueschemaversions · example on GitHub
Example
# GlueSchemaVersion — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#glueschemaversion
apiVersion: aws.konfig.io/v1alpha1
kind: GlueSchemaVersion
metadata:
name: example-glueschemaversion
namespace: default
spec:
providerRef:
name: example-glueschemaversion
region: us-east-1
schema:
registryName: example-glueschemaversion
schemaArn: arn:aws:iam::123456789012:role/example-role
schemaName: example-glueschemaversion
schemaDefinition: example
Spec
| Field | Type | Required | Description |
|---|---|---|---|
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
schema | object | yes | Create-only in AWS: changing it requires replacing the resource. |
schema.registryName | string | — | Name of the registry to identify where the Schema is located. |
schema.schemaArn | string | — | Amazon Resource Name for the Schema. |
schema.schemaName | string | — | Name of the schema. |
schemaDefinition | string | yes | Complete definition of the schema in plain-text. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
versionId | string | — | Represents the version ID associated with the schema version. |
GlueSchemaVersionMetadata # CLOUD CONTROL · AWS::Glue::SchemaVersionMetadata
GlueSchemaVersionMetadata manages AWS::Glue::SchemaVersionMetadata through the AWS Cloud Control API.
kubectl get glueschemaversionmetadata · example on GitHub
Example
# GlueSchemaVersionMetadata — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#glueschemaversionmetadata
apiVersion: aws.konfig.io/v1alpha1
kind: GlueSchemaVersionMetadata
metadata:
name: example-glueschemaversionmetadata
namespace: default
spec:
key: example
providerRef:
name: example-glueschemaversionmetadata
region: us-east-1
schemaVersionId: example-id
value: example
Spec
| Field | Type | Required | Description |
|---|---|---|---|
key | string | yes | Metadata key Create-only in AWS: changing it requires replacing the resource. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
schemaVersionId | string | yes | Represents the version ID associated with the schema version. |
value | string | yes | Metadata value Create-only in AWS: changing it requires replacing the resource. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
GlueSecurityConfiguration # CLOUD CONTROL · AWS::Glue::SecurityConfiguration
GlueSecurityConfiguration manages AWS::Glue::SecurityConfiguration through the AWS Cloud Control API.
kubectl get gluesecurityconfigurations · example on GitHub
Example
# GlueSecurityConfiguration — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#gluesecurityconfiguration
apiVersion: aws.konfig.io/v1alpha1
kind: GlueSecurityConfiguration
metadata:
name: example-gluesecurityconfiguration
namespace: default
spec:
encryptionConfiguration:
cloudWatchEncryption:
cloudWatchEncryptionMode: example
kmsKeyArn: arn:aws:iam::123456789012:role/example-role
jobBookmarksEncryption:
jobBookmarksEncryptionMode: example
kmsKeyArn: arn:aws:iam::123456789012:role/example-role
s3Encryptions:
- kmsKeyArn: arn:aws:iam::123456789012:role/example-role
s3EncryptionMode: example
name: example-gluesecurityconfiguration
providerRef:
name: example-gluesecurityconfiguration
region: us-east-1
Spec
| Field | Type | Required | Description |
|---|---|---|---|
encryptionConfiguration | object | yes | GlueSecurityConfigurationEncryptionConfiguration is a nested property type of AWS::Glue::SecurityConfiguration. |
encryptionConfiguration.cloudWatchEncryption | object | — | GlueSecurityConfigurationCloudWatchEncryption is a nested property type of AWS::Glue::SecurityConfiguration. |
encryptionConfiguration.cloudWatchEncryption.cloudWatchEncryptionMode | string | — | |
encryptionConfiguration.cloudWatchEncryption.kmsKeyArn | string | — | |
encryptionConfiguration.jobBookmarksEncryption | object | — | GlueSecurityConfigurationJobBookmarksEncryption is a nested property type of AWS::Glue::SecurityConfiguration. |
encryptionConfiguration.jobBookmarksEncryption.jobBookmarksEncryptionMode | string | — | |
encryptionConfiguration.jobBookmarksEncryption.kmsKeyArn | string | — | |
encryptionConfiguration.s3Encryptions | array<object> | — | The encryption configuration for Amazon Simple Storage Service (Amazon S3) data. |
encryptionConfiguration.s3Encryptions[].kmsKeyArn | string | — | |
encryptionConfiguration.s3Encryptions[].s3EncryptionMode | string | — | |
name | string | yes | The name for the security configuration. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
GlueSession # CLOUD CONTROL · AWS::Glue::Session
GlueSession manages AWS::Glue::Session through the AWS Cloud Control API.
kubectl get gluesessions · example on GitHub
Example
# GlueSession — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#gluesession
apiVersion: aws.konfig.io/v1alpha1
kind: GlueSession
metadata:
name: example-gluesession
namespace: default
spec:
command:
name: example-gluesession
pythonVersion: '1.0'
connections:
connections:
- example
defaultArguments:
key: value
description: Managed by konfig-konector
glueVersion: '1.0'
id: example-id
idleTimeout: 300
maxCapacity: 2
numberOfWorkers: 1
providerRef:
name: example-gluesession
region: us-east-1
requestOrigin: example
role: example-xxxxxxxxxxxx
securityConfiguration: example
tags:
- key: example
value: example
timeout: 1
workerType: Standard
Spec
| Field | Type | Required | Description |
|---|---|---|---|
command | object | yes | Create-only in AWS: changing it requires replacing the resource. |
command.name | string | — | Specifies the name of the SessionCommand. |
command.pythonVersion | string | — | Specifies the Python version. |
connections | object | — | Create-only in AWS: changing it requires replacing the resource. |
connections.connections | array<string> | — | A list of connection names used by the session. |
defaultArguments | map<string> | — | A map array of key-value pairs. |
description | string | — | The description of the session. |
glueVersion | string | — | The Glue version determines the versions of Apache Spark and Python that Glue supports. |
id | string | yes | The ID of the session. |
idleTimeout | integer | — | The number of minutes when idle before session times out. |
maxCapacity | number | — | The number of Glue data processing units (DPUs) that can be allocated when the job runs. |
numberOfWorkers | integer | — | The number of workers of a defined WorkerType to use for the session. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
requestOrigin | string | — | The origin of the request. |
role | string | yes | The IAM Role ARN. |
securityConfiguration | string | — | The name of the SecurityConfiguration structure to be used with the session. |
tags | array<object> | — | The tags belonging to the session. |
tags[].key | string | yes | |
tags[].value | string | yes | |
timeout | integer | — | The number of minutes before session times out. |
workerType | enum | — | The type of predefined worker that is allocated when a session runs. Allowed: Standard, G.1X, G.2X, G.025X, G.4X, G.8X, Z.2X |
Status
| Field | Type | Required | Description |
|---|---|---|---|
arn | string | — | The Amazon Resource Name (ARN) of the session. |
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
createdOn | string | — | The time and date when the session was created. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
progress | number | — | The code execution progress of the session. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
status | enum | — | The session status. Allowed: PROVISIONING, READY, FAILED, TIMEOUT, STOPPING, STOPPED |
GlueTableOptimizer # CLOUD CONTROL · AWS::Glue::TableOptimizer
GlueTableOptimizer manages AWS::Glue::TableOptimizer through the AWS Cloud Control API.
kubectl get gluetableoptimizers · example on GitHub
Example
# GlueTableOptimizer — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#gluetableoptimizer
apiVersion: aws.konfig.io/v1alpha1
kind: GlueTableOptimizer
metadata:
name: example-gluetableoptimizer
namespace: default
spec:
catalogId: example-id
databaseName: example-gluetableoptimizer
providerRef:
name: example-gluetableoptimizer
region: us-east-1
tableName: example-gluetableoptimizer
tableOptimizerConfiguration:
compactionConfiguration:
icebergConfiguration:
deleteFileThreshold: 1
minInputFiles: 1
strategy: example
enabled: true
orphanFileDeletionConfiguration:
icebergConfiguration:
location: example
orphanFileRetentionPeriodInDays: 7
retentionConfiguration:
icebergConfiguration:
cleanExpiredFiles: false
numberOfSnapshotsToRetain: 1
snapshotRetentionPeriodInDays: 7
roleArn: arn:aws:iam::123456789012:role/example-role
vpcConfiguration:
glueConnectionName: example-gluetableoptimizer
type: example
Spec
| Field | Type | Required | Description |
|---|---|---|---|
catalogId | string | yes | The catalog ID of the table Create-only in AWS: changing it requires replacing the resource. |
databaseName | string | yes | The name of the database. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
tableName | string | yes | The table name. |
tableOptimizerConfiguration | object | yes | Specifies configuration details of a table optimizer. |
tableOptimizerConfiguration.compactionConfiguration | object | — | The configuration for a compaction optimizer. |
tableOptimizerConfiguration.compactionConfiguration.icebergConfiguration | object | — | The configuration for an Iceberg compaction optimizer. |
tableOptimizerConfiguration.compactionConfiguration.icebergConfiguration.deleteFileThreshold | integer | — | The minimum number of deletes in a data file to make it eligible for compaction. |
tableOptimizerConfiguration.compactionConfiguration.icebergConfiguration.minInputFiles | integer | — | The minimum number of input files before compaction is triggered. |
tableOptimizerConfiguration.compactionConfiguration.icebergConfiguration.strategy | string | — | The compaction strategy to use. |
tableOptimizerConfiguration.enabled | boolean | yes | Whether the table optimization is enabled. |
tableOptimizerConfiguration.orphanFileDeletionConfiguration | object | — | OrphanFileDeletionConfiguration is a property that can be included within the TableOptimizer resource. |
tableOptimizerConfiguration.orphanFileDeletionConfiguration.icebergConfiguration | object | — | The IcebergConfiguration property helps optimize your Iceberg tables in AWS Glue by allowing you to specify format-specific settings that control how data is stored, compressed, and managed. |
tableOptimizerConfiguration.orphanFileDeletionConfiguration.icebergConfiguration.location | string | — | Specifies a directory in which to look for orphan files (defaults to the table's location). |
tableOptimizerConfiguration.orphanFileDeletionConfiguration.icebergConfiguration.orphanFileRetentionPeriodInDays | integer | — | The specific number of days you want to keep the orphan files. |
tableOptimizerConfiguration.retentionConfiguration | object | — | The configuration for a snapshot retention optimizer for Apache Iceberg tables. |
tableOptimizerConfiguration.retentionConfiguration.icebergConfiguration | object | — | The configuration for an Iceberg snapshot retention optimizer. |
tableOptimizerConfiguration.retentionConfiguration.icebergConfiguration.cleanExpiredFiles | boolean | — | |
tableOptimizerConfiguration.retentionConfiguration.icebergConfiguration.numberOfSnapshotsToRetain | integer | — | |
tableOptimizerConfiguration.retentionConfiguration.icebergConfiguration.snapshotRetentionPeriodInDays | integer | — | |
tableOptimizerConfiguration.roleArn | string | yes | A role passed by the caller which gives the service permission to update the resources associated with the optimizer on the caller's behalf. |
tableOptimizerConfiguration.vpcConfiguration | object | — | An object that describes the VPC configuration for a table optimizer. |
tableOptimizerConfiguration.vpcConfiguration.glueConnectionName | string | — | The name of the AWS Glue connection used for the VPC for the table optimizer. |
type | string | yes | The type of table optimizer. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
GlueTrigger # GA
GlueTrigger is the Schema for managing Glue triggers.
kubectl get gluetriggers · example on GitHub
Example
# GlueTrigger — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#gluetrigger
apiVersion: aws.konfig.io/v1alpha1
kind: GlueTrigger
metadata:
name: example-gluetrigger
namespace: default
spec:
actions:
- arguments:
key: value
jobName: example-gluetrigger
description: Managed by konfig-konector
name: example-gluetrigger
predicate:
conditions:
- crawlerName: example-gluetrigger
jobName: example-gluetrigger
logicalOperator: EQUALS
state: example
logical: AND
providerRef:
name: example-gluetrigger
region: us-east-1
schedule: example
startOnCreation: false
tags:
environment: dev
team: platform
type: SCHEDULED
Spec
| Field | Type | Required | Description |
|---|---|---|---|
actions | array<object> | yes | Actions are initiated when the trigger fires. |
actions[].arguments | map<string> | — | Arguments are job arguments that replace the job's default arguments for this run. |
actions[].jobName | string | yes | JobName is the name of the Glue job to run. |
description | string | — | Description is a description of the trigger. |
name | string | yes | Name is the name of the trigger. |
predicate | object | — | Predicate defines when a CONDITIONAL trigger fires. |
predicate.conditions | array<object> | — | Conditions determine when the trigger fires. |
predicate.conditions[].crawlerName | string | — | CrawlerName is the crawler this condition applies to. |
predicate.conditions[].jobName | string | — | JobName is the job whose runs this condition applies to. |
predicate.conditions[].logicalOperator | enum | — | LogicalOperator is the comparison operator; only EQUALS is supported. Allowed: EQUALS |
predicate.conditions[].state | string | — | State is the job/crawler state the trigger listens for (SUCCEEDED, STOPPED, FAILED, TIMEOUT for jobs). |
predicate.logical | enum | — | Logical is how multiple conditions combine: AND or ANY. Allowed: AND, ANY |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
schedule | string | — | Schedule is a cron expression for SCHEDULED triggers, e.g. |
startOnCreation | boolean | — | StartOnCreation activates SCHEDULED/CONDITIONAL triggers when created. |
tags | map<string> | — | Tags are AWS resource tags to apply at creation. |
type | enum | yes | Type is the trigger type. Allowed: SCHEDULED, CONDITIONAL, ON_DEMAND |
Status
| Field | Type | Required | Description |
|---|---|---|---|
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
lastSyncTime | string | — | LastSyncTime is when the resource was last successfully reconciled. |
observedGeneration | integer | — | ObservedGeneration is the most recent .metadata.generation reconciled. |
state | string | — | State is the current trigger state reported by AWS. |
triggerName | string | — | TriggerName is the name of the trigger in AWS. |
GlueUsageProfile # CLOUD CONTROL · AWS::Glue::UsageProfile
GlueUsageProfile manages AWS::Glue::UsageProfile through the AWS Cloud Control API.
kubectl get glueusageprofiles · example on GitHub
Example
# GlueUsageProfile — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#glueusageprofile
apiVersion: aws.konfig.io/v1alpha1
kind: GlueUsageProfile
metadata:
name: example-glueusageprofile
namespace: default
spec:
description: Managed by konfig-konector
name: example-glueusageprofile
providerRef:
name: example-glueusageprofile
region: us-east-1
tags:
- key: example
value: example
Spec
| Field | Type | Required | Description |
|---|---|---|---|
configuration | object | — | UsageProfile configuration for supported service ex: (Jobs, Sessions). |
configuration.jobConfiguration | object | — | |
configuration.sessionConfiguration | object | — | |
description | string | — | The description of the UsageProfile. |
name | string | yes | The name of the UsageProfile. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
tags | array<object> | — | The tags to be applied to this UsageProfiles. |
tags[].key | string | yes | |
tags[].value | string | yes |
Status
| Field | Type | Required | Description |
|---|---|---|---|
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
createdOn | string | — | Creation time. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
GlueUserDefinedFunction # CLOUD CONTROL · AWS::Glue::UserDefinedFunction
GlueUserDefinedFunction manages AWS::Glue::UserDefinedFunction through the AWS Cloud Control API.
kubectl get glueuserdefinedfunctions · example on GitHub
Example
# GlueUserDefinedFunction — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#glueuserdefinedfunction
apiVersion: aws.konfig.io/v1alpha1
kind: GlueUserDefinedFunction
metadata:
name: example-glueuserdefinedfunction
namespace: default
spec:
className: example-glueuserdefinedfunction
databaseName: example-glueuserdefinedfunction
functionName: example-glueuserdefinedfunction
functionType: REGULAR_FUNCTION
ownerName: example-glueuserdefinedfunction
ownerType: USER
providerRef:
name: example-glueuserdefinedfunction
region: us-east-1
resourceUris:
- resourceType: JAR
uri: example
Spec
| Field | Type | Required | Description |
|---|---|---|---|
className | string | — | The Java class that contains the function code. |
databaseName | string | yes | The name of the catalog database in which the function is located. |
functionName | string | yes | The name of the function. |
functionType | enum | — | The type of the function. Allowed: REGULAR_FUNCTION, AGGREGATE_FUNCTION, STORED_PROCEDURE |
ownerName | string | — | The owner of the function. |
ownerType | enum | — | The owner type. Allowed: USER, ROLE, GROUP |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
resourceUris | array<object> | — | The resource URIs for the function. |
resourceUris[].resourceType | enum | — | The type of the resource. Allowed: JAR, FILE, ARCHIVE |
resourceUris[].uri | string | — | The URI for accessing the resource. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
arn | string | — | The Amazon Resource Name (ARN) of the user-defined function. |
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
GlueWorkflow # CLOUD CONTROL · AWS::Glue::Workflow
GlueWorkflow manages AWS::Glue::Workflow through the AWS Cloud Control API.
kubectl get glueworkflows · example on GitHub
Example
# GlueWorkflow — Glue
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/glue.html#glueworkflow
apiVersion: aws.konfig.io/v1alpha1
kind: GlueWorkflow
metadata:
name: example-glueworkflow
namespace: default
spec:
description: Managed by konfig-konector
maxConcurrentRuns: 1
name: example-glueworkflow
providerRef:
name: example-glueworkflow
region: us-east-1
Spec
| Field | Type | Required | Description |
|---|---|---|---|
defaultRunProperties | object | — | A collection of properties to be used as part of each execution of the workflow |
description | string | — | A description of the workflow |
maxConcurrentRuns | integer | — | You can use this parameter to prevent unwanted multiple updates to data, to control costs, or in some cases, to prevent exceeding the maximum number of concurrent runs of any of the component jobs. |
name | string | — | The name of the workflow representing the flow Create-only in AWS: changing it requires replacing the resource. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
tags | object | — | The tags to use with this workflow. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |