EMR on EKS
3 resource kinds. Generated from the operator's CRD schemas.
API Group:
aws.konfig.io/v1alpha1
EMRContainersEndpoint # CLOUD CONTROL · AWS::EMRContainers::Endpoint
EMRContainersEndpoint manages AWS::EMRContainers::Endpoint through the AWS Cloud Control API.
kubectl get emrcontainersendpoints · example on GitHub
Example
# EMRContainersEndpoint — EMR on EKS
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/emrcontainers.html#emrcontainersendpoint
apiVersion: aws.konfig.io/v1alpha1
kind: EMRContainersEndpoint
metadata:
name: example-emrcontainersendpoint
namespace: default
spec:
configurationOverrides:
applicationConfiguration:
- classification: example
monitoringConfiguration:
cloudWatchMonitoringConfiguration:
logGroupName: example-emrcontainersendpoint
logStreamNamePrefix: example
containerLogRotationConfiguration:
maxFilesToKeep: 1
rotationSize: example
persistentAppUI: ENABLED
s3MonitoringConfiguration:
logUri: example
executionRoleArn: arn:aws:iam::123456789012:role/example-role
name: example-emrcontainersendpoint
providerRef:
name: example-emrcontainersendpoint
region: us-east-1
releaseLabel: example
sessionIdleTimeoutInMinutes: 1
tags:
- key: example
value: example
type: example
virtualClusterId: example-id
Spec
| Field | Type | Required | Description |
|---|---|---|---|
configurationOverrides | object | — | The configuration overrides for the managed endpoint. |
configurationOverrides.applicationConfiguration | array<object> | — | |
configurationOverrides.applicationConfiguration[].classification | string | yes | |
configurationOverrides.applicationConfiguration[].configurations | array<object> | — | |
configurationOverrides.applicationConfiguration[].properties | map<string> | — | |
configurationOverrides.monitoringConfiguration | object | — | EMRContainersEndpointMonitoringConfiguration is a nested property type of AWS::EMRContainers::Endpoint. |
configurationOverrides.monitoringConfiguration.cloudWatchMonitoringConfiguration | object | — | EMRContainersEndpointCloudWatchMonitoringConfiguration is a nested property type of AWS::EMRContainers::Endpoint. |
configurationOverrides.monitoringConfiguration.cloudWatchMonitoringConfiguration.logGroupName | string | yes | |
configurationOverrides.monitoringConfiguration.cloudWatchMonitoringConfiguration.logStreamNamePrefix | string | — | |
configurationOverrides.monitoringConfiguration.containerLogRotationConfiguration | object | — | EMRContainersEndpointContainerLogRotationConfiguration is a nested property type of AWS::EMRContainers::Endpoint. |
configurationOverrides.monitoringConfiguration.containerLogRotationConfiguration.maxFilesToKeep | integer | yes | |
configurationOverrides.monitoringConfiguration.containerLogRotationConfiguration.rotationSize | string | yes | |
configurationOverrides.monitoringConfiguration.persistentAppUI | enum | — | Allowed: ENABLED, DISABLED |
configurationOverrides.monitoringConfiguration.s3MonitoringConfiguration | object | — | EMRContainersEndpointS3MonitoringConfiguration is a nested property type of AWS::EMRContainers::Endpoint. |
configurationOverrides.monitoringConfiguration.s3MonitoringConfiguration.logUri | string | yes | |
executionRoleArn | string | yes | The execution role ARN for the managed endpoint. |
name | string | — | The name of the managed endpoint. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
releaseLabel | string | yes | The Amazon EMR release label. |
sessionIdleTimeoutInMinutes | integer | — | The idle timeout in minutes for sessions on the managed endpoint. |
tags | array<object> | — | An array of key-value pairs to apply to this managed endpoint. |
tags[].key | string | yes | |
tags[].value | string | yes | |
type | string | yes | The type of the managed endpoint. |
virtualClusterId | string | yes | The ID of the virtual cluster for which the managed endpoint is created. |
Status
| Field | Type | Required | Description |
|---|---|---|---|
arn | string | — | The ARN of the managed endpoint. |
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
authProxyUrl | string | — | The auth proxy URL for Spark Connect connections. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
certificateAuthority | object | — | The certificate authority for the managed endpoint. |
certificateAuthority.certificateArn | string | — | |
certificateAuthority.certificateData | string | — | |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
createdAt | string | — | The date and time when the managed endpoint was created. |
failureReason | string | — | The reason for a failed managed endpoint. |
id | string | — | The ID of the managed endpoint. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
securityGroup | string | — | The security group associated with the managed endpoint. |
serverUrl | string | — | The server URL of the managed endpoint. |
state | string | — | The state of the managed endpoint. |
stateDetails | string | — | Additional details about the state of the managed endpoint. |
EMRContainersSecurityConfiguration # CLOUD CONTROL · AWS::EMRContainers::SecurityConfiguration
EMRContainersSecurityConfiguration manages AWS::EMRContainers::SecurityConfiguration through the AWS Cloud Control API.
kubectl get emrcontainerssecurityconfigurations · example on GitHub
Example
# EMRContainersSecurityConfiguration — EMR on EKS
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/emrcontainers.html#emrcontainerssecurityconfiguration
apiVersion: aws.konfig.io/v1alpha1
kind: EMRContainersSecurityConfiguration
metadata:
name: example-emrcontainerssecurityconfiguration
namespace: default
spec:
containerProvider:
id: example-id
info:
eksInfo:
name: example-eksinfo
type: EKS
name: example-emrcontainerssecurityconfiguration
providerRef:
name: example-emrcontainerssecurityconfiguration
region: us-east-1
securityConfigurationData:
authenticationConfiguration:
iamConfiguration:
systemRole: example
identityCenterConfiguration:
enableIdentityCenter: true
identityCenterApplicationAssignmentRequired: false
identityCenterInstanceARN: arn:aws:iam::123456789012:role/example-role
authorizationConfiguration:
lakeFormationConfiguration:
authorizedSessionTagValue: example
queryAccessControlEnabled: true
queryEngineRoleArn: arn:aws:iam::123456789012:role/example-role
tags:
- key: example
value: example
Spec
| Field | Type | Required | Description |
|---|---|---|---|
containerProvider | object | — | Container provider for the security configuration. |
containerProvider.id | string | yes | The container provider ID. |
containerProvider.info | object | — | EMRContainersSecurityConfigurationContainerInfo is a nested property type of AWS::EMRContainers::SecurityConfiguration. |
containerProvider.info.eksInfo | object | — | EMRContainersSecurityConfigurationEksInfo is a nested property type of AWS::EMRContainers::SecurityConfiguration. |
containerProvider.info.eksInfo.namespace | string | — | The EKS namespace. |
containerProvider.type | enum | yes | The container provider type. Allowed: EKS |
name | string | — | The name of the security configuration. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
securityConfigurationData | object | yes | Security configuration input for the security configuration. |
securityConfigurationData.authenticationConfiguration | object | — | EMRContainersSecurityConfigurationAuthenticationConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration. |
securityConfigurationData.authenticationConfiguration.iamConfiguration | object | — | EMRContainersSecurityConfigurationIAMConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration. |
securityConfigurationData.authenticationConfiguration.iamConfiguration.systemRole | string | — | The system role ARN. |
securityConfigurationData.authenticationConfiguration.identityCenterConfiguration | object | — | EMRContainersSecurityConfigurationIdentityCenterConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration. |
securityConfigurationData.authenticationConfiguration.identityCenterConfiguration.enableIdentityCenter | boolean | — | Whether to enable Identity Center integration. |
securityConfigurationData.authenticationConfiguration.identityCenterConfiguration.identityCenterApplicationAssignmentRequired | boolean | — | Whether Identity Center application assignment is required. |
securityConfigurationData.authenticationConfiguration.identityCenterConfiguration.identityCenterInstanceARN | string | — | The ARN of the Identity Center instance. |
securityConfigurationData.authorizationConfiguration | object | — | EMRContainersSecurityConfigurationAuthorizationConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration. |
securityConfigurationData.authorizationConfiguration.lakeFormationConfiguration | object | — | EMRContainersSecurityConfigurationLakeFormationConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration. |
securityConfigurationData.authorizationConfiguration.lakeFormationConfiguration.authorizedSessionTagValue | string | — | The session tag to authorize Lake Formation access. |
securityConfigurationData.authorizationConfiguration.lakeFormationConfiguration.queryAccessControlEnabled | boolean | — | Whether query access control is enabled. |
securityConfigurationData.authorizationConfiguration.lakeFormationConfiguration.queryEngineRoleArn | string | — | The ARN of the query engine role. |
securityConfigurationData.authorizationConfiguration.lakeFormationConfiguration.secureNamespaceInfo | object | — | EMRContainersSecurityConfigurationSecureNamespaceInfo is a nested property type of AWS::EMRContainers::SecurityConfiguration. |
securityConfigurationData.authorizationConfiguration.lakeFormationConfiguration.secureNamespaceInfo.clusterId | string | — | The ID of the cluster. |
securityConfigurationData.authorizationConfiguration.lakeFormationConfiguration.secureNamespaceInfo.namespace | string | — | The namespace. |
securityConfigurationData.encryptionConfiguration | object | — | EMRContainersSecurityConfigurationEncryptionConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration. |
securityConfigurationData.encryptionConfiguration.atRestEncryptionConfiguration | object | — | EMRContainersSecurityConfigurationAtRestEncryptionConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration. |
securityConfigurationData.encryptionConfiguration.atRestEncryptionConfiguration.localDiskEncryptionConfiguration | object | — | EMRContainersSecurityConfigurationLocalDiskEncryptionConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration. |
securityConfigurationData.encryptionConfiguration.atRestEncryptionConfiguration.localDiskEncryptionConfiguration.awsKmsKeyId | string | — | The AWS KMS key ID. |
securityConfigurationData.encryptionConfiguration.atRestEncryptionConfiguration.localDiskEncryptionConfiguration.encryptionKeyProviderType | enum | — | The encryption key provider type. Allowed: AwsKms |
securityConfigurationData.encryptionConfiguration.atRestEncryptionConfiguration.s3EncryptionConfiguration | object | — | EMRContainersSecurityConfigurationS3EncryptionConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration. |
securityConfigurationData.encryptionConfiguration.atRestEncryptionConfiguration.s3EncryptionConfiguration.encryptionOption | enum | — | The S3 encryption option. Allowed: SSE-S3, SSE-KMS, CSE-KMS |
securityConfigurationData.encryptionConfiguration.atRestEncryptionConfiguration.s3EncryptionConfiguration.kmsKeyId | string | — | The KMS key ID for encryption. |
securityConfigurationData.encryptionConfiguration.inTransitEncryptionConfiguration | object | — | EMRContainersSecurityConfigurationInTransitEncryptionConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration. |
securityConfigurationData.encryptionConfiguration.inTransitEncryptionConfiguration.tlsCertificateConfiguration | object | — | EMRContainersSecurityConfigurationTLSCertificateConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration. |
securityConfigurationData.encryptionConfiguration.inTransitEncryptionConfiguration.tlsCertificateConfiguration.certificateProviderType | enum | — | The certificate provider type. Allowed: PEM |
securityConfigurationData.encryptionConfiguration.inTransitEncryptionConfiguration.tlsCertificateConfiguration.privateKeySecretArn | string | — | The ARN of the secret containing the private key. |
securityConfigurationData.encryptionConfiguration.inTransitEncryptionConfiguration.tlsCertificateConfiguration.publicKeySecretArn | string | — | The ARN of the secret containing the public key. |
tags | array<object> | — | An array of key-value pairs to apply to this security configuration. |
tags[].key | string | yes | |
tags[].value | string | yes |
Status
| Field | Type | Required | Description |
|---|---|---|---|
arn | string | — | The ARN of the security configuration. |
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
id | string | — | The ID of the security configuration. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |
EMRContainersVirtualCluster # CLOUD CONTROL · AWS::EMRContainers::VirtualCluster
EMRContainersVirtualCluster manages AWS::EMRContainers::VirtualCluster through the AWS Cloud Control API.
kubectl get emrcontainersvirtualclusters · example on GitHub
Example
# EMRContainersVirtualCluster — EMR on EKS
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/emrcontainers.html#emrcontainersvirtualcluster
apiVersion: aws.konfig.io/v1alpha1
kind: EMRContainersVirtualCluster
metadata:
name: example-emrcontainersvirtualcluster
namespace: default
spec:
containerProvider:
id: example-id
info:
eksInfo:
name: example-eksinfo
type: example
name: example-emrcontainersvirtualcluster
providerRef:
name: example-emrcontainersvirtualcluster
region: us-east-1
sessionEnabled: true
tags:
- key: example
value: example
Spec
| Field | Type | Required | Description |
|---|---|---|---|
containerProvider | object | yes | Container provider of the virtual cluster. |
containerProvider.id | string | yes | The ID of the container cluster |
containerProvider.info | object | yes | EMRContainersVirtualClusterContainerInfo is a nested property type of AWS::EMRContainers::VirtualCluster. |
containerProvider.info.eksInfo | object | yes | EMRContainersVirtualClusterEksInfo is a nested property type of AWS::EMRContainers::VirtualCluster. |
containerProvider.info.eksInfo.namespace | string | yes | |
containerProvider.type | string | yes | The type of the container provider |
name | string | yes | Name of the virtual cluster. |
providerRef | object | — | ProviderRef selects the AWSProvider (account/region) this resource is reconciled against. |
providerRef.name | string | yes | Name of a cluster-scoped AWSProvider. |
providerRef.region | string | — | Region overrides the provider's region for this resource only. |
securityConfigurationId | string | — | The ID of the security configuration. |
sessionEnabled | boolean | — | Whether the virtual cluster is session-enabled for Spark Connect. |
tags | array<object> | — | An array of key-value pairs to apply to this virtual cluster. |
tags[].key | string | yes | |
tags[].value | string | yes |
Status
| Field | Type | Required | Description |
|---|---|---|---|
arn | string | — | Read-only: reported by AWS after creation. |
attempt | integer | — | Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure. |
awsProvider | object | — | AWSProvider confirms the account and region this resource was reconciled against. |
awsProvider.accountId | string | — | AccountID the resource lives in. |
awsProvider.name | string | — | Name of the AWSProvider used; empty when the operator's own credentials were used. |
awsProvider.region | string | — | Region the resource lives in (empty for global services). |
conditions | array<object> | — | Conditions describe the current state of the resource. |
conditions[].lastTransitionTime | string | yes | lastTransitionTime is the last time the condition transitioned from one status to another. |
conditions[].message | string | yes | message is a human readable message indicating details about the transition. |
conditions[].observedGeneration | integer | — | observedGeneration represents the .metadata.generation that the condition was set based upon. |
conditions[].reason | string | yes | reason contains a programmatic identifier indicating the reason for the condition's last transition. |
conditions[].status | enum | yes | status of the condition, one of True, False, Unknown. Allowed: True, False, Unknown |
conditions[].type | string | yes | type of condition in CamelCase or in foo.example.com/CamelCase. |
id | string | — | Id of the virtual cluster. |
identifier | string | — | Identifier is the Cloud Control primary identifier of the resource. |
lastSyncTime | string | — | |
observedGeneration | integer | — | |
operation | string | — | Operation is the in-flight operation (CREATE, UPDATE, DELETE). |
operationStatus | string | — | OperationStatus is the last reported operation status. |
requestToken | string | — | RequestToken tracks an in-flight asynchronous operation. |