EMR on EKS

3 resource kinds. Generated from the operator's CRD schemas.

API Group: aws.konfig.io/v1alpha1

EMRContainersEndpoint # CLOUD CONTROL · AWS::EMRContainers::Endpoint

EMRContainersEndpoint manages AWS::EMRContainers::Endpoint through the AWS Cloud Control API.

kubectl get emrcontainersendpoints · example on GitHub

Example

# EMRContainersEndpoint — EMR on EKS
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/emrcontainers.html#emrcontainersendpoint
apiVersion: aws.konfig.io/v1alpha1
kind: EMRContainersEndpoint
metadata:
  name: example-emrcontainersendpoint
  namespace: default
spec:
  configurationOverrides:
    applicationConfiguration:
    - classification: example
    monitoringConfiguration:
      cloudWatchMonitoringConfiguration:
        logGroupName: example-emrcontainersendpoint
        logStreamNamePrefix: example
      containerLogRotationConfiguration:
        maxFilesToKeep: 1
        rotationSize: example
      persistentAppUI: ENABLED
      s3MonitoringConfiguration:
        logUri: example
  executionRoleArn: arn:aws:iam::123456789012:role/example-role
  name: example-emrcontainersendpoint
  providerRef:
    name: example-emrcontainersendpoint
    region: us-east-1
  releaseLabel: example
  sessionIdleTimeoutInMinutes: 1
  tags:
  - key: example
    value: example
  type: example
  virtualClusterId: example-id

Spec

FieldTypeRequiredDescription
configurationOverridesobject—The configuration overrides for the managed endpoint.
configurationOverrides.applicationConfigurationarray<object>—
configurationOverrides.applicationConfiguration[].classificationstringyes
configurationOverrides.applicationConfiguration[].configurationsarray<object>—
configurationOverrides.applicationConfiguration[].propertiesmap<string>—
configurationOverrides.monitoringConfigurationobject—EMRContainersEndpointMonitoringConfiguration is a nested property type of AWS::EMRContainers::Endpoint.
configurationOverrides.monitoringConfiguration.cloudWatchMonitoringConfigurationobject—EMRContainersEndpointCloudWatchMonitoringConfiguration is a nested property type of AWS::EMRContainers::Endpoint.
configurationOverrides.monitoringConfiguration.cloudWatchMonitoringConfiguration.logGroupNamestringyes
configurationOverrides.monitoringConfiguration.cloudWatchMonitoringConfiguration.logStreamNamePrefixstring—
configurationOverrides.monitoringConfiguration.containerLogRotationConfigurationobject—EMRContainersEndpointContainerLogRotationConfiguration is a nested property type of AWS::EMRContainers::Endpoint.
configurationOverrides.monitoringConfiguration.containerLogRotationConfiguration.maxFilesToKeepintegeryes
configurationOverrides.monitoringConfiguration.containerLogRotationConfiguration.rotationSizestringyes
configurationOverrides.monitoringConfiguration.persistentAppUIenum—Allowed: ENABLED, DISABLED
configurationOverrides.monitoringConfiguration.s3MonitoringConfigurationobject—EMRContainersEndpointS3MonitoringConfiguration is a nested property type of AWS::EMRContainers::Endpoint.
configurationOverrides.monitoringConfiguration.s3MonitoringConfiguration.logUristringyes
executionRoleArnstringyesThe execution role ARN for the managed endpoint.
namestring—The name of the managed endpoint.
providerRefobject—ProviderRef selects the AWSProvider (account/region) this resource is reconciled against.
providerRef.namestringyesName of a cluster-scoped AWSProvider.
providerRef.regionstring—Region overrides the provider's region for this resource only.
releaseLabelstringyesThe Amazon EMR release label.
sessionIdleTimeoutInMinutesinteger—The idle timeout in minutes for sessions on the managed endpoint.
tagsarray<object>—An array of key-value pairs to apply to this managed endpoint.
tags[].keystringyes
tags[].valuestringyes
typestringyesThe type of the managed endpoint.
virtualClusterIdstringyesThe ID of the virtual cluster for which the managed endpoint is created.

Status

FieldTypeRequiredDescription
arnstring—The ARN of the managed endpoint.
attemptinteger—Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure.
authProxyUrlstring—The auth proxy URL for Spark Connect connections.
awsProviderobject—AWSProvider confirms the account and region this resource was reconciled against.
awsProvider.accountIdstring—AccountID the resource lives in.
awsProvider.namestring—Name of the AWSProvider used; empty when the operator's own credentials were used.
awsProvider.regionstring—Region the resource lives in (empty for global services).
certificateAuthorityobject—The certificate authority for the managed endpoint.
certificateAuthority.certificateArnstring—
certificateAuthority.certificateDatastring—
conditionsarray<object>—Conditions describe the current state of the resource.
conditions[].lastTransitionTimestringyeslastTransitionTime is the last time the condition transitioned from one status to another.
conditions[].messagestringyesmessage is a human readable message indicating details about the transition.
conditions[].observedGenerationinteger—observedGeneration represents the .metadata.generation that the condition was set based upon.
conditions[].reasonstringyesreason contains a programmatic identifier indicating the reason for the condition's last transition.
conditions[].statusenumyesstatus of the condition, one of True, False, Unknown. Allowed: True, False, Unknown
conditions[].typestringyestype of condition in CamelCase or in foo.example.com/CamelCase.
createdAtstring—The date and time when the managed endpoint was created.
failureReasonstring—The reason for a failed managed endpoint.
idstring—The ID of the managed endpoint.
identifierstring—Identifier is the Cloud Control primary identifier of the resource.
lastSyncTimestring—
observedGenerationinteger—
operationstring—Operation is the in-flight operation (CREATE, UPDATE, DELETE).
operationStatusstring—OperationStatus is the last reported operation status.
requestTokenstring—RequestToken tracks an in-flight asynchronous operation.
securityGroupstring—The security group associated with the managed endpoint.
serverUrlstring—The server URL of the managed endpoint.
statestring—The state of the managed endpoint.
stateDetailsstring—Additional details about the state of the managed endpoint.

EMRContainersSecurityConfiguration # CLOUD CONTROL · AWS::EMRContainers::SecurityConfiguration

EMRContainersSecurityConfiguration manages AWS::EMRContainers::SecurityConfiguration through the AWS Cloud Control API.

kubectl get emrcontainerssecurityconfigurations · example on GitHub

Example

# EMRContainersSecurityConfiguration — EMR on EKS
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/emrcontainers.html#emrcontainerssecurityconfiguration
apiVersion: aws.konfig.io/v1alpha1
kind: EMRContainersSecurityConfiguration
metadata:
  name: example-emrcontainerssecurityconfiguration
  namespace: default
spec:
  containerProvider:
    id: example-id
    info:
      eksInfo:
        name: example-eksinfo
    type: EKS
  name: example-emrcontainerssecurityconfiguration
  providerRef:
    name: example-emrcontainerssecurityconfiguration
    region: us-east-1
  securityConfigurationData:
    authenticationConfiguration:
      iamConfiguration:
        systemRole: example
      identityCenterConfiguration:
        enableIdentityCenter: true
        identityCenterApplicationAssignmentRequired: false
        identityCenterInstanceARN: arn:aws:iam::123456789012:role/example-role
    authorizationConfiguration:
      lakeFormationConfiguration:
        authorizedSessionTagValue: example
        queryAccessControlEnabled: true
        queryEngineRoleArn: arn:aws:iam::123456789012:role/example-role
  tags:
  - key: example
    value: example

Spec

FieldTypeRequiredDescription
containerProviderobject—Container provider for the security configuration.
containerProvider.idstringyesThe container provider ID.
containerProvider.infoobject—EMRContainersSecurityConfigurationContainerInfo is a nested property type of AWS::EMRContainers::SecurityConfiguration.
containerProvider.info.eksInfoobject—EMRContainersSecurityConfigurationEksInfo is a nested property type of AWS::EMRContainers::SecurityConfiguration.
containerProvider.info.eksInfo.namespacestring—The EKS namespace.
containerProvider.typeenumyesThe container provider type. Allowed: EKS
namestring—The name of the security configuration.
providerRefobject—ProviderRef selects the AWSProvider (account/region) this resource is reconciled against.
providerRef.namestringyesName of a cluster-scoped AWSProvider.
providerRef.regionstring—Region overrides the provider's region for this resource only.
securityConfigurationDataobjectyesSecurity configuration input for the security configuration.
securityConfigurationData.authenticationConfigurationobject—EMRContainersSecurityConfigurationAuthenticationConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration.
securityConfigurationData.authenticationConfiguration.iamConfigurationobject—EMRContainersSecurityConfigurationIAMConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration.
securityConfigurationData.authenticationConfiguration.iamConfiguration.systemRolestring—The system role ARN.
securityConfigurationData.authenticationConfiguration.identityCenterConfigurationobject—EMRContainersSecurityConfigurationIdentityCenterConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration.
securityConfigurationData.authenticationConfiguration.identityCenterConfiguration.enableIdentityCenterboolean—Whether to enable Identity Center integration.
securityConfigurationData.authenticationConfiguration.identityCenterConfiguration.identityCenterApplicationAssignmentRequiredboolean—Whether Identity Center application assignment is required.
securityConfigurationData.authenticationConfiguration.identityCenterConfiguration.identityCenterInstanceARNstring—The ARN of the Identity Center instance.
securityConfigurationData.authorizationConfigurationobject—EMRContainersSecurityConfigurationAuthorizationConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration.
securityConfigurationData.authorizationConfiguration.lakeFormationConfigurationobject—EMRContainersSecurityConfigurationLakeFormationConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration.
securityConfigurationData.authorizationConfiguration.lakeFormationConfiguration.authorizedSessionTagValuestring—The session tag to authorize Lake Formation access.
securityConfigurationData.authorizationConfiguration.lakeFormationConfiguration.queryAccessControlEnabledboolean—Whether query access control is enabled.
securityConfigurationData.authorizationConfiguration.lakeFormationConfiguration.queryEngineRoleArnstring—The ARN of the query engine role.
securityConfigurationData.authorizationConfiguration.lakeFormationConfiguration.secureNamespaceInfoobject—EMRContainersSecurityConfigurationSecureNamespaceInfo is a nested property type of AWS::EMRContainers::SecurityConfiguration.
securityConfigurationData.authorizationConfiguration.lakeFormationConfiguration.secureNamespaceInfo.clusterIdstring—The ID of the cluster.
securityConfigurationData.authorizationConfiguration.lakeFormationConfiguration.secureNamespaceInfo.namespacestring—The namespace.
securityConfigurationData.encryptionConfigurationobject—EMRContainersSecurityConfigurationEncryptionConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration.
securityConfigurationData.encryptionConfiguration.atRestEncryptionConfigurationobject—EMRContainersSecurityConfigurationAtRestEncryptionConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration.
securityConfigurationData.encryptionConfiguration.atRestEncryptionConfiguration.localDiskEncryptionConfigurationobject—EMRContainersSecurityConfigurationLocalDiskEncryptionConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration.
securityConfigurationData.encryptionConfiguration.atRestEncryptionConfiguration.localDiskEncryptionConfiguration.awsKmsKeyIdstring—The AWS KMS key ID.
securityConfigurationData.encryptionConfiguration.atRestEncryptionConfiguration.localDiskEncryptionConfiguration.encryptionKeyProviderTypeenum—The encryption key provider type. Allowed: AwsKms
securityConfigurationData.encryptionConfiguration.atRestEncryptionConfiguration.s3EncryptionConfigurationobject—EMRContainersSecurityConfigurationS3EncryptionConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration.
securityConfigurationData.encryptionConfiguration.atRestEncryptionConfiguration.s3EncryptionConfiguration.encryptionOptionenum—The S3 encryption option. Allowed: SSE-S3, SSE-KMS, CSE-KMS
securityConfigurationData.encryptionConfiguration.atRestEncryptionConfiguration.s3EncryptionConfiguration.kmsKeyIdstring—The KMS key ID for encryption.
securityConfigurationData.encryptionConfiguration.inTransitEncryptionConfigurationobject—EMRContainersSecurityConfigurationInTransitEncryptionConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration.
securityConfigurationData.encryptionConfiguration.inTransitEncryptionConfiguration.tlsCertificateConfigurationobject—EMRContainersSecurityConfigurationTLSCertificateConfiguration is a nested property type of AWS::EMRContainers::SecurityConfiguration.
securityConfigurationData.encryptionConfiguration.inTransitEncryptionConfiguration.tlsCertificateConfiguration.certificateProviderTypeenum—The certificate provider type. Allowed: PEM
securityConfigurationData.encryptionConfiguration.inTransitEncryptionConfiguration.tlsCertificateConfiguration.privateKeySecretArnstring—The ARN of the secret containing the private key.
securityConfigurationData.encryptionConfiguration.inTransitEncryptionConfiguration.tlsCertificateConfiguration.publicKeySecretArnstring—The ARN of the secret containing the public key.
tagsarray<object>—An array of key-value pairs to apply to this security configuration.
tags[].keystringyes
tags[].valuestringyes

Status

FieldTypeRequiredDescription
arnstring—The ARN of the security configuration.
attemptinteger—Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure.
awsProviderobject—AWSProvider confirms the account and region this resource was reconciled against.
awsProvider.accountIdstring—AccountID the resource lives in.
awsProvider.namestring—Name of the AWSProvider used; empty when the operator's own credentials were used.
awsProvider.regionstring—Region the resource lives in (empty for global services).
conditionsarray<object>—Conditions describe the current state of the resource.
conditions[].lastTransitionTimestringyeslastTransitionTime is the last time the condition transitioned from one status to another.
conditions[].messagestringyesmessage is a human readable message indicating details about the transition.
conditions[].observedGenerationinteger—observedGeneration represents the .metadata.generation that the condition was set based upon.
conditions[].reasonstringyesreason contains a programmatic identifier indicating the reason for the condition's last transition.
conditions[].statusenumyesstatus of the condition, one of True, False, Unknown. Allowed: True, False, Unknown
conditions[].typestringyestype of condition in CamelCase or in foo.example.com/CamelCase.
idstring—The ID of the security configuration.
identifierstring—Identifier is the Cloud Control primary identifier of the resource.
lastSyncTimestring—
observedGenerationinteger—
operationstring—Operation is the in-flight operation (CREATE, UPDATE, DELETE).
operationStatusstring—OperationStatus is the last reported operation status.
requestTokenstring—RequestToken tracks an in-flight asynchronous operation.

EMRContainersVirtualCluster # CLOUD CONTROL · AWS::EMRContainers::VirtualCluster

EMRContainersVirtualCluster manages AWS::EMRContainers::VirtualCluster through the AWS Cloud Control API.

kubectl get emrcontainersvirtualclusters · example on GitHub

Example

# EMRContainersVirtualCluster — EMR on EKS
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/emrcontainers.html#emrcontainersvirtualcluster
apiVersion: aws.konfig.io/v1alpha1
kind: EMRContainersVirtualCluster
metadata:
  name: example-emrcontainersvirtualcluster
  namespace: default
spec:
  containerProvider:
    id: example-id
    info:
      eksInfo:
        name: example-eksinfo
    type: example
  name: example-emrcontainersvirtualcluster
  providerRef:
    name: example-emrcontainersvirtualcluster
    region: us-east-1
  sessionEnabled: true
  tags:
  - key: example
    value: example

Spec

FieldTypeRequiredDescription
containerProviderobjectyesContainer provider of the virtual cluster.
containerProvider.idstringyesThe ID of the container cluster
containerProvider.infoobjectyesEMRContainersVirtualClusterContainerInfo is a nested property type of AWS::EMRContainers::VirtualCluster.
containerProvider.info.eksInfoobjectyesEMRContainersVirtualClusterEksInfo is a nested property type of AWS::EMRContainers::VirtualCluster.
containerProvider.info.eksInfo.namespacestringyes
containerProvider.typestringyesThe type of the container provider
namestringyesName of the virtual cluster.
providerRefobject—ProviderRef selects the AWSProvider (account/region) this resource is reconciled against.
providerRef.namestringyesName of a cluster-scoped AWSProvider.
providerRef.regionstring—Region overrides the provider's region for this resource only.
securityConfigurationIdstring—The ID of the security configuration.
sessionEnabledboolean—Whether the virtual cluster is session-enabled for Spark Connect.
tagsarray<object>—An array of key-value pairs to apply to this virtual cluster.
tags[].keystringyes
tags[].valuestringyes

Status

FieldTypeRequiredDescription
arnstring—Read-only: reported by AWS after creation.
attemptinteger—Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure.
awsProviderobject—AWSProvider confirms the account and region this resource was reconciled against.
awsProvider.accountIdstring—AccountID the resource lives in.
awsProvider.namestring—Name of the AWSProvider used; empty when the operator's own credentials were used.
awsProvider.regionstring—Region the resource lives in (empty for global services).
conditionsarray<object>—Conditions describe the current state of the resource.
conditions[].lastTransitionTimestringyeslastTransitionTime is the last time the condition transitioned from one status to another.
conditions[].messagestringyesmessage is a human readable message indicating details about the transition.
conditions[].observedGenerationinteger—observedGeneration represents the .metadata.generation that the condition was set based upon.
conditions[].reasonstringyesreason contains a programmatic identifier indicating the reason for the condition's last transition.
conditions[].statusenumyesstatus of the condition, one of True, False, Unknown. Allowed: True, False, Unknown
conditions[].typestringyestype of condition in CamelCase or in foo.example.com/CamelCase.
idstring—Id of the virtual cluster.
identifierstring—Identifier is the Cloud Control primary identifier of the resource.
lastSyncTimestring—
observedGenerationinteger—
operationstring—Operation is the in-flight operation (CREATE, UPDATE, DELETE).
operationStatusstring—OperationStatus is the last reported operation status.
requestTokenstring—RequestToken tracks an in-flight asynchronous operation.