OpenSearch Ingestion

1 resource kind. Generated from the operator's CRD schemas.

API Group: aws.konfig.io/v1alpha1

OSISPipeline # CLOUD CONTROL · AWS::OSIS::Pipeline

OSISPipeline manages AWS::OSIS::Pipeline through the AWS Cloud Control API.

kubectl get osispipelines · example on GitHub

Example

# OSISPipeline — OpenSearch Ingestion
# Full-options example generated from the CRD schema. Optional fields are
# included with sample values; delete what you don't need. Field reference:
# https://konfig-konector.io/docs/osis.html#osispipeline
apiVersion: aws.konfig.io/v1alpha1
kind: OSISPipeline
metadata:
  name: example-osispipeline
  namespace: default
spec:
  bufferOptions:
    persistentBufferEnabled: true
  encryptionAtRestOptions:
    kmsKeyArn: arn:aws:iam::123456789012:role/example-role
  logPublishingOptions:
    cloudWatchLogDestination:
      logGroup: example
    isLoggingEnabled: true
  maxUnits: 1
  minUnits: 1
  pipelineConfigurationBody: example
  pipelineName: example-osispipeline
  pipelineRoleArn: arn:aws:iam::123456789012:role/example-role
  providerRef:
    name: example-osispipeline
    region: us-east-1
  tags:
  - key: example
    value: example
  vpcOptions:
    securityGroupIds:
    - example
    subnetIds:
    - example
    vpcAttachmentOptions:
      attachToVpc: false
      cidrBlock: 10.0.0.0/16
    vpcEndpointManagement: CUSTOMER

Spec

FieldTypeRequiredDescription
bufferOptionsobject—OSISPipelineBufferOptions is a nested property type of AWS::OSIS::Pipeline.
bufferOptions.persistentBufferEnabledbooleanyesWhether persistent buffering should be enabled.
encryptionAtRestOptionsobject—OSISPipelineEncryptionAtRestOptions is a nested property type of AWS::OSIS::Pipeline.
encryptionAtRestOptions.kmsKeyArnstringyesThe KMS key to use for encrypting data.
logPublishingOptionsobject—OSISPipelineLogPublishingOptions is a nested property type of AWS::OSIS::Pipeline.
logPublishingOptions.cloudWatchLogDestinationobject—The destination for OpenSearch Ingestion Service logs sent to Amazon CloudWatch.
logPublishingOptions.cloudWatchLogDestination.logGroupstringyes
logPublishingOptions.isLoggingEnabledboolean—Whether logs should be published.
maxUnitsintegeryesThe maximum pipeline capacity, in Ingestion OpenSearch Compute Units (OCUs).
minUnitsintegeryesThe minimum pipeline capacity, in Ingestion OpenSearch Compute Units (OCUs).
pipelineConfigurationBodystringyesThe Data Prepper pipeline configuration.
pipelineNamestringyesName of the OpenSearch Ingestion Service pipeline to create.
pipelineRoleArnstring—The Pipeline Role (ARN) for the pipeline.
providerRefobject—ProviderRef selects the AWSProvider (account/region) this resource is reconciled against.
providerRef.namestringyesName of a cluster-scoped AWSProvider.
providerRef.regionstring—Region overrides the provider's region for this resource only.
resourcePolicyobject—OSISPipelineResourcePolicy is a nested property type of AWS::OSIS::Pipeline.
resourcePolicy.policyobjectyes
tagsarray<object>—An array of key-value pairs to apply to this resource.
tags[].keystringyes
tags[].valuestringyes
vpcOptionsobject—OSISPipelineVpcOptions is a nested property type of AWS::OSIS::Pipeline.
vpcOptions.securityGroupIdsarray<string>—A list of security groups associated with the VPC endpoint.
vpcOptions.subnetIdsarray<string>yesA list of subnet IDs associated with the VPC endpoint.
vpcOptions.vpcAttachmentOptionsobject—Options for attaching a VPC to the pipeline.
vpcOptions.vpcAttachmentOptions.attachToVpcbooleanyesWhether the pipeline should be attached to the provided VPC
vpcOptions.vpcAttachmentOptions.cidrBlockstringyesThe CIDR block to be reserved for OpenSearch Ingestion to create elastic network interfaces (ENIs).
vpcOptions.vpcEndpointManagementenum—Defines whether you or Amazon OpenSearch Ingestion service create and manage the VPC endpoint configured for the pipeline. Allowed: CUSTOMER, SERVICE

Status

FieldTypeRequiredDescription
attemptinteger—Attempt counts failed create/delete requests; it salts the Cloud Control idempotency token so a retry is not served the cached failure.
awsProviderobject—AWSProvider confirms the account and region this resource was reconciled against.
awsProvider.accountIdstring—AccountID the resource lives in.
awsProvider.namestring—Name of the AWSProvider used; empty when the operator's own credentials were used.
awsProvider.regionstring—Region the resource lives in (empty for global services).
conditionsarray<object>—Conditions describe the current state of the resource.
conditions[].lastTransitionTimestringyeslastTransitionTime is the last time the condition transitioned from one status to another.
conditions[].messagestringyesmessage is a human readable message indicating details about the transition.
conditions[].observedGenerationinteger—observedGeneration represents the .metadata.generation that the condition was set based upon.
conditions[].reasonstringyesreason contains a programmatic identifier indicating the reason for the condition's last transition.
conditions[].statusenumyesstatus of the condition, one of True, False, Unknown. Allowed: True, False, Unknown
conditions[].typestringyestype of condition in CamelCase or in foo.example.com/CamelCase.
identifierstring—Identifier is the Cloud Control primary identifier of the resource.
ingestEndpointUrlsarray<string>—A list of endpoints that can be used for ingesting data into a pipeline Read-only: reported by AWS after creation.
lastSyncTimestring—
observedGenerationinteger—
operationstring—Operation is the in-flight operation (CREATE, UPDATE, DELETE).
operationStatusstring—OperationStatus is the last reported operation status.
pipelineArnstring—The Amazon Resource Name (ARN) of the pipeline.
requestTokenstring—RequestToken tracks an in-flight asynchronous operation.
vpcEndpointServicestring—The VPC endpoint service name for the pipeline.
vpcEndpointsarray<object>—The VPC interface endpoints that have access to the pipeline.
vpcEndpoints[].vpcEndpointIdstring—The unique identifier of the endpoint.
vpcEndpoints[].vpcIdstring—The ID for your VPC.
vpcEndpoints[].vpcOptionsobject—OSISPipelineVpcOptions is a nested property type of AWS::OSIS::Pipeline.
vpcEndpoints[].vpcOptions.securityGroupIdsarray<string>—A list of security groups associated with the VPC endpoint.
vpcEndpoints[].vpcOptions.subnetIdsarray<string>yesA list of subnet IDs associated with the VPC endpoint.
vpcEndpoints[].vpcOptions.vpcAttachmentOptionsobject—Options for attaching a VPC to the pipeline.
vpcEndpoints[].vpcOptions.vpcAttachmentOptions.attachToVpcbooleanyesWhether the pipeline should be attached to the provided VPC
vpcEndpoints[].vpcOptions.vpcAttachmentOptions.cidrBlockstringyesThe CIDR block to be reserved for OpenSearch Ingestion to create elastic network interfaces (ENIs).
vpcEndpoints[].vpcOptions.vpcEndpointManagementenum—Defines whether you or Amazon OpenSearch Ingestion service create and manage the VPC endpoint configured for the pipeline. Allowed: CUSTOMER, SERVICE