aws-classic-py-aws-load-balancer-controller-helm-release

AWS EKS SPOT Managed Nodes with Helm Chart aws-load-balancer-controller via Release

AWS eks with spot managed nodes in python. Helm Release of aws-load-balancer-controller More info on Helm Release

Deployment

1. Initialize a new stack called: dev via pulumi stack init.

   pulumi stack init dev

2. Create a Python virtualenv, activate it, and install dependencies:

   python3 -m venv venv
   source venv/bin/activate
   pip3 install -r requirements.txt

3. View the current config settings. This will be empty.

   pulumi config

   KEY                     VALUE

4. Populate the config. Here are aws endpoints

   Setting subnets via pulumi config set-all

   pulumi config set aws:region us-east-2 # any valid aws region
   pulumi config set vpc_cidr_block 10.0.0.0/23
   pulumi config set number_of_nat_gateways 1 # optional
   pulumi config set-all --path --plaintext public_subnet_cidr[0]="10.0.0.0/25" --plaintext public_subnet_cidr[1]="10.0.0.128/26" --plaintext public_subnet_cidr[2]="10.0.0.192/26"
   pulumi config set-all --path --plaintext private_subnet_cidr[0]="10.0.1.0/26" --plaintext private_subnet_cidr[1]="10.0.1.64/26" --plaintext private_subnet_cidr[2]="10.0.1.128/25"

5. The main problem is that the ResourceOptions' provider arg doesn't yet accept Output[ProviderResource], which is tracked by pulumi/pulumi#7012.

In the meantime, this can be worked around by creating a new instance of the pulumi_kubernetes.Provider using the Cluster's kubeconfig output:

1. Launch

   pulumi up -y

   Results

   Updating (dev)
   
   View Live: https://app.pulumi.com/shaht/aws-classic-py-aws-load-balancer-controller-helm-release/dev/updates/4
   
      Type                             Name                                                          Status       
   +   pulumi:pulumi:Stack              aws-classic-py-aws-load-balancer-controller-helm-release-dev  creating.    
   +   ├─ aws:ec2:Vpc                   demo-eks-vpc                                                  created      
   +   │  ├─ aws:ec2:InternetGateway    demo-eks-igw                                                  creating     
   +   │  ├─ aws:ec2:SecurityGroup      demo-eks-security-group                                       creating     
   +   │  ├─ aws:ec2:Subnet             demo-eks-private-subnet-us-east-2a                            creating     
   +   │  ├─ aws:ec2:Subnet             demo-eks-private-subnet-us-east-2b                            creating     
   +   │  ├─ aws:ec2:Subnet             demo-eks-public-subnet-us-east-2b                             creating     
   +   │  ├─ aws:ec2:InternetGateway    demo-eks-igw                                                  created      
   +   │  ├─ aws:ec2:Subnet                    demo-eks-public-subnet-us-east-2c                             created      
   +   │  │  └─ aws:ec2:RouteTableAssociation  demo-eks-public-rt-association-us-east-2c                     creating     
   +   │  │  └─ aws:ec2:RouteTableAssociation  demo-eks-public-rt-association-us-east-2c                     creating.    
   +   │  │  └─ aws:ec2:RouteTableAssociation  demo-eks-public-rt-association-us-east-2a                     creating..   
   +   │  │  └─ aws:ec2:RouteTableAssociation  demo-eks-public-rt-association-us-east-2a                     creating...  
   +   │  │  └─ aws:ec2:RouteTableAssociation  demo-eks-public-rt-association-us-east-2a                     creating     
   +   ├─ aws:ec2:Eip                          demo-eks-eip-nat-gateway-us-east-2a                           created      
   +   │  └─ aws:ec2:NatGateway                demo-eks-natgw-us-east-2a                                     creating     
   +   │  └─ aws:ec2:NatGateway                demo-eks-natgw-us-east-2a                                     creating..   
   +   ├─ aws:iam:RolePolicyAttachment         demo-py-role0-policy-0                                        created      
   +   │  └─ aws:ec2:NatGateway                demo-eks-natgw-us-east-2a                                     creating...  
   +   ├─ aws:iam:RolePolicyAttachment         demo-py-role0-policy-1                                        created      
   +   ├─ aws:iam:RolePolicyAttachment         demo-py-role0-policy-1                                        created      
   +   ├─ aws:iam:RolePolicyAttachment         demo-py-role0-policy-1                                        created      
   +   ├─ aws:iam:RolePolicyAttachment         demo-py-role0-policy-1                                        created      
   +   ├─ aws:iam:RolePolicyAttachment         demo-py-role0-policy-1                                        created      
   +   ├─ aws:iam:RolePolicyAttachment         demo-py-role0-policy-1                                        created      
   +   ├─ aws:iam:RolePolicyAttachment         demo-py-role0-policy-1                                        created      
   +   └─ eks:index:Cluster                    demo-py-eks                                                   creating..   
   +   └─ eks:index:Cluster                    demo-py-eks                                                   creating.    
   +      │  ├─ aws:iam:Role                   demo-py-eks-eksRole-role                                      created      
   +      │  ├─ aws:iam:RolePolicyAttachment   demo-py-eks-eksRole-90eb1c99                                  created      
   +      │  └─ aws:iam:RolePolicyAttachment   demo-py-eks-eksRole-4b490823                                  created      
   +      ├─ aws:ec2:SecurityGroup             demo-py-eks-eksClusterSecurityGroup                           created      
   +   └─ eks:index:Cluster                    demo-py-eks                                                   creating.    
   +   └─ eks:index:Cluster                    demo-py-eks                                                   created      
   +      ├─ aws:ec2:SecurityGroup             demo-py-eks-nodeSecurityGroup                                 created      
   +      ├─ aws:ec2:SecurityGroupRule         demo-py-eks-eksExtApiServerClusterIngressRule                 created      
   +   │  ├─ aws:ec2:SecurityGroupRule         demo-py-eks-eksNodeInternetEgressRule                         created      
   +   │  ├─ aws:ec2:SecurityGroupRule         demo-py-eks-eksNodeIngressRule                                created      
   +   pulumi:pulumi:Stack                     aws-classic-py-aws-load-balancer-controller-helm-release-dev  creating     Warning: apiextensions.
   +   pulumi:pulumi:Stack                     aws-classic-py-aws-load-balancer-controller-helm-release-dev  creating..   Warning: apiextensions.
   +   │  ├─ pulumi:providers:kubernetes       demo-py-eks-eks-k8s                                           created      
   +   │  ├─ pulumi:providers:kubernetes       demo-py-eks-provider                                          created     
   +   │  ├─ kubernetes:core/v1:ConfigMap      demo-py-eks-nodeAccess                                        created     
   +   │  └─ eks:index:VpcCni                  demo-py-eks-vpc-cni                                           created     
   +   ├─ pulumi:providers:kubernetes          mycluster_provider                                            created     
   +   ├─ eks:index:ManagedNodeGroup           demo-py-managed-nodegroup-spot-ng0                            created     
   +   │  └─ aws:eks:NodeGroup                 demo-py-managed-nodegroup-spot-ng0                            created     
   +   ├─ kubernetes:core/v1:Namespace         awslb-controller-ns                                           created     
   +   └─ kubernetes:helm.sh/v3:Release        aws-load-balancer-controller                                  created     
   
   Diagnostics:
   pulumi:pulumi:Stack (aws-classic-py-aws-load-balancer-controller-helm-release-dev):
      Warning: apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition
   
      zone: us-east-2a
      public cidr: 10.0.0.0/25
      private cidr: 10.0.1.0/26
      zone: us-east-2b
      public cidr: 10.0.0.128/26
      private cidr: 10.0.1.64/26
      zone: us-east-2c
      public cidr: 10.0.0.192/26
      private cidr: 10.0.1.128/25
   
   Outputs:
      cluster_name                   : "demo-py-eks-eksCluster-01e16d0"
      k8s_chart                      : "aws-load-balancer-controller"
      k8s_chart_app_version          : "v2.4.0"
      k8s_namespace                  : "awslb-controller-ns-8dakd1s0"
      kubeconfig                     : "[secret]"
      managed_nodegroup_capacity_type: "SPOT"
      managed_nodegroup_name         : "demo-py-managed-nodegroup-spot-ng0-b659a06"
      managed_nodegroup_version      : "1.21"
      vpcname                        : "vpc-07d77eeda3e22cfc6"
   
   Resources:
      + 49 created
   
   Duration: 13m55s

2. View the outputs.

   pulumi stack output

   Results

    Current stack outputs (9):
    OUTPUT                           VALUE
    Current stack outputs (9):
    OUTPUT                           VALUE
    cluster_name                     demo-py-eks-eksCluster-01e16d0
    k8s_chart                        aws-load-balancer-controller
    k8s_chart_app_version            v2.4.0
    k8s_namespace                    awslb-controller-ns-8dakd1s0
    kubeconfig                       [secret]
    managed_nodegroup_capacity_type  SPOT
    managed_nodegroup_name           demo-py-managed-nodegroup-spot-ng0-b659a06
    managed_nodegroup_version        1.21
    vpcname                          vpc-07d77eeda3e22cfc6

   If you need to see the value in kubeconfig, you will have to do the following

   pulumi stack output kubeconfig --show-secrets

3. Clean up

   pulumi destroy -y

4. Remove. This will remove the Pulumi.dev.yaml file also

   pulumi stack rm dev -y