aws-classic-ts-lakeformation

AWS Lake Formation Permissions with S3, Glue, Iam User, IAM Roles

AWS Lake Formation Permissions with S3, Glue, Iam User, IAM Roles.

Deployment

1. Initialize a new stack called: vpc-fargate via pulumi stack init.

   pulumi stack init vpc-fargate-dev

2. Install dependencies. Note that the "@pulumi/aws" in package.json has to at/above 4.19.0. Otherwise, you will get the error below.

   error: aws:lakeformation/permissions:Permissions resource 'demo-lakepermissions' has a problem: ExactlyOne: "table_with_columns": only one of `catalog_resource,data_location,database,table,table_with_columns` can be specified, but `catalog_resource,database` were specified.. Examine values at 'Permissions.TableWithColumns'.

   npm install

3. View the current config settings. This will be empty.

   pulumi config

   KEY                     VALUE

4. Populate the config.

   Here are aws endpoints

   pulumi config set aws:region us-east-2 # any valid aws region endpoint
   

5. Run pulumi up

   pulumi up -y

   Results

   Previewing update (dev)
   
      View Live: https://app.pulumi.com/myuser/aws-ts-lakeformation/dev/updates/1
   
      Type                                   Name                                 Status      
   +   pulumi:pulumi:Stack                    aws-ts-lakeformation-dev             created     
   +   ├─ aws:s3:Bucket                       demo-datalake-bucket                 created     
   +   ├─ aws:iam:User                        demo-datalake-iam-user               created     
   +   ├─ aws:glue:CatalogDatabase            demo-datalake-glue-catalog-database  created     
   +   ├─ aws:iam:Role                        demo-datalake-role-0-iamrole         created     
   +   ├─ aws:iam:Policy                      demo-datalake-datalakebasic-policy   created     
   +   ├─ aws:glue:CatalogTable               demo-datalake-glue-catalog-table     created     
   +   ├─ aws:iam:UserPolicyAttachment        demo-datalake-userpolicyattachment   created     
   +   ├─ aws:iam:RolePolicyAttachment        demo-datalake-role-0-policy-1        created     
   +   ├─ aws:iam:RolePolicyAttachment        demo-datalake-role-0-policy-3        created     
   +   ├─ aws:iam:RolePolicyAttachment        demo-datalake-role-0-policy-4        created     
   +   ├─ aws:iam:RolePolicyAttachment        demo-datalake-role-0-policy-0        created     
   +   ├─ aws:iam:RolePolicyAttachment        demo-datalake-role-0-policy-2        created     
   +   ├─ aws:lakeformation:Permissions       demo-lakepermissions                 created     
   +   ├─ aws:lakeformation:DataLakeSettings  demo-datalakesettings                created     
   +   └─ aws:lakeformation:Resource          demo-lakeformation                   created     
   
   Outputs:
      adminpermission_for_datalakesettings_name: {
         admins                          : [
               [0]: "arn:aws:iam::12334567768:role/demo-datalake-role-0-iamrole-44583c9"
               [1]: "arn:aws:iam::12334567768:user/demo-datalake-iam-user-0a334f2"
         ]
         id                              : "2686881313"
         urn                             : "urn:pulumi:dev::aws-ts-lakeformation::aws:lakeformation/dataLakeSettings:DataLakeSettings::demo-datalakesettings"
      }
      bucket_name                              : "demo-datalake-bucket-581d8c7"
      glue_database_catalog_table_name         : "mycatalogtable"
      glue_database_name                       : "mycatalogdatabase"
      lakeformation_iam_user_name              : "demo-datalake-iam-user-0a334f2"
      lakeformation_permissions_name           : "3786145756"
      lakeformation_role_name                  : "demo-datalake-role-0-iamrole-44583c9"
      lakeformations_name                      : "arn:aws:s3:::demo-datalake-bucket-581d8c7"
   
   Resources:
      + 16 created
   
   Duration: 20s

6. View the outputs

   pulumi stack output

   Results

   Current stack outputs (8):
       OUTPUT                                     VALUE
    adminpermission_for_datalakesettings_name  {"admins":["arn:aws:iam::12334567768:role/demo-datalake-role-0-iamrole-44583c9","arn:aws:iam::12334567768:user/demo-datalake-iam-user-0a334f2"],"createDatabaseDefaultPermissions":[],"createTableDefaultPermissions":[],"id":"2686881313","trustedResourceOwners":[],"urn":"urn:pulumi:dev::aws-ts-lakeformation::aws:lakeformation/dataLakeSettings:DataLakeSettings::demo-datalakesettings"}
    bucket_name                                demo-datalake-bucket-581d8c7
    glue_database_catalog_table_name           mycatalogtable
    glue_database_name                         mycatalogdatabase
    lakeformation_iam_user_name                demo-datalake-iam-user-0a334f2
    lakeformation_permissions_name             3786145756
    lakeformation_role_name                    demo-datalake-role-0-iamrole-44583c9
    lakeformations_name                        arn:aws:s3:::demo-datalake-bucket-581d8c7

7. Destroy the stack

   pulumi destroy -y

8. Remove the stack

   pulumi stack rm