Popular repositories

1. 02-airflow-gcs-bigquery-pipeline 02-airflow-gcs-bigquery-pipeline Public

   Airflow script that ingest data from API and upload it to gcs bucket

   Python 2

2. 01-upload-to-gcp-buckets 01-upload-to-gcp-buckets Public

   Simple python scripts to upload local files into GCP's bucket containerized with docker.

   Python

3. 03-bigquery-query 03-bigquery-query Public

   Example of complex query performed on BigQuery's public data. Task description are on REAMD.MD

4. 04-dbt-analyticial-engineering 04-dbt-analyticial-engineering Public

   Performing transformation from staging into dim and fact tables used on Data Warehouse with dbt tools.

5. 05-data-visualization-and-spark-install 05-data-visualization-and-spark-install Public

   Task repo to try out visualization with Google Looker Studio and create pyspark installation guide

6. 06-sparksql-dataframes 06-sparksql-dataframes Public

   Perform certain task using spark dataframe and sql. Task description are on README.MD. Airflow orchestration on progress.

   Python