Skip to content

ETL (extract, transform, load) pipeline project that involves extracting data from flat files, manipulating and organizing the data through a series of transformation steps, and loading the resulting data into an SQLite database.

License

Notifications You must be signed in to change notification settings

saboye/Extract-Transform-Load-Weather-Data

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

19 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Extract Transform Load Weather Data

GitHub contributors GitHub forks GitHub issues GitHub GitHub last commit


Logo

ETL

project description
Explore the docs »

View Demo · Report Bug · Request Feature

Table of contents

  1. About The Project
  2. Installation
  3. Schema
  4. Data Wearhouse demo
  5. License
  6. Contact
  7. Acknowledgements

About The Project

In this project, I create an ETL pipeline that extracts data from flat files and transforms and loads it into an SQLite database. The project tasks need to define the data warehouse Schema for a particular analytic use.

Installation

  1. requirement
pip install pysqlite

2,

git clone https://github.com/saboye/Extract-Transform-Load-Weather-Data.git

Schema

CREATE TABLE IF NOT EXISTS weather (
    day DATE,	    -- day of measurements
    min_temp FLOAT, -- min temperature in Fahrenheit
    max_temp FLOAT, -- max temperature in Fahrenheit
    snow INTEGETR   -- snow in inches
);

CREATE INDEX IF NOT EXISTS weather_day ON weather(day);

Data Wearhouse demo

To see or to make a SQL query, After downloading please drag and drop the weather.db to https://db.samuelaboye.dev/

License

Distributed under the MIT License. See LICENSE for more information.

Contact

Your Name - @saboye

Project Link: https://github.com/saboye/Extract-Transform-Load-Weather-Data

Acknowledgements

About

ETL (extract, transform, load) pipeline project that involves extracting data from flat files, manipulating and organizing the data through a series of transformation steps, and loading the resulting data into an SQLite database.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages