ETL & Reporting of Covid Cases

Avatar of Ardhani Rahmadianto.
Avatar of Ardhani Rahmadianto.

ETL & Reporting of Covid Cases

Software Engineer - Data Engineer
Jakarta, Indonesia
On this project objective is to get Covid 19 case of Jawa Barat data from public API, store to MySQL database, then create reporting table in PostgreSQL. The reporting is about total covid 19 case by daily, monthly and yearly in each of district and province. This data will be received from API within daily schedule which automated by Airflow and all of this service applications is wrapped up using Docker. I managed to create Docker Compose file that contain services of Airflow, MySQL and PostgreSQL. Then using python and SQL script called from Airflow, the project task that explained before can be done.
Avatar of the user.
Please login to comment.

Published: Sep 24th 2022
64
7
0

Tools

docker
Docker
postgresql
PostgreSQL
mysql
MySQL
python
Python

DataPipeline

Share