【Job Description】

1. Design, implement and deploy data pipeline

2. Ensure the accuracy, completeness and timeliness of data stored in the data lake.

3. Automating manual processes, optimizing data delivery.

4. Cooperate with data analysts for statistics reports and data mining.

【Must to have】

1. Experience in Amazon Web Services (Lambda, S3, EMR, Athena, IAM, etc.)

2. Good implementation skills with Python or SQL.

3. 2+ years of experience working with data pipeline or software development.

【Nice to have】

1. Experience in big data frameworks and tools, such as Hadoop, Hive and Spark.

2. Experience with Cloudformation, Terraform or CDK.

3. Familiar with Kubernetes and Docker.