Big Data Engineer (3005433)

產業類別： 電腦軟體相關

職責要求

Our Big Data team focuses on implementing the business intelligence platform to support multiple internal partner teams to meet their operational needs. We are responsible for establishing processes for continual improvement, crafting data and reporting solutions at large scale. Our mission is to keep our business running optimally while maintaining a balanced application environment.

As a member of the Big Data team, you will build and own mission-critical data pipelines as well as modern data warehouse solutions while collaborating closely with Data Science, Marketing, and Product teams.

You will be a part of an early stage team and have a significant stake in defining its future with a considerable potential to impact all of revenue and millions of users. Your efforts will reveal invaluable business and user insights to fuel revenue by leveraging vast amounts of data.

1.Experience with Hadoop or other MapReduce-based architectures

2.Good understanding of one or more of the following: Python, Scala, C++, or Java

3.Experience working with large data volumes

4.Experience writing Big Data pipelines, as well as custom or structured ETL, implementation and maintenance

5.Experience with large-scale data warehousing architecture and data modeling Experience with Druid or Apache Flink

6.Experience with real-time streaming (Apache Kafka, Apache Beam, Heron, Spark Streaming)

7.Ability in managing and communicating data warehouse project plans to internal clients