51 - 200 people

Data Backend Engineer (Hadoop, Spark related)

Job Description

1. Develop and operate data warehouse system and ETL pipeline for data access, collection, processing and storage, and support data analysis tasks
2. Manage deployment of the platform on public clouds with hundreds of instances across the globe
3. Dedicate to Big Data and Machine Learning Platform using Apache Spark and related technologies
4. Responsible for laying the foundation for the platform as well as proposing solutions to ease software development, monitoring of software, etc.
5. Handling hundred of terabyte data



Qualification: 1. 2+ years of experience building and operating large scale distributed systems or applications 2. Experience with operating Spark or Hadoop farm 3. Experience with managing data storage using HDFS and Cassandra 4. Expertise in developing data structures, algorithms on top of Big Data platforms 5. Ability to operate effectively and independently in a dynamic, fluid environment 6. Ability to work in a fast-moving team environment and juggle many tasks and projects 7. Eagerness to change the world in a huge way by being a self-motivated learner and builder Other: 1. Degree from a top Computer Science school or a related technical discipline a plus 2. Contributing to open source projects a huge plus (Please include your github page) 3. Experience working with Scala a plus 4. Experience with Hadoop, Hive, Flink, Storm, Presto and related big data systems is a plus 5. Experience with Public Cloud like AWS is a plus



Similar Jobs

愛卡拉互動媒體股份有限公司 - LIVEhouse 客戶經理 (Account Manager)

【LIVEhouse事業簡介】LIVEhouse 協助品牌或企業主製作高規格直播節目,並提供客製化及完整直播整合行銷方案,讓品牌主用直播來傳達形象、經營社群。 【你的工作內容是...】 1. 廣告策略企劃與執行 2. 具獨立完成簡報的能力 3. 良好的內部溝通與領導能力、完整及仔細的執行能力4. 能提供專業業務服務,且具獨立應對客戶在溝通、維繫與客戶情...

17 Media - Project Manager - 17 Live Streaming



2018 Senior Developer Speed Interview

2018 Senior Developer Speed Interview


此次活動由 CakeResume 嚴選 10 家科技公司,聯合舉辦快速面試活動。iOS / Android / Web / Unity / Hardware / Server 等高薪職缺,2018.03.03 等你來挑戰!