Senior Data Engineer (數據分析團隊,Imagineer )

Job Description

【工作簡介】  你邏輯清晰,龐大且雜亂無章的資料,經過你的設計的資料架構、收集、清洗後,便成了分析師好用的資訊嗎?你膽大心細,富有組織能力又有工程師的實作經驗,並尋尋覓覓一個以data-driven的公司嗎?如果你想要帶給世界一些正面的改變,或許你就是我們在找的人!Migo企圖解決數位落差的挑戰,自行研發軟體技術、硬體設備、傳輸系統,讓開發中國家消費者能以親近的價格於我們佈設的熱點下載影音內容,並能夠於行動裝置上離線觀看,不再受到網路的限制。

Migo’s Data Science Team將負責建構數據分析工具,幫助Migo各部門解決各種複雜的問題,提供business insight並根據數據做決策。Data Science Team 透過敏捷式開發各種跨部門專案,如果你喜歡步調快、變化多端的工作環境,不僅握有一身專業更期待自己成為跨領域人才,有滿滿的學習能量,歡迎加入我們!

【Responsibility】

  • Design, develop, document, and test advanced data systems that bring together data from disparate sources, making it available to data scientists, analysts, and other users using scripting and/or programming languages (Python, Java, etc) 
  • Design, develop, implement and scale data processing pipelines and data schemas according to business needs.
  • Write and refine code to ensure performance and reliability of extracting data from multiple sources, integrating disparate data into a common data model, and integrate data into a target database, application, or file using efficient programming processes.; debug data pipeline and ensure the timely delivery of application;
  •  Manage deployment/data migration of the platform on public clouds and private clouds. Familiar with CI/CD tools, such as Jenkins and workflow management tools, such as Oozie, Luigi or airflow.
  •  Evaluate structured and unstructured datasets utilizing statistics, data mining, and predictive analytics to gain additional business insights.
  •  Independently initiates and drives projects; communicate data warehouse plans to internal stakeholders. 
  •  Recommend process improvements to increase efficiency and reliability in ETL development. 
  •  Constantly updates knowledge by tracking and understanding emerging data pipeline practices and solutions.
  •  Provide guidance and mentoring to less experienced team members 

Requirements

【Our Ideal candidate】 o 3-5 years of experience building and operating large scale distributed systems or applications o 8 years hands-on experience in the data warehouse space, custom ETL design, implementation and maintenance. o Deep domain knowledge on data pipeline for both real-time and batch-processing data applications in Big Data and Machine Learning Platform. Familiar with following big data and distributed computing technology (e.g. Hive, Spark, Presto, Parquet, Cassandra,…) and production level data lake solutions (e.g. Hadoop Cluster or AWS S3). o Experience with design and implementing real-time monitoring/alerting systems with Splunk or ELK stack. o Experience with batch processing and streaming data pipeline/architecture design patterns such as lambda architecture or kappa architecture. o Experience in SQL or similar languages and development experience in at least one scripting language (Python preferred). o Bachelor's degree in Computer Science, Information Management or related field.

Salary

1M ~ 1.8M TWD / year

Location

台北

Share this Job

Please Sign in or Register to get your personal invite link.

Team

Yi-Chieh Chen
Default avatar

Other Popular Jobs at Migo熱鬧點科技

Engineering Jobs

Senior Full-Stack Developer

Full-timeMid-Senior level1.3M ~ 1.9M TWD / yearUpdated 4 days ago

Technology Jobs

Principal Software Architect

Full-timeMid-Senior level1.5M ~ 2.5M TWD / yearUpdated 4 days ago

Senior SRE

Full-timeMid-Senior level1.2M ~ 1.7M TWD / yearUpdated 5 days ago

Principal Software Engineer in Test / SDET

Full-timeMid-Senior level1.5M ~ 2M TWD / yearUpdated 5 days ago

Senior Mobile Developer

Full-timeMid-Senior level1.2M ~ 1.7M TWD / yearUpdated 9 days ago

Senior User Interface (UI) Designer

Full-timeMid-Senior level800K ~ 1.5M TWD / yearUpdated 30 days ago

Design Jobs

Senior User Experience (UX) Designer

Full-timeMid-Senior level900K ~ 1.7M TWD / yearUpdated 5 days ago

Similar Jobs

Page  logo 1482125639

Machine Learning Engineer (Visual Creativity)

Do you want to make multimedia magic for millions of users around the world? ...
Page  logo 1482125694

數據分析師

~~~~~~~~~~~~~~~~未來熱門產業佈局你知道是什麼嗎 ? 成功者不光想著現在,更須籌劃著未來!!!當下知名企業Amazon、迪士尼、蘋果全投入大...
Vgin0wcgkvm5tyygv3m9

Data Scientist

WeMo Scooter 籌備規劃Data Team中,需要有經驗的你加入,讓大量的資料發揮應用價值,並提供即時的決策: 執行資料清洗及探索...
Wobidf4op2fgkpipzunf

Deep Learning Engineer/Researcher

Responsibility: Support the design, development and model testing for NLP, t...