Big Data Engineer

Updated about 2 months ago

Job Description

We are looking for talents with skills and interests as Big Data Engineer who will join us to develop enterprise scale solution assets. In the AI era, data are essential to all kinds of application innovations, e.g. IT management automation with pro-active sense and respond, online user intention discovery and personalized services, non-stop robotic manufacturing etc. Big Data Management is a critical stage towards digging out insightful info from the new oil. There needs solid knowledge of data variety, dealing with large volume of data with scalable architecture design etc.

There will be needs of working at client-sites or traveling domestically and internationally on demand.
English communication is required for collaborating with global stakeholders and team. The candidate's job responsibilities include:
- Understand technical requirements based on written or verbal communications.
- Develop, test and maintain adaptable data management systems.
- Apply DevOps methodology and tools.
- Apply state-of-the-arts Big Data technologies.

The ideal candidate will have solid knowledge of Big Data technologies and experiences of Big Data application development & management.

Requirements

*Required Professional and Technical Expertise

- Solid experiences (design and build data processing pipelines) of ETL by structured and non-structured DBMS technologies.

- Experiences of operationalizing machine learning models.

- Experiences of BI application development and maintenance.

- Experiences of GCP: DataProc, DataFusion, DataFlow, BigQuery, BigTable, Pub/Sub, GKE, Piper Framework.

- Experiences of Python, Spark, PySpark, Hadoop, Hive, HBase, NiFi.

- Good analytical and problem-solving skills. 

- Quick learner of state-of-the-arts Big Data technologies.

- Excellent teamwork, knowledge sharing and communication skills.



    *Preferred Professional and Technical Expertise

    - CS related disciplines is a plus.

    - Linux shell commands and hypervisors, such as VMWare, KVM, or Xen is a plus.

      1
      1.5M ~ 2.2M TWD / year
      Optional Remote Work
      Personal Invitation Link
      This is your personal referral link for job invitation. You'll receive an email notification when someone applied for the position via your job link.
      Share this job
      Logo of IBM Taiwan.

      About us

      IBM 台灣招募網站:https://ibm.com/jobs/tw


      IBM 是全球領先的混合雲、人工智慧及企業服務的提供者,為全球超過 175 個國家的客戶服務,協助其從擁有的資料裡獲取商業洞察、簡化業務流程、降低成本,並取得產業競爭優勢。屬於金融服務、電信和健康醫療等關鍵基礎設施領域、近 3,800 家政府和企業機構,採用 IBM 混合雲平台和紅帽 OpenShift 解決方案,快速、高效、安全地實現企業數位轉型。IBM 在人工智慧、量子運算、產業導向的雲端運算解決方案和企業服務領域的突破性創新,為客戶提供開放和靈活的選擇。IBM 對企業誠信、透明治理、企業社會責任、多元與包容文化和服務精神的承諾,歷久彌新,是 IBM 業務發展的基礎。

      IBM是全球唯一一家營運超過一世紀的科技公司。在全球致力於透過最先進與創新的技術,將智慧注入我們的日常生活,協助解決各行業的問題,帶給每一個人更好的生活。在台灣,我們將持續以IBM創新的技術、深厚的產業知識,提供客戶可信賴且安全的服務,協助企業加速探索與實現目前還未知的新服務、新商業模式、新形態,提高台灣企業整體的競爭力與價值。

      At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. To lead in this new era of technology and solve some of the world's most challenging problems.

      IBM is a leading cloud platform and cognitive solutions company. Restlessly reinventing since 1911, we are the largest technology and consulting employer in the world, with more than 380,000 employees serving clients in 170 countries. With Watson, the AI platform for business, powered by data, we are building industry-based solutions to real-world problems. For more than seven decades, IBM Research has defined the future of information technology with more than 3,000 researchers in 12 labs located across six continents. For more information, visit www.ibm.com.


      Team

      Avatar of the user.
      Talent Acquisition Partner
      Avatar of the user.
      Talent Acquisition Partner
      Avatar of the user.
      Talent Acquistion Partner
      Avatar of the user.
      Talent Acquistion Partner

      Other Popular Jobs at IBM Taiwan

      Android Developer

      Application Developer: Mobile Android

      Full-time
      Mid-Senior level
      3
      1.3M ~ 1.7M TWD / year
      Updated about 2 months ago

      App Developer

      Application Developer: Java & Web Technologies

      Full-time
      Entry level
      17
      1.3M ~ 1.7M TWD / year
      Updated about 1 month ago

      Back-end Engineer

      Cloud Application Developer

      Full-time
      Entry level
      1
      900K ~ 1.2M TWD / year
      Updated about 2 months ago

      DevOps / System Admin

      Application Developer - DevOps

      Full-time
      Entry level
      1
      900K ~ 1.7M TWD / year
      Updated about 1 month ago

      Front-end Engineer

      Application Developer: React JS Developer

      Full-time
      Entry level
      8
      1.3M ~ 1.7M TWD / year
      Updated about 1 month ago

      Application Developer: Experience Front End

      Full-time
      Entry level
      1
      800K ~ 1.4M TWD / year
      Updated about 1 month ago

      Full Stack Development

      Application Architect: Java & Web Technologies

      Full-time
      Mid-Senior level
      1
      1M ~ 2.8M TWD / year
      Updated about 1 month ago

      Application Architect: Full Stack

      Full-time
      Mid-Senior level
      1
      2M ~ 2.8M TWD / year
      Updated about 2 months ago

      iOS Developer

      Application Developer: Mobile iOS

      Full-time
      Entry level
      3
      1.3M ~ 1.7M TWD / year
      Updated about 1 month ago

      Project / Product Management

      System Analyst

      Full-time
      Entry level
      3
      1M ~ 2M TWD / year
      Updated about 1 month ago

      Software Engineer

      Technical Architect - IBM Cloud Site Reliability

      Full-time
      Entry level
      1
      1.4M ~ 2M TWD / year
      Updated about 2 months ago

      IBM Security SOAR Platform – BE SW Development and Support

      Full-time
      Entry level
      1
      1M ~ 1.5M TWD / year
      Updated about 2 months ago

      System Architecture

      Solution Architect-Enterprise Transformation

      Full-time
      Mid-Senior level
      8
      2M ~ 2.8M TWD / year
      Updated about 2 months ago

      Technical Customer Service Engineer

      Cloud Engineer – Client Engineering

      Full-time
      Entry level
      1
      1M ~ 1.8M TWD / year
      Updated about 2 months ago

      Product Engineer

      Infrastructure Specialist-Server Product Services-System z

      Full-time
      Entry level
      1
      800K ~ 1.2M TWD / year
      Updated about 2 months ago

      Consultant

      Application Consultant: Mobile

      Full-time
      Entry level
      3
      1M ~ 2M TWD / year
      Updated about 1 month ago

      Data Analyst

      Business Analyst

      Full-time
      Mid-Senior level
      15
      1.4M ~ 1.9M TWD / year
      Updated about 1 month ago

      Project Manager

      Scrum Master -Project Manager

      Full-time
      Mid-Senior level
      4
      1.3M ~ 2.8M TWD / year
      Updated about 1 month ago