Senior Data Engineer (數據工程師)

Job Description

Responsibilities:
- Develop core components in distributed SQL engine (mainly using Spark and Presto)
- Develop distributed computing architecture in CannerFlow
- Develop and operate and manage data infrastructure
- Develop new connectors to data-sources and maintain existing connectors

Requirements

Requirements:
- A BS or MS degree in Computer Science or Computer Engineering, or equivalent experience
- Familiar with Scala or Java
- Experience in Docker
- Experience of using AWS, Azure, and/or Google Cloud Platform
- Experience with SQL and relational databases such as Postgres or MySQL
- Experience big data technologies such as HDFS, Spark, etc..

Plus:
- Experience of using Kubernetes
- Experience of using any Distributed SQL Engine (Hive, Presto, Spark SQL …etc)
- Familiar with scripting languages (such as NodeJS and Python, etc..)

Personal Invitation Link

Please Sign in or Register to get your personal invitation link.

View all jobs

Canner (易開科技)

板橋區民生路一段 33 號 7F 之 2 (正隆大樓)

About us

Canner 的 CannerFlow - 跨資料庫虛擬資料倉儲系統 - 讓您輕鬆的把數據孤島 連結、聚合、轉換、合作、到呈現 轉化為企業影響力。導入 CannerFlow 也只需要短短幾分鐘不需要像過去數日數月的時間建置數據渠道,且不需要擔心數據增長的問題 CannerFlow 會自動化的擴充運算與優化,像是全自動的 data engineer。

CannerFlow 能夠快速的把企業的各種資料庫以及資料倉儲資料進行轉換連結到各式 BI, AI 軟體,更重要的是 DBA 可以針對團隊中每個人的使用情境切分用量、每個資料庫 "欄位" 權限,讓團隊不同職位的人能夠在數據上比過去更簡單的協作!

Team

Howard Chi

Similar Jobs

Mid. - Sr. 後端工程師 Backend Engineer

H2 Inc.
Full-timeMid-Senior level800K ~ 1.4M TWD/yearUpdated 17 days ago

CakeResume Job Search

Tens of thousands of jobs listings. Salary transparency. Accurate and instant search experience.