[台北]Data Engineer

TechDesign

Job Description

• Design, construct, install, test and maintain highly scalable data pipelines with state-of-the-art monitoring and logging practices.

• Investigate and resolve performance and stability issues in data processing systems and advise necessary infrastructure changes
• Select and integrate data tools and frameworks required to provide requested capabilities
• Recommend ways to improve data reliability, efficiency and quality.
• Collaborate with Data Scientists, DevOps and Project Managers on meeting project goals.

Requirements

Minimum qualifications: • BS or MS in Computer Science or Computer Engineering • Proficient understanding of distributed computing principles • Data warehouse experience with major ETL tool. The experience and knowledge of good hands in any ETL tools is required. • Familiar with relational database and NoSQL database. like MySQL, Hadoop/HBase, MongoDB, Redis…etc • 3+ years of experience in working with big data using technologies like Spark, Kafka, Flink, Hadoop, and NoSQL datastores. • 2+ years of experience on distributed, high throughput and low latency architecture. • 2+ years of experience deploying or managing data pipelines for supporting data-science-driven decisioning at scale. Preferred qualifications: • A successful track-record of processing and extracting value from large disconnected datasets. • Machine learning or statistics related knowledge • Experience with the AWS ecosystem tools and system level DevOps tools. 薪資視個人能力與經驗面議

Location

台北台灣

Share this Job

Please Sign in or Register to get your personal invite link.

TechDesign

(10351)台北市大同區承德路一段40號5樓

About us

TechDesign was founded in 2015 under Winbond Electronics Corp, the trusted name in semiconductors since 1987. The idea behind the formation of TechDesign was simple: we saw a growing need to make the increasingly complex electronics supply chain more accessible to small and medium sized enterprises and big corporations alike. Since then, we have stayed true to our roots by making TechDesign a place where our clients and suppliers can connect with ease.

See more

Learn more

Team

Default avatar
Default avatar
Default avatar
Default avatar

Similar Jobs

Hadoop/Spark System Developer 軟體工程師

WASAI Technology - Full-timeEntry level50K ~ 70K TWD/monthUpdated 14 days ago

Spark/Scala Engineer/DevOp

WASAI Technology - Full-timeEntry level50K ~ 80K TWD/monthUpdated 14 days ago

CakeResume Job Search

Tens of thousands of jobs listings. Salary transparency. Accurate and instant search experience.

Other Popular Jobs at TechDesign

Technology Jobs

[台北]Project Manager

Full-timeMid-Senior levelUpdated 2 months ago

[台北]Technical Lead/Manager

Full-timeMid-Senior levelUpdated 2 months ago

[台北]Backend Software Engineer

Full-timeEntry level50K ~ 80K TWD/monthUpdated 4 months ago

[台北]UX & Research

Full-timeEntry level40K ~ 70K TWD/monthUpdated 4 months ago

[台北]Full Stack Developer

Full-timeEntry levelUpdated 4 months ago

[台北]Senior Backend QA Engineer

Full-timeEntry levelUpdated 4 months ago

[台北]DevOps Engineer

Full-timeEntry levelUpdated 4 months ago

[台北]Project Manager

Full-timeEntry level50K+ TWD/monthUpdated 7 months ago

Marketing & Business Development Jobs

[台北]Business Development Manager - Buyer

Full-timeEntry levelUpdated 4 months ago

[台北]Supplier Chain Manager

Full-timeEntry level50K+ TWD/monthUpdated 7 months ago