Job Description

• Design, construct, install, test and maintain highly scalable data pipelines with state-of-the-art monitoring and logging practices.

• Investigate and resolve performance and stability issues in data processing systems and advise necessary infrastructure changes
• Select and integrate data tools and frameworks required to provide requested capabilities
• Recommend ways to improve data reliability, efficiency and quality.
• Collaborate with Data Scientists, DevOps and Project Managers on meeting project goals.


Minimum qualifications:
• BS or MS in Computer Science or Computer Engineering
• Proficient understanding of distributed computing principles
• Data warehouse experience with major ETL tool. The experience and knowledge of good hands in any ETL tools is required.
• Familiar with relational database and NoSQL database. like MySQL, Hadoop/HBase, MongoDB, Redis…etc
• 3+ years of experience in working with big data using technologies like Spark, Kafka, Flink, Hadoop, and NoSQL datastores.
• 2+ years of experience on distributed, high throughput and low latency architecture.
• 2+ years of experience deploying or managing data pipelines for supporting data-science-driven decisioning at scale.

Preferred qualifications:
• A successful track-record of processing and extracting value from large disconnected datasets.
• Machine learning or statistics related knowledge
• Experience with the AWS ecosystem tools and system level DevOps tools




Share this Job

Please Sign in or Register to get your personal invite link.



About us

TechDesign was founded in 2015 under Winbond Electronics Corp, the trusted name in semiconductors since 1987. The idea behind the formation of TechDesign was simple: we saw a growing need to make the increasingly complex electronics supply chain more accessible to small and medium sized enterprises and big corporations alike. Since then, we have stayed true to our roots by making TechDesign a place where our clients and suppliers can connect with ease.


Default avatar
Default avatar
Default avatar

Other Popular Jobs at TechDesign

[台北]DevOps Engineer

Full-timeEntry levelUpdated 5 days ago

[台北]Senior Data Analyst

Full-timeMid-Senior levelUpdated 5 days ago

[台北]Software Engineer in Test

Full-timeEntry levelUpdated 5 days ago

[台北]Frontend Engineer

Full-timeEntry levelUpdated 10 days ago