CakeResume 找人才

size:GB Number of rows: 6,268,519,176 Qudowe Project Lead & Software Engineer Product of Pixnet Travel Hackathon 2019, a trip planner based on Instagram's data Work Experience Vpon, Data Engineer Aug 2018 ~ Oct 2020 Implement Akka-http(Scala) server endpoints for Vpon Data Platform Product Create new ETL pipelines using GCP Spark(Apache Spark) and GCP Dataflow(Apache Beam) to batch input/output hundreds of files Migrate existing ETL pipelines from AWS(Hive SQL) to GCP(BigQuery SQL) using python Migrate datawarehouse from AWS(Hive) to GCP(BigQuery) Setup Prometheus on GKE (Google Kubernetes Engine) to

Chin-Hung (Wilson) Liu I am a lead architect responsible for designing and implementing a large-scale data pipeline for Lomotif, Paktor x 17LIVE, utilizing GCP/AWS/Python/Scala, in collaboration with data science and machine learning teams in Singapore and TW HQ, as well as with the Hadoop ecosystem (HDFS/HBase/Kafka) at JSpectrum in Hong Kong and Sydney. With over 15 years of experience in designing and developing Java/Scala/Python-based applications for daily operations, I bring: ● At least 8 years of experience in data analysis, pipeline design

business process automation using data techniques on loan, credit analysis and procurement process. • Design solutions for data leakage prevention and data security. • Implement end-to-end generative AI solution integrating with GraphDB, Chatbot & Avatar. Morrison Express Corp., Data Engineer, Jan 2021 ~ Jul 2022 • Orchestrated data pipeline, ETL process and API to connect diverse data systems and facilitate data migration. • Full accountability for overseeing data architecture and services spanning 70 offices across five continents. • Integrated AWS cloud services, optimizing applications with S3, Lambda, SQS, SNS, and ECS. ASUSTeK Computer Inc., Digital Analyst, Sep

開立發票桌面程式 天下雜誌, 後端工程師, Mar 2020 ~ Jun 2020 協助天下學習產品開發 研究 airflow 功能，管理數據分析流程 交接以 Laravel 製作 ETL 專案 協助建立工程文件 協助維護的產品 天下學習 數據分析系統 104 人力銀行, 後端工程師, Jul 2019 ~ Jan 2020 使用 Laravel 框架建立產

maintenance and optimization cost of AI projects with integration of customizable data validation, metadata registration, and time/memory-profiling tools. Ensure flexibility and extensibility in pandas-like packages (such as CuDF, Polars, PySpark, etc) for future parallelizability, targeting 1000X speedup. Responsibility: Coordinate the design and development of ETL framework components. Give instruction to ETL research intern and provide code review and design guidance for the project participants. Accomplishment: Have wrapped the framework into a workable python package and successfully imported it into two production projects, with ETL business logic automatically rendered on the Airflow UI

Git / SVN Android APP Arduino Development Container Technology and Kubernetes Operating Experience Experience / 經歷 Senior Java Developer at Delta Electronics / 台達電子工業股份有限公司 (2018/03~present) 於台達IABG內進行Holmes Project之ETL相關專案開發、管理。 Senior Java Developer at Delta Electronics / 台達電子工業股份有限公司 (2017/03~2018/03) 於台達研究院內進行Block Control、IoT、Big Data Analytics Platform