size:GB Number of rows: 6,268,519,176 Qudowe Project Lead & Software Engineer Product of Pixnet Travel Hackathon 2019, a trip planner based on Instagram's data Work Experience Vpon, Data Engineer Aug 2018 ~ Oct 2020 Implement Akka-http(Scala) server endpoints for Vpon Data Platform Product Create new ETL pipelines using GCP Spark(Apache Spark) and GCP Dataflow(Apache Beam) to batch input/output hundreds of files Migrate existing ETL pipelines from AWS(Hive SQL) to GCP(BigQuery SQL) using python Migrate datawarehouse from AWS(Hive) to GCP(BigQuery) Setup Prometheus on GKE (Google Kubernetes Engine) to

助公司 app 增加 6 % 用戶參與度並獲得 70 % 用戶滿意度 - 運用 DVC 建置 model experiment tracking, dataset versioning 以及 model management 【Airflow 定期排程以及維運 data reports】 - 創建 2 個 ETL pipeline - 幫助 3 個不同部門維護 8 個 data reports - 利用 python 去處理並且整合 SQL, Google big query, AWS S3 bucket 不同來源的 data source 【Data analysis】 - 根據各部門所需提

Emily Ledoux Delivery Principal Seasoned Delivery Principal in the Data Practice. Focused on designing robust, scalable data ecosystems in the cloud to feed insights and data visualizations. Well-rounded consultant with experience spanning sales, recruiting, and delivery. Proven Delivery & Client Lead. Portland, OR, USA https://www.linkedin.com/in/emily-ledoux/ Work Experience JanuaryPresent Principal Data Architect Kin + Carta Delivery or Client Lead for over 25 resources, including direct reports, delivery oversight, hours tracking, QBRs, onboarding management, budget ownership and related responsibilities. Cloud Architect, designing Azure and

load for a particular site level. Have been using Data lake, Azure SQL Database, Azure Databricks, Azure Synapse Analytics as intermediate layer for data storage and end products involving Facts and Dimensions that can be further consumed by Azure Analysis Services. Worked on writing SQL Logic that involves pipeline re-run process so that pipeline can be re-run from the same watermark point as it was failed to avoid data loss. Also worked on Logic App to ingest the data from SQL Database into Sharepoint List on the basis of Row Active flag. Cloud Consultant

Chart, Terraform, ArgoCD, Gitlab CI - Workflow: Argo Workflow Key Roles and Achievements: - iKala Interactive Media Inc.: - Served as an Architect, designing cross-team interfaces and leading AI department design documentation efforts. - As a Senior Backend Engineer, refactored crawler services, developed the Datahub system, and led ML Inference and ETL pipeline integration projects. - Lintor International Co., Ltd.: - Led the design and implementation of 33 games, demonstrating leadership in game logic system development. - Developed a Golang server framework and implemented microservices to enhance system functionality. - CHUNG YO INTERNET INFORMATION CO., LTD.: - Maintained platform

Yoyo Lu, Data Analyst professional [email protected] Resourceful Data Analyst and Programmer with 5+ years of experience at Alfred Labs. Strong background in Mathematics and Computer Science. Adept at providing crucial analysis to cooperating teams. WORK EXPERIENCE Alfred Labs., Data Science, Jul 2017 ~ Present As an early employee of the company, I played a pivotal role in the development of our data infrastructure. This included the creation of robust ETL pipelines and automated dashboards, key advancements that enabled the entire organization to make data-driven decisions. My expertise in designing

. Migrate part of services from on-perm (Hadoop) to cloud (AWS) to become a hybrid cloud environment. Senior Data Engineer/ Team Lead, at BOOYAH! Live Garena．Oct,Sep, 2022 Working at ML team as a first data engineer. The challenge include build up data warehouse/pipeline from scratch. And design the data flow to support both batch/real-time recommendation systems. More responsibilities/details as below. Design data model from scratch and Manage Hadoop based data warehouse for the training system. Develop streaming ETL pipeline via Spark from Message