Backend Engineer, Data Engineer
Group music (UMG) and full catalog feed with 7digital. DataOps team handling 10TB+ data for day-to-day operation, moderating model training results, and designing SLIs/SLOs for EKS Clusters. More responsibilities/details as below. Optimize music (UMG) pipeline with queries and memories for Elasticsearch and PostgreSQL, the pipeline saving 90% execution time from 10+ hours to 40 mins. Migrate service from apache spark, AWS Data Lake Formation to AWS MWAA, EKS airflow environment. Design, and deliver distributed system for Ray Serve with AI team. Design, and implement a modern
Full-time / Interested in working remotely
National Taiwan University
EMBA Programs, Business Administration, Accounting, Finance and International Business.