Backend Engineer, Data Engineer
More responsibilities/details as below. Optimize music (UMG) pipeline with queries and memories for Elasticsearch and PostgreSQL, the pipeline saving 90% execution time from 10+ hours to 40 mins. Migrate service from apache spark, AWS Data Lake Formation to AWS MWAA, EKS airflow environment. Design, and deliver distributed system for Ray Serve with AI team. Design, and implement a modern machine learning pipeline for a recommendation, and moderation pipe. Design SLA and implement alert log reporting system (history logs) for moderation pipeline, histories logs handling application, server levels information f...
National Taiwan University
EMBA Programs, Business Administration, Accounting, Finance and International Business.