Senior Data Engineer
Garena
・
Full-time• Build and manage self-distributed systems (e.g., Hadoop, Spark, and Kafka Cluster)
• Design data warehouse and provide more than 50 ETL pipelines for various game operations
• Collaborate with data scientists to optimize ML models, pipelines, and services
• Refactor ML projects by improving software design for easier to reuse and adaptation
• Develop internal config service based on RESTful API via Go and Docker