Languages: Golang, Python(ML inference).
Refactored crawler service and established a new system architecture to improve efficiency and scalability.
Developed the Datahub system to facilitate data integration and analytics for the MarTech RD team, driving innovation.
Designed and implemented ML Inference and ETL pipelines, seamlessly integrating these into the Datahub system to enhance data processing capabilities.
Led the development of the Datahub project, fostering collaboration among Backend Engineers, Machine Learning Engineers, Data Scientists, and Data Engineers, and ensuring project success.
Deployed and managed services on Kubernetes using Helm Charts and Terraform, streamlining the provisioning and configuration of containerized applications.
Transitioned to Argo CD for Kubernetes deployments, optimizing the continuous delivery pipeline by automating application updates and maintaining desired states through Gitlab CI.
Implemented OpenTelemetry for robust tracing and metrics, enhancing system observability. Utilized the LGTM stack (Loki, Grafana, Tempo, Metrics) for comprehensive monitoring, ensuring high-quality real-time insights into application performance and behavior.