Avatar of Ethan Yi En Ooi.
Ethan Yi En Ooi
Machine Learning Engineer + LLMs + Entrepreneurship
Profile
Posts
0Connections
Print
Avatar of the user.

Ethan Yi En Ooi

Machine Learning Engineer + LLMs + Entrepreneurship
As head of AI, Ied a team to design and deliver complex software. As a software architect, I'm skilled in designing and executing projects with many moving parts, ensuring production-ready deployment. I stay ahead in the open source language model field, creating tools to benchmark these models against specific client metrics. My expertise includes deploying open source models for high throughput inference, reaching up to 1900 tokens per second on a 13B LLM with an RTX 4090. Beyond tech, I actively contribute to community projects in grassroots music and gaming scenes. Outside of work, I have 10 years of experience leading musical projects and I play multiple instruments at a professional level.
Logo of the organization.
Aqua Security
Logo of the organization.
The University of Manchester
Prague, Czechia

Professional Background

  • Current status
    Unemployed
  • Profession
    CTO, Chief Technology Officer
    Machine Learning Engineer
    Python Developer
  • Fields
  • Work experience
    4-6 years (4-6 years relevant)
  • Management
  • Skills
    Python
    Pytorch
    Pandas
    AI & Machine Learning
    LLM
    Software Engineering
    Deep Learning
    Director of Engineering
    AWS
  • Languages
    English
    Native or Bilingual
    Chinese
    Professional
  • Highest level of education

Job search preferences

  • Desired job type
    Full-time
    Interested in working remotely
  • Desired positions
    CTO
  • Desired work locations
  • Freelance

Work Experience

Logo of the organization.

Generative AI Consultant/Engineer

Aqua Security
Part-time
Jan 2024 - Present
Tel Aviv, Israel
Leveraging my hobbyist passion for cybersecurity, I construct generative agents to streamline and enhance Aqua Security's current projects and workflows
Logo of the organization.

Director of Artificial Intelligence

Dec 2021 - Present
Prague, Czechia
• Architect, Build, and Scale a department to deliver next generation AI powered immersive storytelling • Talent Budgeting, Acquisition and Management • Generating innovations in structured NLG, Text Entity Extraction and Zero-Shot Transfer Learning • Goal based Planning and Motivations using Knowledge Graphs and guided Text Generation • Scaling OpenSource LLMs to production with MLOPS, GGML, and llama.cpp • Create and Operate automated data generation pipelines with humans-in-the-loop • Creating proof-of-technology demonstrations to acquire more capital • Deliver all of our research into the productionized game through crossfunctional collaboration with the whole game studio • Lead and Answer to all AI related discussion with investors • Text embedding, Emotional analysis, Structured Text Extraction, BERT, Blazingtext, HMMs, Meta Learning • Python, Pytorch, Tensorflow, Pandas, Numpy, Knowledge Graphs, Genetic Algorithms for Reinforcement Learning • Amazon Sagemaker, EC2, S3, Lambda, API Gateway
Logo of the organization.

Machine Learning Engineer

Freelance
Contract
Aug 2023 - Oct 2023
3 mos
• Production grade LLM deployment with automated ingestion pipeline and on-line hyperparameter search • High throughput benchmarking on a custom reward model stack. • Use of vLLM, exLlama, GPTQ, AWQ to improve performance of models both in experimentation and in production. (Up to 1900 tokens per second on 13B model RTX4090) • Feature engineering of quantitative metrics such as RSI, MACD, Bollinger Bands, and EMA for financial modelling. Collect historical data, preprocess and generate normalized sequences of training data
Logo of the organization.

AI Developer

Apr 2021 - Nov 2021
8 mos
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
• Deliver various Text/Voice chatbots on Dialogflow for use in client acquisition • Solutions and Product Architect on AWS and GCP stacks, empower and guide the team to deliver • R&D to increase/enhance our product offerings with custom machine learning • Directly carry out business development and client acquisition • Train junior developers to fill backend/serverless roles
Logo of the organization.

Freelance Machine Learning Engineer

Aug 2021 - Oct 2021
3 mos
Ukraine
• Created a custom neural network that utilized CNNs and Mel-Spectrograms to determine when the client has verbal oddities in speech. The classifier was trained on Sep-28k: A Dataset for Stuttering Event Detection from Podcasts with People Who Stutter. • Delivered the model and code to run live inference so that the client can identify how to improve their speech during meetings
Logo of the organization.

Data Scientist

Sep 2020 - Apr 2021
8 mos
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
• Hands on application of Pandas and AWS EC2, S3, and EMR to carry out cell-tower analytics for clients spanning over 300 million users • Delivered a robust ETL Pipeline to ingest data over multiple sources and produce development and planning insights for client EdotCo whilst adapting to changing requirements. • Spearhead R&D such as ML based enrichment of current data sources • Lead the team in adopting AGILE Software Engineering principles such as Test-Driven-Development, Continuous Integration and Deployment, Version Control, Peer Review and Pair Programming
Logo of the organization.

Machine Learning Engineer

Oct 2019 - Mar 2020
6 mos
Manchester, UK
• Experience training a Reinforcement Learning agent to control the compressors on an actual gas pipeline in South America. Solely responsible for ML implementation(DDPG, A2C, A3C) • Constructed a serverless microservice architecture to ingest training data and simultaneously train on multiple models to compare performance • Tensorflow, Keras, Golang, Python, Protobuf/GRPC
Logo of the organization.

Machine Learning Research Intern

Jul 2019 - Aug 2019
2 mos
Beijing, China
• Provide financial analytic systems to empower the local financial industry using Graph Database Technology, paired with Cutting Edge Machine Learning techniques. • Use of LSTMs to interface with graph based Knowledge Bases for the use of Natural Language Processing, for Question and Answer Retrieval • Produced reports comparing techniques in multiple research papers and how they can apply to our client- Agricultural Bank of China in dealing with credit-score estimation and fraud-ring detection. • Presented my findings to clients in Mandarin

Education

Logo of the organization.
Master’s Degree
MEng Computer Science
2016 - 2020

Licenses & Certifications

LinkedIn
Issued Jan 2021
No Expiration Date
LinkedIn
Issued Jan 2021
No Expiration Date
LinkedIn
Issued Jan 2021
No Expiration Date
LinkedIn
Issued Dec 2020
No Expiration Date
LinkedIn
Issued Dec 2020
No Expiration Date
LinkedIn
Issued Nov 2020
No Expiration Date
LinkedIn
Issued Nov 2020
No Expiration Date