AI工程師、機器學習工程師、深度學習工程師、資料科學家、Machine Learning Engineer、Deep Learning Engineer、Data Scientist
Sinica, Taiwan Natural Language and Knowledge Processing Lab (NLP Lab) National Taiwan University Hospital (NTUH): Focused on exploring the generality and expertise of LLMs ( e.g., LLaMA2, Zephyr. ) in medical Q&A applications, improving model performance by 2.01% . Efficiency Optimization: Utilized Low-Rank Adaptation (LoRA) for training LLM, reducing parameter training volume to 2% , decreasing memory usage by 70%, and increasing training speed by 25%. Architecture Optimization: Used Direct Preference Optimization (DPO) to optimize Reinforcement Learning, improving model efficiency and decision quality. [ G itHub ] Graduate Research Assistant OctOct 2023 Institute of Information
國立政治大學(National Chengchi University)・
資訊科學系