Research Interests
Work Experience
Microsoft AI Research and Development Center
Research Software Development Engineer Taipei, Taiwan Jan. 2018 - Now
Microsoft Research Asia
Research Intern (Mentor: Ruihua Song) Beijing, China Feb. 2016 - Aug. 2016
National Institute of Informatics
Research Intern (Mentor: Shin’ichi Satoh) Tokyo, Japan Aug. 2015 - Feb. 2016
Academia Sinica
Summer Intern (Mentor: Tsan-sheng Hsu) Taipei, Taiwan Jul. 2013 - Aug. 2013
Awards
Deep Learning Computer Vision Nature Language Processing
Designed and implement deep learning approaches to improve the quality of document understanding, hugely surpassing all competitors on English receipts.
Learning Nature Language Processing
Designed an unsupervised word segmentation algorithm and implement a word segmentation tool for all languages. This approach reduces the end-to-end relative error rate by 12% for Chinese IME (input method editor).
Deep Learning Nature Language Generating
Main contributor of this work, including the implementation of an application prototype. By leveraging multi-modal understanding with deep learning, this application takes an image from users and extracts information from the image to construct fluent poems. Within the first twenty-four hours of release, this application received near 300 thousand requests from users and has generated over 2 million poems since launch. A collection of the generated poem was published in 2017.
Social Media Mining Deep Learning Computer Vision Nature Language Processing
Collected a social media dataset of Sapporo (0.64M image posts on Instagram and tweets on Twitter). By leveraging multi-modal deep learning approaches, this work combines both location types prediction and user hometown predictions to discover different travel behaviors in Sapporo for 15,563 travelers from different countries.
Social Media Mining Deep Learning Computer Vision Nature Language Processing
Collected a large scale Instagram dataset including more than 14 million photos from half a million locations in New York. By leveraging a multi-modal classification model, the model achieves 73.18% accuracy on locations type prediction.
Education
National Taiwan University Sep. 2013 - Jan. 2017
M.S. in Graduate Institute of Networking and Multimedia
Communications and Multimedia Laboratory (CMLAB), MiRA Group (Advisor: Winston H. Hsu)
Thesis: Location classification on social media by multi-modality engagement
National Taiwan University Sep. 2009 - Jan. 2013
Publications