Haoyang Fang (方昊扬)

Applied Scientist @ AWS AutoGluon

I am an Applied Scientist based in Seattle, working on democratizing machine learning through automated systems. My research interests span Reinforcement Learning, Agentic Coding, and LLM Post-training.

My primary research focuses on LLM post-training, specifically building automation systems to improve Reinforcement Learning performance. I also develop frameworks for general end-to-end machine learning automation, such as AutoGluon Assistant (aka MLZero) .

Also, I developed AutoGluon Multimodal from release 0.7 to 1.5 .

🔥 News

Mar 2026 One paper accepted by AISTATS 2026.
Dec 2025 "Efficient Table Retrieval and Understanding with Multimodal Large Language Models" accepted by EACL 2026 Findings.
Nov 2025 Hosting AutoGluon Workshop @ Re:invent 2025.
Nov 2025 Featured in Amazon Science Blog.
Nov 2025 Our paper on MLZero (AutoGluon Assistant) was accepted to NeurIPS 2025.
Nov 2025 Contributed Talk @ AMLC Workshop: 2nd Gen-AI Autonomous Agents.
Nov 2025 Poster Presentation @ Stanford Graph Learning Workshop 2025.
Jul 2024 Paper on AutoGluon-Multimodal (AutoMM) accepted to AutoML 2024.
Jan 2024 Conv-LoRA accepted to ICLR 2024.
Jan 2024 Paper on Controllable Diffusion Models accepted to WACV 2024.

📚 Selected Publications

MLZero: A Multi-Agent System for End-to-end Machine Learning Automation

Haoyang Fang, Boran Han, Nick Erickson, Xiyuan Zhang, et al.

NeurIPS 2025

PDF Blog Code

Convolution Meets LoRA: Parameter Efficient Finetuning for Segment Anything Model

Zihan Zhong, Zhiqiang Tang, Tong He, Haoyang Fang, Chun Yuan

ICLR 2024

PDF Code

AutoGluon-Multimodal (AutoMM): Supercharging multimodal AutoML with foundation models

Zhiqiang Tang, Haoyang Fang, Su Zhou, Taojiannan Yang, Zihan Zhong, et al.

AutoML 2024

PDF Code

Data augmentation for object detection via controllable diffusion models

Haoyang Fang, Boran Han, Shuai Zhang, Su Zhou, Cuixiong Hu, Wen-Ming Ye

WACV 2024

PDF Code

🎓 Education

M.S. in Computer Vision (MSCV)
Carnegie Mellon University (CMU) | 2019 - 2020
B.S. in Pure Math Advanced and Computer Science
Hong Kong University of Science and Technology (HKUST) | 2015 - 2019