Edward Hu is incubating companies in Woodside, CA with Don R. Wilson and Suna Said. He was a researcher at OpenAI, where he worked on o1, and received his Ph.D. in Computer Science under the supervision of Yoshua Bengio, a recipient of the 2018 A.M. Turing Award.

Before graduate school, Edward was a researcher at Microsoft, where he invented LoRA, μP (muP), and μTransfer. LoRA is now the industry standard for customizing AI models, and μTransfer is underpinning the largest AI model training runs today.

Selected Publications

LoRA: Low-Rank Adaptation of Large Language Models
ICLR 2022
[Paper | Video | Code | Mentioned in "The innovation behind AI at Scale"]

Amortizing Intractable Inference in Large Language Models
Outstanding Paper Honorable Mention at ICLR 2024
[Paper | Code]

μTransfer: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer
NeurIPS 2021
[Paper | Blog | Code | Video | TheRegister | TechRadar | AIM]

μP: Feature Learning in Infinite-Width Neural Networks
ICML 2021
[Paper | Blog | Code]

Improved Image Wasserstein Attacks and Defenses
Best Paper at ICLR Trustworthy ML Workshop 2020
[Paper | Code]