Microsoft AI scientist quits after 14 years, saying ideas were ignored

John Langford, an AI scientist who spent more than 14 years at Microsoft, has left the company. He is a respected researcher in machine learning.

Langford said the key reason was that his research showed no clear path to real-world use, and new ideas were rarely taken seriously. His team had been merged into the Microsoft AI division led by Mustafa Suleyman, but they disagreed on research direction and how the team was reorganized.

He admits that making models bigger does improve results, but opposes making it the only focus. His "Full-Bandwidth Transformer" study shows a 1-billion-parameter model can reuse internal states to match models trained with about 1.5 times more data.

ByteDance's Seed team later released similar work called Recycler, which beats models with two to three times more parameters on reasoning and math tasks.

SponsoredDomoAI
AI Tools Mentioned

Comments

Loading comments…