QLabs

Researchers at QLabs have published Dust, a method for pretraining transformer models without using backpropagation. The work challenges the fundamental training algorithm underpinning modern AI, and it is drawing attention among machine learning practitioners debating whether such alternatives could ever match gradient-based training at scale.