I built a PyTorch optimizer for large GPU workloads — looking for feedback
Hey, I've been working on a PyTorch optimizer called ApexW and figured I'd share it here to get some feedback from people who know more about this stuff than I do. The main goal is to reduce...