Issues

• use_syrk=True makes Newton-Schulz ~3x slower on small matrices in eager mode (host overhead)

  NVIDIA-NeMo/Emerging-Optimizers#326 · Filter by author 0z5a opened on Nov 3, 2026
  2

• test_soap_v3 legacy-comparison tests fail on B300 (sm_103), pass on GH200 (sm_90)

  NVIDIA-NeMo/Emerging-Optimizers#325 · Filter by author 0z5a opened on Nov 3, 2026
  4

• [Optimizer Proposal] NEAT: conflict-aware optimization via directional gradient correction

  enhancement
  NVIDIA-NeMo/Emerging-Optimizers#295 · Filter by author ItCodinTime opened on Sep 5, 2026

• Locoprop-S and Newton-Muon support via TE, Megatron-LM changes.

  enhancement
  NVIDIA-NeMo/Emerging-Optimizers#215 · Filter by author plugyawn opened on May 30, 2026
  4

• Adding symmetry-compatible / equivariant optimizers for general matrix-valued parameters

  enhancement
  NVIDIA-NeMo/Emerging-Optimizers#188 · Filter by author timlautk opened on May 20, 2026
  5