Lion (EvoLved Sign Momentum) optimizer utilizing sign operations for memory-efficient uniform gradient updates.
Lion (EvoLved Sign Momentum) optimizer utilizing sign operations for memory-efficient uniform gradient updates.
Implementation of LION gradient optimizer.
Homemade Copilot: Fine-tune LLM through LoftQ initialization and QLoRA-style training for code generation.
Super-Convergence on CIFAR10
A feature-packed Logistic Regression engine built from the ground up using NumPy. This implementation handles the entire ML pipeline from "Data Janitor" cleaning and normalization to "Architect" level optimizations.
Reproducible AdamW vs Lion comparison on CIFAR-10 with ResNet-18: equal-budget tuning, accuracy, convergence, memory, and throughput.
To associate your repository with the lion-optimizer topic, visit your repo's landing page and select "manage topics."