AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)
-
Updated
Jan 13, 2021 - Python
#
optimizer-algorithms
Here are 23 public repositories matching this topic...
🌹 Rose: Range-Of-Slice Equilibration PyTorch optimizer. Stateless optimization through range-normalized gradient updates.
machine-learning ai deep-learning transformers optimizer pytorch artificial-intelligence sgd gradient-descent gpt lora adam-optimizer fine-tuning diffusion-models pretraining optimizers optimizer-algorithms large-language-models llm
-
Updated
Apr 28, 2026 - Python
This project implements optimizers for TensorFlow and Keras, which can be used in the same way as Keras optimizers. Machine learning, Deep learning
machine-learning reinforcement-learning deep-learning tensorflow keras deep-reinforcement-learning optimizer machinelearning deeplearning optimizer-algorithms
-
Updated
Apr 11, 2026 - Python
Unofficial implementation of the Adan optimizer with Schedule-Free
-
Updated
Jul 8, 2024 - Python
Deep learning on class
deep-learning tensorflow keras lstm convolutional-neural-network pooling-layers resnet50 fpt-university optimizer-algorithms
-
Updated
Sep 27, 2025 - Jupyter Notebook
AeroAttention is an innovative, quantum-enhanced attention mechanism designed for transformer models. It offers optimized memory usage and accelerated computations, enabling scalable and efficient training for advanced neural network architectures
-
Updated
Sep 28, 2025 - Python
Muon is an optimizer for hidden layers in neural networks
-
Updated
Oct 17, 2025 - Python
AixrOptima is an artificial intelligence startup that speeds up the process process by integrating quantum circuits.
machine-learning quantum machine-learning-algorithms optimizer quantum-algorithms quantum-machine-learning artifical-neural-network artifical-intelligence optimizer-algorithms quantumalgorithms
-
Updated
Mar 19, 2025 - Python
Learning about the algorithms used in machine learning, along with techniques for training and testing models.
python nlp html learning data-science gradient-descent backpropagation-learning-algorithm ia feature-engineering regression-models loss-functions metrics-visualization normalization-techniques optimizer-algorithms neuronal-networks preprocessing-data
-
Updated
May 10, 2025 - Jupyter Notebook
The Bird Species Classifier is an application built using a Convolutional Neural Network (CNN) to classify images of birds into one of 525 different species. It allows users to upload an image of a bird and receive a prediction of the bird species. Along with analysing the performance of various optimising algorithms.
-
Updated
Jun 28, 2024 - Jupyter Notebook
Training the fully connected neural network (FCNN) using different optimizers for the backpropagation algorithm and compare the number of epochs that it takes for convergence along with their classification performance. Also building an autoencoder to obtain the hidden representation and use it for classification.
-
Updated
Jul 13, 2022 - Jupyter Notebook
Generating a TensorFlow model that predicts values in a sinewave
-
Updated
Dec 8, 2021 - Jupyter Notebook
COVID-19-Xray-Dataset Deep Learning using 3 models
deep-learning metrics tensorflow keras warnings cnn-model loss-functions imagedatagenerator optimizer-algorithms mobilenetv2-model resnet50-model
-
Updated
Oct 7, 2024 - Jupyter Notebook
A fast ML library for experimentation and training on consumer hardware
machine-learning configuration ml datasets language-model inference-server finetuning consumer-hardware pretraining optimizer-algorithms llm
-
Updated
May 21, 2026 - Python
A NumPy based Neural Network Package Implementation
python neural-network numpy optimizer derivatives loss-functions activation-functions optimizer-algorithms
-
Updated
Jun 22, 2022 - Python
AdaRankGrad: Adaptive Gradient Rank and Moments for Memory-Efficient LLMs Training and Fine-Tuning
-
Updated
Apr 22, 2025 - Python
This repository introduces novel Ai optimizers: the Consistency Optimizer Family—comprising ConsistencySGD and ConsistencyAdamW—a framework that dynamically modulates parameter updates based on local trajectory alignment.
-
Updated
Mar 12, 2026 - Jupyter Notebook
TradingView mean reversion strategy with an optimizer. This is version 1 so expect bugs and glitches
trading-strategies trading-algorithms quantitative-finance pinescript meanreversion optimizer-algorithms
-
Updated
Oct 27, 2025 - Jupyter Notebook
Introduction to the Adam Optimizer with examples
-
Updated
Dec 21, 2022 - Jupyter Notebook
Experimented with and compared DFW neural network optimizer with SGD and ADAM on both vision and language tasks
pytorch densenet dfw cifar10 back-propagation wide-resnet bilstm infersent optimizer-algorithms deep-frank-wolfie
-
Updated
May 21, 2021 - Jupyter Notebook
Improve this page
Add a description, image, and links to the optimizer-algorithms topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the optimizer-algorithms topic, visit your repo's landing page and select "manage topics."