Official implementation for the paper "Model-based Diffusion for Trajectory Optimization". Model-based diffusion (MBD) is a novel diffusion-based trajectory optimization framework that employs a dynamics model to run the reverse denoising process to generate high-quality trajectories.

[JMLR (CCF-A)] PyPop7: A Pure-Python LibrarY for POPulation-based Black-Box Optimization (BBO), especially *Large-Scale* variants (including evolutionary algorithms, swarm-based randomized optimizers, pattern search, and random search). [https://jmlr.org/papers/v25/23-0386.html] (Its Planned Extensions: PyCoPop7, PyNoPop7, PyDPop77, and PyMePop7)

Square Attack: a query-efficient black-box adversarial attack via random search [ECCV 2020]

Elo ratings for global black box derivative-free optimizers

Official implementation for the paper "CoVO-MPC: Theoretical Analysis of Sampling-based MPC and Optimal Covariance Design" accepted by L4DC 2024. CoVO-MPC is an optimal sampling-based MPC algorithm.

[ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".

Powell's Derivative-Free Optimization solvers.

ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory

[ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Diffenderfer, Jiancheng Liu, Konstantinos Parasyris, Yihua Zhang, Zheng Zhang, Bhavya Kailkhura, Sijia Liu

This repository contains the PyTorch implementation of Zeroth Order Optimization Based Adversarial Black Box Attack (https://arxiv.org/abs/1708.03999)

Robustify Black-Box Models (ICLR'22 - Spotlight)

Every Call is Precious: Global Optimization of Black-Box Functions with Unknown Lipschitz Constants

Zeroth-Order Regularized Optimization (ZORO): Approximately Sparse Gradients and Adaptive Sampling

Code for IEEE MLSP 2021 paper titled "Model-Free Learning of Optimal Deterministic Resource Allocations in Wireless Systems via Action-Space Exploration"

Benchmarking optimization solvers.

SCOBO: Sparsity-aware Comparison Oracle Based Optimization

Hard-Thresholding Meets Evolution Strategies in Reinforcement Learning

Implementation of the algorithms described in the papers "ZO-AdaMM: Zeroth Order Adaptive Momentum" by Chen et al., "Stochastic first- and zeroth-order methods" by Ghadimi et al. and "SignSGD via zeroth- order oracle" by Liu et al.

Modular optimization library for PyTorch.

Blockwise Direct Search (MATLAB version)