Ömer Deniz Akyıldız

arXiv antilibrary

FAQ

Q: What is this page about?
A: This is a collection of papers that I have saved on arXiv (with a few ProjectEuclid and JMLR additions) since 2012.

Q: Did you read all of these papers?
A: No. This is an antilibrary. I save papers that I find interesting or potentially useful in the future. Until now, I did not have a good way to traverse them, so I created this page to make it easier to browse through them.

Q: Why are there so many papers?
A: I am interested in everything and saved papers liberally.

Q: Since you have seen it all, why are you not the most clever person?
A: I have scanned widely, but, sometimes, I did not necessarily even read beyond the (vaguely interesting) abstract.

Q: What does this mean in the age of AI?
A: I don't know.

Q: Is this up-to-date?
A: Mostly yes. More recent papers will be added periodically (perhaps bi-annually), as I won't be exporting my entire antilibrary every time I save a new paper.

Q: Did you spend an insane amount of time preparing this page?
A: No. I scan papers in certain categories for years daily with an RSS reader (Feedly). "Save for Later" consists of just clicking a button. For many years, I couldn't go back due to the volume but I kept saving. After years, I managed to export the .html automatically, I vibe-coded a short Python script to clean it up. Papers older than 07/2013 were fetched separately (as I was using Google Reader which shut down in 2013).

Saved in 2025

• An interpretation of the Brownian bridge as a physics-informed prior for the Poisson equation
• NRGPT: An Energy-based Alternative for GPT
• A Unification of Discrete, Gaussian, and Simplicial Diffusion
• Wasserstein error bounds for aggregations of continuous-time Markov chains
• Machine Learning and Control: Foundations, Advances, and Perspectives
• Generative design of stabilizing controllers with diffusion models: the Youla approach
• On The Hidden Biases of Flow Matching Samplers
• Riemannian Stochastic Interpolants for Amorphous Particle Systems
• Efficient Monte-Carlo sampling of metastable systems using non-local collective variable updates
• Muon is Provably Faster with Momentum Variance Reduction
• Continuized Nesterov Acceleration for Non-Convex Optimization
• Learning without training: The implicit dynamics of in-context learning
• Curved representational Bregman divergences and their applications
• DiffEM: Learning from Corrupted Data with Diffusion Models via Expectation Maximization
• Sample-Efficient Optimization over Generative Priors via Coarse Learnability
• Variational Continual Test-Time Adaptation
• SoFlow: Solution Flow Models for One-Step Generative Modeling
• Corrective Diffusion Language Models
• The Universal Property of Measure-Theoretic Probability
• Quantitative estimates: How well does the discrete Fourier transform approximate the Fourier transform on $\mathbb{R}$
• Scale-invariant Attention
• Convergence of Noise-Free Sampling Algorithms with Regularized Wasserstein Proximals
• Error Bounds and Optimal Schedules for Masked Diffusions with Factorized Approximations
• Natural Variational Annealing for Multimodal Optimization
• Bregman proximal gradient method for linear optimization under entropic constraints
• Historical Information Accelerates Decentralized Optimization: A Proximal Bundle Method
• Tractable Model for Tunable Non-Markovian Dynamics
• Code, Data and Media Associated with this Article
• Effective sample size approximations as entropy measures
• Viability Theory in the $1$-Wasserstein Space
• On the Design of One-step Diffusion via Shortcutting Flow Paths
• Small Batch Size Training for Language Models: When Vanilla SGD Works, and Why Gradient Accumulation Is Wasteful
• Mathematics and Coding are Universal AI Benchmarks
• Geometric calculations on probability manifolds from reciprocal relations in Master equations
• Gradient descent avoids strict saddles with a simple line-search method too
• Two-scale integrators with high accuracy and long-time conservations for the nonlinear Klein-Gordon equation in the nonrelativistic limit regime
• Operator Splitting Methods for Numerical Solutions of Ordinary Differential Equations
• Polynomial Log-Marginals and Tweedie's Formula : When Is Bayes Possible?
• Understanding Sampler Stochasticity in Training Diffusion Models for RLHF
• On fractal minimizers and potentials of occupation measures
• Multiple Scale Methods For Optimization Of Discretized Continuous Functions
• A preconditioned second-order convex splitting algorithm with extrapolation
• DAMA: A Unified Accelerated Approach for Decentralized Nonconvex Minimax Optimization-Part I: Algorithm Development and Results
• q-Analogue of Hamiltonian Monte Carlo method
• RiemannFormer: A Framework for Attention in Curved Spaces
• Learning to Integrate Diffusion ODEs by Averaging the Derivatives
• Universality of high-dimensional scaling limits of stochastic gradient descent
• Stopping Rules for Stochastic Gradient Descent via Anytime-Valid Confidence Sequences
• Flow-matching Operators for Residual-Augmented Probabilistic Learning of Partial Differential Equations
• Iterative Sampling Methods for Sinkhorn Distributionally Robust Optimization
• Unified Control for Inference-Time Guidance of Denoising Diffusion Models
• Evolving Deep Learning Optimizers
• Image Diffusion Preview with Consistency Solver
• Scalable Formal Verification via Autoencoder Latent Space Abstraction
• B\'ezierFlow: B\'ezier Stochastic Interpolant Schedulers for Few-Step Generation
• On the continuity of flows
• Exploring the Design Space of Transition Matching
• On a $T_1$ Transport inequality for the adapted Wasserstein distance
• Imprecise Markov Semigroups and their Ergodicity
• Random Reshuffling for Stochastic Gradient Langevin Dynamics
• Newton Methods for Mean Field Games: A Numerical Study
• Temporal parallelisation of continuous-time maximum-a-posteriori trajectory estimation
• Efficient Generation of Smooth Paths with Curvature Guarantees by Mollification
• Generative Stochastic Optimal Transport: Guided Harmonic Path-Integral Diffusion
• Adaptive Path Integral Diffusion: AdaPID
• Residual subspace evolution strategies for nonlinear inverse problems
• Nonstationary Distribution Estimation via Wasserstein Probability Flows
• Augmenting Iterative Trajectory for Bilevel Optimization: Methodology, Analysis and Extensions
• A gradient flow on control space with rough initial condition
• Collective Annealing by Switching Temperatures: a Boltzmann-type description
• Linear convergence of relocated fixed-point iterations
• Next-Generation Iterative Algorithms for Large-Scale Min-Max Optimization: Design and Analysis
• Fractional Calculus in Optimal Control and Game Theory: Theory, Numerics, and Applications -- A Survey
• How Muon's Spectral Design Benefits Generalization: A Study on Imbalanced Data
• Stochastics of shapes and Kunita flows
• Small-Gain Nash: Certified Contraction to Nash Equilibria in Differentiable Games
• Gamma-Convergence of Convex Functions, Conjugates, and Subdifferentials
• Entropic Optimal Transport Problem with Convex Functional Cost
• Gradient Descent as a Perceptron Algorithm: Understanding Dynamics and Implicit Acceleration
• PDF Download from null
• Distributional Shrinkage I: Universal Denoisers in Multi-Dimensions
• Trustworthy scientific inference with generative models
• Equivariant Test-Time Training with Operator Sketching for Imaging Inverse Problems
• Differential Smoothing Mitigates Sharpening and Improves LLM Reasoning
• An efficient probabilistic hardware architecture for diffusion-like models
• An Eulerian Perspective on Straight-Line Sampling
• If generative AI is the answer, what is the question?
• Symmetry in Neural Network Parameter Spaces
• On the Design of KL-Regularized Policy Gradient Algorithms for LLM Reasoning
• Nonasymptotic CLT and Error Bounds for Two-Time-Scale Stochastic Approximation
• An Elementary Proof of the Near Optimality of LogSumExp Smoothing
• On Learning-Curve Monotonicity for Maximum Likelihood Estimators
• Generative Modeling from Black-box Corruptions via Self-Consistent Stochastic Interpolants
• Scaling Behavior of Discrete Diffusion Language Models
• The Localization Method for High-Dimensional Inequalities
• Metric-driven numerical methods
• Understanding Outer Optimizers in Local SGD: Learning Rates, Momentum, and Acceleration
• Variational structures for the Fokker--Planck equation with general Dirichlet boundary conditions
• A Smooth Approximation Framework for Weakly Convex Optimization
• Extending Douglas-Rachford Splitting for Convex Optimization
• Moreau envelope and proximal-point methods under the lens of high-order regularization
• On the Convergence Analysis of an Inexact Preconditioned Stochastic Model-Based Algorithm
• Primal-dual splitting for structured composite monotone inclusions with or without cocoercivity
• Workflow is All You Need: Escaping the "Statistical Smoothing Trap" via High-Entropy Information Foraging and Adversarial Pacing
• FALCON: Few-step Accurate Likelihoods for Continuous Flows
• Learning Unmasking Policies for Diffusion Language Models
• Open interacting particle systems and Ising measures
• Disordered Gibbs measures and Gaussian conditioning
• Understanding temperature tuning in energy-based models
• A Taxonomy of Numerical Differentiation Methods
• Analysis of splitting schemes for stochastic evolution equations with non-Lipschitz nonlinearities driven by fractional noise
• Spectral Analysis of Diffusion Models with Application to Schedule Design
• Statistical Properties of Rectified Flow
• Estimation of Stochastic Optimal Transport Maps
• Distributional Shrinkage II: Optimal Transport Denoisers with Higher-Order Scores
• A Minimalist Optimizer Design for LLM Pretraining
• New Results on the Polyak Stepsize: Tight Convergence Analysis and Universal Function Classes
• The tangent space to the Wasserstein space: parallel transport and other applications
• A Benamou-Brenier Proximal Splitting Method for Constrained Unbalanced Optimal Transport
• Astral Space: Convex Analysis at Infinity
• Curse of Slicing: Why Sliced Mutual Information is a Deceptive Measure of Statistical Dependence
• Numerical integrators for confined Langevin dynamics
• On the convergence of adaptive approximations for stochastic differential equations
• Solving the Poisson equation using coupled Markov chains
• Provable Diffusion Posterior Sampling for Bayesian Inversion
• A Unifying Framework for Global Optimization: From Theory to Formalization
• Sliced Wasserstein distance between probability measures on Hilbert spaces
• On Solving Minimization and Min-Max Problems by First-Order Methods with Relative Error in Gradients
• Robust equilibria in continuous games: From strategic to dynamic robustness
• Worst-case generation via minimax optimization in Wasserstein space
• Life as a Categorical Information-Handling System: An Evolutionary Information-Theoretic Model of the Holobiont
• Generalized Probabilistic Approximate Optimization Algorithm
• FlowLPS: Langevin-Proximal Sampling for Flow-based Inverse Problem Solvers
• Small-Gain Nash: Certified Contraction to Nash Equilibria in Differentiable Games
• Pathway to $O(\sqrt{d})$ Complexity bound under Wasserstein metric of flow-based models
• How to simulate L\'evy flights in a steep potential: An explicit splitting numerical scheme
• The Optimal Approximation Factor in Density Estimation
• Long memory score-driven models as approximations for rough Ornstein-Uhlenbeck processes
• Non-asymptotic convergence bounds of modified EM schemes for non-dissipative SDEs
• Scale-free weak output synchronization of multi-agent systems with adaptive protocols
• A Variable Smoothing for Weakly Convex Composite Minimization with Manifold Constraint
• A Particle Algorithm for Mean-Field Variational Inference
• Optimizing Optimizers for Fast Gradient-Based Learning
• Latent Nonlinear Denoising Score Matching for Enhanced Learning of Structured Distributions
• A Latent Variable Framework for Scaling Laws in Large Language Models
• From Tail Universality to Bernstein-von Mises: A Unified Statistical Theory of Semi-Implicit Variational Inference
• Inverse problems for infinite-dimensional transport PDEs on Wasserstein space
• Optimal and Diffusion Transports in Machine Learning
• Optimal Preconditioning is a Geodesically Convex Optimization Problem
• A Survey on Diffusion Language Models
• Do you precondition on the left or on the right?
• Operator learning meets inverse problems: A probabilistic perspective
• Fast Solvers for Discrete Diffusion Models: Theory and Applications of High-Order Algorithms
• Theoretical guarantees for lifted samplers
• Diffusion Models are Molecular Dynamics Simulators
• Optimal Control of McKean--Vlasov Branching Diffusion Processes
• Convergence of Reflected Langevin Diffusion for Constrained Sampling
• Quantitative rigidity of the Wasserstein contraction under convolution
• Towards Continuous-Time Approximations for Stochastic Gradient Descent without Replacement
• Convergence rate of empirical measures in the subspace robust Wasserstein distance
• Global Regularity Estimates for Optimal Transport via Entropic Regularisation
• Learning to Solve Constrained Bilevel Control Co-Design Problems
• Foundations of Diffusion Models in General State Spaces: A Self-Contained Introduction
• Control Consistency Losses for Diffusion Bridges
• Towards a unified framework for guided diffusion models
• Deep Unfolding: Recent Developments, Theory, and Design Guidelines
• Optimal Transportation and Alignment Between Gaussian Measures
• Computing Equilibrium Points of Electrostatic Potentials
• Simpson variational integrator for nonlinear systems: a tutorial on the Lagrange top
• Symplectic methods for stochastic Hamiltonian systems: asymptotic error distributions and Hamiltonian-specific analysis
• When Heating Isn't Cooling in Reverse: Nos\'e-Hoover Thermostat Fluctuations from Equilibrium Symmetry to Nonequilibrium Asymmetry
• Gradient-free optimization via integration
• Unbiased Kinetic Langevin Monte Carlo with Inexact Gradients
• Iterative Tilting for Diffusion Fine-Tuning
• Convergence of a class of gradient-free optimisation schemes when the objective function is noisy, irregular, or both
• Multiscale guidance of protein structure prediction with heterogeneous cryo-EM data
• Connecting Neural Models Latent Geometries with Relative Geodesic Representations
• In Search of Adam's Secret Sauce
• Testing Noise Assumptions of Learning Algorithms
• Formalization of Brownian motion in Lean
• SimpleFold: Folding Proteins is Simpler than You Think
• Error analysis of an acceleration corrected diffusion approximation of Langevin dynamics with background flow
• Phase Transitions as Emergent Geometric Phenomena: A Deterministic Entropy Evolution Law
• Chain of Unit-Physics: A Primitive-Centric Approach to Scientific Code Synthesis
• Non-Asymptotic Convergence of Discrete Diffusion Models: Masked and Random Walk dynamics
• Efficient and Programmable Exploration of Synthesizable Chemical Space
• The Mean-Field Dynamics of Transformers
• Can a Higher Order Markov Chain Be Treated as a First Order Markov Chain?
• Convergence of Reflected Langevin Diffusion for Constrained Sampling
• A brief introduction to matrix hydrodynamics
• Error analysis of an acceleration corrected diffusion approximation of Langevin dynamics with background flow
• Geometric Regularity in Deterministic Sampling of Diffusion-based Generative Models
• A Sampling-Based Domain Generalization Study with Diffusion Generative Models
• On the Condition Number Dependency in Bilevel Optimization
• Test-time scaling of diffusions with flow maps
• Flow Density Control: Generative Optimization Beyond Entropy-Regularized Fine-Tuning
• Closed-Loop Transformers: Autoregressive Modeling as Iterative Latent Equilibrium
• Wasserstein-{\L}ojasiewicz inequalities and asymptotics of McKean-Vlasov equation
• Covering-Space Normalizing Flows: Approximating Pushforwards on Lens Spaces
• Fast Solvers for Discrete Diffusion Models: Theory and Applications of High-Order Algorithms
• A boosted second-order convex splitting algorithm based on gradient flows
• Accelerating Diffusion Models with Parallel Sampling: Inference at Sub-Linear Time Complexity
• Convergence of Ray- and Pixel-Driven Discretization Frameworks in the Strong Operator Topology
• Generalization of Silver Stepsize Schedule to Stochastic Optimization
• Bayesian tit-for-tat fosters cooperation in evolutionary stochastic games
• Adam Simplified: Bias Correction Debunked
• Beyond Expectation: Concentration Inequalities for Randomized Iterative Methods
• Searching Latent Program Spaces
• Optimal transport maps, majorization, and log-subharmonic measures
• Darboux Transformation of Diffusion Processes
• Structured Continuity Equations in Fibred Wasserstein Spaces
• Formalization of Brownian motion in Lean
• Propagation of chaos in Fisher information
• Modified Equations for Stochastic Optimization
• Designing Preconditioners for SGD: Local Conditioning, Noise Floors, and Basin Stability
• Modified Equations for Stochastic Optimization
• Terminal Velocity Matching
• Demystifying Diffusion Objectives: Reweighted Losses are Better Variational Bounds
• Extending Douglas-Rachford Splitting for Convex Optimization
• Diffusion Models are Molecular Dynamics Simulators
• Solving a Research Problem in Mathematical Statistics with AI Assistance
• Time-uniform concentration bounds for iterative algorithms
• A Diffusion Model to Shrink Proteins While Maintaining Their Function
• Posterior Collapse as a Phase Transition in Variational Autoencoders
• Is Grokking a Computational Glass Relaxation?
• Equivariant Deep Equilibrium Models for Imaging Inverse Problems
• An operator splitting analysis of Wasserstein--Fisher--Rao gradient flows
• Analog Physical Systems Can Exhibit Double Descent
• Importance-Weighted Non-IID Sampling for Flow Matching Models
• CDLM: Consistency Diffusion Language Models For Faster Sampling
• On the Lipschitz properties of transportation along heat flows
• The Brownian transport map
• Machine learning on manifolds for inverse scattering: Lipschitz stability analysis
• When do World Models Successfully Learn Dynamical Systems?
• Ergodic control of McKean-Vlasov systems on the Wasserstein space
• Consensus Planning with Primal, Dual, and Proximal Agents
• Moduli space of optimization algorithms
• Iterative improvement of free energy landscape reconstructions with optimal protocols derived from differentiable simulations
• Thermodynamics + Natural Selection = Bayesian Inference
• Divide, Interact, Sample: The Two-System Paradigm
• Gradient flow for deep equilibrium single-index models
• Iterating marginalized Bayes maps for likelihood maximization with application to nonlinear panel models
• Evolution Strategies at the Hyperscale
• discretize_distributions: Efficient Quantization of Gaussian Mixtures with Guarantees in Wasserstein Distance
• Time dependent loss reweighting for flow matching and diffusion models is theoretically justified
• Global Convergence of Four-Layer Matrix Factorization under Random Initialization
• MAP Estimation with Denoisers: Convergence Rates and Guarantees
• Energy-based generator matching: A neural sampler for general state space
• QUASAR: An Evolutionary Algorithm to Accelerate High-Dimensional Optimization
• On the Convex Interpolation for Linear Operators
• Implicit Bias of the JKO Scheme
• Complex variational autoencoders admit K\"ahler structure
• Bringing Federated Learning to Space
• On the randomized Euler scheme for SDEs with integral-form drift
• Particle Monte Carlo methods for Lattice Field Theory
• The Sequential Nature of Science: Quantifying Learning from a Sequence of Studies
• Learning few-step posterior samplers by unfolding and distillation of diffusion models
• Improved Sample Complexity Bounds for Diffusion Model Training
• Generalized differentiation in Wasserstein space and application to multiagent control problem
• Wright--Fisher kernels: from linear to non-linear dynamics, ergodicity and McKean--Vlasov scaling limits
• An introduction to Coupling
• Time-causal and time-recursive wavelets
• Convex relaxation approaches for high dimensional optimal transport
• Gradient Flows of Potential Energies in the Geometry of Sinkhorn Divergences
• Energy Guided Geometric Flow Matching
• Functional Mean Flow in Hilbert Space
• Training Instabilities Induce Flatness Bias in Gradient Descent
• Chain-of-Generation: Progressive Latent Diffusion for Text-Guided Molecular Design
• Diffusion Models: A Mathematical Introduction
• Compact Schemes for $A^+B$, $A^+AB$ and $AA^+B$
• PID-controlled Langevin Dynamics for Faster Sampling of Generative Models
• Using Linearized Optimal Transport to Predict the Evolution of Stochastic Particle Systems
• On the Information Processing of One-Dimensional Wasserstein Distances with Finite Samples
• Convergence rate of randomized midpoint Langevin Monte Carlo
• Non-asymptotic Analysis of Poisson randomized midpoint Langevin Monte Carlo
• Bregman geometry-aware split Gibbs sampling for Bayesian Poisson inverse problems
• A Symplectic Analysis of Alternating Mirror Descent
• The iterates of FISTA convergence even under inexact computations
• On the Time Derivative of the KL Divergence for a Generalized Langevin Annealing Scheme
• Guaranteeing Higher Order Convergence Rates for Accelerated Wasserstein Gradient Flow Schemes
• Neural Local Wasserstein Regression
• Non-Convex Global Optimization as an Optimal Stabilization Problem: Dynamical Properties
• On the Moreau envelope properties of weakly convex functions
• (Adaptive) Scaled gradient methods beyond locally Holder smoothness: Lyapunov analysis, convergence rate and complexity
• Diffusion annealed Langevin dynamics: a theoretical study
• Computing Wasserstein Barycenters through Gradient Flows
• Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distance
• Theory and computation for structured variational inference
• Bridging Constraints and Stochasticity: A Fully First-Order Method for Stochastic Bilevel Optimization with Linear Constraints
• Edit Flows: Flow Matching with Edit Operations
• Branching Flows: Discrete, Continuous, and Manifold Flow Matching with Splits and Deletions
• Controllable protein design through Feynman-Kac steering
• A kernel method for the learning of Wasserstein geometric flows
• Functional Adjoint Sampler: Scalable Sampling on Infinite Dimensional Spaces
• Proximal Oracles for Optimization and Sampling
• Gradient descent with adaptive stepsize converges (nearly) linearly under fourth-order growth
• Optimal Inference Schedules for Masked Diffusion Models
• The Evolving Nature of Latent Spaces: From GANs to Diffusion
• On the Convergence of Muon and Beyond
• The case for and against fixed step-size: Stochastic approximation algorithms in optimization and machine learning
• On the Kantorovich contraction of Markov semigroups
• Parallel Sampling via Autospeculation
• Schedulers for Schedule-free: Theoretically inspired hyperparameters
• Long-time behavior for discretization schemes of Fokker-Planck equations via couplings
• Fast Direct Solvers
• Uniqueness of DRS as the 2 Operator Resolvent-Splitting and Impossibility of 3 Operator Resolvent-Splitting
• A solvable model of learning generative diffusion: theory and insights
• Contact Wasserstein Geodesics for Non-Conservative Schrodinger Bridges
• Test-Time Iterative Error Correction for Efficient Diffusion Models
• Unveiling the Training Dynamics of ReLU Networks through a Linear Lens
• Effective Test-Time Scaling of Discrete Diffusion through Iterative Refinement
• A kernel method for the learning of Wasserstein geometric flows
• Adam symmetry theorem: characterization of the convergence of the stochastic Adam optimizer
• A PDE Perspective on Generative Diffusion Models
• A Course in Interacting Particle Systems
• Coarse-graining nonequilibrium diffusions with Markov chains
• Convexity and strict convexity for compositional neural networks in high-dimensional optimal control
• An efficient proximal algorithm for squared L1 over L2 regularized sparse recovery
• Piecewise deterministic sampling with splitting schemes
• Diffusion LLMs are Natural Adversaries for any LLM
• When Models Don't Collapse: On the Consistency of Iterative MLE
• Differentiable Generalized Sliced Wasserstein Plans
• Split Gibbs Discrete Diffusion Posterior Sampling
• Stability of the Kim--Milman flow map
• Fractional Diffusion Bridge Models
• Tracking solutions of time-varying variational inequalities
• Consistent Sampling and Simulation: Molecular Dynamics with Energy-Based Diffusion Models
• Forgetting is Everywhere
• Rates of Convergence of Maximum Smoothed Log-Likelihood Estimators for Semi-Parametric Multivariate Mixtures
• Mathematics with large language models as provers and verifiers
• Information-theoretic Generalization Analysis for VQ-VAEs: A Role of Latent Variables
• Measure-Theoretic Time-Delay Embedding
• How Memory in Optimization Algorithms Implicitly Modifies the Loss
• Understanding Adam Requires Better Rotation Dependent Assumptions
• ODE approximation for the Adam algorithm: General and overparametrized setting
• Learning Paths for Dynamic Measure Transport: A Control Perspective
• Functional central limit theorem for Euler--Maruyama scheme with decreasing step sizes
• Mean square error analysis of stochastic gradient and variance-reduced sampling algorithms
• Relative entropy estimate and geometric ergodicity for implicit Langevin Monte Carlo
• Continuous-time Riemannian SGD and SVRG Flows on Wasserstein Probabilistic Space
• Statistical Properties of Rectified Flow
• Training Optimal Large Diffusion Language Models
• On scalable and efficient training of diffusion samplers
• Nonlinear forward-backward-half forward splitting with momentum for monotone inclusions
• Diffusion Language Models are Super Data Learners
• FP-AbDiff: Improving Score-based Antibody Design by Capturing Nonequilibrium Dynamics through the Underlying Fokker-Planck Equation
• The Curved Spacetime of Transformer Architectures
• Uniform-in-time propagation of chaos for mean field Langevin dynamics
• Reversibility, covariance and coarse-graining for Langevin dynamics: On the choice of multiplicative noise
• Adam Reduces a Unique Form of Sharpness: Theoretical Insights Near the Minimizer Manifold
• A Theoretical Framework for Grokking: Interpolation followed by Riemannian Norm Minimisation
• A Review of Bilevel Optimization: Methods, Emerging Applications, and Recent Advancements
• Proximal gradient descent on the smoothed duality gap to solve saddle point problems
• Min-Max Optimization Is Strictly Easier Than Variational Inequalities
• The Evolution of Life as a Categorical Information-Handling Process
• Shifted Composition IV: Toward Ballistic Acceleration for Log-Concave Sampling
• Nonasymptotic Convergence Rates for Plug-and-Play Methods With MMSE Denoisers
• Diffusion LLMs are Natural Adversaries for any LLM
• Wasserstein Convergence of Critically Damped Langevin Diffusions
• Convergence of Random Batch Method with replacement for interacting particle systems
• The heat flow on glued spaces with varying dimension
• Piecewise deterministic sampling with splitting schemes
• Sharp inequalities between Zolotarev and Wasserstein distances in $\mathrm{P}_2(\mathbb{R}^d)$
• Concentration inequalities for strong laws and laws of the iterated logarithm
• Trade Execution Flow as the Underlying Source of Market Dynamics
• Particle system approximation of Nash equilibria in large games
• Accelerating Diffusion LLMs via Adaptive Parallel Decoding
• Discrete Diffusion Models: Novel Analysis and New Sampler Guarantees
• Minimax-Optimal Two-Sample Test with Sliced Wasserstein
• Rivers under Noise
• Gradient flow structure for some nonlocal diffusion equations
• Gradient Flows as Optimal Controlled Evolutions: From Rn to Wasserstein product spaces
• A geometric framework for momentum-based optimizers for low-rank training
• Is Grokking a Computational Glass Relaxation?
• Curly Flow Matching for Learning Non-gradient Field Dynamics
• Posterior Sampling by Combining Diffusion Models with Annealed Langevin Dynamics
• Likely Interpolants of Generative Models
• Differentiable Programming for Differential Equations: A Review
• Tuning-Free Sampling via Optimization on the Space of Probability Measures
• Large-Time Analysis of the Langevin Dynamics for Energies Fulfilling Polyak-{\L}ojasiewicz Conditions
• Hidden convexity property of a speed planning problem
• Star Quasiconvexity: an Unified Approach for Linear Convergence of First-Order Methods Beyond Convexity
• Learning Firmly Nonexpansive Operators
• Provable Scaling Laws for the Test-Time Compute of Large Language Models
• Score-based constrained generative modeling via Langevin diffusions with boundary conditions
• Strong and weak quantitative estimates in slow-fast diffusions using filtering techniques
• Equations driven by fast-oscillating functions of an It\^o diffusion process
• Averaging principle for slow-fast systems of PDEs with rough drivers
• Nonlinear forward-backward-half forward splitting with momentum for monotone inclusions
• Interpolating between Optimal Transport and KL regularized Optimal Transport using R\'enyi Divergences
• On the Contractivity of Stochastic Interpolation Flow
• On the Anisotropy of Score-Based Generative Models
• Model-free filtering in high dimensions via projection and score-based diffusions
• Proximal Hamiltonian Monte Carlo
• Strong and weak quantitative estimates in slow-fast diffusions using filtering techniques
• Thermodynamic Cost of Random-Time Protocols
• Anytime-valid, Bayes-assisted, Prediction-Powered Inference
• Inference-Time Scaling for Flow Models via Stochastic Generation and Rollover Budget Forcing
• Scaling can lead to compositional generalization
• Learning normalized image densities via dual score matching
• Structured Linear CDEs: Maximally Expressive and Parallel-in-Time Sequence Models
• Large Language Bayes
• Fisher meets Feynman: score-based variational inference with a product of experts
• Generalised Flow Maps for Few-Step Generative Modelling on Riemannian Manifolds
• Averaging principle for jump processes depending on fast ergodic dynamics
• Bean: A Language for Backward Error Analysis
• A Convergence Analysis of Adaptive Optimizers under Floating-point Quantization
• From Information to Generative Exponent: Learning Rate Induces Phase Transitions in SGD
• Fisher meets Feynman: score-based variational inference with a product of experts
• A Geometric Analysis of PCA
• Exponential Convergence Guarantees for Iterative Markovian Fitting
• A Brenier Theorem on $(P_2 (...P_2(H)...), W_2 )$ and Applications to Adapted Transport
• Smoothing inequalities for transport metrics in compact spaces
• Convergence of Stochastic Gradient Langevin Dynamics in the Lazy Training Regime
• Near Optimality of Discrete-Time Approximations for Controlled McKean-Vlasov Diffusions and Interacting Particle Systems
• Near optimal sample complexity for matrix and tensor normal models via geodesic convexity
• On the Emergence of Linear Analogies in Word Embeddings
• Sampling from multi-modal distributions with polynomial query complexity in fixed dimension via reverse diffusion
• Sign-In to the Lottery: Reparameterizing Sparse Training From Scratch
• Beyond the Ideal: Analyzing the Inexact Muon Update
• Beneath the kinetic interpretation of noise
• Topics in Probability, Parametric Estimation and Stochastic Calculus
• On the Structure of Stationary Solutions to McKean-Vlasov Equations with Applications to Noisy Transformers
• Unfolding Generative Flows with Koopman Operators: Fast and Interpretable Sampling
• Heavy-Ball Momentum Method in Continuous Time and Discretization Error Analysis
• Position: Many generalization measures for deep learning are fragile
• Smoothed Distance Kernels for MMDs and Applications in Wasserstein Gradient Flows
• Well-posedness and propagation of chaos for McKean-Vlasov stochastic variational inequalities
• Sharp comparisons between sliced and standard $1$-Wasserstein distances
• A Nonparametric Bayesian Solution of the Empirical Stochastic Inverse Problem
• Particle system approximation of Nash equilibria in large games
• Exponential stability of finite-$N$ consensus-based optimization
• REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformers
• The Spacetime of Diffusion Models: An Information Geometry Perspective
• A Frequentist Statistical Introduction to Variational Inference, Autoencoders, and Diffusion Models
• Vision Foundation Models Can Be Good Tokenizers for Latent Diffusion Models
• Learning Boltzmann Generators via Constrained Mass Transport
• Latent Discrete Diffusion Models
• Demystifying Transition Matching: When and Why It Can Beat Flow Matching
• Equations driven by fast-oscillating functions of an It\^o diffusion process
• Variable-preconditioned transformed primal-dual method for generalized Wasserstein Gradient Flows
• Designing trajectories in the Earth-Moon system: a Levenberg-Marquardt approach
• Progressive Tempering Sampler with Diffusion
• Temperature is All You Need for Generalization in Langevin Dynamics and other Markov Processes
• Non-asymptotic error bounds for probability flow ODEs under weak log-concavity
• Inference-Time Compute Scaling For Flow Matching
• Score-based deterministic density sampling
• Free energy Wasserstein gradient flow and their particle counterparts: toy model, (degenerate) PL inequalities and exit times
• Free energy Wasserstein gradient flow and their particle counterparts: toy model, (degenerate) PL inequalities and exit times
• A unified framework for divergences, free energies, and Fokker-Planck equations
• Geometric Convergence Analysis of Variational Inference via Bregman Divergences
• Second order explicit stabilized multirate method for stiff differential equations with error control
• Efficient Single-Loop Stochastic Algorithms for Nonconvex-Concave Minimax Optimization
• Understanding Sampler Stochasticity in Training Diffusion Models for RLHF
• Path Gradients after Flow Matching
• Near-Optimality of Contrastive Divergence Algorithms
• A coupling-based approach to f-divergences diagnostics for Markov chain Monte Carlo
• Non-convex entropic mean-field optimization via Best Response flow
• A Formalization of the Ionescu-Tulcea Theorem in Mathlib
• An Introduction to Sliced Optimal Transport
• Revisit First-order Methods for Geodesically Convex Optimization
• Cumulants, Moments and Selection: The Connection Between Evolution and Statistics
• Non-coupling from the past
• Flows and Diffusions on the Neural Manifold
• A Geometric Approach to Optimal Experimental Design
• Geometric optics approximation sampling: near-field case
• Enhancing Diffusion-Based Sampling with Molecular Collective Variables
• Y-shaped Generative Flows
• Sculpting Latent Spaces With MMD: Disentanglement With Programmable Priors
• Multi Timescale Stochastic Approximation: Stability and Convergence
• Contraction and entropy production in continuous-time Sinkhorn dynamics
• Forward Euler for Wasserstein Gradient Flows: Breakdown and Regularization
• Stochastic optimal transport for the Langevin dynamics and its zero--mass limit
• Convergence, design and training of continuous-time dropout as a random batch method
• Unstable optimal transport maps
• Approximation theory for 1-Lipschitz ResNets
• Reinforced sequential Monte Carlo for amortised sampling
• An Eulerian Perspective on Straight-Line Sampling
• Understanding Sampler Stochasticity in Training Diffusion Models for RLHF
• The Algorithmic Regulator
• On Convolutions, Intrinsic Dimension, and Diffusion Models
• Mixing Times and Privacy Analysis for the Projected Langevin Algorithm under a Modulus of Continuity
• Measure estimation on a manifold explored by a diffusion process
• An Exploration of Non-Euclidean Gradient Descent: Muon and its Many Variants
• A mathematical theory for understanding when abstract representations emerge in neural networks
• A Statistical Physics perspective on fairness in shared expenses: The bar bill analogy
• A framework for the use of generative modelling in non-equilibrium statistical mechanics
• Deep Neural Networks Inspired by Differential Equations
• Modeling AdaGrad, RMSProp, and Adam with Integro-Differential Equations
• Analysis of the Geometric Heat Flow Equation: Computing Geodesics in Real-Time with Convergence Guarantees
• Concentration Inequalities and UQ Bounds for Hypocoercive MCMC Samplers
• Fast Wasserstein rates for estimating probability distributions of probabilistic graphical models
• Generalized Probabilistic Approximate Optimization Algorithm
• Convergence of two-timescale gradient descent ascent dynamics: finite-dimensional and mean-field perspectives
• On the Interpolation Effect of Score Smoothing in Diffusion Models
• Conditional Flow Matching for Bayesian Posterior Inference
• Mirror Flow Matching with Heavy-Tailed Priors for Generative Modeling on Convex Domains
• Geodesic Calculus on Latent Spaces
• Convergence of optimizers implies eigenvalues filtering at equilibrium
• Learning Regularizers: Learning Optimizers that can Regularize
• On the Interpolation Effect of Score Smoothing in Diffusion Models
• Convergence of two-timescale gradient descent ascent dynamics: finite-dimensional and mean-field perspectives
• Optimal Stopping in Latent Diffusion Models
• Nested superposition principle for random measures and the geometry of the Wasserstein on Wasserstein space
• Markets for Models
• Rethinking Losses for Diffusion Bridge Samplers
• The Poisson Midpoint Method for Langevin Dynamics: Provably Efficient Discretization for Diffusion Models
• Ergodicity and error estimate of laws for a random splitting Langevin Monte Carlo
• Inference-Time Scaling of Discrete Diffusion Models via Importance Weighting and Optimal Proposal Design
• Diffusion at Absolute Zero: Langevin Sampling using Successive Moreau Envelopes [journal paper]
• An Inertial Langevin Algorithm
• An Inertial Langevin Algorithm
• Maximum Ideal Likelihood Estimation: A Unified Inference Framework for Latent Variable Models
• Data as Commodity: a Game-Theoretic Principle for Information Pricing
• Measures of Dependence based on Wasserstein distances
• Expected Free Energy-based Planning as Variational Inference
• Bilevel optimization for learning hyperparameters: Application to solving PDEs and inverse problems with Gaussian processes
• A Probabilistic Basis for Low-Rank Matrix Learning
• Generalization of Gibbs and Langevin Monte Carlo Algorithms in the Interpolation Regime
• Carr\'e du champ flow matching: better quality-generalisation tradeoff in generative models
• Markov kernels in Mathlib's probability library
• Averaging principle for slow-fast fractional stochastic differential equations
• Attention as an Adaptive Filter
• How to build a consistency model: Learning flow maps via self-distillation
• Optimization via a Control-Centric Framework
• Evolution of social behaviors in noisy environments
• Curiosity-Driven Co-Development of Action and Language in Robots Through Self-Exploration
• Perspectives on Stochastic Localization
• Categorical Invariants of Learning Dynamics
• Wave-PDE Nets: Trainable Wave-Equation Layers as an Alternative to Attention
• How to Set $\beta_1, \beta_2$ in Adam: An Online Learning Perspective
• On amortizing convex conjugates for optimal transport
• Analysis of kinetic Langevin Monte Carlo under the stochastic exponential Euler discretization from underdamped all the way to overdamped
• Error estimates for deterministic empirical approximations of probability measures
• Dale meets Langevin: A Multiplicative Denoising Diffusion Model
• Effective continuous equations for adaptive SGD: a stochastic analysis view
• When Scores Learn Geometry: Rate Separations under the Manifold Hypothesis
• Averaging principles and central limit theorems for multiscale McKean-Vlasov stochastic systems
• A coarse-graining theory for elliptic operators and homogenization in high contrast
• Understanding Transformer Architecture through Continuous Dynamics: A Partial Differential Equation Perspective
• When Scores Learn Geometry: Rate Separations under the Manifold Hypothesis
• Consistency Models as Plug-and-Play Priors for Inverse Problems
• A multiscale analysis of mean-field transformers in the moderate interaction regime
• Electric Currents for Discrete Data Generation
• Two-Scale Latent Dynamics for Recurrent-Depth Transformers
• Localized Diffusion Models
• Concentration and moment inequalities for sums of independent heavy-tailed random matrices
• Zero variance self-normalized importance sampling via estimating equations
• A Bayesian Characterization of Ensemble Kalman Updates
• Poisson Midpoint Method for Log Concave Sampling: Beyond the Strong Error Lower Bounds
• A Physics-Inspired Optimizer: Velocity Regularized Adam
• Temporal Score Rescaling for Temperature Sampling in Diffusion and Flow Models
• Error Feedback for Muon and Friends
• The Transformer Cookbook
• Flow Autoencoders are Effective Protein Tokenizers
• Learning Energy-based Variational Latent Prior for VAEs
• Diffusion Models and the Manifold Hypothesis: Log-Domain Smoothing is Geometry Adaptive
• Fisher information and trajectorial interpretation to the It\^o--Langevin relative entropy dissipation
• Optimal Denoising in Score-Based Generative Models: The Role of Data Regularity
• Combining complex Langevin dynamics with score-based and energy-based diffusion models
• Modeling Others' Minds as Code
• Equilibrium Matching: Generative Modeling with Implicit Energy-Based Models
• Sampling projections in the uniform norm
• Convex Order and Arbitrage
• Drop-Muon: Update Less, Converge Faster
• Zero variance self-normalized importance sampling via estimating equations
• Spectral gap of Metropolis-within-Gibbs under log-concavity
• Sharpness of Minima in Deep Matrix Factorization: Exact Expressions
• One-shot Conditional Sampling: MMD meets Nearest Neighbors
• When Langevin Monte Carlo Meets Randomization: Non-asymptotic Error Bounds beyond Log-Concavity and Gradient Lipschitzness
• Efficiently Escaping Saddle Points for Policy Optimization
• Sharpness of Minima in Deep Matrix Factorization: Exact Expressions
• A Single-Loop Gradient Algorithm for Pessimistic Bilevel Optimization via Smooth Approximation
• Non-Expansive Mappings in Two-Time-Scale Stochastic Approximation: Finite-Time Analysis
• Local SGD and Federated Averaging Through the Lens of Time Complexity
• Training-Free Bayesianization for Low-Rank Adapters of Large Language Models
• Discretization Error of Fourier Neural Operators
• Mechanisms of Projective Composition of Diffusion Models
• Error Analysis of Discrete Flow with Generator Matching
• Effective continuous equations for adaptive SGD: a stochastic analysis view
• A Theoretical Analysis of Discrete Flow Matching Generative Models
• Transport Based Mean Flows for Generative Modeling
• Generation Properties of Stochastic Interpolation under Finite Training Set
• On the Complexity Theory of Masked Discrete Diffusion: From $\mathrm{poly}(1/\epsilon)$ to Nearly $\epsilon$-Free
• DistillKac: Few-Step Image Generation via Damped Wave Equations
• Are Hallucinations Bad Estimations?
• Effective continuous equations for adaptive SGD: a stochastic analysis view
• Slicing Wasserstein Over Wasserstein Via Functional Optimal Transport
• The Aldous$\unicode{x2013}$Hoover Theorem in Categorical Probability
• Fast Estimation of Wasserstein Distances via Regression on Sliced Wasserstein Distances
• Scaling Laws are Redundancy Laws
• Theoretical Bounds for Stable In-Context Learning
• Latent Twins
• Understanding Optimization in Deep Learning with Central Flows
• GradNetOT: Learning Optimal Transport Maps with GradNets
• Anchored Langevin Algorithms
• Singular jump processes as generalized gradient flows
• Propagation of Chaos in One-hidden-layer Neural Networks beyond Logarithmic Time
• Efficient Sliced Wasserstein Distance Computation via Adaptive Bayesian Optimization
• On the inadequacy of nudging data assimilation algorithms for non-dissipative systems
• Amortized Latent Steering: Low-Cost Alternative to Test-Time Optimization
• Compositional System Dynamics: The Higher Mathematics Underlying System Dynamics Diagrams & Practice
• On the Dynamics of Acceleration in First order Gradient Methods
• Kernel Variational Inference Flow for Nonlinear Filtering Problem
• Convergence, Duality and Well-Posedness in Convex Bilevel Optimization
• Sampling-Based Zero-Order Optimization Algorithms
• Understanding two-scale criteria for Poincar\'{e} and log-Sobolev inequalities in the Euclidean case through \Phi-entropies
• Absorb and Converge: Provable Convergence Guarantee for Absorbing Discrete Diffusion Models
• Averaging principle for two time-scale stochastic differential equations with fast component in noncompact space
• Audio Super-Resolution with Latent Bridge Models
• Discrete Diffusion Models: Novel Analysis and New Sampler Guarantees
• Parallel Simulation for Log-concave Sampling and Score-based Diffusion Models
• Monte Carlo on a single sample
• A Computational Method for the Inverse Robin Problem with Convergence Rate
• Measure-to-measure interpolation using Transformers
• Vibrational Control of Complex Networks
• Global Optimization via Softmin Energy Minimization
• Hessian-guided Perturbed Wasserstein Gradient Flows for Escaping Saddle Points
• A Unified Theory of Exact Inference and Learning in Exponential Family Latent Variable Models
• Gradient-Free Sequential Bayesian Experimental Design via Interacting Particle Systems
• Optimal Experimental Design of a Moving Sensor for Linear Bayesian Inverse Problems
• Lindblad evolution as gradient flow
• Entropic balance with feedback control: information equalities and tight inequalities
• Gradient-Free Sequential Bayesian Experimental Design via Interacting Particle Systems
• Mixing properties of some Markov chains models in random environments
• Transient regime of piecewise deterministic Monte Carlo algorithms
• Statistical Methods in Generative AI
• Pre-training under infinite compute
• Dynamics from iterated averaging
• The Ensemble Kalman Update is an Empirical Matheron Update
• Parameter Estimation for Weakly Interacting Hypoelliptic Diffusions
• Hamiltonian Descent Algorithms for Optimization: Accelerated Rates via Randomized Integration Time
• LiMuon: Light and Fast Muon Optimizer for Large Models
• Should We Relax Stability in Matching Markets?
• The Psychogenic Machine: Simulating AI Psychosis, Delusion Reinforcement and Harm Enablement in Large Language Models
• Nash Equilibria in Games with Playerwise Concave Coupling Constraints: Existence and Computation
• A Universal Banach--Bregman Framework for Stochastic Iterations: Unifying Stochastic Mirror Descent, Learning and LLM Training
• Masked Diffusion Models as Energy Minimization
• Stability of universal properties against perturbations of the Markov Chain Monte Carlo algorithm
• Concave tents: a new tool for constructing concave reformulations of a large class of nonconvex optimization problems
• On the Moreau envelope properties of weakly convex functions
• Absolute continuity, supports and idempotent splitting in categorical probability
• The Diffusion Duality
• A Monte Carlo Approach for Nonsmooth Convex Optimization via Proximal Splitting Algorithms
• Sliding motions on systems with non-Euclidean state spaces: A differential-geometric perspective
• Forward Euler for Wasserstein Gradient Flows: Breakdown and Regularization
• Learning Concave Bid Shading Strategies in Online Auctions via Measure-valued Proximal Optimization
• Contractive kinetic Langevin samplers beyond global Lipschitz continuity
• How to simulate L\'evy flights in a steep potential: An explicit splitting numerical scheme
• Distance Between Stochastic Linear Systems
• Global Optimization Algorithm through High-Resolution Sampling
• Lyapunov stability of the Euler method
• From PowerSGD to PowerSGD+: Low-Rank Gradient Compression for Distributed Optimization with Convergence Guarantees
• Compositionality in algorithms for smoothing
• Symplectic techniques for stochastic differential equations on reductive Lie groups with applications to Langevin diffusions
• Can one condition a killed random walk to survive?
• Entropy and Learning of Lipschitz Functions under Log-Concave Measures
• Input-Time Scaling
• The Overcooked Generalisation Challenge: Evaluating Cooperation with Novel Partners in Unknown Environments Using Unsupervised Environment Design
• Repulsive Monte Carlo on the sphere for the sliced Wasserstein distance
• From the Gradient-Step Denoiser to the Proximal Denoiser and their associated convergent Plug-and-Play algorithms
• Multiscaling in Wasserstein Spaces
• Exact worst-case convergence rates for Douglas--Rachford and Davis--Yin splitting methods
• Understanding Outer Optimizers in Local SGD: Learning Rates, Momentum, and Acceleration
• Constrained Variational Inference via Safe Particle Flow
• Guided filtering and smoothing for infinite-dimensional diffusions
• Euler-type methods for Levy-driven McKean-Vlasov SDEs with super-linear coefficients: mean-square error analysis
• A hierarchical entropy method for the delocalization of bias in high-dimensional Langevin Monte Carlo
• Divide, Interact, Sample: The Two-System Paradigm
• Worst-case convergence analysis of relatively inexact gradient descent on smooth convex functions
• Convexity of Optimization Curves: Local Sharp Thresholds, Robustness Impossibility, and New Counterexamples
• Bregman Douglas-Rachford Splitting Method
• A transport approach to the cutoff phenomenon
• Nesterov acceleration for strongly convex-strongly concave bilinear saddle point problems: discrete and continuous-time approaches
• Finding a Multiple Follower Stackelberg Equilibrium: A Fully First-Order Method
• Matrix Completion in Group Testing: Bounds and Simulations
• Triplication: an important component of the modern scientific method
• Resolvent Compositions for Positive Linear Operators
• Flow-based generative models as iterative algorithms in probability space
• A relaxed version of Ryu's three-operator splitting method for structured nonconvex optimization
• Cryo-EM as a Stochastic Inverse Problem
• On the convergence rate of the Douglas-Rachford splitting algorithm
• Stochastic processes with multiple temporal scales: timescale separation and information
• On the quadratic barycentric transport problem
• Fantastic Pretraining Optimizers and Where to Find Them
• Probabilistic operator learning: generative modeling and uncertainty quantification for foundation models of differential equations
• Stability Analysis for Stochastic Hybrid Inclusions
• Euler-type approximation for the invariant measure: An abstract framework
• Improved sampling algorithms and Poincar\'e inequalities for non-log-concave distributions
• Straighter Flow Matching via a Diffusion-Based Coupling Prior
• Connections between reinforcement learning with feedback,test-time scaling, and diffusion guidance: An anthology
• Energy-Weighted Flow Matching: Unlocking Continuous Normalizing Flows for Efficient and Scalable Boltzmann Sampling
• Attention as an Adaptive Filter
• An explicit splitting SAV scheme for the kinetic Langevin dynamics
• A dynamic view of some anomalous phenomena in SGD
• An overview of Koopman-based control: From error bounds to closed-loop guarantees
• The Information Dynamics of Generative Diffusion
• Scale-Adaptive Generative Flows for Multiscale Scientific Data
• Mathematical research with GPT-5: a Malliavin-Stein experiment
• AdaGrad Meets Muon: Adaptive Stepsizes for Orthogonal Updates
• From Image Denoisers to Regularizing Imaging Inverse Problems: An Overview
• Faster Gradient Methods for Highly-smooth Stochastic Bilevel Optimization
• On the Wasserstein median of probability measures
• A Markov Categorical Framework for Language Modeling
• Strong averaging principle for nonautonomous multi-scale SPDEs with fully local monotone and almost periodic coefficients
• Wasserstein Mirror Gradient Flow as the limit of the Sinkhorn Algorithm
• Fokker-Planck equation for stochastic heat equations
• Sampling, Diffusions, and Stochastic Localization
• Distribution estimation via Flow Matching with Lipschitz guarantees
• Entry Barriers in Content Markets
• Lipschitz-Guided Design of Interpolation Schedules in Generative Models
• Regime-Switching Langevin Monte Carlo Algorithms
• Differentiable Expectation-Maximisation and Applications to Gaussian Mixture Model Optimal Transport
• Data-Dependent Smoothing for Protein Discovery with Walk-Jump Sampling
• Fantastic Pretraining Optimizers and Where to Find Them
• Bouncy particle sampler with infinite exchanging parallel tempering
• Feynman-Kac-Flow: Inference Steering of Conditional Flow Matching to an Energy-Tilted Posterior
• Composable Uncertainty in Symmetric Monoidal Categories for Design Problems (Extended Version)
• Continuously Tempered Diffusion Samplers
• A-FloPS: Accelerating Diffusion Sampling with Adaptive Flow Path Sampler
• Lipschitz-Guided Design of Interpolation Schedules in Generative Models
• Noise equals control
• Preconditioned Regularized Wasserstein Proximal Sampling
• On the Global Optimality of Linear Policies for Sinkhorn Distributionally Robust Linear Quadratic Control
• Optimal control of SDEs with merely measurable drift: an HJB approach
• Boundary Stabilization of a Bending and Twisting Wing by Linear Quadratic Gaussian Theory
• Bayesian Double Descent
• Constrained Optimization From a Control Perspective via Feedback Linearization
• Modern aspects of Markov chains: entropy, curvature and the cutoff phenomenon
• Inference-Time Alignment Control for Diffusion Models with Reinforcement Learning Guidance
• Provable Benefits of In-Tool Learning for Large Language Models
• On the convergence of adaptive approximations for stochastic differential equations
• Understanding Incremental Learning with Closed-form Solution to Gradient Flow on Overparamerterized Matrix Factorization
• Operator learning meets inverse problems: A probabilistic perspective
• An introduction to large deviations with applications in physics
• Formal equivalence between global optimization consistency and random search
• A first-order condition for discrete-time distribution steering
• Revisit Stochastic Gradient Descent for Strongly Convex Objectives: Tight Uniform-in-Time Bounds
• Analysis and Synthesis Denoisers for Forward-Backward Plug-and-Play Algorithms
• Beyond Blur: A Fluid Perspective on Generative Diffusion Models
• Understanding Learning Dynamics Through Structured Representations
• Field Matching: an Electrostatic Paradigm to Generate and Transfer Data
• Occupied Processes: Going with the Flow
• Numerical Integration of stochastic differential equations: The Heun Algorithm Revisited and It\^o-Stratonovich Calculus
• Adaptive control mechanisms in gradient descent algorithms
• The Geometry of Constrained Optimization: Constrained Gradient Flows via Reparameterization: A-Stable Implicit Schemes, KKT from Stationarity, and Geometry-Respecting Algorithms
• Norm-Constrained Flows and Sign-Based Optimization: Theory and Algorithms
• On the Edge of Memorization in Diffusion Models
• Particle exchange Monte Carlo methods for eigenfunction and related nonlinear problems
• Introduction to Regularization and Learning Methods for Inverse Problems
• From Classical Probabilistic Latent Variable Models to Modern Generative AI: A Unified Perspective
• Finite Sample Bounds for Sequential Monte Carlo and Adaptive Path Selection Using the $L_2$ Norm
• Deep Learning for Markov Chains: Lyapunov Functions, Poisson's Equation, and Stationary Distributions
• Threshold Diffusions
• Strong averaging principle for nonautonomous multi-scale SPDEs with fully local monotone and almost periodic coefficients
• Existence of nonnegative mild solutions of stochastic evolution inclusions via weak topology
• Zeroth-Order Non-smooth Non-convex Optimization via Gaussian Smoothing
• Non-Euclidean Monotone Operator Theory and Applications
• Provable Mixed-Noise Learning with Flow-Matching
• The Statistical Fairness-Accuracy Frontier
• Generative diffusion posterior sampling for informative likelihoods
• Source-Guided Flow Matching
• Mirror, Mirror of the Flow: How Does Regularization Shape Implicit Bias?
• On the Collapse Errors Induced by the Deterministic Sampler for Diffusion Models
• Underdamped Langevin MCMC with third order convergence
• Score as Action: Fine-Tuning Diffusion Generative Models by Continuous-time Reinforcement Learning
• Interpretability of linear regression models of glassy dynamics
• Multitask Learning with Stochastic Interpolants
• From Points to Spheres: A Geometric Reinterpretation of Variational Autoencoders
• Mean-Field Langevin Diffusions with Density-dependent Temperature
• Mirror Descent for Stochastic Control Problems with Measure-valued Controls
• Analysis of mean field games via Fokker-Planck-Kolmogorov equations: existence of equilibria
• Flow Matching at Scale: A Machine Learning Framework for Efficient Large-Size Sampling of Many-Body Systems
• Poisson Midpoint Method for Log Concave Sampling: Beyond the Strong Error Lower Bounds
• Singular Perturbations of Hamilton-Jacobi Equations in the Wasserstein Space
• Thermodynamic Cost of Random-Time Protocols
• High to low temperature: $O(N)$ model at large $N$
• Joint Learning of Energy-based Models and their Partition Function
• Joint Problems in Learning Multiple Dynamical Systems
• Langevin Monte-Carlo Provably Learns Depth Two Neural Nets at Any Size and Data
• Convergence of kinetic Langevin samplers for non-convex potentials
• Stability and performance guarantees for misspecified multivariate score-driven filters
• Learning from Samples: Inverse Problems over measures via Sharpened Fenchel-Young Losses
• How can we measure the information created by natural selection?
• An introduction to large deviations with applications in physics
• Improving Diffusion Inverse Problem Solving with Decoupled Noise Annealing
• An Introduction to Sliced Optimal Transport
• Anderson Acceleration For Perturbed Newton Methods
• Constructive approximate transport maps with normalizing flows
• A class of generalized Nesterov's accelerated gradient method from dynamical perspective
• Can a One-Point Feedback Zeroth-order Algorithm Achieve Linear Dimension Dependent Sample Complexity?
• When can in-context learning generalize out of task distribution?
• A Kac system interacting with two heat reservoirs
• Zeroth-Order Non-smooth Non-convex Optimization via Gaussian Smoothing
• Robust Convolution Neural ODEs via Contractivity-promoting regularization
• MDNS: Masked Diffusion Neural Sampler via Stochastic Optimal Control
• Learning Classifiers That Induce Markets
• Rollout Roulette: A Probabilistic Inference Approach to Inference-Time Scaling of LLMs using Particle-Based Monte Carlo Methods
• Clipping Improves Adam-Norm and AdaGrad-Norm when the Noise Is Heavy-Tailed
• A Survey on Diffusion Language Models
• Energy-Based Models for Predicting Mutational Effects on Proteins
• Variance-Reduced Fast Operator Splitting Methods for Generalized Equations
• Solving multiscale dynamical systems by deep learning
• Optimal Transport on Lie Group Orbits
• The Market Effects of Algorithms
• A microscopically reversible kinetic theory of flocking
• Law of the Iterated Logarithm for Markov Semigroups with Exponential Mixing in the Wasserstein Distance
• On Experiments
• On Irreversibility and Stochastic Systems: Part One
• Efficient Approximate Posterior Sampling with Annealed Langevin Monte Carlo
• Finite-Time Convergence Analysis of ODE-based Generative Models for Stochastic Interpolants
• Kinetic Optimal Transport (OTIKIN) -- Part 1: Second-Order Discrepancies Between Probability Measures
• Propagation of weak log-concavity along generalised heat flows via Hamilton-Jacobi equations
• When and how can inexact generative models still sample from the data manifold?
• Gaussian Approximation for Two-Timescale Linear Stochastic Approximation
• What is emergence, after all?
• Optimization of a Nonlinear Acoustics -- Structure Interaction Model
• Time Scaling Makes Accelerated Gradient Flow and Proximal Method Faster in Multiobjective Optimization
• The Ensemble Kalman Update is an Empirical Matheron Update
• Reverse Diffusion Sequential Monte Carlo Samplers
• Improving sampling by modifying the effective diffusion
• A Linear Differential Inclusion for Contraction Analysis to Known Trajectories
• Proximal optimal transport divergences
• A solvable generative model with a linear, one-step denoiser
• Almost-Surely Convergent Randomly Activated Monotone Operator Splitting Methods
• Bernoulli-LoRA: A Theoretical Framework for Randomized Low-Rank Adaptation
• Potential Score Matching: Debiasing Molecular Structure Sampling with Potential Energy Guidance
• Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distance
• On sliced Cram\'er metrics
• Polynomial complexity sampling from multimodal distributions using Sequential Monte Carlo
• A First-order Generative Bilevel Optimization Framework for Diffusion Models
• Stochastic thermodynamics of computation
• Why Heuristic Weighting Works: A Theoretical Analysis of Denoising Score Matching
• Flow Matching: Markov Kernels, Stochastic Processes and Transport Plans
• Categorical probability spaces, ergodic decompositions, and transitions to equilibrium
• Optimality of empirical measures as quantizers
• Stochastic Optimal Control via Measure Relaxations
• Better Embeddings with Coupled Adam
• Matrix Decomposition and Applications
• FMPlug: Plug-In Foundation Flow-Matching Priors for Inverse Problems
• PolarGrad: A Class of Matrix-Gradient Optimizers from a Unifying Preconditioning Perspective
• Single-loop methods for bilevel parameter learning in inverse imaging
• A Novel Sliced Fused Gromov-Wasserstein Distance
• Sliced Optimal Transport Plans
• Agentic Information Theory: Ergodicity and Intrinsic Semantics of Information Processes
• Fast Sampling of Protein Conformational Dynamics
• Categorical Lyapunov Theory I: Stability of Flows
• Generalized Optimal Transport
• Variational Inference Optimized Using the Curved Geometry of Coupled Free Energy
• Categorical Schr\"odinger Bridge Matching
• The Ball-Proximal (="Broximal") Point Method: a New Algorithm, Convergence Theory, and Applications
• Can sparse autoencoders make sense of gene expression latent variable models?
• Testing the spin-bath view of self-attention: A Hamiltonian analysis of GPT-2 Transformer
• A global Lipschitz stability perspective for understanding approximate approaches in Bayesian sequential learning
• State evolution beyond first-order methods I: Rigorous predictions and finite-sample guarantees
• Mean-Field Langevin Diffusions with Density-dependent Temperature
• Numerical Design of Optimized First-Order Algorithms
• A general perspective on CBO methods with stochastic rate of information
• From Conditional to Unconditional Independence: Testing Conditional Independence via Transport Maps
• A Markov Categorical Framework for Language Modeling
• Generalized Yosida Approximation and Multi-Valued Stochastic Evolution Inclusions
• On a $T_1$ Transport inequality for the adapted Wasserstein distance
• An inexact alternating projection method with application to matrix completion
• Stability of Wasserstein projections in convex order via metric extrapolation
• Relaxed and inertial nonlinear Forward-Backward algorithm
• Jacobi Hamiltonian Integrators
• Zeroth-order log-concave sampling
• The Role of the Time-Dependent Hessian in High-Dimensional Optimization
• On the Lipschitz Constant of Deep Networks and Double Descent
• Probabilistic Graphical Models: A Concise Tutorial
• Time Deep Gradient Flow Method for pricing American options
• Physical models realizing the transformer architecture of large language models
• Pre-Training LLMs on a budget: A comparison of three optimizers
• Rapid Mixing at the Uniqueness Threshold
• Protein folding classes -- High-dimensional geometry of amino acid composition space revisited
• Efficient design of rna sequences with desired properties, structure, and motifs using a grammar variational autoencoder
• Bridged Posterior: Optimization, Profile Likelihood and a New Approach to Generalized Bayes
• A Distributional View of High Dimensional Optimization
• ReDi: Rectified Discrete Flow
• The Intrinsic Riemannian Proximal Gradient Method for Convex Optimization
• Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains
• Deep RL Dual Sourcing Inventory Management with Supply and Capacity Risk Awareness
• Telegrapher's Generative Model via Kac Flows
• Concentration inequalities for log-concave sequences
• Global Regularity Estimates for Optimal Transport via Entropic Regularisation
• MAP Estimation with Denoisers: Convergence Rates and Guarantees
• On an Abstraction of Lyapunov and Lagrange Stability
• Sampling Decisions
• Harnessing higher-dimensional fluctuations in an information engine
• Sharper Exponential Convergence Rates for Sinkhorn's Algorithm in Continuous Settings
• Compositional Discrete Latent Code for High Fidelity, Productive Diffusion Models
• On Accelerated Mixing of the No-U-turn Sampler
• Analysis of Langevin midpoint methods using an anticipative Girsanov theorem
• On the Effectiveness of the z-Transform Method in Quadratic Optimization
• Geometric Stability Analysis for Differential Inclusions Governed by Maximally Monotone Operators
• On the Statistical Properties of Generative Adversarial Models for Low Intrinsic Data Dimension
• A Survey of Deep Learning for Geometry Problem Solving
• Linearization-Based Feedback Stabilization of McKean-Vlasov PDEs
• Acceleration methods for fixed point iterations
• Model averaging in the space of probability distributions
• A Complete Loss Landscape Analysis of Regularized Deep Matrix Factorization
• A Unified View on Learning Unnormalized Distributions via Noise-Contrastive Estimation
• A General Framework for Inference-time Scaling and Steering of Diffusion Models
• BiLO: Bilevel Local Operator Learning for PDE Inverse Problems. Part I: PDE-Constrained Optimization
• Geometry, Computation, and Optimality in Stochastic Optimization
• Convergence of drift-diffusion PDEs arising as Wasserstein gradient flows of convex functions
• From Kinetic Theory to AI: a Rediscovery of High-Dimensional Divergences and Their Properties
• Improved sampling algorithms and Poincar\'e inequalities for non-log-concave distributions
• Frank-Wolfe Recursions for the Emergency Response Problem on Measure Spaces
• CoVAE: Consistency Training of Variational Autoencoders
• Learning Diffusion Models with Flexible Representation Guidance
• Theory-Informed Improvements to Classifier-Free Guidance for Discrete Diffusion Models
• Beyond Scores: Proximal Diffusion Models
• Revisiting Convergence: Shuffling Complexity Beyond Lipschitz Smoothness
• Convergence of non-reversible Markov processes via lifting and flow Poincar\'e inequality
• L\'evy Langevin Monte Carlo for sampling from heavy-tailed target distributions
• Convergence Rate of the Solution of Multi-marginal Schrodinger Bridge Problem with Marginal Constraints from SDEs
• Gromov-Wasserstein Barycenters: The Analysis Problem
• Large Deviations for Empirical Measures of Self-Interacting Markov Chains
• Solving Monge problem by Hilbert space embeddings of probability measures
• On the Uniform Convergence of Subdifferentials in Stochastic Optimization and Learning
• From Controllability to Information: A Unified Analysis via Gramian, Minimum Energy, Fisher Information Matrix and Entropy
• Amortized Posterior Sampling with Diffusion Prior Distillation
• Open Materials Generation with Stochastic Interpolants
• Field Matching: an Electrostatic Paradigm to Generate and Transfer Data
• Pocket2Mol: Efficient Molecular Sampling Based on 3D Protein Pockets
• Review, Remask, Refine (R3): Process-Guided Block Diffusion for Text Generation
• Unraveling the Potential of Diffusion Models in Small Molecule Generation
• Inference-Time Scaling of Diffusion Language Models with Particle Gibbs Sampling
• Splitting Regularized Wasserstein Proximal Algorithms for Nonsmooth Sampling Problems
• Local Flow Matching Generative Models
• Bayesian Double Descent
• Learning to control non-equilibrium dynamics using local imperfect gradients
• A statistical physics framework for optimal learning
• Pullback Flow Matching on Data Manifolds
• Guided filtering and smoothing for infinite-dimensional diffusions
• Parameter estimation in interacting particle systems on dynamic random networks
• Optimal closed-loop control of active particles and a minimal information engine
• Multilevel Bregman Proximal Gradient Descent
• Proximal Oracles for Optimization and Sampling
• Random Walks with Tweedie: A Unified View of Score-Based Diffusion Models
• Navigating Sparse Molecular Data with Stein Diffusion Guidance
• Simple Convergence Proof of Adam From a Sign-like Descent Perspective
• Iterative Importance Fine-tuning of Diffusion Models
• A Malliavin calculus approach to score functions in diffusion generative models
• Nonstationary Distribution Estimation via Wasserstein Probability Flows
• Computer-aided analyses of stochastic first-order methods, via interpolation conditions for stochastic optimization
• Why is it easier to predict the epidemic curve than to reconstruct the underlying contact network?
• The surrogate Gibbs-posterior of a corrected stochastic MALA: Towards uncertainty quantification for neural networks
• Test-Time Alignment of Discrete Diffusion Models with Sequential Monte Carlo
• Kinetic Langevin Diffusion for Crystalline Materials Generation
• A note on the unique properties of the Kullback--Leibler divergence for sampling via gradient flows
• Implicit Regularisation in Diffusion Models: An Algorithm-Dependent Generalisation Analysis
• The Difference between the Left and Right Invariant Extended Kalman Filter
• On the Dynamics of Control
• On the Mathematical Impossibility of Safe Universal Approximators
• Nested importance sampling for Bayesian inference: error bounds and the role of dimension
• On Global and Local Convergence of Iterative Linear Quadratic Optimization Algorithms for Discrete Time Nonlinear Control
• Iterative Linear Quadratic Optimization for Nonlinear Control: Differentiable Programming Algorithmic Templates
• Exploring the Design Space of Diffusion Bridge Models
• Learning few-step posterior samplers by unfolding and distillation of diffusion models
• Guided Generation for Developable Antibodies
• Affine Gateaux Differentials and the von Mises Statistical Calculus
• Analysis of Muon's Convergence and Critical Batch Size
• Efficiently Vectorized MCMC on Modern Accelerators
• Entropic optimal transport beyond product reference couplings: the Gaussian case on Euclidean space
• Asymptotic convexity of wide and shallow neural networks
• Disintegration theorem for multifunctions, with applications to empirical Wasserstein distances and average-case statistical bounds
• A first-order method for nonconvex-nonconcave minimax problems under a local Kurdyka-\L{}ojasiewicz condition
• Optimization, Isoperimetric Inequalities, and Sampling via Lyapunov Potentials
• Persistence Paradox in Dynamic Science
• Geometric Gaussian Approximations of Probability Distributions
• Navigating with Annealing Guidance Scale in Diffusion Space
• Neural Langevin Machine: a local asymmetric learning rule can be creative
• SGD with Adaptive Preconditioning: Unified Analysis and Momentum Acceleration
• Transition Matching: Scalable and Flexible Generative Modeling
• Riemannian-Geometric Fingerprints of Generative Models
• Concentration inequalities for random dynamical systems
• A convex lifting approach for the Calder\'on problem
• Fragile, Robust, and Antifragile: A Perspective from Parameter Responses in Reinforcement Learning Under Stress
• Experimenting, Fast and Slow: Bayesian Optimization of Long-term Outcomes with Online Experiments
• On the Convergence of Min-Max Langevin Dynamics and Algorithm
• Optimization, Isoperimetric Inequalities, and Sampling via Lyapunov Potentials
• Annealed Leap-Point Sampler for Multimodal Target Distributions
• Breaking a Logarithmic Barrier in the Stopping Time Convergence Rate of Stochastic First-order Methods
• Shifted Composition IV: Underdamped Langevin and Numerical Discretizations with Partial Acceleration
• Adjoint Schr\"odinger Bridge Sampler
• Mixing Time of the Proximal Sampler in Relative Fisher Information via Strong Data Processing Inequality
• Are Convex Optimization Curves Convex?
• Projected gradient descent accumulates at Bouligand stationary points
• Adjoint Schr\"odinger Bridge Sampler
• Swapping objectives accelerates Davis-Yin splitting
• Optimized methods for composite optimization: a reduction perspective
• Sociophysics models inspired by the Ising model
• Local convergence rates for Wasserstein gradient flows and McKean-Vlasov equations with multiple stationary solutions
• A gradient flow that is none: Heat flow with Wentzell boundary condition
• Mixing Time Bounds for the Gibbs Sampler under Isoperimetry
• Average-case complexity in statistical inference: A puzzle-driven research seminar
• Critically-Damped Higher-Order Langevin Dynamics
• Ecosystems as adaptive living circuits
• Toward a Unified Theory of Gradient Descent under Generalized Smoothness
• Energy Matching: Unifying Flow Matching and Energy-Based Models for Generative Modeling
• Gaussian Invariant Markov Chain Monte Carlo
• On Convolutions, Intrinsic Dimension, and Diffusion Models
• Non-equilibrium Annealed Adjoint Sampler
• Telegrapher's Generative Model via Kac Flows
• Gradient-Free Sequential Bayesian Experimental Design via Interacting Particle Systems
• Building Population-Informed Priors for Bayesian Inference Using Data-Consistent Stochastic Inversion
• On gradient descent-ascent flows in metric spaces
• The Elements of Differentiable Programming
• Information-Theoretic Proofs for Diffusion Sampling
• Statistical Inference for Optimal Transport Maps: Recent Advances and Perspectives
• Interpolating between Optimal Transport and KL regularized Optimal Transport using R\'enyi Divergences
• Leveraging neural network interatomic potentials for a foundation model of chemistry
• Geometric Contact Flows: Contactomorphisms for Dynamics and Control
• Simulation-Free Differential Dynamics through Neural Conservation Laws
• Optimization-Induced Dynamics of Lipschitz Continuity in Neural Networks
• Non-equilibrium Annealed Adjoint Sampler
• A geometric framework for momentum-based optimizers for low-rank training
• Origins of Creativity in Attention-Based Diffusion Models
• Stabilizing Temporal Difference Learning via Implicit Stochastic Recursion
• Averaging principles for time-inhomogeneous multi-scale SDEs with partially dissipative coefficients
• A Linear Parameter-Varying Framework for the Analysis of Time-Varying Optimization Algorithms
• Projected Normal Distribution: Moment Approximations and Generalizations
• Flow Matching: Markov Kernels, Stochastic Processes and Transport Plans
• Diffusion & Adversarial Schr\"odinger Bridges via Iterative Proportional Markovian Fitting
• Solving Zero-Sum Convex Markov Games
• Deep generative models as the probability transformation functions
• A Minimalist Optimizer Design for LLM Pretraining
• Energy-Based Transfer for Reinforcement Learning
• Progressive Inference-Time Annealing of Diffusion Models for Sampling from Boltzmann Densities
• Alternating Gradient-Type Algorithm for Bilevel Optimization with Inexact Lower-Level Solutions via Moreau Envelope-based Reformulation
• Accelerating Proximal Gradient Descent via Silver Stepsizes
• Finite Dimensional Projections of HJB Equations in the Wasserstein Space
• Evolution of Measures in Nonsmooth Dynamical Systems: Formalisms and Computation
• The LQR-Schr\"odinger Bridge
• Generative thermodynamic computing
• Lectures on Statistical Mechanics
• Stability of universal properties against perturbations of the Markov Chain Monte Carlo algorithm
• Stochastic heat flow is a black noise
• Consistent Sampling and Simulation: Molecular Dynamics with Energy-Based Diffusion Models
• Diffusion-Based Hypothesis Testing and Change-Point Detection
• Sampling conditioned diffusions via Pathspace Projected Monte Carlo
• Transport maps as flows of control-affine systems
• Moment Constrained Optimal Transport for Control Applications
• Online Feedback Optimization for Monotone Systems without Timescale Separation
• On the Convergence Rates of Iterative Regularization Algorithms for Composite Bi-Level Optimization
• Simultaneous sampling of multiple transition channels using adaptive paths of collective variables
• Local minima of the empirical risk in high dimension: General theorems and convex examples
• Simulating Diffusion Bridges with Score Matching
• Categorical Schr\"odinger Bridge Matching
• Learning Algorithms in the Limit
• Beyond Propagation of Chaos: A Stochastic Algorithm for Mean Field Optimization
• Coarse graining of stochastic differential equations: averaging and projection method
• Inexact JKO and proximal-gradient algorithms in the Wasserstein space
• Convergence analysis of controlled particle systems arising in deep learning: from finite to infinite sample size
• Proximal Operators of Sorted Nonconvex Penalties
• Revisiting Shooting Point Monte Carlo Methods for Transition Path Sampling
• Benchmarks for protocol control in nonequilibrium statistical mechanics
• Generative thermodynamic computing
• Posterior contraction rates of computational methods for Bayesian data assimilation
• Convergence Analysis of the Wasserstein Proximal Algorithm beyond Geodesic Convexity
• Universal Approximation of Operators with Transformers and Neural Integral Operators
• The Milieu, Science & Logic of Feedback Control
• Upper and lower bounds for local Lipschitz stability of Bayesian posteriors
• Computational lower bounds in latent models: clustering, sparse-clustering, biclustering
• Absolutely Continuous Curves of Stochastic Processes
• Stochastic intrinsic gradient flows on the Wasserstein space
• Restarted contractive operators to learn at equilibrium
• Adaptive Acceleration Without Strong Convexity Priors Or Restarts
• Foundations of ecological and evolutionary change
• Joint Learning of Energy-based Models and their Partition Function
• Lyapunov analysis for FISTA under strong convexity
• Heavy-ball dynamics with Hessian-driven damping for non-convex optimization under the {\L}ojasiewicz condition
• Accelerating Diffusion Large Language Models with SlowFast: The Three Golden Principles
• Geometric Regularity in Deterministic Sampling of Diffusion-based Generative Models
• Constrained Denoising, Empirical Bayes, and Optimal Transport
• Follow the Energy, Find the Path: Riemannian Metrics from Energy-Based Models
• Leveraging Coordinate Momentum in SignSGD and Muon: Memory-Optimized Zero-Order
• Chip Placement with Diffusion Models
• Scaling Laws in Linear Regression: Compute, Parameters, and Data
• A Simple Analysis of Discretization Error in Diffusion Models
• On a structure preserving closure of Langevin dynamics
• Solving Convex-Concave Problems with $\tilde{\mathcal{O}}(\epsilon^{-4/7})$ Second-Order Oracle Complexity
• Optimal hedging of an informed broker facing many traders
• The global convergence time of stochastic gradient descent in non-convex landscapes: Sharp estimates via large deviations
• Generalized Interpolating Discrete Diffusion
• Improving the Diffusability of Autoencoders
• Neural Flow Diffusion Models: Learnable Forward Process for Improved Diffusion Modelling
• Jarzynski Reweighting and Sampling Dynamics for Training Energy-Based Models: Theoretical Analysis of Different Transition Kernels
• On Fitting Flow Models with Large Sinkhorn Couplings
• Path Integral Optimiser: Global Optimisation via Neural Schr\"odinger-F\"ollmer Diffusion
• GeoClip: Geometry-Aware Clipping for Differentially Private SGD
• Stability of Mean-Field Variational Inference
• On the Instability of Nesterov's ODE under Non-Conservative Vector Fields
• Theoretical smoothing frameworks for nonsmooth simple bilevel problems
• Bregman level proximal subdifferentials and new characterizations of Bregman proximal operators
• Computational bottlenecks for denoising diffusions
• How to explain grokking
• MCMC-Correction of Score-Based Diffusion Models for Model Composition
• On the Importance of Gaussianizing Representations
• Constrained Sampling for Language Models Should Be Easy: An MCMC Perspective
• Long run convergence of discrete-time interacting particle systems of the McKean-Vlasov type
• Computational bottlenecks for denoising diffusions
• RNE: a plug-and-play framework for diffusion density estimation and inference-time control
• Sequential Monte Carlo approximations of Wasserstein--Fisher--Rao gradient flows
• Computable Bounds on Convergence of Markov Chains in Wasserstein Distance via Contractive Drift
• Zeroth-Order Optimization Finds Flat Minima
• UniSim: A Unified Simulator for Time-Coarsened Dynamics of Biomolecules
• Psi-Sampler: Initial Particle Sampling for SMC-Based Inference-Time Reward Alignment in Score Models
• Stein Variational Evolution Strategies
• On the Wasserstein Geodesic Principal Component Analysis of probability measures
• Optical Physics-Based Generative Models
• Second Order Ensemble Langevin Method for Sampling and Inverse Problems
• Kinetics: Rethinking Test-Time Scaling Laws
• Progressive Tempering Sampler with Diffusion
• Gradient flow in parameter space is equivalent to linear interpolation in output space
• An SDE Perspective on Stochastic Inertial Gradient Dynamics with Time-Dependent Viscosity and Geometric Damping
• Direct-search methods in the year 2025: Theoretical guarantees and algorithmic paradigms
• Curse of Slicing: Why Sliced Mutual Information is a Deceptive Measure of Statistical Dependence
• Strong and weak convergence rates for fully coupled multiscale stochastic differential equations driven by $\alpha$-stable processes
• Global Optimization Algorithm through High-Resolution Sampling
• On scalable and efficient training of diffusion samplers
• Flow map matching with stochastic interpolants: A mathematical framework for consistency models
• An Introduction to Flow Matching and Diffusion Models
• How to build your latent Markov model -- the role of time and space
• Latent Stochastic Interpolants
• Constrained Sliced Wasserstein Embedding
• Optimal control of the Poisson equation with transport regularization: Properties of optimal transport plans and transport map
• Inverse Entropic Optimal Transport Solves Semi-supervised Learning via Data Likelihood Maximization
• Geometry Meets Incentives: Sample-Efficient Incentivized Exploration with Linear Contexts
• Learning of Population Dynamics: Inverse Optimization Meets JKO Scheme
• Protocol Models: Scaling Decentralized Training with Communication-Efficient Model Parallelism
• Quantization-based Bounds on the Wasserstein Metric
• Generalization in VAE and Diffusion Models: A Unified Information-Theoretic Analysis
• Adapted Wasserstein distance between the laws of SDEs
• Phase transition for Minesweeper
• Markovian projections for functionals of It\^o semimartingales with jumps
• The Fastest Known First-Order Method for Minimizing Twice Continuously Differentiable Smooth Strongly Convex Functions
• Gradient-Free Score-Based Sampling Methods with Ensembles
• Machine-Learned Sampling of Conditioned Path Measures
• A geometric perspective of state estimation using Kalman filters
• Preconditioned primal-dual dynamics in convex optimization: non-ergodic convergence rates
• On the natural domain of Bregman operators
• Folded State Dynamics -- A Geometric and Deterministic Origin of Irreversibility
• Nonlinear Drift in Feynman-Kac Theory: Preserving Early Probabilistic Insights
• Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles
• The Gaussian Mixing Mechanism: Renyi Differential Privacy via Gaussian Sketches
• Rigorous enclosure of Lyapunov exponents of stochastic flows
• Provably convergent stochastic fixed-point algorithm for free-support Wasserstein barycenter of continuous non-parametric measures
• The Rich and the Simple: On the Implicit Bias of Adam and SGD
• Non-convex entropic mean-field optimization via Best Response flow
• Understanding Mode Connectivity via Parameter Space Symmetry
• Upper and lower bounds for local Lipschitz stability of Bayesian posteriors
• A gradient flow perspective on McKean-Vlasov equations in econophysics
• Optimal Protocols for Continual Learning via Statistical Physics and Control Theory
• Diffusive noise controls early stages of genetic demixing
• Adjoint Sampling: Highly Scalable Diffusion Samplers via Adjoint Matching
• On the Convergence Analysis of Muon
• Latent Representations for Control Design with Provable Stability and Safety Guarantees
• Inexact JKO and proximal-gradient algorithms in the Wasserstein space
• Provable Benefit of Random Permutations over Uniform Sampling in Stochastic Coordinate Descent
• Outsourced diffusion sampling: Efficient posterior inference in latent spaces of generative models
• Non-Asymptotic Analysis of (Sticky) Track-and-Stop
• Differentiable Generalized Sliced Wasserstein Plans
• In Search of Adam's Secret Sauce
• On creating convexity in high dimensions
• Adaptive tail index estimation: minimal assumptions and non-asymptotic guarantees
• Are Statistical Methods Obsolete in the Era of Deep Learning?
• On the performance of machine-learning assisted Monte Carlo in sampling from simple statistical physics models
• On Averaging and Extrapolation for Gradient Descent
• A Convergence Theory for Diffusion Language Models: An Information-Theoretic Perspective
• Conditional Diffusion Models with Classifier-Free Gibbs-like Guidance
• Dual Ascent Diffusion for Inverse Problems
• Computing Optimal Transport Plans via Min-Max Gradient Flows
• On the Almost Sure Convergence of the Stochastic Three Points Algorithm
• Learning Mixtures of Experts with EM: A Mirror Descent Perspective
• Continuous-Time Analysis of Heavy Ball Momentum in Min-Max Games
• When Models Don't Collapse: On the Consistency of Iterative MLE
• Energy-based generator matching: A neural sampler for general state space
• On scalable and efficient training of diffusion samplers
• Temperature is All You Need for Generalization in Langevin Dynamics and other Markov Processes
• How to build a consistency model: Learning flow maps via self-distillation
• Follow the Energy, Find the Path: Riemannian Metrics from Energy-Based Models
• Weighted quantization using MMD: From mean field to mean shift via gradient flows
• Homogenisation for Maxwell and Friends
• The velocity jump Langevin process and its splitting scheme: long time convergence and numerical accuracy
• A Langevin sampling algorithm inspired by the Adam optimizer
• On theoretical guarantees and a blessing of dimensionality for nonconvex sampling
• On the Relation between Rectified Flows and Optimal Transport
• Backpropagation-Free Metropolis-Adjusted Langevin Algorithm
• Discrete Neural Flow Samplers with Locally Equivariant Transformer
• Spacetime Geometry of Denoising in Diffusion Models
• A new class of finite difference methods: The zigzag schemes
• Importance Corrected Neural JKO Sampling
• Learning with Restricted Boltzmann Machines: Asymptotics of AMP and GD in High Dimensions
• New Tight Bounds for SGD without Variance Assumption: A Computer-Aided Lyapunov Analysis
• Why Diffusion Models Don't Memorize: The Role of Implicit Dynamical Regularization in Training
• Sampling from Conditional Distributions of Simplified Vines
• ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting
• Sampled-data Systems: Stability, Contractivity and Single-iteration Suboptimal MPC
• Split-as-a-Pro: behavioral control via operator splitting and alternating projections
• Hamiltonian Theory and Computation of Optimal Probability Density Control in High Dimensions
• From Score Matching to Diffusion: A Fine-Grained Error Analysis in the Gaussian Setting
• Lindblad evolution as gradient flow
• Power of Generalized Smoothness in Stochastic Convex Optimization: First- and Zero-Order Algorithms
• SpectraLDS: Provable Distillation for Linear Dynamical Systems
• Algorithmic Collusion by Large Language Models
• Stochastic agent-based Monte Carlo simulations for reaction-diffusion models, population dynamics, and epidemic spreading
• Educational programs and crime: a compartmental model approach
• To Code or not to Code? Adaptive Tool Integration for Math Language Models via Expectation-Maximization
• Gradient Flows and Riemannian Structure in the Gromov-Wasserstein Geometry
• PO-Flow: Flow-based Generative Models for Sampling Potential Outcomes and Counterfactuals
• An Operator Splitting View of Federated Learning
• Gradient Flows and Riemannian Structure in the Gromov-Wasserstein Geometry
• Dimension-adapted Momentum Outscales SGD
• Smooth transport map via diffusion process
• An interacting particle consensus method for constrained global optimization
• Continuous-time iterative linear-quadratic regulator
• Neural Entropy
• Subspace Langevin Monte Carlo
• Harnessing the Universal Geometry of Embeddings
• Mirror Bridges Between Probability Measures
• An Empirical Analysis of Forgetting in Pre-trained Models with Incremental Low-Rank Updates
• From stability of Langevin diffusion to convergence of proximal MCMC for non-log-concave sampling
• Selective Code Generation for Functional Guarantees
• Latent Flow Transformer
• Fractional interacting particle system: drift parameter estimation via Malliavin calculus
• Nesterov Acceleration for Ensemble Kalman Inversion and Variants
• Training-Free Bayesianization for Low-Rank Adapters of Large Language Models
• Bayesian Inverse Problems Meet Flow Matching: Efficient and Flexible Inference via Transformers
• Greed is Good: A Unifying Perspective on Guided Generation
• Grokking at the Edge of Numerical Stability
• Wasserstein Flow Matching: Generative modeling over families of distributions
• On Probabilistic Pullback Metrics for Latent Hyperbolic Manifolds
• A Comprehensive Framework for Analyzing the Convergence of Adam: Bridging the Gap with SGD
• Group Symmetry Enables Faster Optimization in Inverse Problems
• Self-interacting approximation to McKean-Vlasov long-time limit: a Markov chain Monte Carlo method
• Black-box unadjusted Hamiltonian Monte Carlo
• A parameterized Wasserstein Hamiltonian flow approach for solving the Schr\"odinger equation
• EconoJax: A Fast & Scalable Economic Simulation in Jax
• Nesterov Acceleration for Ensemble Kalman Inversion and Variants
• A Symplectic Analysis of Alternating Mirror Descent
• Accelerated Markov Chain Monte Carlo Algorithms on Discrete States
• Hamiltonian Descent Algorithms for Optimization: Accelerated Rates via Randomized Integration Time
• Proximal optimal transport divergences
• A Generative Framework for Causal Estimation via Importance-Weighted Diffusion Distillation
• On the Nonconvexity of Push-Forward Constraints and Its Consequences in Machine Learning
• An Exponential Averaging Process with Strong Convergence Properties
• EXAdam: The Power of Adaptive Cross-Moments
• Variational structure of Fokker-Planck equations with variable mobility
• Laplace Meets Moreau: Smooth Approximation to Infimal Convolutions Using Laplace's Method
• Path Gradients after Flow Matching
• Energy Matching: Unifying Flow Matching and Energy-Based Models for Generative Modeling
• Nesterov acceleration in benignly non-convex landscapes
• Free-energy estimates from nonequilibrium trajectories under varying-temperature protocols
• Analytic theory of dropout regularization
• Discrete distributions are learnable from metastable samples
• Uniform-in-time propagation of chaos for Consensus-Based Optimization
• Hamiltonian replica exchange augmented with diffusion-based generative models and importance sampling to assess biomolecular conformational basins and barriers
• Unified Continuous Generative Models
• Diffusion Processes on $p$-Wasserstein Space over Banach Space
• Stochastic moments dynamics: a flexible finite-dimensional random perturbation of Wasserstein gradient descent
• Learning from Samples: Inverse Problems over measures via Sharpened Fenchel-Young Losses
• Langevin Diffusion Approximation to Same Marginal Schr\"{o}dinger Bridge
• A stochastic gradient method for trilevel optimization
• Sparsity for dynamic inverse problems on Wasserstein curves with bounded variation
• Strong and weak quantitative estimates in slow-fast diffusions using filtering techniques
• Iterative Orthogonalization Scaling Laws
• Guide your favorite protein sequence generative model
• Particle Gibbs without the Gibbs bit
• Categorical and geometric methods in statistical, manifold, and machine learning
• Gradient flow structure for some nonlocal diffusion equations
• Geometric Foundation of Nonequilibrium Transport: A Minkowski Embedding of Markov Dynamics
• Linear Analysis of Stochastic Verlet-Type Integrators for Langevin Equations
• Accelerated Gradient Methods Through Variable and Operator Splitting
• Lifting couplings in Wasserstein spaces
• Mitigating mode collapse in normalizing flows by annealing with an adaptive schedule: Application to parameter estimation
• Resolving Memorization in Empirical Diffusion Model for Manifold Data in High-Dimensional Spaces
• Metric extrapolation in the Wasserstein space
• Fluctuation without dissipation: Microcanonical Langevin Monte Carlo
• Which exceptional low-dimensional projections of a Gaussian point cloud can be found in polynomial time?
• Entropic Time Schedulers for Generative Diffusion Models
• Faster logconcave sampling from a cold start in high dimension
• A dynamic view of the double descent
• Mirror Mean-Field Langevin Dynamics
• Entropy-Guided Sampling of Flat Modes in Discrete Spaces
• Minimax entropy: The statistical physics of optimal models
• A non-asymptotic approach to stochastic differential games with many players under semi-monotonicity
• The dynamical law behind eye movements: distinguishing between L\'evy and intermittent strategies
• A Provably Convergent Plug-and-Play Framework for Stochastic Bilevel Optimization
• A Bayesian approach to inverse problems in spaces of measures
• On the Importance of Gaussianizing Representations
• A Theory of "Likes"
• Climate Science and Control Engineering: Insights, Parallels, and Connections
• Wellposedness and averaging principle for conditional distribution dependent SDEs driven by standard Brownian motions and fractional Brownian motions
• Extended convexity and smoothness and their applications in deep learning
• Geometry and Duality of Alternating Markov Chains
• Large deviation-based tuning schemes for Metropolis-Hastings algorithms
• Sharp higher order convergence rates for the Adam optimizer
• Inverse Problems Over Probability Measure Space
• A reverse isoperimetric inequality for the Cheeger constant under width constraint
• Negative Imaginary Neural ODEs: Learning to Control Mechanical Systems with Stability Guarantees
• A higher-order Otto calculus approach to the Gaussian completely monotone conjecture
• Mixing of metastable diffusion processes with Gibbs invariant distribution
• Entropic continuity bounds for conditional covariances with applications to Schr\" odinger and Sinkhorn bridges
• Sampling and estimation on manifolds using the Langevin diffusion
• A Langevin sampling algorithm inspired by the Adam optimizer
• Flow Matching Ergodic Coverage
• Action-Minimization Meets Generative Modeling: Efficient Transition Path Sampling with the Onsager-Machlup Functional
• A Geometric Framework for Stochastic Iterations
• Averaging principle for slow-fast systems of rough differential equations via controlled paths
• Heat kernels, intrinsic contractivity and ergodicity of discrete-time Markov chains killed by potentials
• Kalman-Langevin dynamics : exponential convergence, particle approximation and numerical approximation
• Score-Based Deterministic Density Sampling
• Analysis of Multiple-try Metropolis via Poincar\'e inequalities
• On the equivalence of a Hessian-free inequality and Lipschitz continuous Hessian
• Nonasymptotic CLT and Error Bounds for Two-Time-Scale Stochastic Approximation
• Likelihood-Free Variational Autoencoders
• Embedding Empirical Distributions for Computing Optimal Transport Maps
• Mean convergence rates for Gaussian-smoothed Wasserstein distances and classical Wasserstein distances
• Applied Antifragility in Natural Systems: Evolutionary Antifragility
• Computing Optimal Transport Plans via Min-Max Gradient Flows
• Solving Inverse Problems in Protein Space Using Diffusion-Based Priors
• Exact Sampling of Gibbs Measures with Estimated Losses
• Compositionality in algorithms for smoothing
• Transport f divergences
• On the Guidance of Flow Matching
• Muon Optimizer Accelerates Grokking
• An interacting particle consensus method for constrained global optimization
• Recovering Nesterov accelerated dynamics from Heavy Ball dynamics via time rescaling
• Markov Kernels, Distances and Optimal Control: A Parable of Linear Quadratic Non-Gaussian Distribution Steering
• First-Order Methods for Linearly Constrained Bilevel Optimization
• A Bayesian Interpretation of the Internal Model Principle
• Generative Learning of Densities on Manifolds
• A direct proof of a unified law of robustness for Bregman divergence losses
• Optimal Scheduling of Dynamic Transport
• First and Second Order Approximations to Stochastic Gradient Descent Methods with Momentum Terms
• Adjoint Sampling: Highly Scalable Diffusion Samplers via Adjoint Matching
• Entropic Time Schedulers for Generative Diffusion Models
• Convergence of the fully discrete JKO scheme
• Learning from Similar Linear Representations: Adaptivity, Minimaxity, and Robustness
• Efficient Primal-dual Forward-backward Splitting Method for Wasserstein-like Gradient Flows with General Nonlinear Mobilities
• Integral control of the proximal gradient method for unbiased sparse optimization
• Introduction to Langevin Stochastic Processes
• FEAT: Free energy Estimators with Adaptive Transport
• Adjoint Sampling: Highly Scalable Diffusion Samplers via Adjoint Matching
• Score as Action: Fine-Tuning Diffusion Generative Models by Continuous-time Reinforcement Learning
• Model-free Estimation of Latent Structure via Multiscale Nonparametric Maximum Likelihood
• On the Contractivity of Stochastic Interpolation Flow
• Energy Matching: Unifying Flow Matching and Energy-Based Models for Generative Modeling
• Non-Reversible Langevin Algorithms for Constrained Sampling
• Hessian stability and convergence rates for entropic and Sinkhorn potentials via semiconcavity
• Off-the-grid regularisation for Poisson inverse problems
• Adaptive teachers for amortized samplers
• Towards Weaker Variance Assumptions for Stochastic Optimization
• No-Regret Generative Modeling via Parabolic Monge-Amp\`ere PDE
• Score Matching Diffusion Based Feedback Control and Planning of Nonlinear Systems
• Improving the evaluation of samplers on multi-modal targets
• $\alpha$-Flow: A Unified Framework for Continuous-State Discrete Flow Matching Models
• A User's Guide to Sampling Strategies for Sliced Optimal Transport
• Convergence of the denoising diffusion probabilistic models for general noise schedules
• Exact inequalities and optimal recovery by inaccurate information
• Agentic Workflows for Economic Research: Design and Implementation
• Ising 100: review of solutions
• Entropically Driven Agents
• Global Regularity Estimates for Optimal Transport via Entropic Regularisation
• Measure Theory of Conditionally Independent Random Function Evaluation
• Proofs as Explanations: Short Certificates for Reliable Predictions
• Optimal Transport-Based Generative Models for Bayesian Posterior Sampling
• Controlled stochastic processes for simulated annealing
• On iteratively regularized first-order methods for simple bilevel optimization
• Microfoundation Inference for Strategic Prediction
• Wasserstein Gradient Flows for Moreau Envelopes of f-Divergences in Reproducing Kernel Hilbert Spaces
• Bregman-Wasserstein divergence: geometry and applications
• Slicing the Gaussian Mixture Wasserstein Distance
• Smoothed Distance Kernels for MMDs and Applications in Wasserstein Gradient Flows
• Bridging the Theoretical Gap in Randomized Smoothing
• Sampling from mixture distributions based on regime-switching diffusions
• Error estimate for regularized optimal transport problems via Bregman divergence
• Language Models Are Implicitly Continuous
• Gaussian Mixture Flow Matching Models
• On the Convergence Rate of Sinkhorn's Algorithm
• Transport information Bregman divergences
• Stability of optimal transport maps on Riemannian manifolds
• A New Approach to Controlling Linear Dynamical Systems
• Gradient-free stochastic optimization for additive models
• Sampling with time-changed Markov processes
• Dimension-Free Convergence of Diffusion Models for Approximate Gaussian Mixtures
• Randomised Splitting Methods and Stochastic Gradient Descent
• DDPM Score Matching and Distribution Learning
• Information Geometry of Exponentiated Gradient: Convergence beyond L-Smoothness
• Accelerating Particle-based Energetic Variational Inference
• Conditioning Diffusions Using Malliavin Calculus
• Averaging principle for rough slow-fast systems of level 3
• Stochastic Optimization with Optimal Importance Sampling
• Beyond Smoothness and Convexity: Optimization via sampling
• Geometric Reasoning in the Embedding Space
• Diffusion at Absolute Zero: Langevin Sampling Using Successive Moreau Envelopes [conference paper]
• Error Analysis of Sampling Algorithms for Approximating Stochastic Optimal Control
• A Geometric Framework for Stochastic Iterations
• Beyond Gaussian Assumptions: A Nonlinear Generalization of Linear Inverse Modeling
• Convergence of Ray- and Pixel-Driven Discretization Frameworks in the Strong Operator Topology
• A Unified Approach to Analysis and Design of Denoising Markov Models
• Are Convex Optimization Curves Convex?
• Acceleration via Perturbations on Low-resolution Ordinary Differential Equations
• Deep Generative Models: Complexity, Dimensionality, and Approximation
• Gradient Descent for Convex and Smooth Noisy Optimization
• Theoretical Insights into Fine-Tuning Attention Mechanism: Generalization and Optimization
• Remarks on the Polyak-Lojasiewicz inequality and the convergence of gradient systems
• Steering Large Agent Populations using Mean-Field Schrodinger Bridges with Gaussian Mixture Models
• Polynomial Inequalities and Optimal Stability of Numerical Integrators
• Decentralized Bilevel Optimization: A Perspective from Transient Iteration Complexity
• Accelerated Stein Variational Gradient Flow
• Single-loop Projection-free and Projected Gradient-based Algorithms for Nonconvex-concave Saddle Point Problems with Bilevel Structure
• Convergence analysis of controlled particle systems arising in deep learning: from finite to infinite sample size
• On the convergence of the Euler-Maruyama scheme for McKean-Vlasov SDEs
• Open-loop control design for contraction in affine nonlinear systems
• Manifold learning in Wasserstein space
• A Tutorial on Multi-time Scale Optimization Models and Algorithms
• Asymptotics of the quantization problem on metric measure spaces
• Finite-Time Bounds for Two-Time-Scale Stochastic Approximation with Arbitrary Norm Contractions and Markovian Noise
• Solving Schr\"{o}dinger bridge problem via continuous normalizing flow
• Homotopy Methods for Convex Optimization
• On the Computational Power of Particle Methods
• Synthesis and Analysis of Data as Probability Measures with Entropy-Regularized Optimal Transport
• Entropy annealing for policy mirror descent in continuous time and space
• Generalization of the Gibbs algorithm with high probability at low temperatures
• Theory on Score-Mismatched Diffusion Models and Zero-Shot Conditional Samplers
• Wasserstein bounds for non-linear Gaussian filters
• Empirical Measures and Strong Laws of Large Numbers in Categorical Probability
• A uniform rate of convergence for the entropic potentials in the quadratic Euclidean setting
• Turnpike in optimal control and beyond: a survey
• Unlocking Guidance for Discrete State-Space Diffusion and Flow Models
• Learning Straight Flows by Learning Curved Interpolants
• Global Regularity Estimates for Optimal Transport via Entropic Regularisation
• Denoising Diffusion Variational Inference: Diffusion Models as Expressive Variational Posteriors
• Stochastic Transport Maps in Diffusion Models and Sampling
• A four-operator splitting algorithm for nonconvex and nonsmooth optimization
• KL-geodesics flow matching with a novel sampling scheme
• Lean Formalization of Generalization Error Bound by Rademacher Complexity
• Flow to Learn: Flow Matching on Neural Network Parameters
• Factorizations of relative entropy using stochastic localization
• Stochastic neighborhood embedding and the gradient flow of relative entropy
• An Overview of Low-Rank Structures in the Training and Adaptation of Large Models
• Accelerating Langevin Monte Carlo Sampling: A Large Deviations Analysis
• High-Order and Energy-Stable Implicit-Explicit Relaxation Runge-Kutta Schemes for Gradient Flows
• Non-Bayesian Learning in Misspecified Models
• AutoBayes: A Compositional Framework for Generalized Variational Inference
• Schr\"odinger Bridges for Systems of Interacting Particles
• Semi-Implicit Functional Gradient Flow for Efficient Sampling
• Advances in Protein Representation Learning: Methods, Applications, and Future Directions
• Contraction Theory for Nonlinear Stability Analysis and Learning-based Control: A Tutorial Overview
• Semi-Implicit Functional Gradient Flow for Efficient Sampling
• Statistical exploration of the Manifold Hypothesis
• Tuning Sequential Monte Carlo Samplers via Greedy Incremental Divergence Minimization
• Stability of Schr\"odinger bridges and Sinkhorn semigroups for log-concave models
• Efficient Bayesian Computation Using Plug-and-Play Priors for Poisson Inverse Problems
• Statistical accuracy of the ensemble Kalman filter in the near-linear setting
• Tuning Sequential Monte Carlo Samplers via Greedy Incremental Divergence Minimization
• The global convergence time of stochastic gradient descent in non-convex landscapes: Sharp estimates via large deviations
• Stability of Schr\"odinger bridges and Sinkhorn semigroups for log-concave models
• An introduction to large deviations with applications in physics
• From Denoising Score Matching to Langevin Sampling: A Fine-Grained Error Analysis in the Gaussian Setting
• Revisiting Strong Duality, Hidden Convexity, and Gradient Dominance in the Linear Quadratic Regulator
• Understanding Flatness in Generative Models: Its Role and Benefits
• Stochastic Primal-Dual Three Operator Splitting Algorithm with Extension to Equivariant Regularization-by-Denoising
• Beyond Propagation of Chaos: A Stochastic Algorithm for Mean Field Optimization
• SynLlama: Generating Synthesizable Molecules and Their Analogs with Large Language Models
• Explicit numerical approximations for McKean-Vlasov stochastic differential equations in finite and infinite time
• Strong convergence of multiscale truncated Euler-Maruyama method for super-linear slow-fast stochastic differential equations
• How compositional generalization and creativity improve as diffusion models are trained
• Regularization Using Synthetic Data in High-Dimensional Models
• Memorization and Regularization in Generative Diffusion Models
• On The Convergence of Euler Discretization of Finite-Time Convergent Gradient Flows
• Sampling Decisions
• Topology meets Machine Learning: An Introduction using the Euler Characteristic Transform
• Control, Optimal Transport and Neural Differential Equations in Supervised Learning
• A Unified Model for High-Resolution ODEs: New Insights on Accelerated Methods
• On The Convergence of Euler Discretization of Finite-Time Convergent Gradient Flows
• Fast alignment of heterogeneous images in sliced Wasserstein distance
• Theoretical Convergence Guarantees for Variational Autoencoders
• Optimal Denoising in Score-Based Generative Models: The Role of Data Regularity
• Informed Correctors for Discrete Diffusion Models
• Zero-shot Imputation with Foundation Inference Models for Dynamical Systems
• Constrained Optimization From a Control Perspective via Feedback Linearization
• From Denoising Score Matching to Langevin Sampling: A Fine-Grained Error Analysis in the Gaussian Setting
• InverseBench: Benchmarking Plug-and-Play Diffusion Priors for Inverse Problems in Physical Sciences
• Numerical and statistical analysis of NeuralODE with Runge-Kutta time integration
• The Problem of the Priors, or Posteriors?
• Online estimation of the inverse of the Hessian for stochastic optimization with application to universal stochastic Newton algorithms
• Quadratically Regularized Optimal Transport: Existence and Multiplicity of Potentials
• SGD with memory: fundamental properties and stochastic acceleration
• Multi-Iteration Stochastic Optimizers
• Scaffold with Stochastic Gradients: New Analysis with Linear Speed-Up
• On Solving Minimization and Min-Max Problems by First-Order Methods with Relative Error in Gradients
• Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models
• KL-geodesics flow matching with a novel sampling scheme
• RNACG: A Universal RNA Sequence Conditional Generation model based on Flow-Matching
• Convergence of the Chambolle-Pock Algorithm in the Absence of Monotonicity
• Self-interacting processes via Doob conditioning
• Schr\"odinger Bridges for Systems of Interacting Particles
• Thermodynamic inference in molecular motors: a Martingale approach
• Diffusion Models as Cartoonists: The Curious Case of High Density Regions
• Inductive Moment Matching
• Representation Theorems for Convex Expectations and Semigroups on Path Space
• Score matching for bridges without learning time-reversals
• Sample and Map from a Single Convex Potential: Generation using Conjugate Moment Measures
• Are Convex Optimization Curves Convex?
• Improving Diffusion-based Inverse Algorithms under Few-Step Constraint via Learnable Linear Extrapolation
• The Curse of Conditions: Analyzing and Improving Optimal Transport for Conditional Flow-Based Generation
• Optimal Riemannian metric for Poincar\'e inequalities and how to ideally precondition Langevin dynamics
• Langevin Monte-Carlo Provably Learns Depth Two Neural Nets at Any Size and Data
• Connections between sequential Bayesian inference and evolutionary dynamics
• A Geometric Framework for Understanding Memorization in Generative Models
• Bayesian Experimental Design via Contrastive Diffusions
• Score matching for bridges without learning time-reversals
• Sample and Map from a Single Convex Potential: Generation using Conjugate Moment Measures
• Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
• Theoretical Guarantees for High Order Trajectory Refinement in Generative Flows
• On the Generalization Properties of Diffusion Models
• State-space systems as dynamic generative models
• Minimax Optimality of the Probability Flow ODE for Diffusion Models
• One-step Diffusion Models with $f$-Divergence Distribution Matching
• SGD with memory: fundamental properties and stochastic acceleration
• Plug-and-Play Posterior Sampling under Mismatched Measurement and Prior Models
• Constrained Approximate Optimal Transport Maps
• Learning Energy-Based Models by Self-normalising the Likelihood
• Time-reversal solution of BSDEs in stochastic optimal control: a linear quadratic study
• Sampling the space of solutions of an artificial neural network
• Flow Matching for Discrete Systems: Efficient Free Energy Sampling Across Lattice Sizes and Temperatures
• Statistical and Geometrical properties of regularized Kernel Kullback-Leibler divergence
• Regularization by Texts for Latent Diffusion Inverse Solvers
• Computing high-dimensional optimal transport by flow neural networks
• Adaptive Methods through the Lens of SDEs: Theoretical Insights on the Role of Noise
• Chemistry-Inspired Diffusion with Non-Differentiable Guidance
• Structure Preserving Diffusion Models
• Rethinking Diffusion Model in High Dimension
• FlowDPS: Flow-Driven Posterior Sampling for Inverse Problems
• Computational bottlenecks for denoising diffusions
• The Space Between: On Folding, Symmetries and Sampling
• Convergence Dynamics and Stabilization Strategies of Co-Evolving Generative Models
• Diffusion Approximation for Slow-Fast SDEs with State-Dependent Switching
• Sampling from Bayesian Neural Network Posteriors with Symmetric Minibatch Splitting Langevin Dynamics
• Computational bottlenecks for denoising diffusions
• Understanding the Learning Dynamics of LoRA: A Gradient Flow Perspective on Low-Rank Adaptation in Matrix Factorization
• Generative modelling with jump-diffusions
• The Parametric Complexity of Operator Learning
• Slow-fast systems with stochastic resetting
• Energy-Based Diffusion Language Models for Text Generation
• Riemannian Metric Learning: Closer to You than You Imagine
• SymmetricDiffusers: Learning Discrete Diffusion on Finite Symmetric Groups
• Implicit Diffusion: Efficient Optimization through Stochastic Sampling
• Tutorial on amortized optimization
• Generalized Interpolating Discrete Diffusion
• All-atom Diffusion Transformers: Unified generative modelling of molecules and materials
• When Can You Get Away with Low Memory Adam?
• On the Convergence of Adam-Type Algorithm for Bilevel Optimization under Unbounded Smoothness
• Convergence of non-reversible Markov processes via lifting and flow Poincar{\'e} inequality
• R\'enyi Divergences in Central Limit Theorems: Old and New
• Learning truly monotone operators with applications to nonlinear inverse problems
• Quantitative Flow Approximation Properties of Narrow Neural ODEs
• Iterative Flow Matching -- Path Correction and Gradual Refinement for Enhanced Generative Modeling
• Guided smoothing and control for diffusion processes
• Accelerating optimization over the space of probability measures
• Sliced-Wasserstein Distances and Flows on Cartan-Hadamard Manifolds
• Fractional Sobolev paths on Wasserstein spaces and their energy-minimizing particle representations
• Introduction to Online Control
• Linear-quadratic optimal control for non-exchangeable mean-field SDEs and applications to systemic risk
• Amortized Probabilistic Conditioning for Optimization, Simulation and Inference
• Wasserstein metric, gradient flow structure and well-posedness of Fokker-Planck equation on locally finite graphs
• Flow-based Bayesian filtering for high-dimensional nonlinear stochastic dynamical systems
• From Learning to Optimize to Learning Optimization Algorithms
• Grams: Gradient Descent with Adaptive Momentum Scaling
• $\mu^2$-SGD: Stable Stochastic Optimization via a Double Momentum Mechanism
• Can Diffusion Models Provide Rigorous Uncertainty Quantification for Bayesian Inverse Problems?
• Optimization, Isoperimetric Inequalities, and Sampling via Lyapunov Potentials
• Gradient-Free Generation for Hard-Constrained Systems
• Meta Flow Matching: Integrating Vector Fields on the Wasserstein Manifold
• Feynman-Kac Correctors in Diffusion: Annealing, Guidance, and Product of Experts
• Intrinsic regularity in the discrete log-Sobolev inequality
• Partition function approach to non-Gaussian likelihoods: information theory and state variables for Bayesian inference
• Does SGD really happen in tiny subspaces?
• Topology of the simplest gene switch
• High-Resolution Image Synthesis via Next-Token Prediction
• PnP-Flow: Plug-and-Play Image Restoration with Flow Matching
• Optimal Protocols for Continual Learning via Statistical Physics and Control Theory
• LDAdam: Adaptive Optimization from Low-Dimensional Gradient Statistics
• Simplifying, Stabilizing and Scaling Continuous-Time Consistency Models
• Lean Copilot: Large Language Models as Copilots for Theorem Proving in Lean
• On the Asymptotic Mean Square Error Optimality of Diffusion Models
• Probing the Latent Hierarchical Structure of Data via Diffusion Models
• How Discrete and Continuous Diffusion Meet: Comprehensive Analysis of Discrete Diffusion Models via a Stochastic Integral Framework
• Trajectory Inference with Smooth Schr\"odinger Bridges
• When Can You Get Away with Low Memory Adam?
• Split Gibbs Discrete Diffusion Posterior Sampling
• Underdamped Diffusion Bridges with Applications to Sampling
• End-To-End Learning of Gaussian Mixture Priors for Diffusion Sampler
• Contractive coupling rates and curvature lower bounds for Markov chains
• Learning Dynamics of Deep Linear Networks Beyond the Edge of Stability
• Numerical approximation of McKean-Vlasov SDEs via stochastic gradient descent
• The No-Underrun Sampler: A Locally-Adaptive, Gradient-Free MCMC Method
• Iterative Flow Matching -- Path Correction and Gradual Refinement for Enhanced Generative Modeling
• Provable Acceleration for Diffusion Models under Minimal Assumptions
• (Mis)Fitting: A Survey of Scaling Laws
• Constrained Generative Modeling with Manually Bridged Diffusion Models
• On the Interpolation Effect of Score Smoothing
• Large deviations for Independent Metropolis Hastings and Metropolis-adjusted Langevin algorithm
• Exponential convergence of general iterative proportional fitting procedures
• Posterior Inference with Diffusion Models for High-dimensional Black-box Optimization
• Concentration of Measure for Distributions Generated via Diffusion Models
• Near-Optimal Approximations for Bayesian Inference in Function Space
• A Concise Lyapunov Analysis of Nesterov's Accelerated Gradient Method
• Linear multistep methods with repeated global Richardson extrapolation
• The Stability and Accuracy of The Adams-Bashforth-type Integrator
• Nonlinear Assimilation via Score-based Sequential Langevin Sampling
• On Convergence of Adam for Stochastic Optimization under Relaxed Assumptions
• Flow-based linear embedding for Bayesian filtering of nonlinear stochastic dynamical systems
• Splitting Regularized Wasserstein Proximal Algorithms for Nonsmooth Sampling Problems
• One-step Diffusion Models with $f$-Divergence Distribution Matching
• Feedback Schr\"odinger Bridge Matching
• Antifragility and response to damage in the synchronization of oscillators on networks
• Kinetic Optimal Transport (OTIKIN) -- Part 1: Second-Order Discrepancies Between Probability Measures
• Categorical Lyapunov Theory I: Stability of Flows
• Categorical algebra of conditional probability
• Local geometry of high-dimensional mixture models: Effective spectral theory and dynamical transitions
• Jeffrey's update rule as a minimizer of Kullback-Leibler divergence
• Solving Inverse Problems with Deep Linear Neural Networks: Global Convergence Guarantees for Gradient Descent with Weight Decay
• MRS: A Fast Sampler for Mean Reverting Diffusion based on ODE and SDE Solvers
• High-dimensional manifold of solutions in neural networks: insights from statistical physics
• Interleaved Gibbs Diffusion for Constrained Generation
• Value Gradient Sampler: Sampling as Sequential Decision Making
• Poincare Inequality for Local Log-Polyak-\L ojasiewicz Measures: Non-asymptotic Analysis in Low-temperature Regime
• Stochastic Inertial Dynamics Via Time Scaling and Averaging
• Energy-Based Diffusion Language Models for Text Generation
• Improving the Diffusability of Autoencoders
• A Non-Asymptotic Theory of Seminorm Lyapunov Stability: From Deterministic to Stochastic Iterative Algorithms
• A Non-Asymptotic Theory of Seminorm Lyapunov Stability: From Deterministic to Stochastic Iterative Algorithms
• Sampling from the Continuous Random Energy Model in Total Variation Distance
• A Novel Unified Parametric Assumption for Nonconvex Optimization
• Gradient Equilibrium in Online Learning: Theory and Applications
• Derivative-Free Optimization via Finite Difference Approximation: An Experimental Study
• Composition and Control with Distilled Energy Diffusion Models and Sequential Monte Carlo
• Stability Bounds for Smooth Optimal Transport Maps and their Statistical Implications
• Separation of time scales in weakly interacting diffusions
• The gene's eye-view of quantitative genetics
• Anytime Solvers for Variational Inequalities: the (Recursive) Safe Monotone Flows
• Towards a Mechanistic Explanation of Diffusion Model Generalization
• Uniform-in-time bounds for a stochastic hybrid system with fast periodic sampling and small white-noise
• Fast Inexact Bilevel Optimization for Analytical Deep Image Priors
• On the unconventional Hug integrator
• Generalised Parallel Tempering: Flexible Replica Exchange via Flows and Diffusions
• LoRA Training Provably Converges to a Low-Rank Global Minimum or It Fails Loudly (But it Probably Won't Fail)
• A Bregman firmly nonexpansive proximal operator for baryconvex optimization
• Score-of-Mixture Training: Training One-Step Generative Models Made Simple via Score Estimation of Mixture Distributions
• Nonasymptotic CLT and Error Bounds for Two-Time-Scale Stochastic Approximation
• On creating convexity in high dimensions
• Rigorous lower bound of the dynamical critical exponent of the Ising model
• @Hesamation Same approach works for diffusion models too: arxiv.org/abs/2401.08741
• Partial Gromov-Wasserstein Metric
• Flow Matching: Markov Kernels, Stochastic Processes and Transport Plans
• Scaling Law for Stochastic Gradient Descent in Quadratically Parameterized Linear Regression
• Finite-Time Analysis of Discrete-Time Stochastic Interpolants
• A First-order Generative Bilevel Optimization Framework for Diffusion Models
• Scalable Discrete Diffusion Samplers: Combinatorial Optimization and Statistical Physics
• Flow Matching: Markov Kernels, Stochastic Processes and Transport Plans
• Non-asymptotic Analysis of Diffusion Annealed Langevin Monte Carlo for Generative Modelling
• Deep Generative Models with Hard Linear Equality Constraints
• A Probabilistic Inference Approach to Inference-Time Scaling of LLMs using Particle-Based Monte Carlo Methods
• The Role of Randomness in Stability
• An introduction to Malliavin calculus
• Fast Convergence of $\Phi$-Divergence Along the Unadjusted Langevin Algorithm and Proximal Sampler
• Understanding Classifier-Free Guidance: High-Dimensional Theory and Non-Linear Generalizations
• Concentration Inequalities for the Stochastic Optimization of Unbounded Objectives with Application to Denoising Score Matching
• On the Convergence of Min-Max Langevin Dynamics and Algorithm
• Coupled Wasserstein Gradient Flows for Min-Max and Cooperative Games
• Convergence analysis for a variant of manifold proximal point algorithm based on Kurdyka-{\L}ojasiewicz property
• Operator convexity along lines, self-concordance, and sandwiched R\'enyi entropies
• Gradient Flows and the Curvature of Theory Space
• Neural Flow Samplers with Shortcut Models
• Poincar\'e Inequality for Local Log-Polyak-Lojasiewicz Measures : Non-asymptotic Analysis in Low-temperature Regime
• Optimality in importance sampling: a gentle survey
• Riemannian Proximal Sampler for High-accuracy Sampling on Manifolds
• Flowing Through Layers: A Continuous Dynamical Systems Perspective on Transformers
• UniDB: A Unified Diffusion Bridge Framework via Stochastic Optimal Control
• Rate of convergence of the smoothed empirical Wasserstein distance
• On the query complexity of sampling from non-log-concave distributions
• Mixing Time of the Proximal Sampler in Relative Fisher Information via Strong Data Processing Inequality
• Random Variables aren't Random
• Properties of Wasserstein Gradient Flows for the Sliced-Wasserstein Distance
• Two-Point Deterministic Equivalence for Stochastic Gradient Dynamics in Linear Models
• Mechanisms of Projective Composition of Diffusion Models
• Optimizing the diffusion coefficient of overdamped Langevin dynamics
• Complexity Analysis of Normalizing Constant Estimation: from Jarzynski Equality to Annealed Importance Sampling and beyond
• Advancing Wasserstein Convergence Analysis of Score-Based Models: Insights from Discretization and Second-Order Acceleration
• Analysis of Diffusion Models for Manifold Data
• Iterative Importance Fine-tuning of Diffusion Models
• Importance Sampling via Score-based Generative Models
• On the Convergence of Min-Max Langevin Dynamics and Algorithm
• Lovely little pedagogical note; well worth a look. arxiv.org/abs/2502.02305 'Information-Theoretic Proofs for Diffusion Sampling' - Galen Reeves, Henry D. Pfister
• On the sequential convergence of Lloyd's algorithms
• MPAX: Mathematical Programming in JAX
• Variational Control for Guidance in Diffusion Models
• A Bayesian perspective on single-shot laser characterization
• The Ensemble Kalman Update is an Empirical Matheron Update
• Theoretical Guarantees for Low-Rank Compression of Deep Neural Networks
• Latent Space Energy-based Neural ODEs
• Diffusion Bridge Implicit Models
• A Mixture-Based Framework for Guiding Diffusion Models
• The Performance Of The Unadjusted Langevin Algorithm Without Smoothness Assumptions
• Data denoising with self consistency, variance maximization, and the Kantorovich dominance
• Variations on the Expectation Due to Changes in the Probability Measure
• Beyond Fixed Horizons: A Theoretical Framework for Adaptive Denoising Diffusions
• A theoretical framework for overfitting in energy-based modeling
• Temperature-Annealed Boltzmann Generators
• Constant Rate Schedule: Constant-Rate Distributional Change for Efficient Training and Sampling in Diffusion Models
• On the Guidance of Flow Matching
• Connections between Schedule-Free Optimizers, AdEMAMix, and Accelerated SGD Variants
• Field Matching: an Electrostatic Paradigm to Generate and Transfer Data
• How Memory in Optimization Algorithms Implicitly Modifies the Loss
• Rethinking Timesteps Samplers and Prediction Types
• Learning with Differentially Private (Sliced) Wasserstein Gradients
• SDE Matching: Scalable and Simulation-Free Training of Latent Stochastic Differential Equations
• Information-Theoretic Proofs for Diffusion Sampling
• A User Guide to Sampling Strategies for Sliced Optimal Transport
• The Ball-Proximal (="Broximal") Point Method: a New Algorithm, Convergence Theory, and Applications
• Approximate Slow Manifolds in the Fokker-Planck Equation
• Functional role of synchronization: A mean-field control perspective
• Uniform-in-time weak propagation of chaos for consensus-based optimization
• Equilibrium Moment Analysis of It\^o SDEs
• On Probabilistic Pullback Metrics on Latent Hyperbolic Manifolds
• Sampling in High-Dimensions using Stochastic Interpolants and Forward-Backward Stochastic Differential Equations
• Re-examining Double Descent and Scaling Laws under Norm-based Capacity via Deterministic Equivalence
• Flow Matching: Markov Kernels, Stochastic Processes and Transport Plans
• Diffusion at Absolute Zero: Langevin Sampling Using Successive Moreau Envelopes
• Doubly Adaptive Importance Sampling
• Statistical and Computational Guarantees of Kernel Max-Sliced Wasserstein Distances
• Hutchinson's Estimator is Bad at Kronecker-Trace-Estimation
• Wellposedness, exponential ergodicity and numerical approximation of fully super-linear McKean--Vlasov SDEs and associated particle systems
• Linearization Turns Neural Operators into Function-Valued Gaussian Processes
• The Surprising Agreement Between Convex Optimization Theory and Learning-Rate Scheduling for Large Model Training
• Lightspeed Geometric Dataset Distance via Sliced Optimal Transport
• Adaptivity and Convergence of Probability Flow ODEs in Diffusion Generative Models
• Fisher information dissipation for time-inhomogeneous stochastic differential equations
• A Unified Perspective on the Dynamics of Deep Transformers
• Global Optimization Algorithm through High-Resolution Sampling
• Joint Learning of Energy-based Models and their Partition Function
• Convergence rates for an Adaptive Biasing Potential scheme from a Wasserstein optimization perspective
• A Proximal Operator for Inducing 2:4-Sparsity
• Joint Learning of Energy-based Models and their Partition Function
• Exploring Non-Convex Discrete Energy Landscapes: A Langevin-Like Sampler with Replica Exchange
• Hellinger-Kantorovich Gradient Flows: Global Exponential Decay of Entropy Functionals
• Safe Gradient Flow for Bilevel Optimization
• Predictive variational inference: Learn the predictively optimal posterior distribution
• Generative diffusion models from a PDE perspective
• Variational Schr\"odinger Momentum Diffusion
• Flow Matching: Markov Kernels, Stochastic Processes and Transport Plans
• Convergence of two-timescale gradient descent ascent dynamics: finite-dimensional and mean-field perspectives
• Safe Gradient Flow for Bilevel Optimization
• Two-Timescale Gradient Descent Ascent Algorithms for Nonconvex Minimax Optimization
• Closed-Form Diffusion Models
• Matrix Calculus (for Machine Learning and Beyond)
• A mirror descent approach to maximum likelihood estimation in latent variable models
• Fast convex optimization via closed-loop time scaling of gradient dynamics
• Memorization and Regularization in Generative Diffusion Models
• Bean: A Language for Backward Error Analysis
• Hidden Markov Models and the Bayes Filter in Categorical Probability
• Diffusive transport on the real line: semi-contractive gradient flows and their discretization
• Full Event Particle-Level Unfolding with Variable-Length Latent Variational Diffusion
• The Pseudo-Dimension of Contracts
• The Wasserstein Space of Stochastic Processes in Continuous Time
• Variational Analysis of Proximal Compositions and Integral Proximal Mixtures
• Gradient correlation is a key ingredient to accelerate SGD with momentum
• Sticky-reflecting diffusion as a Wasserstein gradient flow
• On the Almost Sure Convergence of the Stochastic Three Points Algorithm
• Differentially Private Gradient Flow based on the Sliced Wasserstein Distance
• MirrorCBO: A consensus-based optimization method in the spirit of mirror descent
• Second-order flows for approaching stationary points of a class of non-convex energies via convex-splitting schemes
• Solving Non-Monotone Inclusions Using Monotonicity of Pairs of Operators
• A solvable generative model with a linear, one-step denoiser
• Mini-batch descent in semiflows
• Linearization of ergodic McKean SDEs and applications
• O(d/T) Convergence Theory for Diffusion Probabilistic Models under Minimal Assumptions
• Low-dimensional adaptation of diffusion models: Convergence in total variation
• On measures strongly log-concave on a subspace
• Approximating particle-based clustering dynamics by stochastic PDEs
• Global Regularity Estimates for Optimal Transport via Entropic Regularisation
• Large Deviations for Slow-Fast Mean-Field Diffusions
• Averaging principles and central limit theorems for multiscale McKean-Vlasov stochastic systems
• Wellposedness, exponential ergodicity and numerical approximation of fully super-linear McKean--Vlasov SDEs and associated particle systems
• Non-Expansive Mappings in Two-Time-Scale Stochastic Approximation: Finite-Time Analysis
• Uniform in time convergence of numerical schemes for stochastic differential equations via Strong Exponential stability: Euler methods, Split-Step and Tamed Schemes
• Lee and Seung (2000)'s Algorithms for Non-negative Matrix Factorization: A Supplementary Proof Guide
• Differentially Private Gradient Flow based on the Sliced Wasserstein Distance
• On the Convergence of the Gradient Descent Method with Stochastic Fixed-point Rounding Errors under the Polyak-Lojasiewicz Inequality
• Non-Reversible Langevin Algorithms for Constrained Sampling
• Quantitative Error Bounds for Scaling Limits of Stochastic Iterative Algorithms
• Stochastic Optimal Control via Local Occupation Measures
• Geometry-Preserving Encoder/Decoder in Latent Generative Models
• Optimal Execution among $N$ Traders with Transient Price Impact
• Nonsmooth Nonconvex-Nonconcave Minimax Optimization: Primal-Dual Balancing and Iteration Complexity Analysis
• A General Framework for Inference-time Scaling and Steering of Diffusion Models
• FlowDock: Geometric Flow Matching for Generative Protein-Ligand Docking and Affinity Prediction
• Generative diffusion model with inverse renormalization group flows
• Rapid Bayesian Computation and Estimation for Neural Networks via Log-Concave Coupling
• Wasserstein Gradient Flows for Moreau Envelopes of f-Divergences in Reproducing Kernel Hilbert Spaces
• Generative Models with ELBOs Converging to Entropy Sums
• A General Framework for Inference-time Scaling and Steering of Diffusion Models
• Differentiability and overlap concentration in optimal Bayesian inference
• Particle Semi-Implicit Variational Inference
• Nesterov Acceleration for Ensemble Kalman Inversion and Variants
• On the Asymptotics of Importance Weighted Variational Inference
• Slicing of Radial Functions: a Dimension Walk in the Fourier Space
• Measure transfer via stochastic slicing and matching
• Flow matching for stochastic linear control systems
• Grand-Canonical Optimal Transport
• A Similarity Measure Between Functions with Applications to Statistical Learning and Optimization
• Proximal Flow Inspired Multi-Step Methods
• Control Strategies for Maintaining Transport Symmetries Far From Equilibrium
• On the Statistical Capacity of Deep Generative Models
• Concentration of Measure for Distributions Generated via Diffusion Models
• A General Framework for Inference-time Scaling and Steering of Diffusion Models
• Uniform large-scale $\varepsilon$-regularity for entropic optimal transport
• From discrete-time policies to continuous-time diffusion samplers: Asymptotic equivalences and faster training
• Structure preservation via the Wasserstein distance
• Regret Analysis: a control perspective
• Control of Overpopulated Tails in Kinetic Epidemic Models
• Decentralized Diffusion Models
• Accelerated Diffusion Models via Speculative Sampling
• Stochastic Process Learning via Operator Flow Matching
• Sharp Quantitative Stability for the Pr\'ekopa-Leindler and Borell-Brascamp-Lieb Inequalities
• New probabilistic methods for physics
• Grokking at the Edge of Numerical Stability
• Kinetic theory of decentralized learning for smart active matter
• Manifolds, Random Matrices and Spectral Gaps: The geometric phases of generative diffusion
• A precise asymptotic analysis of learning diffusion models: theory and insights
• Smooth transport map via diffusion process
• Constrained Sampling with Primal-Dual Langevin Monte Carlo
• Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distance
• MCMC Importance Sampling via Moreau-Yosida Envelopes
• From thermodynamics to protein design: Diffusion models for biomolecule generation towards autonomous protein engineering
• The Mean Value Theorem: Analytical Proof and Computational Approaches
• Can ChatGPT implement finite element models for geotechnical engineering applications?
• How to explain grokking
• Variational autoencoders with latent high-dimensional steady geometric flows for dynamics
• Adapting to Unknown Low-Dimensional Structures in Score-Based Diffusion Models
• High-accuracy sampling from constrained spaces with the Metropolis-adjusted Preconditioned Langevin Algorithm
• Algebraic Control: Complete Stable Inversion with Necessary and Sufficient Conditions
• Polynomial time sampling from log-smooth distributions in fixed dimension under semi-log-concavity of the forward diffusion with application to strongly dissipative distributions
• Optimizing Noise Schedules of Generative Models in High Dimensionss
• Score-Based Metropolis-Hastings Algorithms
• Poincare Inequality for Local Log-Polyak-Lojasiewicz Measures: Non-asymptotic Analysis in Low-temperature Regime
• Which constraints of a numerical problem cause ill-conditioning?
• Mimetic finite difference schemes for transport operators with divergence-free advective field and applications to plasma physics
• High-Dimensional Differential Parameter Inference in Exponential Family using Time Score Matching
• An analytic theory of creativity in convolutional diffusion models
• Fitting Dynamically Misspecified Models: An Optimal Transportation Approach
• Stability and convergence analysis of AdaGrad for non-convex optimization via novel stopping time-based techniques
• Tighter Learning Guarantees on Digital Computers via Concentration of Measure on Finite Spaces

Saved in 2024

• Convergence of the Min-Max Langevin Dynamics and Algorithm for Zero-Sum Games
• Isoperimetry is All We Need: Langevin Posterior Sampling for RL with Sublinear Regret
• EXAdam: The Power of Adaptive Cross-Moments
• Deep Kalman Filters Can Filter
• Stochastic Approximation with Two Time Scales: The General Case
• Gradient flow structure for some nonlocal diffusion equations
• A Particle Algorithm for Mean-Field Variational Inference
• Slow and fast dynamics in measure functional differential equations with state-dependent delays through averaging principles and applications to extremum seeking
• Global Search of Optimal Spacecraft Trajectories using Amortization and Deep Generative Models
• Optimal longevity of a dynasty
• Empirical likelihood for Fr\'echet means on open books
• High-accuracy sampling from constrained spaces with the Metropolis-adjusted Preconditioned Langevin Algorithm
• Methods for Convex $(L_0,L_1)$-Smooth Optimization: Clipping, Acceleration, and Adaptivity
• Optimality of the Right-Invariant Prior
• Shifted Composition III: Local Error Framework for KL Divergence
• Go With the Flow: Fast Diffusion for Gaussian Mixture Models
• Foxtsage vs. Adam: Revolution or Evolution in Optimization?
• Sch\"odinger Bridge Type Diffusion Models as an Extension of Variational Autoencoders
• Stochastic Control for Fine-tuning Diffusion Models: Optimality, Regularity, and Convergence
• Shifted Composition III: Local Error Framework for KL Divergence
• Latent Schr{\"o}dinger Bridge Diffusion Model for Generative Learning
• Transport Quasi-Monte Carlo
• Anisotropic Proximal Point Algorithm
• The Unreasonable Effectiveness of Guidance for Diffusion Models
• Posterior Mean Matching: Generative Modeling through Online Bayesian Inference
• Learning sparsity-promoting regularizers for linear inverse problems
• On cutoff via rigidity for high dimensional curved diffusions
• Covariance-modulated optimal transport and gradient flows
• Covariance-modulated optimal transport and gradient flows
• Langevin dynamics for high-dimensional optimization: the case of multi-spiked tensor PCA
• Data for Mathematical Copilots: Better Ways of Presenting Proofs for Machine Learning
• Log-concavity in one-dimensional Coulomb gases and related ensembles
• Langevin dynamics for high-dimensional optimization: the case of multi-spiked tensor PCA
• Posterior Projection for Inference in Constrained Spaces
• Sinkhorn Algorithm for Sequentially Composed Optimal Transports
• Lyapunov Analysis For Monotonically Forward-Backward Accelerated Algorithms
• Go With the Flow: Fast Diffusion for Gaussian Mixture Models
• Time-Reversible Bridges of Data with Machine Learning
• Computing Your Ideal Haircut Routine
• Improving Diffusion Inverse Problem Solving with Decoupled Noise Annealing
• jinns: a JAX Library for Physics-Informed Neural Networks
• Preconditioned Subspace Langevin Monte Carlo
• Diffusion map particle systems for generative modeling
• The impact of AI on engineering design procedures for dynamical systems
• Controllability and Tracking of Ensembles: An Optimal Transport Theory Viewpoint
• Transport maps as flows of control-affine systems
• Variational f-divergence Minimization
• Statistical analysis of the drying pattern of coffee
• Proposing and solving olympiad geometry with guided tree search
• Wasserstein Bounds for generative diffusion models with Gaussian tail targets
• Exploring Diffusion and Flow Matching Under Generator Matching
• State-Space Systems as Dynamic Generative Models
• Small-time asymptotics for hypoelliptic diffusions
• Hypocoercivity meets lifts
• Dynamical Reversibility and A New Theory of Causal Emergence
• Averaging principles for time-inhomogeneous multi-scale SDEs via nonautonomous Poisson equations
• Liquidity Pools as Mean Field Games: A New Framework
• Training Free Guided Flow Matching with Optimal Control
• Entropy-Regularized Optimal Transport in Information Design
• A semiconcavity approach to stability of entropic plans and exponential convergence of Sinkhorn's algorithm
• Controlling the asymptotic bias of the unadjusted (Microcanonical) Hamiltonian and Langevin Monte Carlo
• Large Deviations and Metastability Analysis for Heavy-Tailed Dynamical Systems
• Mathematical description of continuous time and space replicator-mutator equations for quadratic fitness landscapes
• Score Change of Variables
• Nonlinear Bayesian Filtering with Natural Gradient Gaussian Approximation
• Learning Variational Inequalities from Data: Fast Generalization Rates under Strong Monotonicity
• Phase-aware Training Schedule Simplifies Learning in Flow-Based Generative Models
• Statistical Convergence Rates of Optimal Transport Map Estimation between General Distributions
• Analysis and Synthesis Denoisers for Forward-Backward Plug-and-Play Algorithms
• A tutorial on automatic differentiation with complex numbers
• Parallel simulation for sampling under isoperimetry and score-based diffusion models
• Diffusing Differentiable Representations
• Geometric properties of disintegration of measures
• Ballistic Convergence in Hit-and-Run Monte Carlo and a Coordinate-free Randomized Kaczmarz Algorithm
• Mathematical analysis of singularities in the diffusion model under the submanifold assumption
• Paired Wasserstein Autoencoders for Conditional Sampling
• Acceleration by Random Stepsizes: Hedging, Equalization, and the Arcsine Stepsize Schedule
• Improved Sample Complexity Bounds for Diffusion Model Training
• Enhancing Sample Generation of Diffusion Models using Noise Level Correction
• Flow Matching Guide and Code
• Understanding the differences in Foundation Models: Attention, State Space Models, and Recurrent Neural Networks
• Energy-based, geometric, and compositional formulation of fluid and plasma models
• Local Curvature Smoothing with Stein's Identity for Efficient Score Matching
• 2-Rectifications are Enough for Straight Flows: A Theoretical Insight into Wasserstein Convergence
• Old Optimizer, New Norm: An Anthology
• EM Distillation for One-step Diffusion Models
• The Score-Difference Flow for Implicit Generative Modeling
• APOLLO: SGD-like Memory, AdamW-level Performance
• Optimal transport maps, majorization, and log-subharmonic measures
• Perfect sampling from rapidly mixing Markov chains
• Conditions for uniform in time convergence: applications to averaging, numerical discretisations and mean-field systems
• Strong convergence of the Euler scheme for singular kinetic SDEs driven by $\alpha$-stable processes
• A Complexity-Based Theory of Compositionality
• A Noise is Worth Diffusion Guidance
• Understanding Memorization in Generative Models via Sharpness in Probability Landscapes
• Flow Matching with General Discrete Paths: A Kinetic-Optimal Perspective
• Path-Guided Particle-based Sampling
• Non-asymptotic entropic bounds for non-linear kinetic Langevin sampler with second-order splitting scheme
• Causal transport on path space
• Sinkhorn Algorithm for Sequentially Composed Optimal Transports
• Schrodinger Bridge over Averaged Systems
• Denoising: A Powerful Building-Block for Imaging, Inverse Problems, and Machine Learning
• Flow matching for stochastic linear control systems
• Beyond Monte Carlo: Harnessing Diffusion Models to Simulate Financial Market Dynamics
• Foundations of algorithmic thermodynamics
• Nonequilbrium physics of generative diffusion models
• CBX: Python and Julia packages for consensus-based interacting particle methods
• Scaling Law for Language Models Training Considering Batch Size
• An overview of diffusion models for generative artificial intelligence
• Stochastic sewing lemma on Wasserstein space
• On the Surprising Effectiveness of Spectrum Clipping in Learning Stable Linear Dynamics
• Optimal Particle-based Approximation of Discrete Distributions (OPAD)
• A Pontryagin Perspective on Reinforcement Learning
• Bias-inducing geometries: an exactly solvable data model with fairness implications
• An Operator Splitting View of Federated Learning
• Tractable Agreement Protocols
• Towards a Mechanistic Explanation of Diffusion Model Generalization
• Isoperimetric inequalities in high-dimensional convex sets
• Markov Equivalence and Consistency in Differentiable Structure Learning
• Diffusion State-Guided Projected Gradient for Inverse Problems
• From memorization to generalization: a theoretical framework for diffusion-based generative models
• Exponential speed up in Monte Carlo sampling through Radial Updates
• Fast convolution algorithm for state space models
• Federated Automatic Differentiation
• Annealing Flow Generative Model Towards Sampling High-Dimensional and Multi-Modal Distributions
• On Statistical Rates of Conditional Diffusion Transformers: Approximation, Estimation and Minimax Optimality
• Conditional Variable Flow Matching: Transforming Conditional Densities with Amortized Conditional Optimal Transport
• Improving the Convergence Rates of Forward Gradient Descent with Repeated Sampling
• Frequency-Guided Posterior Sampling for Diffusion-Based Image Restoration
• Statistical algorithms for low-frequency diffusion data: A PDE approach
• Controllability and Vector Potential
• Anytime Acceleration of Gradient Descent
• Avoiding Deadlocks Is Not Enough: Analysis and Resolution of Blocked Airplanes
• Logarithmic Sobolev inequalities for generalised Cauchy measures
• Lipschitz constant estimation for general neural network architectures using control tools
• A Theoretical Survey on Foundation Models
• Connections between sequential Bayesian inference and evolutionary dynamics
• Cautious Optimizers: Improving Training with One Line of Code
• Adaptive Methods through the Lens of SDEs: Theoretical Insights on the Role of Noise
• Stability properties of gradient flow dynamics for the symmetric low-rank matrix factorization problem
• Why you don't overfit, and don't need Bayes if you only train for one epoch
• Geometry and analytic properties of the sliced Wasserstein space
• Linear convergence of proximal descent schemes on the Wasserstein space
• Massive Particle Systems, Wasserstein Brownian Motions, and the Dean--Kawasaki Equation
• In-and-Out: Algorithmic Diffusion for Sampling Convex Bodies
• The stabilizing role of multiplicative noise in non-confining potentials
• Partition function approach to non-Gaussian likelihoods: information theory and state variables for Bayesian inference
• Multi-Objective Optimization via Wasserstein-Fisher-Rao Gradient Flow
• Schr\"odinger Bridge Problem for Jump Diffusions
• Long time behavior of killed Feynman-Kac semigroups with singular Schr{\"o}dinger potentials
• Computational and Experimental Exploration of Protein Fitness Landscapes: Navigating Smooth and Rugged Terrains
• Sampling and Integration of Logconcave Functions by Algorithmic Diffusion
• Derivatives of Stochastic Gradient Descent in parametric optimization
• Wavelet s-Wasserstein distances for 0 < s <= 1
• Ergodicity of Langevin Dynamics and its Discretizations for Non-smooth Potentials
• Optimal transport maps, majorization, and log-subharmonic measures
• Anisotropic Gaussian Smoothing for Gradient-based Optimization
• Straightness of Rectified Flow: A Theoretical Insight into Wasserstein Convergence
• Constrained Diffusion with Trust Sampling
• 4+3 Phases of Compute-Optimal Neural Scaling Laws
• Spectral gap bounds for reversible hybrid Gibbs chains
• Straightness of Rectified Flow: A Theoretical Insight into Wasserstein Convergence
• From Optimization to Sampling via Lyapunov Potentials
• Understanding Learning with Sliced-Wasserstein Requires Rethinking Informative Slices
• Parallelly Tempered Generative Adversarial Networks
• Unbiased Approximations for Stationary Distributions of McKean-Vlasov SDEs
• Efficient inference for differential equation models without numerical solvers
• PAPAL: A Provable PArticle-based Primal-Dual ALgorithm for Mixed Nash Equilibrium
• Geometric optics approximation sampling
• Hamiltonian Monte Carlo for efficient Gaussian sampling: long and random steps
• Scaling Law for Post-training after Model Pruning
• The Unreasonable Effectiveness of Guidance for Diffusion Models
• Modeling AdaGrad, RMSProp, and Adam with Integro-Differential Equations
• Self-interacting CBO: Existence, uniqueness, and long-time convergence
• Smooth transport map via diffusion process
• Learning efficient and provably convergent splitting methods
• Golden Noise for Diffusion Models: A Learning Framework
• Inconsistencies In Consistency Models: Better ODE Solving Does Not Imply Better Samples
• How to implement the Bayes' formula in the age of ML?
• On importance sampling and independent Metropolis-Hastings with an unbounded weight function
• Parameter Inference via Differentiable Diffusion Bridge Importance Sampling
• Weak Poincar\'e Inequalities, Simulated Annealing, and Sampling from Spherical Spin Glasses
• Harmonic Path Integral Diffusion
• Searching Latent Program Spaces
• Stochastic Optimization under Hidden Convexity
• Gravity from entropy
• Event-horizon-scale Imaging of M87* under Different Assumptions via Deep Generative Image Priors
• Divide-and-Conquer Posterior Sampling for Denoising Diffusion Priors
• Conditioning non-linear and infinite-dimensional diffusion processes
• Accelerating optimization over the space of probability measures
• Learning Energy-Based Models by Cooperative Diffusion Recovery Likelihood
• Scaling Law Hypothesis for Multimodal Model
• Diffusion Models With Learned Adaptive Noise
• Conditional simulation via entropic optimal transport: Toward non-parametric estimation of conditional Brenier maps
• Diverse capability and scaling of diffusion and auto-regressive models when learning abstract rules
• Convergence Rate Analysis of LION
• On theoretical guarantees and a blessing of dimensionality for nonconvex sampling
• Localized KBO with genetic dynamics for multi-modal optimization
• Score-based generative diffusion with "active" correlated noise sources
• The Unreasonable Effectiveness of Monte Carlo Simulations in A/B Testing
• Understanding Scaling Laws with Statistical and Approximation Theory for Transformer Neural Networks on Intrinsically Low-dimensional Data
• Diffusion Sampling Correction via Approximately 10 Parameters
• Linear Spherical Sliced Optimal Transport: A Fast Metric for Comparing Spherical Data
• Kaczmarz Kac Walk
• JKO for Landau: a variational particle method for homogeneous Landau equation
• Learnability of high-dimensional targets by two-parameter models and gradient flow
• Optimal Flow Matching: Learning Straight Trajectories in Just One Step
• Nonlinear Fokker--Planck--Kolmogorov equations as gradient flows on the space of probability measures
• Control of probability flow in Markov chain Monte Carlo -- Nonreversibility and lifting
• Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent
• Stochastic Optimization Using Ricci Flow
• Kinetic Theory of Stellar Systems: A Tutorial
• Latent Diffusion Model for Conditional Reservoir Facies Generation
• GENOT: Entropic (Gromov) Wasserstein Flow Matching with Applications to Single-Cell Genomics
• Scaling Law Hypothesis for Multimodal Model
• Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent
• Scaling Laws for Pre-training Agents and World Models
• Scaling Laws for Precision
• Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play Priors
• Sampling metastable systems using collective variables and Jarzynski-Crooks paths
• Measure-to-measure interpolation using Transformers
• Constrained Sampling with Primal-Dual Langevin Monte Carlo
• Inclusive KL Minimization: A Wasserstein-Fisher-Rao Gradient Flow Perspective
• A Three-Operator Splitting Scheme Derived from Three-Block ADMM
• Risk-sensitive control as inference with R\'enyi divergence
• Bayesian scaling laws for in-context learning
• Understanding Generalizability of Diffusion Models Requires Rethinking the Hidden Gaussian Structure
• Constrained Synthesis with Projected Diffusion Models
• Learning Controlled Stochastic Differential Equations
• Denoising Diffusions with Optimal Transport: Localization, Curvature, and Multi-Scale Complexity
• Conditional Latent Space Molecular Scaffold Optimization for Accelerated Molecular Design
• Bridge-IF: Learning Inverse Protein Folding with Markov Bridges
• Finite-time thermodynamics: A journey beginning with optimizing heat engines
• DMPlug: A Plug-in Method for Solving Inverse Problems with Diffusion Models
• Contraction Theory for Nonlinear Stability Analysis and Learning-based Control: A Tutorial Overview
• Pathway-Guided Optimization of Deep Generative Molecular Design Models for Cancer Therapy
• Exponential convergence rates for momentum stochastic gradient descent in the overparametrized setting
• Denoising Fisher Training For Neural Implicit Samplers
• Analysis of Primal-Dual Langevin Algorithms
• Scaling Laws with Hidden Structure
• Diffusion Bridge Implicit Models
• ADOPT: Modified Adam Can Converge with Any $\beta_2$ with the Optimal Rate
• How much is a noisy image worth? Data Scaling Laws for Ambient Diffusion
• MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence
• A Framework for Bilevel Optimization on Riemannian Manifolds
• eXponential FAmily Dynamical Systems (XFADS): Large-scale nonlinear Gaussian state-space modeling
• Denoising Diffusions with Optimal Transport: Localization, Curvature, and Multi-Scale Complexity
• Statistical guarantees for denoising reflected diffusion models
• Scaling Laws with Hidden Structure
• Provable optimal transport with transformers: The essence of depth and prompt engineering
• Modern, Efficient, and Differentiable Transport Equation Models using JAX: Applications to Population Balance Equations
• Wasserstein Flow Matching: Generative modeling over families of distributions
• Constrained Diffusion Implicit Models
• Constant Acceleration Flow
• DiffusionPDE: Generative PDE-Solving Under Partial Observation
• Why do we regularise in every iteration for imaging inverse problems?
• Fast Samplers for Inverse Problems in Iterative Refinement Models
• Categorical Flow Matching on Statistical Manifolds
• Conditional Generative Models are Sufficient to Sample from Any Causal Effect Estimand
• Nesterov acceleration despite very noisy gradients
• Constrained Sampling with Primal-Dual Langevin Monte Carlo
• Inclusive KL Minimization: A Wasserstein-Fisher-Rao Gradient Flow Perspective
• A Geometric Framework for Understanding Memorization in Generative Models
• Micro-macro Parareal, from ODEs to SDEs and back again
• Why do we regularise in every iteration for imaging inverse problems?
• On Statistical Rates and Provably Efficient Criteria of Latent Diffusion Transformers (DiTs)
• Global Convergence in Training Large-Scale Transformers
• Understanding Optimization in Deep Learning with Central Flows
• Plug-and-play superiorization
• Non-Euclidean Monotone Operator Theory and Applications
• Fisher Flow Matching for Generative Modeling over Discrete Data
• Understanding Optimization in Deep Learning with Central Flows
• Bridging Geometric States via Geometric Diffusion Bridge
• CaAdam: Improving Adam optimizer using connection aware methods
• Learning Lipschitz Operators with respect to Gaussian Measures with Near-Optimal Sample Complexity
• Scaling Laws in Linear Regression: Compute, Parameters, and Data
• The Road Less Scheduled
• Universality of the $\pi^2/6$ Pathway in Avoiding Model Collapse
• Unpicking Data at the Seams: VAEs, Disentanglement and Independent Components
• Functional Gradient Flows for Constrained Sampling
• ET-Flow: Equivariant Flow-Matching for Molecular Conformer Generation
• Compositional imprecise probability
• Provable acceleration for diffusion models under minimal assumptions
• Consistency Diffusion Bridge Models
• Zeroth-Order Sampling Methods for Non-Log-Concave Distributions: Alleviating Metastability by Denoising Diffusion
• Adam with model exponential moving average is effective for nonconvex optimization
• Provable acceleration for diffusion models under minimal assumptions
• Life at low Reynolds number isn't such a drag
• Constrained Optimization with Compressed Gradients: A Dynamical Systems Perspective
• On the potential benefits of entropic regularization for smoothing Wasserstein estimators
• Averaging principle for multiscale controlled jump diffusions and associated nonlocal HJB equations
• The Poisson Midpoint Method for Langevin Dynamics: Provably Efficient Discretization for Diffusion Models
• Diffusion Approximations for Thompson Sampling
• A Mathematical Analysis of Neural Operator Behaviors
• Energy-Based Diffusion Language Models for Text Generation
• Evaluating the Posterior Sampling Ability of Plug&Play Diffusion Methods in Sparse-View CT
• Exploring the Design Space of Diffusion Bridge Models via Stochasticity Control
• E(3)-invaraint diffusion model for pocket-aware peptide generation
• Sharp spectral gap of adaptive Langevin dynamics
• Rivers under Noise
• EconoJax: A Fast & Scalable Economic Simulation in Jax
• Constrained Optimization with Compressed Gradients: A Dynamical Systems Perspective
• Long time behaviour of generalised gradient flows via occupational measures
• High-order Moreau envelope beyond convexity: An inexact two-level smoothing framework
• The Distance Between the Perturbation of a Convex Function and its $\Gamma$-regularization
• On Linear Convergence of PI Consensus Algorithm under the Restricted Secant Inequality
• Gradient-adjusted underdamped Langevin dynamics for sampling
• A new class of splitting methods that preserve ergodicity and exponential integrability for stochastic Langevin equation
• Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Control
• Evaluating the design space of diffusion-based generative models
• Learning Variational Inequalities from Data: Fast Generalization Rates under Strong Monotonicity
• Stochastic Flow Matching for Resolving Small-Scale Physics
• Aligning Target-Aware Molecule Diffusion Models with Exact Energy Optimization
• Schr\"{o}dinger Bridge with Quadratic State Cost is Exactly Solvable
• Denoising Diffusion Variational Inference: Diffusion Models as Expressive Variational Posteriors
• Kernel Approximation of Fisher-Rao Gradient Flows
• Generator Matching: Generative modeling with arbitrary Markov processes
• Hamiltonian Score Matching and Generative Flows
• Understanding Adam Requires Better Rotation Dependent Assumptions
• Privacy without Noisy Gradients: Slicing Mechanism for Generative Model Training
• Provable optimal transport with transformers: The essence of depth and prompt engineering
• Sampling from Bayesian Neural Network Posteriors with Symmetric Minibatch Splitting Langevin Dynamics
• A twenty-first century statistical physics of life
• Optimizing Economic Markets through Monte Carlo Simulations and Magnetism-Inspired Modeling
• Accelerated optimization algorithms and ordinary differential equations: the convex non Euclidean case
• Fixed-Point Automatic Differentiation of Forward--Backward Splitting Algorithms for Partly Smooth Functions
• Optimization with First Order Algorithms
• Variational Schr\"odinger Diffusion Models
• Learned Reference-based Diffusion Sampling for multi-modal distributions
• Simpler Diffusion (SiD2): 1.5 FID on ImageNet512 with pixel-space diffusion
• Scaling Law with Learning Rate Annealing
• Notes on the Mathematical Structure of GPT LLM Architectures
• Jump Restore Light Transport
• Gradients of Functions of Large Matrices
• Derivative-Free Guidance in Continuous and Discrete Diffusion Models with Soft Value-Based Decoding
• Structured Diffusion Models with Mixture of Gaussians as Prior Distribution
• Conditional diffusions for neural posterior estimation
• Deterministic Fokker-Planck Transport -- With Applications to Sampling, Variational Inference, Kernel Mean Embeddings & Sequential Monte Carlo
• Diffusion Bridge Implicit Models
• Can we spot a fake?
• Saddlepoint Monte Carlo and its Application to Exact Ecological Inference
• Stochastic gradient descent in high dimensions for multi-spiked tensor PCA
• GeoLoRA: Geometric integration for parameter efficient fine-tuning
• Fast constrained sampling in pre-trained diffusion models
• Denoising diffusion probabilistic models are optimally adaptive to unknown low dimensionality
• Training Free Guided Flow Matching with Optimal Control
• Transport map unadjusted Langevin algorithms: learning and discretizing perturbed samplers
• Error estimates between SGD with momentum and underdamped Langevin diffusion
• Stable generative modeling using Schr\"odinger bridges
• One-Step Diffusion Distillation through Score Implicit Matching
• Theoretical Convergence Guarantees for Variational Autoencoders
• A Simple Model of Inference Scaling Laws
• Automatic Differentiation of Optimization Algorithms with Time-Varying Updates
• Transformers are Efficient Compilers, Provably
• Truncated Consistency Models
• NETS: A Non-Equilibrium Transport Sampler
• Antifragility of stochastic transport on networks with damage
• Provable Acceleration of Nesterov's Accelerated Gradient for Rectangular Matrix Factorization and Linear Neural Networks
• Wasserstein Gradient Flow over Variational Parameter Space for Variational Inference
• Concentration of the Langevin Algorithm's Stationary Distribution
• LDAdam: Adaptive Optimization from Low-Dimensional Gradient Statistics
• On the Relation Between Linear Diffusion and Power Iteration
• Straightness of Rectified Flow: A Theoretical Insight into Wasserstein Convergence
• Beyond Discretization: Learning the Optimal Solution Path
• Diffusion-PINN Sampler
• Multi-marginal Schr\"odinger Bridges with Iterative Reference Refinement
• Emergence in non-neural models: grokking modular arithmetic via average gradient outer product
• Learning diffusion at lightspeed
• Plug-and-Play Posterior Sampling under Mismatched Measurement and Prior Models
• Matrix normal distribution and elliptic distribution
• Feedback Schr{\"o}dinger Bridge Matching
• Stochastic Gradient Descent Jittering for Inverse Problems: Alleviating the Accuracy-Robustness Tradeoff
• Unified Convergence Analysis for Score-Based Diffusion Models with Deterministic Samplers
• Heavy-Tailed Diffusion Models
• A Mirror Descent Perspective of Smoothed Sign Descent
• Faster Diffusion Sampling with Randomized Midpoints: Sequential and Parallel
• Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations
• Improved Convergence Rate for Diffusion Probabilistic Models
• Geometric Trajectory Diffusion Models
• Theory on Score-Mismatched Diffusion Models and Zero-Shot Conditional Samplers
• Global Optimization Algorithm through High-Resolution Sampling
• Training Neural Samplers with Reverse Diffusive KL Divergence
• Expected Sliced Transport Plans
• Geometry and analytic properties of the sliced Wasserstein space
• Bayesian Experimental Design via Contrastive Diffusions
• Differentiable Programming for Computational Plasma Physics
• A Hitchhiker's Guide to Scaling Law Estimation
• Latent Schr{\"o}dinger Bridge Diffusion Model for Generative Learning
• Comparison Theorems for the Mixing Times of Systematic and Random Scan Dynamics
• Simplifying, Stabilizing and Scaling Continuous-Time Consistency Models
• Manifolds, Random Matrices and Spectral Gaps: The geometric phases of generative diffusion
• Improving Consistency Models with Generator-Induced Flows
• Improving Probabilistic Diffusion Models With Optimal Covariance Matching
• Unraveling the Smoothness Properties of Diffusion Models: A Gaussian Mixture Perspective
• Geometry, Computation, and Optimality in Stochastic Optimization
• Provable Acceleration of Nesterov's Accelerated Gradient for Rectangular Matrix Factorization and Linear Neural Networks
• Variational Diffusion Posterior Sampling with Midpoint Guidance
• Fast Convergence of $\Phi$-Divergence Along the Unadjusted Langevin Algorithm and Proximal Sampler
• High-Dimensional Differential Parameter Inference in Exponential Family using Time Score Matching
• Inverse Problems and Data Assimilation: A Machine Learning Approach
• Provable Convergence and Limitations of Geometric Tempering for Langevin Dynamics
• DFM: Interpolant-free Dual Flow Matching
• Convergence of the Adapted Smoothed Empirical Measures
• Adapted Wasserstein distance between the laws of SDEs
• Matrix denoising: Bayes-optimal estimators via low-degree polynomials
• Penalized Overdamped and Underdamped Langevin Monte Carlo Algorithms for Constrained Sampling
• Linear Convergence of Diffusion Models Under the Manifold Hypothesis
• Gradient-adjusted underdamped Langevin dynamics for sampling
• The velocity jump Langevin process and its splitting scheme: long time convergence and numerical accuracy
• Gradient-adjusted underdamped Langevin dynamics for sampling
• Efficient, Multimodal, and Derivative-Free Bayesian Inference With Fisher-Rao Gradient Flows
• Consistency Models Made Easy
• Flow matching achieves almost minimax optimal convergence
• Linear Convergence of Diffusion Models Under the Manifold Hypothesis
• Losing dimensions: Geometric memorization in generative diffusion
• Scaling Laws for Predicting Downstream Performance in LLMs
• Randomized Asymmetric Chain of LoRA: The First Meaningful Theoretical Framework for Low-Rank Adaptation
• Stochastic Optimal Control Matching
• Step-by-Step Reasoning for Math Problems via Twisted Sequential Monte Carlo
• Unlocking Guidance for Discrete State-Space Diffusion and Flow Models
• A Practical Guide to Sample-based Statistical Distances for Evaluating Generative Models in Science
• Adam Exploits $\ell_\infty$-geometry of Loss Landscape via Coordinate-wise Adaptivity
• Simple ReFlow: Improved Techniques for Fast Flow Models
• Linear combinations of Gaussian latents in generative models: interpolation and beyond
• Control, Transport and Sampling: Towards Better Loss Design
• Generalizing Stochastic Smoothing for Differentiation and Gradient Estimation
• Talagrand's mathematical journey to the Abel Prize 2024
• Improving the Training of Rectified Flows
• Gradient correlation is needed to accelerate SGD with momentum
• Towards a Theoretical Understanding of Memorization in Diffusion Models
• Posterior Sampling via Autoregressive Generation
• Through the Looking Glass: Mirror Schr\"odinger Bridges
• Backward Map for Filter Stability Analysis
• Independent projections of diffusions: Gradient flows for variational inference and optimal mean field approximations
• Diffusion Density Estimators
• A noise-corrected Langevin algorithm and sampling by half-denoising
• Ensemble Kalman Methods: A Mean Field Perspective
• On Interactions for Large Scale Interacting Systems
• On the Optimization and Generalization of Two-layer Transformers with Sign Gradient Descent
• Grokking at the Edge of Linear Separability
• To Clip or not to Clip: the Dynamics of SGD with Gradient Clipping in High-Dimensions
• Stochastic Optimal Control for Diffusion Bridges in Function Spaces
• Generative Marginalization Models
• Stochastic Runge-Kutta Methods: Provable Acceleration of Diffusion Models
• Generative Flows on Synthetic Pathway for Drug Design
• The Optimization Landscape of SGD Across the Feature Learning Strength
• A Comprehensive Framework for Analyzing the Convergence of Adam: Bridging the Gap with SGD
• SGD with memory: fundamental properties and stochastic acceleration
• On the SAGA algorithm with decreasing step
• Interpretation of generalized Langevin equations
• Bregman Proximal Method for Efficient Communications under Similarity
• How Discrete and Continuous Diffusion Meet: Comprehensive Analysis of Discrete Diffusion Models via a Stochastic Integral Framework
• Large Language Models as Markov Chains
• Randomized Runge-Kutta-Nystr\"om Methods for Unadjusted Hamiltonian and Kinetic Langevin Monte Carlo
• Randomized Runge-Kutta-Nystr\"om Methods for Unadjusted Hamiltonian and Kinetic Langevin Monte Carlo
• Diffusion Models are Evolutionary Algorithms
• Posterior sampling via Langevin dynamics based on generative priors
• NETS: A Non-Equilibrium Transport Sampler
• Diffusion & Adversarial Schr\"odinger Bridges via Iterative Proportional Markovian Fitting
• Convergence of Score-Based Discrete Diffusion Models: A Discrete-Time Analysis
• Stochastic Sampling from Deterministic Flow Models
• Score-based pullback Riemannian geometry
• Maximum Ideal Likelihood Estimator: An New Estimation and Inference Framework for Latent Variable Models
• Improving sampling by modifying the effective diffusion
• Thermodynamic Bayesian Inference
• Parametrized Families of Resolvent Compositions
• Edge-preserving noise for diffusion models
• Flow Matching for Accelerated Simulation of Atomic Transport in Materials
• Bellman Diffusion: Generative Modeling as Learning a Linear Operator in the Distribution Space
• Robust Guided Diffusion for Offline Black-Box Optimization
• Smoothed Energy Guidance: Guiding Diffusion Models with Reduced Energy Curvature of Attention
• Flow Priors for Linear Inverse Problems via Iterative Corrupted Trajectory Matching
• Beyond Single Concept Vector: Modeling Concept Subspace in LLMs with Gaussian Distribution
• A Taxonomy of Loss Functions for Stochastic Optimal Control
• Preconditioning for Accelerated Gradient Descent Optimization and Regularization
• A Survey on Diffusion Models for Inverse Problems
• Entropy contraction of the Gibbs sampler under log-concavity
• Stochastic Inverse Problem: stability, regularization and Wasserstein gradient flow
• A Unified Stability Theory for Classical and Monotone Markov Chains
• Bicausal optimal transport for SDEs with irregular coefficients
• Generative AI for fast and accurate Statistical Computation of Fluids
• Entropy, concentration, and learning: a statistical mechanics primer
• Density of states in neural networks: an in-depth exploration of learning in parameter space
• Concave tents: a new tool for constructing concave reformulations of a large class of nonconvex optimization problems
• Convergence of Diffusion Models Under the Manifold Hypothesis in High-Dimensions
• $O(d/T)$ Convergence Theory for Diffusion Probabilistic Models under Minimal Assumptions
• Loop-Diffusion: an equivariant diffusion model for designing and scoring protein loops
• Gradient-free Decoder Inversion in Latent Diffusion Models
• Bayesian Matrix Decomposition and Applications
• When Is Inductive Inference Possible?
• Optimal Protocols for Continual Learning via Statistical Physics and Control Theory
• Proximal Estimation and Inference
• Schr\"odinger bridge based deep conditional generative learning
• Uniform log-Sobolev inequalities for mean field particles beyond flat-convexity
• Two-Timescale Gradient Descent Ascent Algorithms for Nonconvex Minimax Optimization
• Forward Primal-Dual Half-Forward Algorithm for Splitting Four Operators
• Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connections
• Acceleration Methods
• Protein Conformation Generation via Force-Guided SE(3) Diffusion Models
• Optimal longevity of a dynasty
• Robust Estimation under the Wasserstein Distance
• Bayesian computation with generative diffusion models by Multilevel Monte Carlo
• A theory of generalised coordinates for stochastic differential equations
• Examples of slow convergence for adaptive regularization optimization methods are not isolated
• Stochastic interpolants with data-dependent couplings
• The discrete analogue of the Gaussian
• Convergence rate of random scan Coordinate Ascent Variational Inference under log-concavity
• A Contract Theory for Layered Control Architectures
• What does guidance do? A fine-grained analysis in a simple setting
• State space models, emergence, and ergodicity: How many parameters are needed for stable predictions?
• Provable In-Context Learning of Linear Systems and Linear Elliptic PDEs with Transformers
• JKO for Landau: a variational particle method for homogeneous Landau equation
• Inverse Problems with Diffusion Models: A MAP Estimation Perspective
• From exponential to finite/fixed-time stability: Applications to optimization
• On the Statistical Complexity of Sample Amplification
• Differential Inversion of the Implicit Euler Method: Symbolic Analysis
• An Approximation Theory Framework for Measure-Transport Sampling Algorithms
• Denoising diffusion models for high-resolution microscopy image restoration
• A Fisher-Rao gradient flow for entropic mean-field min-max games
• From exponential to finite/fixed-time stability: Applications to optimization
• Proximal Gradient Dynamics: Monotonicity, Exponential Convergence, and Applications
• A Dynamical System View of Langevin-Based Non-Convex Sampling
• BM$^2$: Coupled Schr\"{o}dinger Bridge Matching
• Accuracy of the Ensemble Kalman Filter in the Near-Linear Setting
• Neural Thermodynamic Integration: Free Energies from Energy-based Diffusion Models
• A Note on the Convergence of Denoising Diffusion Probabilistic Models
• Conditional sampling within generative diffusion models
• A Statistical Viewpoint on Differential Privacy: Hypothesis Testing, Representation and Blackwell's Theorem
• BM$^2$: Coupled Schr\"{o}dinger Bridge Matching
• Schr\"odinger Bridge Flow for Unpaired Data Translation
• Uniform-in-$N$ log-Sobolev inequality for the mean-field Langevin dynamics with convex energy
• Causal Tracking of Distributions in Wasserstein Space: A Model Predictive Control Scheme
• HJ-sampler: A Bayesian sampler for inverse problems of a stochastic process by leveraging Hamilton-Jacobi PDEs and score-based generative models
• Neural Thermodynamic Integration: Free Energies from Energy-based Diffusion Models
• Optimal Low-dimensional Approximation of Transfer Operators via Flow Matching: Computation and Error Analysis
• Measure-Theoretic Time-Delay Embedding
• Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Control
• Theoretical guarantees in KL for Diffusion Flow Matching
• Improved Finite-Particle Convergence Rates for Stein Variational Gradient Descent
• Revisiting Convergence of AdaGrad with Relaxed Assumptions
• Convergence Rate Bounds for the Mirror Descent Method: IQCs, Popov Criterion and Bregman Divergence
• Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Control
• Tensor-train methods for sequential state and parameter learning in state-space models
• On the Concentration of the Minimizers of Empirical Risks
• Gaussian Interpolation Flows
• KL Convergence Guarantees for Score diffusion models under minimal data assumptions
• Localized Schr\"odinger Bridge Sampler
• Critically Damped Third-Order Langevin Dynamics
• Understanding Foundation Models: Are We Back in 1924?
• Projected gradient descent accumulates at Bouligand stationary points
• From optimal score matching to optimal sampling
• Proof mining and probability theory
• Convergence of Sinkhorn's Algorithm for Entropic Martingale Optimal Transport Problem
• A Short Information-Theoretic Analysis of Linear Auto-Regressive Learning
• Approximately Gaussian Replicator Flows: Nonconvex Optimization as a Nash-Convergent Evolutionary Game
• What happens to diffusion model likelihood when your model is conditional?
• Denoising: A Powerful Building-Block for Imaging, Inverse Problems, and Machine Learning
• Differentiable programming across the PDE and Machine Learning barrier
• A Unified Analysis of Saddle Flow Dynamics: Stability and Algorithm Design
• Unbiased Kinetic Langevin Monte Carlo with Inexact Gradients
• Faster Sampling from Log-Concave Densities over Polytopes via Efficient Linear Solvers
• WarpAdam: A new Adam optimizer based on Meta-Learning approach
• Latent Space Energy-based Neural ODEs
• The Stochastic Proximal Distance Algorithm
• A Partition Function Estimator
• Relative-Translation Invariant Wasserstein Distance
• Guidance for twisted particle filter: a continuous-time perspective
• Generalized Continuous-Time Models for Nesterov's Accelerated Gradient Methods
• Subspace Diffusion Posterior Sampling for Travel-Time Tomography
• Probabilistic Decomposed Linear Dynamical Systems for Robust Discovery of Latent Neural Dynamics
• An Empirical Study of Scaling Laws for Transfer
• Theoretical Insights into Overparameterized Models in Multi-Task and Replay-Based Continual Learning
• Non-Monotone Variational Inequalities
• Heat Death of Generative Models in Closed-Loop Learning
• Unlocking Global Optimality in Bilevel Optimization: A Pilot Study
• Force-Guided Bridge Matching for Full-Atom Time-Coarsened Dynamics of Peptides
• Statistical and Geometrical properties of regularized Kernel Kullback-Leibler divergence
• Local convergence rates for Wasserstein gradient flows and McKean-Vlasov equations with multiple stationary solutions
• Geometric Ergodicity and Wasserstein Continuity of Non-Linear Filters
• A Score-Based Density Formula, with Applications in Diffusion Generative Models
• A Tutorial on Brownian Motion for Biostatisticians
• Probabilistic Forecasting with Stochastic Interpolants and F\"ollmer Processes
• chemtrain: Learning Deep Potential Models via Automatic Differentiation and Statistical Physics
• Reconstructing dynamical systems as zero-noise limits
• Causal structure learning with momentum: Sampling distributions over Markov Equivalence Classes of DAGs
• On latent dynamics learning in nonlinear reduced order modeling
• Force-Guided Bridge Matching for Full-Atom Time-Coarsened Dynamics of Peptides
• Unveiling the Statistical Foundations of Chain-of-Thought Prompting Methods
• Meta Flow Matching: Integrating Vector Fields on the Wasserstein Manifold
• An invitation to adaptive Markov chain Monte Carlo convergence theory
• Quantitative convergence of a discretization of dynamic optimal transport using the dual formulation
• Sub-Riemannian Geometry, Mixing, and the Holonomy of Optimal Mass Transport
• A higher-order Otto calculus approach to the Gaussian completely monotone conjecture
• Symmetry & Critical Points
• Geometric ergodicity of SGLD via reflection coupling
• Randomized Kaczmarz with geometrically smoothed momentum
• How Diffusion Models Learn to Factorize and Compose
• Symplectic Bregman divergences
• Asymptotics for Optimal Empirical Quantization of Measures
• A Geometric Perspective on Diffusion Models
• Posterior Sampling in High Dimension via Diffusion Processes
• Convergence of Unadjusted Langevin in High Dimensions: Delocalization of Bias
• Optimised Annealed Sequential Monte Carlo Samplers
• Geometrical structures of digital fluctuations in parameter space of neural networks trained with adaptive momentum optimization
• Policy-guided Monte Carlo on general state spaces: Application to glass-forming mixtures
• On Statistical Rates and Provably Efficient Criteria of Latent Diffusion Transformers (DiTs)
• Stochastic Compositional Minimax Optimization with Provable Convergence Guarantees
• Two-Timescale Gradient Descent Ascent Algorithms for Nonconvex Minimax Optimization
• Adaptive Stereographic MCMC
• Small Sample Behavior of Wasserstein Projections, Connections to Empirical Likelihood, and Other Applications
• Nonequilbrium physics of generative diffusion models
• Inflationary Flows: Calibrated Bayesian Inference with Diffusion-Based Models
• Recent Advances in Optimal Transport for Machine Learning
• Plug-in estimation of Schr\"odinger bridges
• A Markovian Model for Learning-to-Optimize
• Annealed Sinkhorn for Optimal Transport: convergence, regularization path and debiasing
• Learning Deep Dissipative Dynamics
• How to Make the Gradients Small Privately: Improved Rates for Differentially Private Non-Convex Optimization
• Learning Multimodal Latent Space with EBM Prior and MCMC Inference
• Second-Order Forward-Mode Automatic Differentiation for Optimization
• Diffusion Model for Planning: A Systematic Literature Review
• Continuous Approximations of Projected Dynamical Systems via Control Barrier Functions
• A new perspective on the learning dynamics for a class of learning problems via averaged gradient systems coupled with diffusion-transmutation processes
• Sampling Foundational Transformer: A Theoretical Perspective
• Narrowing the Focus: Learned Optimizers for Pretrained Models
• Classifier-Free Guidance is a Predictor-Corrector
• Convergence in total variation for the kinetic Langevin algorithm
• Sharp $L^q$-Convergence Rate in $p$-Wasserstein Distance for Empirical Measures of Diffusion Processes
• Tractable Optimal Experimental Design using Transport Maps
• Accurate, scalable, and efficient Bayesian optimal experimental design with derivative-informed neural operators
• Quantized Distributed Nonconvex Optimization Algorithms with Linear Convergence under the Polyak--${\L}$ojasiewicz Condition
• Faster Adaptive Decentralized Learning Algorithms
• Learning to Optimally Stop a Diffusion Process
• Refining asymptotic complexity bounds for nonconvex optimization methods, including why steepest descent is $o(\epsilon^{-2})$ rather than $\mathcal{O}(\epsilon^{-2})$
• Explicit Convergence Rate of The Proximal Point Algorithm under R-Continuity
• On the convergence of adaptive approximations for stochastic differential equations
• Optimal transport natural gradient for statistical manifolds with continuous sample space
• AdamMCMC: Combining Metropolis Adjusted Langevin with Momentum-based Optimization
• Explore-then-Commit Algorithms for Decentralized Two-Sided Matching Markets
• Predictive performance of power posteriors
• Ensemble Kalman Methods: A Mean Field Perspective
• Rate of convergence of the smoothed empirical Wasserstein distance
• Understanding the Local Geometry of Generative Model Manifolds
• Mean-field limits for Consensus-Based Optimization and Sampling
• Two Completely Parameter-Free Alternating Gradient Projection Algorithms for Nonconvex-(strongly) Concave Minimax Problems
• Variational Analysis of Proximal Compositions and Integral Proximal Mixtures
• Error bounds, PL condition, and quadratic growth for weakly convex functions, and linear convergences of proximal point methods
• Blessing of Dimensionality for Approximating Sobolev Classes on Manifolds
• Exploring the generalizability of the optimal 0.234 acceptance rate in random-walk Metropolis and parallel tempering algorithms
• Quasi-Monte Carlo Beyond Hardy-Krause
• High-order Structure-preserving Methods for Damped Hamiltonian System
• Revisiting Inexact Fixed-Point Iterations for Min-Max Problems: Stochasticity and Structured Nonconvexity
• PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Accelerator
• Convergence Properties of Score-Based Models for Linear Inverse Problems Using Graduated Optimisation
• Simplified Diffusion Schr\"odinger Bridge
• Rough stochastic differential equations
• Nonconvex Factorization and Manifold Formulations are Almost Equivalent in Low-rank Matrix Optimization
• A mathematical perspective on Transformers
• Accelerating Distributed Optimization: A Primal-Dual Perspective on Local Steps
• The distribution of Bayes' ratio
• Statistically Optimal Uncertainty Quantification for Expensive Black-Box Models
• On the Convergence of a Federated Expectation-Maximization Algorithm
• Testing Elliptical Models in High Dimensions
• Moreau-Yoshida Variational Transport: A General Framework For Solving Regularized Distributional Optimization Problems
• Kernel Density Estimators in Large Dimensions
• Integral Resolvent and Proximal Mixtures
• The Foundations of Tokenization: Statistical and Computational Concerns
• Differentiable Annealed Importance Sampling Minimizes The Symmetrized Kullback-Leibler Divergence Between Initial and Target Distribution
• Searching for (sharp) thresholds in random structures: where are we now?
• Consistent expansion of the Langevin propagator with application to entropy production
• Geometric theory of (extended) time-reversal symmetries in stochastic processes -- Part I: finite dimension
• Connective Viewpoints of Signal-to-Noise Diffusion Models
• The Road Less Scheduled
• Flexible Bayesian Last Layer Models Using Implicit Priors and Diffusion Posterior Sampling
• Regularity Properties of Optimization-Based Controllers
• A Hessian-Aware Stochastic Differential Equation for Modelling SGD
• Weak convergence analysis in the particle limit of the McKean--Vlasov equations using stochastic flows of particle systems
• Back-Projection Diffusion: Solving the Wideband Inverse Scattering Problem with Diffusion Models
• Closed-loop Diffusion Control of Complex Physical Systems
• Randomized Transport Plans via Hierarchical Fully Probabilistic Design
• Locally Stationary Distributions: A Framework for Analyzing Slow-Mixing Markov Chains
• On the Low-Temperature MCMC threshold: the cases of sparse tensor PCA, sparse regression, and a geometric rule
• Uniform log-Sobolev inequalites for mean field particles with flat-convex energy
• Optimal Control of Underdamped Systems: An Analytic Approach
• Embedding generalization within the learning dynamics: An approach based-on sample path large deviation theory
• Kullback-Leibler-based characterizations of score-driven updates
• Molecular relaxation by reverse diffusion with time step prediction
• Learnability of Parameter-Bounded Bayes Nets
• Variational Flow Models: Flowing in Your Style
• On Probabilistic Embeddings in Optimal Dimension Reduction
• A Sharp Convergence Theory for The Probability Flow ODEs of Diffusion Models
• Meta-Posterior Consistency for the Bayesian Inference of Metastable System
• Gradient flow in parameter space is equivalent to linear interpolation in output space
• Complexity of Minimizing Projected-Gradient-Dominated Functions with Stochastic First-order Oracles
• Using Linearized Optimal Transport to Predict the Evolution of Stochastic Particle Systems
• Autoencoders in Function Space
• Gradient-free optimization via integration
• Dilated convolution neural operator for multiscale partial differential equations
• On quantitative convergence for stochastic processes: Crossings, fluctuations and martingales
• The random timestep Euler method and its continuous dynamics
• Analysis of continuous data assimilation with large (or even infinite) nudging parameters
• Annealing approach to root-finding
• Potential Mean-Field Games and Gradient Flows
• Unlocking Guidance for Discrete State-Space Diffusion and Flow Models
• Conditional Independence in Stationary Diffusions
• Bounding adapted Wasserstein metrics
• Total variation distance between SDEs with stable noise and Brownian motion with applications to Poisson PDEs
• Convergence rates for the Adam optimizer
• Entropy, Thermodynamics and the Geometrization of the Language Model
• Zigzag path connects two Monte Carlo samplers: Hamiltonian counterpart to a piecewise deterministic Markov process
• Importance Corrected Neural JKO Sampling
• Persistent Sampling: Unleashing the Potential of Sequential Monte Carlo
• Inverse Problems with Diffusion Models: A MAP Estimation Perspective
• Doubly nonlinear diffusive PDEs: new existence results via generalized Wasserstein gradient flows
• Introduction to Nonsmooth Analysis and Optimization
• Accelerated forward-backward and Douglas-Rachford splitting dynamics
• Unsupervised Training of Convex Regularizers using Maximum Likelihood Estimation
• An Approximation Theory Framework for Measure-Transport Sampling Algorithms
• Differentially Private Gradient Flow based on the Sliced Wasserstein Distance
• Piecewise deterministic generative models
• Perspectives on Contractivity in Control, Optimization, and Learning
• Time-Varying Convex Optimization: A Contraction and Equilibrium Tracking Approach
• Analysis of Gradient Descent with Varying Step Sizes using Integral Quadratic Constraints
• A Lyapunov Analysis of Accelerated PDHG Algorithms
• Score matching through the roof: linear, nonlinear, and latent variables causal discovery
• Ensemble Kalman inversion approximate Bayesian computation
• Variational Inference via Smoothed Particle Hydrodynamics
• Log-Concave Coupling for Sampling Neural Net Posteriors
• Mathematical theory of deep learning
• Statistical optimal transport
• Fast convergence of the Expectation Maximization algorithm under a logarithmic Sobolev inequality
• A New Scalar Auxiliary Variable Approach for Gradient Flows
• A unified law of robustness for Bregman divergence losses
• Amortized Posterior Sampling with Diffusion Prior Distillation
• Strong solution of stochastic differential equations with discontinuous and unbounded coefficients
• The Anytime Convergence of Stochastic Gradient Descent with Momentum: From a Continuous-Time Perspective
• Efficient Convex Optimization Requires Superlinear Memory
• A particle consensus approach to solving nonconvex-nonconcave min-max problems
• Algorithm-independent bounds on complex optimization through the statistics of marginal optima
• Provable Benefit of Annealed Langevin Monte Carlo for Non-log-concave Sampling
• The Elements of Differentiable Programming
• Explicit convergence rates of underdamped Langevin dynamics under weighted and weak Poincar\'e--Lions inequalities
• Minimax Optimality of Score-based Diffusion Models: Beyond the Density Lower Bound Assumptions
• Fisher-Rao Gradient Flow: Geodesic Convexity and Functional Inequalities
• Diffusion Models as Optimizers for Efficient Planning in Offline RL
• Score matching for bridges without time-reversals
• Convergence of Empirical Optimal Transport in Unbounded Settings
• A finite-dimensional approximation for partial differential equations on Wasserstein space
• Existence of stationary measures for partially damped SDEs with generic, Euler-type nonlinearities
• A new numerical scheme for It\^o stochastic differential equations based on Wick-type Wong-Zakai arguments
• Rendering Wireless Environments Useful for Gradient Estimators: A Zero-Order Stochastic Federated Learning Method
• Data-Driven Optimal Feedback Laws via Kernel Mean Embeddings
• EM++: A parameter learning framework for stochastic switching systems
• Optimal Design of Resolvent Splitting Algorithms
• Discrete time crystals in the presence of non-Markovian dynamics
• Fast second-order dynamics with slow vanishing damping approaching the zeros of a monotone and continuous operator
• Metric extrapolation in the Wasserstein space
• Discrete Flow Matching
• Score matching for bridges without time-reversals
• Convergence of Sinkhorn's Algorithm for Entropic Martingale Optimal Transport Problem
• Stochastic Monotone Inclusion with Closed Loop Distributions
• Improved motif-scaffolding with SE(3) flow matching
• Conditional Generative Models are Provably Robust: Pointwise Guarantees for Bayesian Inverse Problems
• Learning Firmly Nonexpansive Operators
• An electrical engineering perspective on naturality in computational physics
• Constrained Approximate Optimal Transport Maps
• Sampling from mixture distributions based on regime-switching diffusions
• Importance Weighted Expectation-Maximization for Protein Sequence Design
• A Methodology Establishing Linear Convergence of Adaptive Gradient Methods under PL Inequality
• Kinetic based optimization enhanced by genetic dynamics
• Combining Wasserstein-1 and Wasserstein-2 proximals: robust manifold learning via well-posed generative flows
• A geometric integration approach to smooth optimisation: Foundations of the discrete gradient method
• Gradient Flows and Riemannian Structure in the Gromov-Wasserstein Geometry
• An exactly solvable model for emergence and scaling laws
• Generative Modeling by Minimizing the Wasserstein-2 Loss
• Construction of the Kolmogorov-Arnold representation using the Newton-Kaczmarz method
• The Anytime Convergence of Stochastic Gradient Descent with Momentum: From a Continuous-Time Perspective
• Metric extrapolation in the Wasserstein space
• Structure preserving schemes for a class of Wasserstein gradient flows
• Diffusion Tempering Improves Parameter Estimation with Probabilistic Integrators for Ordinary Differential Equations
• Inflationary Flows: Calibrated Bayesian Inference with Diffusion-Based Models
• Convergence in total variation for the kinetic Langevin algorithm
• What's the score? Automated Denoising Score Matching for Nonlinear Diffusions
• New algorithms for sampling and diffusion models
• How to beat a Bayesian adversary
• Diffusion Tempering Improves Parameter Estimation with Probabilistic Integrators for Ordinary Differential Equations
• Abide by the Law and Follow the Flow: Conservation Laws for Gradient Flows
• Sliced Wasserstein Geodesics and Equivalence Wasserstein and Sliced Wasserstein metrics
• Analysis of Langevin Monte Carlo from Poincar\'e to Log-Sobolev
• Dynamical Measure Transport and Neural PDE Solvers for Sampling
• Accelerated Fully First-Order Methods for Bilevel and Minimax Optimization
• Gaussian Interpolation Flows
• Convergence of the Chambolle-Pock Algorithm in the Absence of Monotonicity
• Learning Diffusion Priors from Observations by Expectation Maximization
• UDPM: Upsampling Diffusion Probabilistic Models
• LPGD: A General Framework for Backpropagation through Embedded Optimization Layers
• Scaling Exponents Across Parameterizations and Optimizers
• Finite Time Explosion of Stochastic Differential Equations: A survey into Khasminskii's Lyapunov Method and its Consistency with the Osgood Criterion
• Einstein from Noise: Statistical Analysis
• pythOS: A Python library for solving IVPs by operator splitting
• Low-rank approximated Kalman filter using Oja's principal component flow for discrete-time linear systems
• A general framework for inexact splitting algorithms with relative errors and applications to Chambolle-Pock and Davis-Yin methods
• Alice's Adventures in a Differentiable Wonderland -- Volume I, A Tour of the Land
• Adaptive proximal gradient methods are universal without approximation
• Proximity Operators of Perspective Functions with Nonlinear Scaling
• Langevin Dynamics: A Unified Perspective on Optimization via Lyapunov Potentials
• Convergence of flow-based generative models via proximal gradient descent in Wasserstein space
• Weak Convergence Of Tamed Exponential Integrators for Stochastic Differential Equations
• Lower bounds on the rate of convergence for accept-reject-based Markov chains in Wasserstein and total variation distances
• Learning to Control Unknown Strongly Monotone Games
• Stochastic Optimal Control Matching
• Adam-mini: Use Fewer Learning Rates To Gain More
• An exit contract optimization problem
• Toward Global Convergence of Gradient EM for Over-Parameterized Gaussian Mixture Models
• Sharper Exponential Convergence Rates for Sinkhorn's Algorithm in Continuous Settings
• Unified Control Framework for Optimization: A Fresh Perspective on Constrained Optimization, Optimization-based Control, and Parameter Estimation
• Particle Semi-Implicit Variational Inference
• Improving Diffusion Inverse Problem Solving with Decoupled Noise Annealing
• Posterior Sampling with Denoising Oracles via Tilted Transport
• Quantitative relative entropy estimates for interacting particle systems with common noise
• Sampling from the Continuous Random Energy Model in Total Variation Distance
• Markov-bridge representation of ergodic large-deviation principles
• Importance Weighted Expectation-Maximization for Protein Sequence Design
• Discretized Gradient Flow for Manifold Learning in the Space of Embeddings
• Revisiting Kinetic Monte Carlo Algorithms for Time-dependent Processes: from open-loop control to feedback control
• To smooth a cloud or to pin it down: Guarantees and Insights on Score Matching in Denoising Diffusion Models
• JAXbind: Bind any function to JAX
• The Price of Adaptivity in Stochastic Convex Optimization
• Fast Sampling via Discrete Non-Markov Diffusion Models
• Characterization of optimization problems that are solvable iteratively with linear convergence
• Efficient, Multimodal, and Derivative-Free Bayesian Inference With Fisher-Rao Gradient Flows
• Analysis of learning a flow-based generative model from limited sample complexity
• Can independent Metropolis beat crude Monte Carlo?
• Low-rank approximated Kalman-Bucy filters using Oja's principal component flow for linear time-invariant systems
• Exact worst-case convergence rates of gradient descent: a complete analysis for all constant stepsizes over nonconvex and convex functions
• Logarithmic and power-law entropies from convexity
• A New Perspective on Shampoo's Preconditioner
• Step-by-Step Diffusion: An Elementary Tutorial
• Sampling Strategies in Bayesian Inversion: A Study of RTO and Langevin Methods
• Automating Variational Differentiation
• Scaling and renormalization in high-dimensional regression
• A Dynamical Model of Neural Scaling Laws
• Why Transformers Need Adam: A Hessian Perspective
• Positive concave deep equilibrium models
• Score-based Diffusion Models via Stochastic Differential Equations -- a Technical Tutorial
• Generative Fractional Diffusion Models
• How to train your VAE
• Concentration Inequalities for $(f,\Gamma)$-GANs
• Trace is the New AutoDiff -- Unlocking Efficient Optimization of Computational Workflows
• Probabilistic Programming with Programmable Variational Inference
• Large Sample Theory for Bures-Wasserstein Barycentres
• Provable Adaptivity of Adam under Non-uniform Smoothness
• Jacobian Descent for Multi-Objective Optimization
• A four-operator splitting algorithm for nonconvex and nonsmooth optimization
• Long-time asymptotics of noisy SVGD outside the population limit
• Strong equivalence between metrics of Wasserstein type
• Forward-Backward algorithms for weakly convex problems
• Fast sampling from constrained spaces using the Metropolis-adjusted Mirror Langevin algorithm
• A Sherman--Morrison--Woodbury approach to solving least squares problems with low-rank updates
• Integral Probability Metrics on submanifolds: interpolation inequalities and optimal inference
• Computing the invariant distribution of McKean-Vlasov SDEs by ergodic simulation
• Open Problem: Anytime Convergence Rate of Gradient Descent
• The statistical thermodynamics of generative diffusion models: Phase transitions, symmetry breaking and critical instability
• Variational Schr\"odinger Diffusion Models
• A Practical Diffusion Path for Sampling
• Exponential time differencing for matrix-valued dynamical systems
• Hitchhiker's guide on Energy-Based Models: a comprehensive review on the relation with other generative models, sampling and statistical physics
• Quantitative contraction rates for Sinkhorn algorithm: beyond bounded costs and compact marginals
• Gradient Estimation via Differentiable Metropolis-Hastings
• A variational perspective on the dissipative Hamiltonian structure of the Vlasov-Fokker-Planck equation
• Sharp detection of low-dimensional structure in probability measures via dimensional logarithmic Sobolev inequalities
• Using Autodiff to Estimate Posterior Moments, Marginals and Samples
• To smooth a cloud or to pin it down: Guarantees and Insights on Score Matching in Denoising Diffusion Models
• Efficient algorithms for implementing incremental proximal-point methods
• Mitigating Information Asymmetry in Two-Stage Contracts with Non-Myopic Agents
• On the Convergence of T\^atonnement for Linear Fisher Markets
• Evaluating the design space of diffusion-based generative models
• Sampling metastable systems using collective variables and Jarzynski-Crooks paths
• Weakly Convex Regularisers for Inverse Problems: Convergence of Critical Points and Primal-Dual Optimisation
• A Tutorial on the Non-Asymptotic Theory of System Identification
• Dynamical Low-Rank Approximation for Stochastic Differential Equations
• Auto-Encoding Bayesian Inverse Games
• Stochastic Neural Network Symmetrisation in Markov Categories
• The Implicit Bias of Adam on Separable Data
• Diffusion Model With Optimal Covariance Matching
• Sampling and estimation on manifolds using the Langevin diffusion
• Iterated Schr\"odinger bridge approximation to Wasserstein Gradient Flows
• Bayesian Conditioned Diffusion Models for Inverse Problems
• Sailing in high-dimensional spaces: Low-dimensional embeddings through angle preservation
• Differentiable Programming for Differential Equations: A Review
• An excursion onto Schr\"odinger's bridges: Stochastic flows with spatio-temporal marginals
• New algorithms for sampling and diffusion models
• Flora: Low-Rank Adapters Are Secretly Gradient Compressors
• Rethinking Score Distillation as a Bridge Between Image Distributions
• What is the long-run distribution of stochastic gradient descent? A large deviations analysis
• Operator-informed score matching for Markov diffusion models
• Probabilistic ODE Solvers for Integration Error-Aware Numerical Optimal Control
• Mirror and Preconditioned Gradient Descent in Wasserstein Space
• From Biased to Unbiased Dynamics: An Infinitesimal Generator Approach
• The Monge-Kantorovich problem on Wasserstein space
• Diffusion models for Gaussian distributions: Exact solutions and Wasserstein errors
• Provably Robust Score-Based Diffusion Posterior Sampling for Plug-and-Play Image Reconstruction
• Optimal score estimation via empirical Bayes smoothing
• Scaling Laws in Linear Regression: Compute, Parameters, and Data
• Copy-composition for probabilistic graphical models
• Can Transformers Learn Optimal Filtering for Unknown Systems?
• Approximation properties relative to continuous scale space for hybrid discretizations of Gaussian derivative operators
• The statistical thermodynamics of generative diffusion models: Phase transitions, symmetry breaking and critical instability
• Convergence rate of random scan Coordinate Ascent Variational Inference under log-concavity
• Mean-field Chaos Diffusion Models
• On Differential and Riemannian Calculus on Wasserstein Spaces
• Economic DAO Governance: A Contestable Control Approach
• Fast Two-Time-Scale Stochastic Gradient Method with Applications in Reinforcement Learning
• Improved Performance of Stochastic Gradients with Gaussian Smoothing
• Universality of AdaGrad Stepsizes for Stochastic Optimization: Inexact Oracle, Acceleration and Variance Reduction
• Improving Antibody Design with Force-Guided Sampling in Diffusion Models
• Numerically robust square root implementations of statistical linear regression filters and smoothers
• Combinatorial Complex Score-based Diffusion Modelling through Stochastic Differential Equations
• Crafting Heavy-Tails in Weight Matrix Spectrum without Gradient Noise
• Gradient Clipping Improves AdaGrad when the Noise Is Heavy-Tailed
• Diffusion models for Gaussian distributions: Exact solutions and Wasserstein errors
• Generalised Diffusion Probabilistic Scale-Spaces
• Statistically Optimal Generative Modeling with Maximum Deviation from the Empirical Distribution
• Discrete error dynamics of mini-batch gradient descent for least squares regression
• On Limitation of Transformer for Learning HMMs
• Slicing Mutual Information Generalization Bounds for Neural Networks
• Solving Inverse Problems in Protein Space Using Diffusion-Based Priors
• Entropy annealing for policy mirror descent in continuous time and space
• Symplectic Methods in Deep Learning
• Policy Optimization in Control: Geometry and Algorithmic Implications
• Simulating infinite-dimensional nonlinear diffusion bridges
• Benign Nonconvex Landscapes in Optimal and Robust Control, Part II: Extended Convex Lifting
• Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Design
• Identifying latent state transition in non-linear dynamical systems
• Learning Low-dimensional Latent Dynamics from High-dimensional Observations: Non-asymptotics and Lower Bounds
• Sampling in Unit Time with Kernel Fisher-Rao Flow
• Grokfast: Accelerated Grokking by Amplifying Slow Gradients
• The Illusion of State in State-Space Models
• Event-horizon-scale Imaging of M87* under Different Assumptions via Deep Generative Image Priors
• Conditional Wasserstein Distances with Applications in Bayesian OT Flow Matching
• Remove that Square Root: A New Efficient Scale-Invariant Version of AdaGrad
• Randomized Kaczmarz with geometrically smoothed momentum
• Nonsmooth Implicit Differentiation: Deterministic and Stochastic Convergence Rates
• Can We Remove the Square-Root in Adaptive Gradient Methods? A Second-Order Perspective
• Sifting through the Noise: A Survey of Diffusion Probabilistic Models and Their Applications to Biomolecules
• Generative Conditional Distributions by Neural (Entropic) Optimal Transport
• An excursion onto Schr\"odinger's bridges: Stochastic flows with spatio-temporal marginals
• Consistency Model is an Effective Posterior Sample Approximation for Diffusion Inverse Solvers
• Variational Schr\"odinger Diffusion Models
• Unifying Bayesian Flow Networks and Diffusion Models through Stochastic Differential Equations
• Interpreting and Improving Diffusion Models from an Optimization Perspective
• Learning to Solve Multiresolution Matrix Factorization by Manifold Optimization and Evolutionary Metaheuristics
• Scalable Wasserstein Gradient Flow for Generative Modeling through Unbalanced Optimal Transport
• Non-geodesically-convex optimization in the Wasserstein space
• Schr\"{o}dinger Bridge with Quadratic State Cost is Exactly Solvable
• Loss Symmetry and Noise Equilibrium of Stochastic Gradient Descent
• Interpreting and Improving Diffusion Models from an Optimization Perspective
• Gradient descent in matrix factorization: Understanding large initialization
• Weak convergence of adaptive Markov chain Monte Carlo
• Dirichlet Flow Matching with Applications to DNA Sequence Design
• Variance reduction techniques for stochastic proximal point algorithms
• Stochastic Online Fisher Markets: Static Pricing Limits and Adaptive Enhancements
• Non-asymptotic Convergence of Discrete-time Diffusion Models: New Approach and Improved Rate
• Flow matching achieves minimax optimal convergence
• An excursion onto Schr\"odinger's bridges: Stochastic flows with spatio-temporal marginals
• Representing Molecules as Random Walks Over Interpretable Grammars
• Convergence Bounds for Sequential Monte Carlo on Multimodal Distributions using Soft Decomposition
• Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play Priors
• Sampling metastable systems using collective variables and Jarzynski-Crooks paths
• Cascade of phase transitions in the training of Energy-based models
• Fast Samplers for Inverse Problems in Iterative Refinement Models
• Transition Path Sampling with Boltzmann Generator-based MCMC Moves
• Stochastic Localization via Iterative Posterior Sampling
• Learning Latent Space Hierarchical EBM Diffusion Models
• Role of Momentum in Smoothing Objective Function and Generalizability of Deep Neural Networks
• Diffusion Rejection Sampling
• Critical windows: non-asymptotic theory for feature emergence in diffusion models
• DMPlug: A Plug-in Method for Solving Inverse Problems with Diffusion Models
• Dissecting the Interplay of Attention Paths in a Statistical Mechanics Theory of Transformers
• A unified law of robustness for Bregman divergence losses
• Unraveling the Smoothness Properties of Diffusion Models: A Gaussian Mixture Perspective
• Simplified Diffusion Schr\"odinger Bridge
• Interaction-Force Transport Gradient Flows
• A Fisher-Rao gradient flow for entropic mean-field min-max games
• Gaussian Measures Conditioned on Nonlinear Observations: Consistency, MAP Estimators, and Simulation
• Single-seed generation of Brownian paths and integrals for adaptive and high order SDE solvers
• Wasserstein Gradient Flow over Variational Parameter Space for Variational Inference
• Diffusive Gibbs Sampling
• Why is parameter averaging beneficial in SGD? An objective smoothing perspective
• Gradients of Functions of Large Matrices
• Categorical Flow Matching on Statistical Manifolds
• Diffusion Bridge Implicit Models
• A Separation in Heavy-Tailed Sampling: Gaussian vs. Stable Oracles for Proximal Samplers
• Faster Sampling via Stochastic Gradient Proximal Sampler
• A First Course in Monte Carlo Methods
• A Differential Equation Approach for Wasserstein GANs and Beyond
• Neural Fluidic System Design and Control with Differentiable Simulation
• Causal de Finetti: On the Identification of Invariant Causal Structure in Exchangeable Data
• Score-based generative models are provably robust: an uncertainty quantification perspective
• Understanding the differences in Foundation Models: Attention, State Space Models, and Recurrent Neural Networks
• Learning to Discretize Denoising Diffusion ODEs
• Log-Concave Sampling on Compact Supports: A Versatile Proximal Framework
• Metrizing Fairness
• Learning Latent Space Hierarchical EBM Diffusion Models
• Learning Diffusion Priors from Observations by Expectation Maximization
• Generalized Laplace Approximation
• Differentiable Annealed Importance Sampling Minimizes The Jensen-Shannon Divergence Between Initial and Target Distribution
• Generalised Bayes Linear Inference
• Parameterized Wasserstein Gradient Flow
• Adaptive tempering schedules with approximative intermediate measures for filtering problems
• Differentiable Annealed Importance Sampling Minimizes The Jensen-Shannon Divergence Between Initial and Target Distribution
• Markovian Flow Matching: Accelerating MCMC with Continuous Normalizing Flows
• Control, Transport and Sampling: Towards Better Loss Design
• Adapting to Unknown Low-Dimensional Structures in Score-Based Diffusion Models
• Fisher Flow Matching for Generative Modeling over Discrete Data
• Adversarial Schr\"odinger Bridge Matching
• ComboStoc: Combinatorial Stochasticity for Diffusion Generative Models
• Learning Diffusion Priors from Observations by Expectation Maximization
• Higher-order propagation of chaos in $L^2$ for interacting diffusions
• Diffusion models for Gaussian distributions: Exact solutions and Wasserstein errors
• Gaussian Measures Conditioned on Nonlinear Observations: Consistency, MAP Estimators, and Simulation
• Can Large Language Models Understand Molecules?
• Wasserstein Wormhole: Scalable Optimal Transport Distance with Transformers
• Learning the Infinitesimal Generator of Stochastic Diffusion Processes
• Keep the Momentum: Conservation Laws beyond Euclidean Gradient Flows
• FAdam: Adam is a natural gradient optimizer using diagonal empirical Fisher information
• A description based on optimal transport for a class of stochastic McKean-Vlasov control problems
• Stochastic optimal transport and Hamilton-Jacobi-Bellman equations on the set of probability measures
• TimeGPT-1
• One-step data-driven generative model via Schr\"odinger Bridge
• Entropy Production by Underdamped Langevin Dynamics
• On the Trajectory Regularity of ODE-based Diffusion Sampling
• Majorization-minimization Bregman proximal gradient algorithms for nonnegative matrix factorization with the Kullback--Leibler divergence
• Can a Transformer Represent a Kalman Filter?
• Improving Diffusion Models for Inverse Problems using Manifold Constraints
• Diffusion Posterior Sampling for General Noisy Inverse Problems
• Nonequilbrium physics of generative diffusion models
• Memory corrections to Markovian Langevin dynamics
• Discrete approximations of Gaussian smoothing and Gaussian derivatives
• Transport based particle methods for the Fokker-Planck-Landau equation
• Convergence of flow-based generative models via proximal gradient descent in Wasserstein space
• Convergence of kinetic Langevin samplers for non-convex potentials
• An Exact Theory of Causal Emergence for Linear Stochastic Iteration Systems
• Computation-Aware Kalman Filtering and Smoothing
• Compositional imprecise probability
• Gradient Estimation and Variance Reduction in Stochastic and Deterministic Models
• On the convergence of adaptive approximations for stochastic differential equations
• An interacting particle consensus method for constrained global optimization
• Proximal Langevin Sampling With Inexact Proximal Mapping
• Stochastic Langevin Differential Inclusions with Applications to Machine Learning
• Bayesian sampling using interacting particles
• Diffusion models as probabilistic neural operators for recovering unobserved states of dynamical systems
• Local convergence rates for Wasserstein gradient flows and McKean-Vlasov equations with multiple stationary solutions
• Second order quantitative bounds for unadjusted generalized Hamiltonian Monte Carlo
• Statistical Error of Numerical Integrators for Underdamped Langevin Dynamics with Deterministic And Stochastic Gradients
• Liouville Flow Importance Sampler
• Learning Low-dimensional Latent Dynamics from High-dimensional Observations: Non-asymptotics and Lower Bounds
• Long-Time Asymptotics of the Sliced-Wasserstein Flow
• Asymptotic Normality of $U$-Statistics is Equivalent to Convergence in the Wasserstein Distance
• Optimal schedules for annealing algorithms
• Regularized Stein Variational Gradient Flow
• On foundation of generative statistics with F-entropy: a gradient-based approach
• GD doesn't make the cut: Three ways that non-differentiability affects neural network training
• Accelerating Inference in Molecular Diffusion Models with Latent Representations of Protein Structure
• Diffusion Models as Stochastic Quantization in Lattice Field Theory
• Regularized Stein Variational Gradient Flow
• Learning Structural Causal Models through Deep Generative Models: Methods, Guarantees, and Challenges
• The Riemannian geometry of Sinkhorn divergences
• Wasserstein Proximal Coordinate Gradient Algorithms
• Navigating Chemical Space with Latent Flows
• Diffusion-HMC: Parameter Inference with Diffusion Model driven Hamiltonian Monte Carlo
• Variational Schr\"odinger Diffusion Models
• Projective splitting with backward, half-forward and proximal-Newton steps
• Revisiting Kinetic Monte Carlo Algorithms for Time-dependent Processes: from open-loop control to feedback control
• Splitting Methods for differential equations
• Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation
• Exploring the Frontiers of Softmax: Provable Optimization, Applications in Diffusion Model, and Beyond
• Score-based Generative Priors Guided Model-driven Network for MRI Reconstruction
• Towards a theory of model distillation
• Verlet Flows: Exact-Likelihood Integrators for Flow-Based Generative Models
• Bridging discrete and continuous state spaces: Exploring the Ehrenfest process in time-continuous diffusion models
• Convergence of the Preconditioned Proximal Point Method and Douglas-Rachford Splitting in the Absence of Monotonicity
• A Symplectic Analysis of Alternating Mirror Descent
• Finite Sample Analysis and Bounds of Generalization Error of Gradient Descent in In-Context Linear Regression
• An interacting particle consensus method for constrained global optimization
• F$^3$low: Frame-to-Frame Coarse-grained Molecular Dynamics with SE(3) Guided Flow Matching
• Blue noise for diffusion models
• Diffusive Gibbs Sampling
• Strong convergence of the exponential Euler scheme for SDEs with superlinear growth coefficients and one-sided Lipschitz drift
• Backward Map for Filter Stability Analysis
• The Inverse of Exact Renormalization Group Flows as Statistical Inference
• U-Nets as Belief Propagation: Efficient Classification, Denoising, and Diffusion in Generative Hierarchical Models
• Gaussianity and the Kalman Filter: A Simple Yet Complicated Relationship
• Optimizing the diffusion coefficient of overdamped Langevin dynamics
• Data-driven approximation of Koopman operators and generators: Convergence rates and error bounds
• Stochastic Distinguishability of Markovian Trajectories
• Blurring Diffusion Models
• A variational approach to sampling in diffusion processes
• Do Diffusion Models Learn Semantically Meaningful and Efficient Representations?
• A Unified Theory of Exact Inference and Learning in Exponential Family Latent Variable Models
• More Compute Is What You Need
• Towards a Systems Theory of Algorithms
• On the stability of the invariant probability measures of McKean-Vlasov equations
• Fisher Information Improved Training-Free Conditional Diffusion Model
• MinBackProp -- Backpropagating through Minimal Solvers
• Explaining Neural Scaling Laws
• Learning general Gaussian mixtures with efficient score matching
• Convergence Analysis of Flow Matching in Latent Space with Transformers
• Learning Mixtures of Gaussians Using Diffusion Models
• BiLO: Bilevel Local Operator Learning for PDE inverse problems
• Swarm-based gradient descent meets simulated annealing
• Bayesian sampling using interacting particles
• Aligned Diffusion Schr\"odinger Bridges
• Probabilistic Inference in Language Models via Twisted Sequential Monte Carlo
• An exactly solvable model for emergence and scaling laws
• Beyond Linear Response: Equivalence between Thermodynamic Geometry and Optimal Transport
• Differentiating Through Linear Solvers
• Conditional Variational Diffusion Models
• Probabilistic Inference in Language Models via Twisted Sequential Monte Carlo
• Align Your Steps: Optimizing Sampling Schedules in Diffusion Models
• Heat flow, log-concavity, and Lipschitz transport maps
• Gradient Guidance for Diffusion Models: An Optimization Perspective
• Calculus rules for proximal {\epsilon}-subdifferentials and inexact proximity operators for weakly convex functions
• Generalized Score Matching
• Convergence Analyses of Davis-Yin Splitting via Scaled Relative Graphs
• Accelerating the Generation of Molecular Conformations with Progressive Distillation of Equivariant Latent Diffusion Models
• A General Continuous-Time Formulation of Stochastic ADMM and Its Variants
• Plug-and-Play Algorithm Convergence Analysis From The Standpoint of Stochastic Differential Equation
• Lion Secretly Solves Constrained Optimization: As Lyapunov Predicts
• Noise Stability Optimization for Flat Minima with Tight Rates
• Neural Flow Diffusion Models: Learnable Forward Process for Improved Diffusion Modelling
• Optimizing the diffusion of overdamped Langevin dynamics
• Generalized Schr\"odinger Bridge Matching
• Stochastic Optimal Control Matching
• Reflection coupling for unadjusted generalized Hamiltonian Monte Carlo in the nonconvex stochastic gradient case
• Extending Mean-Field Variational Inference via Entropic Regularization: Theory and Computation
• A Minkowski space embedding to understand Markov models dynamics
• Solving Inverse Obstacle Scattering Problem with Latent Surface Representations
• EMC$^2$: Efficient MCMC Negative Sampling for Contrastive Learning with Global Convergence
• Consistent Diffusion Meets Tweedie: Training Exact Ambient Diffusion Models with Noisy Data
• Image Restoration by Denoising Diffusion Models with Iteratively Preconditioned Guidance
• Unbiased Image Synthesis via Manifold Guidance in Diffusion Models
• 3D Gaussian Splatting as Markov Chain Monte Carlo
• Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectives
• Penalized Overdamped and Underdamped Langevin Monte Carlo Algorithms for Constrained Sampling
• Extending Mean-Field Variational Inference via Entropic Regularization: Theory and Computation
• Convergence Analysis of Probability Flow ODE for Score-based Generative Models
• Energetic Variational Neural Network Discretizations of Gradient Flows
• The Curse of Recursion: Training on Generated Data Makes Models Forget
• The Illusion of State in State-Space Models
• State-Space Systems as Dynamic Generative Models
• Convergence of coordinate ascent variational inference for log-concave measures via optimal transport
• Generalization in diffusion models arises from geometry-adaptive harmonic representations
• Beyond Bayesian Model Averaging over Paths in Probabilistic Programs with Stochastic Support
• Optimal Universal Quantum Encoding for Statistical Inference
• Score Matching for Truncated Density Estimation on a Manifold
• Accelerated Objective Gap and Gradient Norm Convergence for Gradient Descent via Long Steps
• Finite State Mean Field Games with Common Shocks
• Spurious Stationarity and Hardness Results for Mirror Descent
• SE(3)-Stochastic Flow Matching for Protein Backbone Generation
• Diffusion posterior sampling for simulation-based inference in tall data settings
• Towards Faster Training of Diffusion Models: An Inspiration of A Consistency Phenomenon
• An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization
• Deep Generative Sampling in the Dual Divergence Space: A Data-efficient & Interpretative Approach for Generative AI
• Efficient Denoising using Score Embedding in Score-based Diffusion Models
• From latent dynamics to meaningful representations
• FiP: a Fixed-Point Approach for Causal Generative Modeling
• Variational Stochastic Gradient Descent for Deep Neural Networks
• Optimal Transport Divergences induced by Scoring Functions
• Global $\mathcal{L}^2$ minimization at uniform exponential rate via geometrically adapted gradient descent in Deep Learning
• Optimization methods for solving matrix equations
• Linear convergence of forward-backward accelerated algorithms without knowledge of the modulus of strong convexity
• An Edit Friendly DDPM Noise Space: Inversion and Manipulations
• High Noise Scheduling is a Must
• Sharp Propagation of Chaos for the Ensemble Langevin Sampler
• Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEs
• Statistical Inference of Optimal Allocations I: Regularities and their Implications
• Implicit Bias of AdamW: $\ell_\infty$ Norm Constrained Optimization
• Unsupervised Training of Convex Regularizers using Maximum Likelihood Estimation
• Convergence analysis of controlled particle systems arising in deep learning: from finite to infinite sample size
• Randomized matrix computations: Themes and variations
• The convergence of the EM scheme in empirical approximation of invariant probability measure for McKean-Vlasov SDEs
• Generative downscaling of PDE solvers with physics-guided diffusion models
• Compositional Estimation of Lipschitz Constants for Deep Neural Networks
• How Bad is Training on Synthetic Data? A Statistical Analysis of Language Model Collapse
• Heat Death of Generative Models in Closed-Loop Learning
• The Underlying Scaling Laws and Universal Statistical Structure of Complex Datasets
• Poisson Equations with locally-Lipschitz coefficients and Uniform in Time Averaging for Stochastic Differential Equations via Strong Exponential Stability
• Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation
• Gaussian-Smoothed Sliced Probability Divergences
• Convergence Guarantees for RMSProp and Adam in Generalized-smooth Non-convex Optimization with Affine Noise Variance
• A Theoretical and Empirical Study on the Convergence of Adam with an "Exact" Constant Step Size in Non-Convex Settings
• Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connections
• Convergence Analysis of Flow Matching in Latent Space with Transformers
• Proximal Oracles for Optimization and Sampling
• Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion
• Large Language Models for Mathematicians
• Model reduction on manifolds: A differential geometric framework
• Towards a turnkey approach to unbiased Monte Carlo estimation of smooth functions of expectations
• Protocols for Observational Studies: Methods and Open Problems
• Variational Flow Models: Flowing in Your Style
• Deep Equilibrium Diffusion Restoration with Parallel Sampling
• Scalable Diffusion Models with State Space Backbone
• What's in a Prior? Learned Proximal Networks for Inverse Problems
• Taming the Interactive Particle Langevin Algorithm -- the superlinear case
• Nonsmooth Implicit Differentiation: Deterministic and Stochastic Convergence Rates
• SSM Meets Video Diffusion Models: Efficient Video Generation with Structured State Spaces
• Distilling ODE Solvers of Diffusion Models into Smaller Steps
• Conditional Wasserstein Distances with Applications in Bayesian OT Flow Matching
• Diffusion Models Generate Images Like Painters: an Analytical Theory of Outline First, Details Later
• Provably Robust Score-Based Diffusion Posterior Sampling for Plug-and-Play Image Reconstruction
• State Space Models as Foundation Models: A Control Theoretic Overview
• Convergence Analysis of Stochastic Gradient Descent with MCMC Estimators
• Fast ODE-based Sampling for Diffusion Models in Around 5 Steps
• Scalable Optimal Transport Methods in Machine Learning: A Contemporary Survey
• Fast Nonlinear Two-Time-Scale Stochastic Approximation: Achieving $O(1/k)$ Finite-Sample Complexity
• Optimal First-Order Algorithms as a Function of Inequalities
• Considerations in the use of ML interaction potentials for free energy calculations
• The Elements of Differentiable Programming
• Physics-Informed Diffusion Models
• Convergence of Empirical Optimal Transport in Unbounded Settings
• Posterior concentrations of fully-connected Bayesian neural networks with general priors on the weights
• Posterior Sampling Based on Gradient Flows of the MMD with Negative Distance Kernel
• Neural Wasserstein Gradient Flows for Maximum Mean Discrepancies with Riesz Kernels
• Analysing heavy-tail properties of Stochastic Gradient Descent by means of Stochastic Recurrence Equations
• CBX: Python and Julia packages for consensus-based interacting particle methods
• Energy diminishing implicit-explicit Runge--Kutta methods for gradient flows
• Optimal Flow Matching: Learning Straight Trajectories in Just One Step
• Analyzing and Improving the Training Dynamics of Diffusion Models
• Consistency Models Improve Diffusion Inverse Solvers
• Divide-and-Conquer Posterior Sampling for Denoising Diffusion Priors
• Solving General Noisy Inverse Problem via Posterior Sampling: A Policy Gradient Viewpoint
• Unveil Conditional Diffusion Models with Classifier-free Guidance: A Sharp Statistical Theory
• Understanding Diffusion Models by Feynman's Path Integral
• Properties of Discrete Sliced Wasserstein Losses
• Formalization of Complexity Analysis of the First-order Optimization Algorithms
• Convergence of Kinetic Langevin Monte Carlo on Lie groups
• Adaptive stepsize algorithms for Langevin dynamics
• Generalization in diffusion models arises from geometry-adaptive harmonic representations
• Discrete approximations of Gaussian smoothing and Gaussian derivatives
• OverleafCopilot: Empowering Academic Writing in Overleaf with Large Language Models
• Intriguing Properties of Data Attribution on Diffusion Models
• Understanding the Double Descent Phenomenon in Deep Learning
• Long-time behavior for discretization schemes of Fokker-Planck equations via couplings
• Max-sliced 2-Wasserstein distance
• Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal Point
• Evolutionary Algorithms Simulating Molecular Evolution: A New Field Proposal
• Stable Training of Probabilistic Models Using the Leave-One-Out Maximum Log-Likelihood Objective
• Reverse em-problem based on Bregman divergence and its application to classical and quantum information theory
• The Price of Adaptivity in Stochastic Convex Optimization
• Efficient geometric Markov chain Monte Carlo for nonlinear Bayesian inversion enabled by derivative-informed neural operators
• Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion
• Ambient Diffusion Posterior Sampling: Solving Inverse Problems with Diffusion Models trained on Corrupted Data
• Multistep Consistency Models
• Sampling via Gradient Flows in the Space of Probability Measures
• From Posterior Sampling to Meaningful Diversity in Image Restoration
• Training-free Linear Image Inverses via Flows
• Fine-tuning of diffusion models via stochastic control: entropy regularization and beyond
• Implicit Image-to-Image Schrodinger Bridge for CT Super-Resolution and Denoising
• Scalable couplings for the random walk Metropolis algorithm
• Sliced-Wasserstein Distances and Flows on Cartan-Hadamard Manifolds
• Wasserstein Gradient Flows for Moreau Envelopes of f-Divergences in Reproducing Kernel Hilbert Spaces
• A Compositional Framework for First-Order Optimization
• Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks
• Simulating conditioned diffusions on manifolds
• Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models
• Scalable Wasserstein Gradient Flow for Generative Modeling through Unbalanced Optimal Transport
• Diffusion Models for Constrained Domains
• A stochastic optimisation unadjusted Langevin method for empirical Bayesian estimation in semi-blind image deblurring problems
• The Geometric Structure of Topic Models
• On the Origins of Linear Representations in Large Language Models
• Accelerating Convergence of Score-Based Diffusion Models, Provably
• Analysis of Kernel Mirror Prox for Measure Optimization
• Sharp spectral gap of adaptive Langevin dynamics
• Tuning-Free Maximum Likelihood Training of Latent Variable Models via Coin Betting
• Sharp bounds for the max-sliced Wasserstein distance
• Non-asymptotic analysis of Langevin-type Monte Carlo algorithms
• Empirical Bayes in Bayesian learning: understanding a common practice
• The Blessing of Randomness: SDE Beats ODE in General Diffusion-based Image Editing
• Score dynamics: scaling molecular dynamics with picosecond timesteps via conditional diffusion model
• Theoretical Foundations of Deep Selective State-Space Models
• Categorical Deep Learning: An Algebraic Theory of Architectures
• Diffusion Posterior Proximal Sampling for Image Restoration
• Zeroth-Order Sampling Methods for Non-Log-Concave Distributions: Alleviating Metastability by Denoising Diffusion
• Dynamical Regimes of Diffusion Models
• On the different regimes of Stochastic Gradient Descent
• Stochastic Approximation with Biased MCMC for Expectation Maximization
• Proximal Algorithms for a class of abstract convex functions
• A Dynamical View of the Question of Why
• Randomized matrix computations: Themes and variations
• Diffusion Posterior Proximal Sampling for Image Restoration
• The curse of dimensionality in operator learning
• On Independent Samples Along the Langevin Diffusion and the Unadjusted Langevin Algorithm
• Statistical Accuracy of Approximate Filtering Methods
• Generative AI for Bayesian Computation
• Score-based generative models break the curse of dimensionality in learning a family of sub-Gaussian probability distributions
• Nonlinear Bayesian optimal experimental design using logarithmic Sobolev inequalities
• Optimal schedules for annealing algorithms
• A Language Model's Guide Through Latent Space
• Moonwalk: Inverse-Forward Differentiation
• Weak Poincar\'e inequality comparisons for ideal and hybrid slice sampling
• The Emergence of Reproducibility and Consistency in Diffusion Models
• Non-asymptotic Convergence of Discrete-time Diffusion Models: New Approach and Improved Rate
• Linear Convergence of Black-Box Variational Inference: Should We Stick the Landing?
• Touring sampling with pushforward maps
• Diffusion Posterior Sampling is Computationally Intractable
• Euler-Maruyama schemes for stochastic differential equations driven by stable L\'{e}vy processes with i.i.d. stable components
• Stein Boltzmann Sampling: A Variational Approach for Global Optimization
• Contractivity of neural ODEs: an eigenvalue optimization problem
• SDEs for Minimax Optimization
• On Averaging and Extrapolation for Gradient Descent
• On the Posterior Distribution in Denoising: Application to Uncertainty Quantification
• From Denoising Diffusions to Denoising Markov Models
• Decomposed Diffusion Sampler for Accelerating Large-Scale Inverse Problems
• Adam-family Methods for Nonsmooth Optimization with Convergence Guarantees
• Convergence of Gradient Descent for Recurrent Neural Networks: A Nonasymptotic Analysis
• Acousto-electric tomography by the convergence of Kaczamrz two-point gradient-$\Theta$ method
• Transformers Implement Functional Gradient Descent to Learn Non-Linear Functions In Context
• BlackJAX: Composable Bayesian inference in JAX
• Stochastic Localization via Iterative Posterior Sampling
• Efficient Sampling on Riemannian Manifolds via Langevin MCMC
• Optimal Transport with Tempered Exponential Measures
• Symmetric Mean-field Langevin Dynamics for Distributional Minimax Problems
• The Price of Adaptivity in Stochastic Convex Optimization
• The Emergence of Reproducibility and Consistency in Diffusion Models
• R\'enyi Resolvability, Noise Stability, and Anti-contractivity
• Revisiting Stochastic Realization Theory using Functional It\^o Calculus
• Closed-form Filtering for Non-linear Systems
• MCMC-driven learning
• Correction to "Wasserstein distance estimates for the distributions of numerical approximations to ergodic stochastic differential equations"
• Diffeomorphic Measure Matching with Kernels for Generative Modeling
• Sampling from the Mean-Field Stationary Distribution
• Towards Fast Stochastic Sampling in Diffusion Generative Models
• Can We Remove the Square-Root in Adaptive Gradient Methods? A Second-Order Perspective
• Score-based generative models break the curse of dimensionality in learning a family of sub-Gaussian probability distributions
• Mirror Descent-Ascent for mean-field min-max problems
• Fast sampling from constrained spaces using the Metropolis-adjusted Mirror Langevin algorithm
• Towards a mathematical theory for consistency training in diffusion models
• Optimal score estimation via empirical Bayes smoothing
• Sampling from the Mean-Field Stationary Distribution
• Foundations of Monte Carlo methods and stochastic simulations -- From Monte Carlo Lebesgue integration to weak approximation of SDEs
• Score-Based Physics-Informed Neural Networks for High-Dimensional Fokker-Planck Equations
• Controllable seismic velocity synthesis using generative diffusion models
• The Complexity of Sequential Prediction in Dynamical Systems
• Particle Denoising Diffusion Sampler
• Wasserstein proximal operators describe score-based generative models and resolve memorization
• Adaptive proximal gradient methods are universal without approximation
• Entropy and curvature: beyond the Peres-Tetali conjecture
• Linearizability of flows by embeddings
• An Introduction to Transformers
• Scalable Diffusion Models with State Space Backbone
• Incentive-Theoretic Bayesian Inference for Collaborative Science
• JAX-Fluids 2.0: Towards HPC for Differentiable CFD of Compressible Two-phase Flows
• Scalable Wasserstein Gradient Flow for Generative Modeling through Unbalanced Optimal Transport
• Convergence of Alternating Gradient Descent for Matrix Factorization
• Cortical Surface Diffusion Generative Models
• Denoising Diffusion Probabilistic Models in Six Simple Steps
• An analysis of the noise schedule for score-based generative models
• Proximal-point-like algorithms for abstract convex minimisation problems
• To be or not to be stable, that is the question: understanding neural networks for inverse problems
• Variational Representations of Annealing Paths: Bregman Information under Monotonic Embedding
• The Information of Large Language Model Geometry
• Mean-field underdamped Langevin dynamics and its spacetime discretization
• The Anytime Convergence of Stochastic Gradient Descent with Momentum: From a Continuous-Time Perspective
• Can We Remove the Square-Root in Adaptive Gradient Methods? A Second-Order Perspective
• Diffusive Gibbs Sampling
• Spectral State Space Models
• A rigorous introduction to linear models
• Diffusive Gibbs Sampling
• Non-asymptotic Analysis of Biased Adaptive Stochastic Approximation
• Denoising Diffusion-Based Control of Nonlinear Systems
• Universal Gradient Methods for Stochastic Convex Optimization
• Unconditional Latent Diffusion Models Memorize Patient Imaging Data
• Fisher information dissipation for time inhomogeneous stochastic differential equations
• Compositional Generative Modeling: A Single Model is Not All You Need
• Statistical Accuracy of Approximate Filtering Methods
• Weakly Convex Regularisers for Inverse Problems: Convergence of Critical Points and Primal-Dual Optimisation
• Geometry-Aware Normalizing Wasserstein Flows for Optimal Causal Inference
• A Theoretical Analysis of Noise Geometry in Stochastic Gradient Descent
• Hamilton--Jacobi equations for Wasserstein controlled gradient flows: existence of viscosity solutions
• A theoretical and empirical study of new adaptive algorithms with additional momentum steps and shifted updates for stochastic non-convex optimization
• A non-asymptotic error analysis for parallel Monte Carlo estimation from many short Markov chains
• On Inference Stability for Diffusion Models
• Convergence analysis of t-SNE as a gradient flow for point cloud on a manifold
• Enhancing Score-Based Sampling Methods with Ensembles
• Arrows of Time for Large Language Models
• Categorical probability spaces, ergodic decompositions, and transitions to equilibrium
• Convergence Analysis for General Probability Flow ODEs of Diffusion Models in Wasserstein Distances
• Reversing information flow: retrodiction in semicartesian categories
• Recovering Mental Representations from Large Language Models with Markov Chain Monte Carlo
• Prompt Design and Engineering: Introduction and Advanced Methods
• On the Algorithmic Verification of Nonlinear Superposition for Systems of First Order Ordinary Differential Equations
• Time-uniform log-Sobolev inequalities and applications to propagation of chaos
• The Geometry of Monotone Operator Splitting Methods
• Sticky-reflecting diffusion as a Wasserstein gradient flow
• Solving, Tracking and Stopping Streaming Linear Inverse Problems
• Sticky-reflecting diffusion as a Wasserstein gradient flow. (arXiv:2401.16842v1 [math.AP])
• Ensemble-Based Annealed Importance Sampling. (arXiv:2401.15645v1 [stat.CO])
• Neural Network-Based Score Estimation in Diffusion Models: Optimization and Generalization. (arXiv:2401.15604v1 [cs.LG])
• Particle-MALA and Particle-mGRAD: Gradient-based MCMC methods for high-dimensional state-space models. (arXiv:2401.14868v1 [stat.CO])
• Hidden Markov Models and the Bayes Filter in Categorical Probability. (arXiv:2401.14669v1 [math.ST])
• Estimation of partially known Gaussian graphical models with score-based structural priors. (arXiv:2401.14340v2 [stat.ML] UPDATED)
• Neural Sinkhorn Gradient Flow. (arXiv:2401.14069v1 [cs.LG])
• Towards a Systems Theory of Algorithms. (arXiv:2401.14029v1 [math.OC])
• Compositional Generative Inverse Design. (arXiv:2401.13171v1 [cs.LG])
• Contractive Diffusion Probabilistic Models. (arXiv:2401.13115v1 [cs.LG])
• Tensor train based sampling algorithms for approximating regularized Wasserstein proximal operators. (arXiv:2401.13125v2 [math.OC] UPDATED)
• Bayesian sampling using interacting particles. (arXiv:2401.13100v1 [math.NA])
• Accelerating Approximate Thompson Sampling with Underdamped Langevin Monte Carlo. (arXiv:2401.11665v1 [stat.ML])
• Fast Nonlinear Two-Time-Scale Stochastic Approximation: Achieving $O(1/k)$ Finite-Sample Complexity. (arXiv:2401.12764v2 [math.OC] UPDATED)
• Score-Based Generative Models for PET Image Reconstruction. (arXiv:2308.14190v2 [eess.IV] UPDATED)
• Fast Nonlinear Two-Time-Scale Stochastic Approximation: Achieving $O(1/k)$ Finite-Sample Complexity. (arXiv:2401.12764v2 [math.OC] UPDATED)
• Wasserstein Diffusion on Multidimensional Spaces. (arXiv:2401.12721v1 [math.PR])
• The Ensemble Kalman Filter for Dynamic Inverse Problems. (arXiv:2401.11948v1 [math.NA])
• Nearly $d$-Linear Convergence Bounds for Diffusion Models via Stochastic Localization. (arXiv:2308.03686v2 [stat.ML] UPDATED)
• Fast parallel sampling under isoperimetry. (arXiv:2401.09016v1 [cs.DS])
• Introduction to probability and statistics: a computational framework of randomness. (arXiv:2401.08622v2 [math.HO] UPDATED)
• Demystifying Variational Diffusion Models. (arXiv:2401.06281v1 [cs.LG])
• Faster Sampling without Isoperimetry via Diffusion-based Monte Carlo. (arXiv:2401.06325v1 [stat.ML])
• Almost Sure Diffusion Approximation in Averaging: Direct Proofs with Rough Paths Flavors. (arXiv:2401.05038v2 [math.PR] UPDATED)
• Solving the Scattering Problem for Open Wave-Guides, III: Radiation Conditions and Uniqueness. (arXiv:2401.04674v1 [math.AP])
• Stable generative modeling using diffusion maps. (arXiv:2401.04372v1 [stat.ML])
• Image Inpainting via Tractable Steering of Diffusion Models. (arXiv:2401.03349v1 [cs.CV])
• Reflected Schr\"odinger Bridge for Constrained Generative Modeling. (arXiv:2401.03228v1 [stat.ML])
• Diffusion Variational Inference: Diffusion Models as Expressive Variational Posteriors. (arXiv:2401.02739v1 [cs.LG])
• Hamilton--Jacobi equations for Wasserstein controlled gradient flows: existence of viscosity solutions. (arXiv:2401.02240v1 [math.AP])
• Sheaves of Probability. (arXiv:2401.01968v1 [math.PR])
• Nature-Inspired Algorithms in Optimization: Introduction, Hybridization and Insights. (arXiv:2401.00976v1 [cs.NE])
• A review of Monte Carlo-based versions of the EM algorithm. (arXiv:2401.00945v1 [stat.CO])
• Stochastic Optimization under Hidden Convexity. (arXiv:2401.00108v1 [math.OC])
• Fluctuation Theorem on Riemannian Manifold. (arXiv:2401.00046v1 [cond-mat.stat-mech])
• Mixing time of the conditional backward sampling particle filter. (arXiv:2312.17572v1 [stat.CO])
• Principled Gradient-based Markov Chain Monte Carlo for Text Generation. (arXiv:2312.17710v1 [cs.CL])

Saved in 2023

• Image Restoration by Denoising Diffusion Models with Iteratively Preconditioned Guidance. (arXiv:2312.16519v1 [eess.IV])
• Micro-Macro Consistency in Multiscale Modeling: Score-Based Model Assisted Sampling of Fast/Slow Dynamical Systems. (arXiv:2312.05715v2 [cs.LG] UPDATED)
• Projected Langevin Monte Carlo algorithms in non-convex and super-linear setting. (arXiv:2312.17077v2 [math.NA] UPDATED)
• Convergence and stability results for the particle system in the Stein gradient descent method. (arXiv:2312.16344v1 [math.AP])
• Mean-field underdamped Langevin dynamics and its spacetime discretization. (arXiv:2312.16360v4 [stat.CO] UPDATED)
• Unraveling the Temporal Dynamics of the Unet in Diffusion Models. (arXiv:2312.14965v1 [cs.CV])
• Diffusion Models for Generative Artificial Intelligence: An Introduction for Applied Mathematicians. (arXiv:2312.14977v1 [cs.LG])
• On the Trajectories of SGD Without Replacement. (arXiv:2312.16143v1 [cs.LG])
• Mini-batching error and adaptive Langevin dynamics
• Perturbation Analysis of Markov Chain Monte Carlo for Graphical Models. (arXiv:2312.14246v1 [math.PR])
• Time-changed normalizing flows for accurate SDE modeling. (arXiv:2312.14698v2 [cs.LG] UPDATED)
• Single-Cell RNA-seq Synthesis with Latent Diffusion Model. (arXiv:2312.14220v1 [q-bio.GN])
• Exploiting bias in optimal finite-time copying protocols. (arXiv:2312.14682v1 [cond-mat.stat-mech])
• Sampling and estimation on manifolds using the Langevin diffusion. (arXiv:2312.14882v1 [math.ST])
• Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise. (arXiv:2312.14567v1 [cs.LG])
• A mathematical perspective on Transformers. (arXiv:2312.10794v2 [cs.LG] UPDATED)
• Metropolis-adjusted interacting particle sampling. (arXiv:2312.13889v1 [stat.CO])
• Wave Physics-informed Matrix Factorizations. (arXiv:2312.13584v2 [cs.LG] UPDATED)
• A Survey of Emerging Applications of Diffusion Probabilistic Models in MRI. (arXiv:2311.11383v2 [cs.CV] UPDATED)
• How Good Are Deep Generative Models for Solving Inverse Problems?. (arXiv:2312.12691v1 [cs.LG])
• Gradient flows for empirical Bayes in high-dimensional linear models. (arXiv:2312.12708v1 [math.ST])
• Metropolis-adjusted interacting particle sampling. (arXiv:2312.13889v1 [stat.CO])
• On the ensemble Kalman inversion under inequality constraints. (arXiv:2312.13804v1 [math.NA])
• Towards Accurate Guided Diffusion Sampling through Symplectic Adjoint Method. (arXiv:2312.12030v1 [cs.CV])
• Optimizing Diffusion Noise Can Serve As Universal Motion Priors. (arXiv:2312.11994v1 [cs.CV])
• Generalizing Adam to Manifolds for Efficiently Training Transformers. (arXiv:2305.16901v2 [cs.LG] UPDATED)
• Large Language Models Play StarCraft II: Benchmarks and A Chain of Summarization Approach. (arXiv:2312.11865v1 [cs.AI])
• Stability of the numerical scheme for stochastic McKean-Vlasov equations. (arXiv:2312.12699v1 [math.NA])
• On inverse problems in predator-prey models. (arXiv:2312.09653v1 [math.AP] CROSS LISTED)
• Fitting a manifold to data in the presence of large noise. (arXiv:2312.10598v2 [math.ST] UPDATED)
• Nonlocal Approximation of Slow and Fast Diffusion. (arXiv:2312.11438v1 [math.AP])
• Anisotropic Proximal Point Algorithm. (arXiv:2312.09834v1 [math.OC])
• Faster Diffusion: Rethinking the Role of UNet Encoder in Diffusion Models. (arXiv:2312.09608v1 [cs.CV])
• Noise in the reverse process improves the approximation capabilities of diffusion models. (arXiv:2312.07851v2 [cs.LG] UPDATED)
• A New Perspective On Denoising Based On Optimal Transport. (arXiv:2312.08135v1 [math.ST])
• A Unified Sampling Framework for Solver Searching of Diffusion Probabilistic Models. (arXiv:2312.07243v1 [cs.AI])
• Momentum Particle Maximum Likelihood. (arXiv:2312.07335v1 [cs.LG])
• Boosting Latent Diffusion with Flow Matching. (arXiv:2312.07360v1 [cs.CV])
• Mean-field limits for Consensus-Based Optimization and Sampling. (arXiv:2312.07373v1 [math.PR])
• Can a Transformer Represent a Kalman Filter?. (arXiv:2312.06937v2 [cs.LG] UPDATED)
• Towards Stability of Autoregressive Neural Operators. (arXiv:2306.10619v2 [cs.LG] UPDATED)
• The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasets. (arXiv:2310.06824v2 [cs.AI] UPDATED)
• Consistency Models for Scalable and Fast Simulation-Based Inference. (arXiv:2312.05440v1 [cs.LG])
• FreeFlow: A Comprehensive Understanding on Diffusion Probabilistic Models via Optimal Transport. (arXiv:2312.05486v1 [cs.AI])
• KEEC: Embed to Control on An Equivariant Geometry. (arXiv:2312.01544v2 [cs.LG] UPDATED)
• Information divergences of Markov chains and their applications. (arXiv:2312.04863v1 [cs.IT])
• Unnatural Algorithms in Machine Learning. (arXiv:2312.04739v1 [stat.ML])
• How to guess a gradient. (arXiv:2312.04709v1 [cs.LG])
• Train 'n Trade: Foundations of Parameter Markets. (arXiv:2312.04740v1 [cs.LG])
• Second- and third-order properties of multidimensional Langevin equations. (arXiv:2312.04585v1 [cond-mat.stat-mech])
• Schrodinger Bridges Beat Diffusion Models on Text-to-Speech Synthesis. (arXiv:2312.03491v1 [cs.SD])
• Generalized Contrastive Divergence: Joint Training of Energy-Based Model and Diffusion Model through Inverse Reinforcement Learning. (arXiv:2312.03397v1 [cs.LG])
• Improving Gradient-guided Nested Sampling for Posterior Inference. (arXiv:2312.03911v1 [cs.LG])
• Smooth Diffusion: Crafting Smooth Latent Spaces in Diffusion Models. (arXiv:2312.04410v1 [cs.CV])
• Convergence Rate Analysis of Continuous- and Discrete-Time Smoothing Gradient Algorithms. (arXiv:2312.04192v1 [math.OC])
• Iterated invariance principle for random dynamical systems. (arXiv:2312.04550v1 [math.DS])
• Geometry-Aware Normalizing Wasserstein Flows for Optimal Causal Inference. (arXiv:2311.18826v3 [cs.LG] UPDATED)
• The Bayesian Stability Zoo. (arXiv:2310.18428v2 [cs.LG] UPDATED)
• Algorithms for mean-field variational inference via polyhedral optimization in the Wasserstein space. (arXiv:2312.02849v1 [math.ST])
• Training Chain-of-Thought via Latent-Variable Inference. (arXiv:2312.02179v1 [cs.LG])
• Conditional Variational Diffusion Models. (arXiv:2312.02246v3 [cs.CV] UPDATED)
• Adam-like Algorithm with Smooth Clipping Attains Global Minima: Analysis Based on Ergodicity of Functional SDEs. (arXiv:2312.02182v1 [cs.LG])
• Lecture Notes on Computerized Tomography. (arXiv:2312.02393v1 [math.NA])
• Particle-based algorithm for stochastic optimal control. (arXiv:2311.06906v3 [math.OC] UPDATED)
• Taming Latent Diffusion Models to See in the Dark. (arXiv:2312.01027v2 [cs.CV] UPDATED)
• Beyond First-Order Tweedie: Solving Inverse Problems using Latent Diffusion. (arXiv:2312.00852v1 [cs.LG])
• Convergence Of The Unadjusted Langevin Algorithm For Discontinuous Gradients. (arXiv:2312.01950v1 [math.PR])
• Local monotone operator learning using non-monotone operators: MnM-MOL. (arXiv:2312.00386v1 [eess.IV])
• Fast ODE-based Sampling for Diffusion Models in Around 5 Steps. (arXiv:2312.00094v1 [cs.CV])
• Geodesic slice sampling on Riemannian manifolds. (arXiv:2312.00417v1 [stat.CO])
• On Exact Inversion of DPM-Solvers. (arXiv:2311.18387v1 [cs.CV])
• Diffusion Models Without Attention. (arXiv:2311.18257v1 [cs.CV])
• Bayesian Imaging for Radio Interferometry with Score-Based Priors. (arXiv:2311.18012v1 [astro-ph.IM])
• Automatic Functional Differentiation in JAX. (arXiv:2311.18727v2 [cs.PL] UPDATED)
• Learning Exactly Linearizable Deep Dynamics Models. (arXiv:2311.18261v1 [eess.SY])
• Convergence Analysis of Fractional Gradient Descent. (arXiv:2311.18426v3 [math.OC] UPDATED)
• Using Ornstein-Uhlenbeck Process to understand Denoising Diffusion Probabilistic Model and its Noise Schedules. (arXiv:2311.17673v1 [stat.ML])
• Effective Quantization for Diffusion Models on CPUs. (arXiv:2311.16133v2 [cs.CV] UPDATED)
• Sinkhorn Flow: A Continuous-Time Framework for Understanding and Generalizing the Sinkhorn Algorithm. (arXiv:2311.16706v1 [cs.LG])
• Riemannian Self-Attention Mechanism for SPD Networks. (arXiv:2311.16738v1 [cs.CV])
• Manifold Preserving Guided Diffusion. (arXiv:2311.16424v1 [cs.LG])
• General Derivative-Free Optimization Methods under Global and Local Lipschitz Continuity of Gradients. (arXiv:2311.16850v1 [math.OC])
• Closing the ODE-SDE gap in score-based diffusion models through the Fokker-Planck equation. (arXiv:2311.15996v1 [cs.LG])
• Proximal Algorithms for Accelerated Langevin Dynamics. (arXiv:2311.14829v2 [cs.CE] UPDATED)
• How does the contraction property fail for convex functions on normed spaces?. (arXiv:2311.15152v1 [math.OC] CROSS LISTED)
• Sample as You Infer: Predictive Coding With Langevin Dynamics. (arXiv:2311.13664v1 [cs.LG])
• Sample-Efficient Training for Diffusion. (arXiv:2311.13745v1 [cs.LG])
• The Noise Geometry of Stochastic Gradient Descent: A Quantitative and Analytical Characterization. (arXiv:2310.00692v2 [cs.LG] UPDATED)
• A new use of the Kurdyka-Lojasiewicz property to study asymptotic behaviours of some stochastic optimization algorithms in a non-convex differentiable framework. (arXiv:2311.14627v3 [math.OC] UPDATED)
• Concentration and local smoothness of the averaging process. (arXiv:2311.14176v1 [math.PR])
• The attractive log gas: stability, uniqueness, and propagation of chaos. (arXiv:2311.14560v1 [math.AP])
• On the convergence of adaptive approximations for stochastic differential equations. (arXiv:2311.14201v1 [math.NA])
• Differentially Private Non-Convex Optimization under the KL Condition with Optimal Rates. (arXiv:2311.13447v1 [cs.LG])
• Inverse Problems with Learned Forward Operators. (arXiv:2311.12528v1 [math.NA])
• Inverse Problems with Learned Forward Operators. (arXiv:2311.12528v1 [math.NA])
• Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervision. (arXiv:2306.11719v2 [cs.CV] UPDATED)
• The Hidden Linear Structure in Score-Based Models and its Application. (arXiv:2311.10892v1 [cs.AI])
• Wasserstein Convergence Guarantees for a General Class of Score-Based Generative Models. (arXiv:2311.11003v1 [cs.LG])
• Implicit Maximum a Posteriori Filtering via Adaptive Optimization. (arXiv:2311.10580v1 [cs.LG])
• Taming under isoperimetry. (arXiv:2311.09003v1 [math.PR])
• Mean-field variational inference with the TAP free energy: Geometric and statistical properties in linear models. (arXiv:2311.08442v1 [math.ST])
• Manifold learning in Wasserstein space. (arXiv:2311.08549v1 [stat.ML])
• Score-based generative models learn manifold-like structures with constrained mixing. (arXiv:2311.09952v1 [stat.ML])
• Unsupervised approaches based on optimal transport and convex analysis for inverse problems in imaging. (arXiv:2311.08972v2 [cs.CV] UPDATED)
• Taming under isoperimetry. (arXiv:2311.09003v1 [math.PR])
• A statistical perspective on algorithm unrolling models for inverse problems. (arXiv:2311.06395v1 [stat.ML])
• Particle-based algorithm for stochastic optimal control. (arXiv:2311.06906v3 [math.OC] UPDATED)
• Deep JKO: time-implicit particle methods for general nonlinear gradient flows. (arXiv:2311.06700v1 [math.NA])
• Unbiased Kinetic Langevin Monte Carlo with Inexact Gradients. (arXiv:2311.05025v1 [stat.CO])
• Diffusion Based Causal Representation Learning. (arXiv:2311.05421v1 [cs.LG])
• Efficient Compression of Overparameterized Deep Models through Low-Dimensional Learning Dynamics. (arXiv:2311.05061v1 [cs.LG])
• On the Consistency of Maximum Likelihood Estimation of Probabilistic Principal Component Analysis. (arXiv:2311.05046v2 [stat.ML] UPDATED)
• Improved DDIM Sampling with Moment Matching Gaussian Mixtures. (arXiv:2311.04938v2 [cs.CV] UPDATED)
• Unbiased Kinetic Langevin Monte Carlo with Inexact Gradients. (arXiv:2311.05025v1 [stat.CO])
• Geometry and analytic properties of the sliced Wasserstein space. (arXiv:2311.05134v1 [math.AP])
• Integral Resolvent and Proximal Mixtures. (arXiv:2311.04790v1 [math.OC])
• The Linear Representation Hypothesis and the Geometry of Large Language Models. (arXiv:2311.03658v1 [cs.CL])
• Score-based Source Separation with Applications to Digital Communication Signals. (arXiv:2306.14411v3 [cs.LG] UPDATED)
• Exploring the Optimal Choice for Generative Processes in Diffusion Models: Ordinary vs Stochastic Differential Equations. (arXiv:2306.02063v2 [cs.LG] UPDATED)
• Latent Diffusion for Language Generation. (arXiv:2212.09462v2 [cs.CL] UPDATED)
• Sampling via F\"ollmer Flow. (arXiv:2311.03660v1 [stat.ME])
• Improved Convergence Rates of Anderson Acceleration for a Large Class of Fixed-Point Iterations. (arXiv:2311.02490v1 [math.NA])
• Approximating Langevin Monte Carlo with ResNet-like Neural Network architectures. (arXiv:2311.03242v2 [cs.LG] UPDATED)
• Non-convergence to unstable equilibriums for continuous-time and discrete-time stochastic processes. (arXiv:2311.02978v1 [math.PR])
• For how many iterations should we run Markov chain Monte Carlo?. (arXiv:2311.02726v1 [stat.CO])
• A Novel Catalyst Scheme for Stochastic Minimax Optimization. (arXiv:2311.02814v2 [math.OC] UPDATED)
• On the Convergence of Encoder-only Shallow Transformers. (arXiv:2311.01575v1 [cs.LG])
• High Probability Convergence of Adam Under Unbounded Gradients and Affine Variance Noise. (arXiv:2311.02000v1 [math.OC])
• On the Generalization Properties of Diffusion Models. (arXiv:2311.01797v3 [cs.LG] UPDATED)
• A Variational Perspective on High-Resolution ODEs. (arXiv:2311.02002v1 [math.OC])
• Operator learning with PCA-Net: upper and lower complexity bounds
• A Continuous-time Stochastic Gradient Descent Method for Continuous Data
• The Blessing of Randomness: SDE Beats ODE in General Diffusion-based Image Editing. (arXiv:2311.01410v1 [cs.CV])
• Multi-Operational Mathematical Derivations in Latent Space. (arXiv:2311.01230v1 [cs.LG])
• On Feynman--Kac training of partial Bayesian neural networks. (arXiv:2310.19608v1 [cs.LG])
• Reflection coupling for unadjusted generalized Hamiltonian Monte Carlo in the nonconvex stochastic gradient case. (arXiv:2310.18774v1 [math.PR])
• Score Normalization for a Faster Diffusion Exponential Integrator Sampler. (arXiv:2311.00157v2 [cs.LG] UPDATED)
• Bridging the Gap Between Variational Inference and Wasserstein Gradient Flows. (arXiv:2310.20090v1 [stat.ML])
• Approximate Heavy Tails in Offline (Multi-Pass) Stochastic Gradient Descent. (arXiv:2310.18455v1 [cs.LG])
• Conditional score-based diffusion models for Bayesian inference in infinite dimensions. (arXiv:2305.19147v2 [stat.ML] UPDATED)
• Trans-Dimensional Generative Modeling via Jump Diffusion Models. (arXiv:2305.16261v2 [stat.ML] UPDATED)
• Training Energy-Based Normalizing Flow with Score-Matching Objectives. (arXiv:2305.15267v2 [cs.LG] UPDATED)
• Reflection coupling for unadjusted generalized Hamiltonian Monte Carlo in the nonconvex stochastic gradient case. (arXiv:2310.18774v1 [math.PR])
• Diffusion processes as Wasserstein gradient flows via stochastic control of the volatility matrix. (arXiv:2310.18678v1 [math.PR])
• Sample Complexity Bounds for Score-Matching: Causal Discovery and Generative Modeling. (arXiv:2310.18123v1 [cs.LG])
• Understanding the Latent Space of Diffusion Models through the Lens of Riemannian Geometry. (arXiv:2307.12868v2 [cs.CV] UPDATED)
• Closing the Gap Between the Upper Bound and the Lower Bound of Adam's Iteration Complexity. (arXiv:2310.17998v1 [cs.LG])
• Generative Fractional Diffusion Models. (arXiv:2310.17638v1 [cs.LG])
• Monte Carlo guided Diffusion for Bayesian linear inverse problems. (arXiv:2308.07983v2 [stat.ML] UPDATED)
• Unifying GANs and Score-Based Diffusion as Generative Particle Models. (arXiv:2305.16150v3 [cs.LG] UPDATED)
• The statistical thermodynamics of generative diffusion models. (arXiv:2310.17467v1 [stat.ML])
• Causal Modeling with Stationary Diffusions. (arXiv:2310.17405v1 [cs.LG])
• Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Models. (arXiv:2310.17086v1 [cs.LG])
• Benign Oscillation of Stochastic Gradient Descent with Large Learning Rates. (arXiv:2310.17074v1 [cs.LG])
• Probabilistic Integral Circuits. (arXiv:2310.16986v1 [cs.LG])
• Convergence of flow-based generative models via proximal gradient descent in Wasserstein space. (arXiv:2310.17582v1 [stat.ML])
• Covariance Operator Estimation: Sparsity, Lengthscale, and Ensemble Kalman Filters. (arXiv:2310.16933v1 [math.ST])
• Posterior Consistency for Missing Data in Variational Autoencoders. (arXiv:2310.16648v1 [cs.LG])
• Wasserstein Gradient Flow over Variational Parameter Space for Variational Inference. (arXiv:2310.16705v1 [cs.LG])
• Direct Diffusion Bridge using Data Consistency for Inverse Problems. (arXiv:2305.19809v2 [cs.CV] UPDATED)
• Learning Dynamics in Linear VAE: Posterior Collapse Threshold, Superfluous Latent Space Pitfalls, and Speedup with KL Annealing. (arXiv:2310.15440v1 [stat.ML])
• $L^2$-Wasserstein contraction for Euler schemes of elliptic diffusions and interacting particle systems. (arXiv:2310.15897v1 [math.PR])
• Introduction to Infinite Dimensional Statistics and Applications. (arXiv:2310.15818v1 [math.FA])
• Adam through a Second-Order Lens. (arXiv:2310.14963v1 [cs.LG])
• Random Flows of Covariance Operators and their Statistical Inference. (arXiv:2310.13764v1 [stat.ME])
• Randomized Forward Mode of Automatic Differentiation for Optimization Algorithms. (arXiv:2310.14168v2 [math.OC] UPDATED)
• The Fisher metric as a metric on the cotangent bundle. (arXiv:2310.13237v1 [cs.IT])
• Particle Guidance: non-I.I.D. Diverse Sampling with Diffusion Models. (arXiv:2310.13102v2 [cs.LG] UPDATED)
• Stable Nonconvex-Nonconcave Training via Linear Interpolation. (arXiv:2310.13459v2 [cs.LG] UPDATED)
• Numerical approximation of McKean-Vlasov SDEs via stochastic gradient descent. (arXiv:2310.13579v1 [math.NA])
• Closed-Form Diffusion Models. (arXiv:2310.12395v1 [cs.LG])
• A connection between Tempering and Entropic Mirror Descent. (arXiv:2310.11914v1 [stat.CO])
• Why do autoencoders work?. (arXiv:2310.02250v2 [cs.LG] UPDATED)
• Compositional Abilities Emerge Multiplicatively: Exploring Diffusion Models on a Synthetic Task. (arXiv:2310.09336v3 [cs.LG] UPDATED)
• On permutation symmetries in Bayesian neural network posteriors: a variational perspective. (arXiv:2310.10171v1 [stat.ML])
• Statistical guarantees for stochastic Metropolis-Hastings. (arXiv:2310.09335v1 [stat.ML])
• A Computational Framework for Solving Wasserstein Lagrangian Flows. (arXiv:2310.10649v2 [cs.LG] UPDATED)
• NF-ULA: Langevin Monte Carlo with Normalizing Flow Prior for Imaging Inverse Problems. (arXiv:2304.08342v2 [math.NA] UPDATED)
• On the convergence of discrete dynamic unbalanced transport models. (arXiv:2310.09420v1 [math.NA])
• Sampling from Mean-Field Gibbs Measures via Diffusion Processes. (arXiv:2310.08912v1 [math.PR])
• Time-vectorized numerical integration for systems of ODEs. (arXiv:2310.08649v1 [math.NA])
• The Geometry of Monotone Operator Splitting Methods. (arXiv:2310.08443v3 [math.OC] UPDATED)
• Lion Secretly Solves Constrained Optimization: As Lyapunov Predicts. (arXiv:2310.05898v4 [cs.LG] UPDATED)
• Efficient Integrators for Diffusion Generative Models. (arXiv:2310.07894v1 [cs.LG])
• Efficient Integrators for Diffusion Generative Models. (arXiv:2310.07894v1 [cs.LG])
• Fast Sampling and Inference via Preconditioned Langevin Dynamics. (arXiv:2310.07542v1 [stat.CO])
• Solving Inverse Problems with Latent Diffusion Models via Hard Data Consistency. (arXiv:2307.08123v2 [cs.CV] UPDATED)
• Transformers and Large Language Models for Chemistry and Drug Discovery. (arXiv:2310.06083v1 [cs.LG])
• Economic Theory as Successive Approximations of Statistical Moments. (arXiv:2310.05971v1 [econ.GN])
• Ito Diffusion Approximation of Universal Ito Chains for Sampling, Optimization and Boosting. (arXiv:2310.06081v1 [math.OC])
• The foundations of statistical physics: entropy, irreversibility, and inference. (arXiv:2310.06070v1 [cond-mat.stat-mech])
• On variational inference and maximum likelihood estimation with the {\lambda}-exponential family. (arXiv:2310.05781v1 [math.ST])
• In-Context Convergence of Transformers. (arXiv:2310.05249v1 [cs.LG])
• What's the Magic Word? A Control Theory of LLM Prompting. (arXiv:2310.04444v3 [cs.CL] UPDATED)
• Gradient Descent Provably Solves Nonlinear Tomographic Reconstruction. (arXiv:2310.03956v1 [cs.CV])
• Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference. (arXiv:2310.04378v1 [cs.CV])
• Observation-Guided Diffusion Probabilistic Models. (arXiv:2310.04041v1 [cs.LG])
• Categorical probability spaces, ergodic decompositions, and transitions to equilibrium. (arXiv:2310.04267v2 [math.PR] UPDATED)
• A calculus for Markov chain Monte Carlo: studying approximations in algorithms. (arXiv:2310.03853v1 [math.PR])
• High Order Schemes for Gradient Flow with Respect to a Metric. (arXiv:2211.07011v2 [math.NA] UPDATED)
• Accelerating optimization over the space of probability measures. (arXiv:2310.04006v2 [math.OC] UPDATED)
• Plug-and-Play Posterior Sampling under Mismatched Measurement and Prior Models. (arXiv:2310.03546v1 [stat.ML])
• Molecule Design by Latent Prompt Transformer. (arXiv:2310.03253v1 [cs.LG])
• Learning Energy-Based Prior Model with Diffusion-Amortized MCMC. (arXiv:2310.03218v1 [cs.LG])
• Denoising Diffusion Step-aware Models. (arXiv:2310.03337v2 [cs.CV] UPDATED)
• Sampling via Gradient Flows in the Space of Probability Measures. (arXiv:2310.03597v2 [stat.ML] UPDATED)
• Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion. (arXiv:2310.02279v1 [cs.LG])
• Variational Gaussian approximation of the Kushner optimal filter. (arXiv:2310.01859v1 [stat.ML])
• Score-based Data Assimilation for a Two-Layer Quasi-Geostrophic Model. (arXiv:2310.01853v2 [stat.ML] UPDATED)
• Robustifying State-space Models for Long Sequences via Approximate Diagonalization. (arXiv:2310.01698v1 [cs.LG])
• Score dynamics: scaling molecular dynamics with picosecond timesteps via conditional diffusion model. (arXiv:2310.01678v2 [physics.comp-ph] UPDATED)
• How Over-Parameterization Slows Down Gradient Descent in Matrix Sensing: The Curses of Symmetry and Initialization. (arXiv:2310.01769v3 [cs.LG] UPDATED)
• The Fisher-Rao geometry of CES distributions. (arXiv:2310.01032v1 [stat.ML])
• The Noise Geometry of Stochastic Gradient Descent: A Quantitative and Analytical Characterization. (arXiv:2310.00692v2 [cs.LG] UPDATED)
• A Geometric Perspective on Diffusion Models. (arXiv:2305.19947v2 [cs.CV] UPDATED)
• Steered Diffusion: A Generalized Framework for Plug-and-Play Conditional Image Synthesis. (arXiv:2310.00224v1 [cs.CV])
• Linear attention is (maybe) all you need (to understand transformer optimization). (arXiv:2310.01082v1 [cs.LG])
• Symmetric Solutions to Symmetric Partial Difference Equations. (arXiv:2310.00903v1 [math.CA])
• Unadjusted Langevin Algorithms for SDEs with Hoelder Drift. (arXiv:2310.00232v1 [math.PR])
• Denoising Diffusion Bridge Models. (arXiv:2309.16948v3 [cs.CV] UPDATED)
• Water Markets as a Coping Mechanism for Climate-Induced Water Changes on the Canadian Economy: A Computable General Equilibrium Approach. (arXiv:2309.16678v1 [econ.GN])
• Statistical physics, Bayesian inference and neural information processing. (arXiv:2309.17006v1 [cond-mat.dis-nn])
• Insight from the Kullback--Leibler divergence into adaptive importance sampling schemes for rare event analysis in high dimension. (arXiv:2309.16828v1 [math.ST])
• A Control Theoretical Approach to Online Constrained Optimization. (arXiv:2309.15498v1 [math.OC])
• Bayesian Cram\'er-Rao Bound Estimation with Score-Based Models. (arXiv:2309.16076v1 [math.ST])
• Learning Dissipative Neural Dynamical Systems. (arXiv:2309.16032v1 [cs.LG])
• Compositional Sculpting of Iterative Generative Processes. (arXiv:2309.16115v1 [cs.LG])
• Beauty beacon: correlated strategies for the Fisher runaway process. (arXiv:2309.15205v1 [q-bio.PE])
• Joint Sampling and Optimisation for Inverse Rendering. (arXiv:2309.15676v1 [cs.GR])
• Neural Operators for Accelerating Scientific Simulations and Design. (arXiv:2309.15325v5 [cs.LG] UPDATED)
• Beyond Log-Concavity: Theory and Algorithm for Sum-Log-Concave Optimization. (arXiv:2309.15298v1 [math.OC])
• Fantastic Generalization Measures are Nowhere to be Found. (arXiv:2309.13658v3 [cs.LG] UPDATED)
• On the Convergence of Black-Box Variational Inference. (arXiv:2305.15349v4 [cs.LG] UPDATED)
• AntiBARTy Diffusion for Property Guided Antibody Design. (arXiv:2309.13129v1 [q-bio.BM])
• Independent projections of diffusions: Gradient flows for variational inference and optimal mean field approximations. (arXiv:2309.13332v1 [math.PR])
• Self-Tuning Hamiltonian Monte Carlo for Accelerated Sampling. (arXiv:2309.13593v2 [physics.comp-ph] UPDATED)
• Langevin Quasi-Monte Carlo. (arXiv:2309.12664v1 [stat.CO])
• Flow Annealed Kalman Inversion for Gradient-Free Inference in Bayesian Inverse Problems. (arXiv:2309.11490v1 [stat.CO])
• The Topology and Geometry of Neural Representations. (arXiv:2309.11028v2 [q-bio.NC] UPDATED)
• General Optimal Step-size and Initializations for ADMM: A Proximal Operator View. (arXiv:2309.10124v1 [math.OC])
• Diffusion Methods for Generating Transition Paths. (arXiv:2309.10276v1 [physics.comp-ph])
• ChatGPT-4 with Code Interpreter can be used to solve introductory college-level vector calculus and electromagnetism problems. (arXiv:2309.08881v1 [cs.AI])
• High-dimensional manifold of solutions in neural networks: insights from statistical physics. (arXiv:2309.09240v1 [cond-mat.dis-nn])
• Diffusion Generative Inverse Design. (arXiv:2309.02040v2 [cs.LG] UPDATED)
• Finite Expression Methods for Discovering Physical Laws from Data. (arXiv:2305.08342v2 [cs.LG] UPDATED)
• Accelerated Gradient Descent via Long Steps. (arXiv:2309.09961v2 [math.OC] UPDATED)
• Computational Optimal Transport and Filtering on Riemannian manifolds. (arXiv:2309.08847v2 [math.OC] UPDATED)
• Sampling-Free Probabilistic Deep State-Space Models. (arXiv:2309.08256v1 [cs.LG])
• A Geometric Perspective on Autoencoders. (arXiv:2309.08247v2 [cs.LG] UPDATED)
• Projected Langevin dynamics and a gradient flow for entropic optimal transport. (arXiv:2309.08598v1 [math.PR])
• Optimization Algorithm Synthesis based on Integral Quadratic Constraints: A Tutorial. (arXiv:2306.00565v2 [math.OC] UPDATED)
• Bringing PDEs to JAX with forward and reverse modes automatic differentiation. (arXiv:2309.07137v1 [cs.MS])
• Revisiting Energy Based Models as Policies: Ranking Noise Contrastive Estimation and Interpolating Energy Models. (arXiv:2309.05803v1 [cs.RO])
• Elucidating the solution space of extended reverse-time SDE for diffusion models. (arXiv:2309.06169v2 [cs.LG] UPDATED)
• Learning Energy-Based Models by Cooperative Diffusion Recovery Likelihood. (arXiv:2309.05153v2 [stat.ML] UPDATED)
• SA-Solver: Stochastic Adams Solver for Fast Sampling of Diffusion Models. (arXiv:2309.05019v1 [cs.LG])
• Generalization Bounds: Perspectives from Information Theory and PAC-Bayes. (arXiv:2309.04381v1 [cs.LG])
• Computationally Efficient Data-Driven Discovery and Linear Representation of Nonlinear Systems For Control. (arXiv:2309.04074v1 [eess.SY])
• Early warning indicators via latent stochastic dynamical systems. (arXiv:2309.03842v2 [stat.ML] UPDATED)
• Shooting methods for computing geodesics on the Stiefel manifold. (arXiv:2309.03585v1 [math.NA])
• Large Language Models as Optimizers. (arXiv:2309.03409v2 [cs.LG] UPDATED)
• It\^o versus H\"anggi-Klimontovich. (arXiv:2309.03654v1 [math-ph])
• Concepts in Monte Carlo sampling. (arXiv:2309.03136v1 [cond-mat.stat-mech])
• Well-posedness and averaging principle for L\'evy-type McKean-Vlasov stochastic differential equations under local Lipschitz conditions. (arXiv:2309.02906v1 [math.PR])
• Exact Inference for Continuous-Time Gaussian Process Dynamics. (arXiv:2309.02351v2 [cs.LG] UPDATED)
• Backward error analysis and the qualitative behaviour of stochastic optimization algorithms: Application to stochastic coordinate descent. (arXiv:2309.02082v1 [math.OC])
• Accelerating Markov Chain Monte Carlo sampling with diffusion models. (arXiv:2309.01454v1 [hep-ph])
• CausalLM is not optimal for in-context learning. (arXiv:2308.06912v2 [cs.LG] UPDATED)
• An Ensemble Score Filter for Tracking High-Dimensional Nonlinear Dynamical Systems. (arXiv:2309.00983v1 [stat.ML])
• Controlled Martingale Problems And Their Markov Mimics. (arXiv:2309.00488v1 [math.PR])
• Copiloting the Copilots: Fusing Large Language Models with Completion Engines for Automated Program Repair. (arXiv:2309.00608v3 [cs.SE] UPDATED)
• Structure and Gradient Dynamics Near Global Minima of Two-layer Neural Networks. (arXiv:2309.00508v1 [cs.LG])
• Why do universal adversarial attacks work on large language models?: Geometry might be the answer. (arXiv:2309.00254v1 [cs.LG])
• Fast Diffusion EM: a diffusion model for blind inverse problems with application to deconvolution. (arXiv:2309.00287v2 [cs.CV] UPDATED)
• On the Implicit Bias of Adam. (arXiv:2309.00079v3 [cs.LG] UPDATED)
• Transformers as Support Vector Machines. (arXiv:2308.16898v2 [cs.LG] UPDATED)
• Exploring Model Transferability through the Lens of Potential Energy. (arXiv:2308.15074v1 [cs.CV])
• Noise-Free Sampling Algorithms via Regularized Wasserstein Proximals. (arXiv:2308.14945v3 [stat.ML] UPDATED)
• Score-Based Diffusion Models as Principled Priors for Inverse Imaging. (arXiv:2304.11751v2 [cs.CV] UPDATED)
• Compositional maps for registration in complex geometries. (arXiv:2308.15307v1 [math.NA])
• Continuous-time stochastic gradient descent for optimizing over the stationary distribution of stochastic differential equations. (arXiv:2202.06637v2 [cs.LG] UPDATED)
• Learning variational autoencoders via MCMC speed measures. (arXiv:2308.13731v1 [stat.ML])
• Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspective. (arXiv:2308.14085v1 [cond-mat.dis-nn])
• Solving Forward and Inverse Problems of Contact Mechanics using Physics-Informed Neural Networks. (arXiv:2308.12716v1 [math.NA])
• Score diffusion models without early stopping: finite Fisher information is all you need. (arXiv:2308.12240v1 [math.ST])
• Compositional nonlinear audio signal processing with Volterra series. (arXiv:2308.07229v3 [eess.AS] UPDATED)
• On-Manifold Projected Gradient Descent. (arXiv:2308.12279v1 [cs.LG])
• System Identification for Continuous-time Linear Dynamical Systems. (arXiv:2308.11933v2 [cs.LG] UPDATED)
• Solving Elliptic Optimal Control Problems using Physics Informed Neural Networks. (arXiv:2308.11925v1 [math.OC])
• Boosting Diffusion Models with an Adaptive Momentum Sampler. (arXiv:2308.11941v1 [cs.CV])
• Understanding Hessian Alignment for Domain Generalization. (arXiv:2308.11778v1 [cs.LG])
• Variational Autoencoding Molecular Graphs with Denoising Diffusion Probabilistic Model. (arXiv:2307.00623v2 [cs.LG] UPDATED)
• Diffusion Model as Representation Learner. (arXiv:2308.10916v1 [cs.CV])
• Nonlinear Hamiltonian Monte Carlo & its Particle Approximation. (arXiv:2308.11491v1 [math.ST])
• Convergence guarantee for consistency models. (arXiv:2308.11449v1 [math.NA])
• Semi-Implicit Variational Inference via Score Matching. (arXiv:2308.10014v1 [stat.ML])
• Understanding Self-attention Mechanism via Dynamical System Perspective. (arXiv:2308.09939v1 [cs.CV])
• Unbiased Image Synthesis via Manifold-Driven Sampling in Diffusion Models. (arXiv:2307.08199v2 [cs.CV] UPDATED)
• A Principle for Global Optimization with Gradients. (arXiv:2308.09556v1 [math.OC])
• Accelerated Bayesian imaging by relaxed proximal-point Langevin sampling. (arXiv:2308.09460v2 [stat.CO] UPDATED)
• Ensemble Kalman Filters with Resampling. (arXiv:2308.08751v1 [eess.SY])
• Can Transformers Learn Optimal Filtering for Unknown Systems?. (arXiv:2308.08536v1 [eess.SY])
• On the generalized vectorization and its inverse. (arXiv:2308.07928v2 [math.NA] UPDATED)
• SynJax: Structured Probability Distributions for JAX. (arXiv:2308.03291v3 [cs.LG] UPDATED)
• Sign Gradient Descent Algorithms for Kinetostatic Protein Folding. (arXiv:2308.07453v1 [eess.SY])
• GANs as Gradient Flows that Converge
• How many samples are needed to leverage smoothness?. (arXiv:2305.16014v3 [stat.ML] UPDATED)
• Mirror Diffusion Models. (arXiv:2308.06342v2 [cs.LG] UPDATED)
• Sampling and Filtering with Markov Chains. (arXiv:2308.06192v1 [math.ST])
• Homogenization of conditional slow-fast McKean-Vlasov SDEs. (arXiv:2308.05874v1 [math.PR])
• A Law of Data Separation in Deep Learning. (arXiv:2210.17020v2 [cs.LG] UPDATED)
• Filtering Dynamical Systems Using Observations of Statistics. (arXiv:2308.05484v2 [stat.ME] UPDATED)
• On the Stability and Convergence of Physics Informed Neural Networks. (arXiv:2308.05423v1 [math.NA])
• Gaussian Cooling and Dikin Walks: The Interior-Point Method for Logconcave Sampling. (arXiv:2307.12943v3 [cs.DS] UPDATED)
• Finite Element Operator Network for Solving Parametric PDEs. (arXiv:2308.04690v2 [math.NA] UPDATED)
• Symplectic Discretization Approach for Developing New Proximal Point Algorithms. (arXiv:2308.03986v3 [math.OC] UPDATED)
• A Review of Change of Variable Formulas for Generative Modeling. (arXiv:2308.02652v1 [cs.LG])
• SDDM: Score-Decomposed Diffusion Models on Manifolds for Unpaired Image-to-Image Translation. (arXiv:2308.02154v1 [cs.CV])
• Improved Order Analysis and Design of Exponential Integrator for Diffusion Models Sampling. (arXiv:2308.02157v1 [cs.LG])
• Strong convergence of multiscale truncated Euler-Maruyama method for super-linear slow-fast stochastic differential equations. (arXiv:2308.02110v1 [math.NA])
• Generative Modelling of L\'{e}vy Area for High Order SDE Simulation. (arXiv:2308.02452v1 [stat.ML])
• Statistical Estimation Under Distribution Shift: Wasserstein Perturbations and Minimax Theory. (arXiv:2308.01853v2 [stat.ML] UPDATED)
• Non-equilibrium physics: from spin glasses to machine and neural learning. (arXiv:2308.01538v1 [cond-mat.dis-nn])
• Divergence of the ADAM algorithm with fixed-stepsize: a (very) simple example. (arXiv:2308.00720v1 [cs.LG])
• Mirror Natural Evolution Strategies. (arXiv:2308.00469v1 [cs.LG])
• Exploring how a Generative AI interprets music. (arXiv:2308.00015v1 [cs.SD])
• Geometric Ergodicity and Wasserstein Continuity of Non-Linear Filters. (arXiv:2307.15764v2 [math.PR] UPDATED)
• Faster Stochastic Algorithms for Minimax Optimization under Polyak--{\L}ojasiewicz Conditions. (arXiv:2307.15868v1 [math.OC])
• How regularization affects the geometry of loss functions. (arXiv:2307.15744v1 [cs.LG])
• Inexact proximal methods for weakly convex functions. (arXiv:2307.15596v2 [math.OC] UPDATED)
• Nonlinear Convex Optimization: From Relaxed Proximal Point Algorithm to Prediction Correction Method. (arXiv:2307.14615v1 [math.OC])
• Linear Convergence of Black-Box Variational Inference: Should We Stick the Landing?. (arXiv:2307.14642v2 [stat.ML] UPDATED)
• A Survey on Generative Modeling with Limited Data, Few Shots, and Zero Shot. (arXiv:2307.14397v1 [cs.CV])
• BayesDAG: Gradient-Based Posterior Inference for Causal Discovery. (arXiv:2307.13917v2 [cs.LG] UPDATED)
• Sharpness Minimization Algorithms Do Not Only Minimize Sharpness To Achieve Better Generalization. (arXiv:2307.11007v2 [cs.LG] UPDATED)
• Convergence of Adam for Non-convex Objectives: Relaxed Hyperparameters and Non-ergodic Case. (arXiv:2307.11782v1 [math.OC])
• On the Fisher-Rao Gradient of the Evidence Lower Bound. (arXiv:2307.11249v1 [cs.LG])
• Optimal importance sampling for overdamped Langevin dynamics. (arXiv:2307.11744v1 [stat.ME])
• Amortized Variational Inference: When and Why?. (arXiv:2307.11018v2 [stat.ML] UPDATED)
• Properties of Discrete Sliced Wasserstein Losses. (arXiv:2307.10352v2 [stat.ML] UPDATED)
• LongNet: Scaling Transformers to 1,000,000,000 Tokens. (arXiv:2307.02486v2 [cs.CL] UPDATED)
• Gradient Surgery for One-shot Unlearning on Generative Model. (arXiv:2307.04550v2 [cs.LG] UPDATED)
• A Quick Guide for the Iterated Extended Kalman Filter on Manifolds. (arXiv:2307.09237v3 [eess.SY] UPDATED)
• A Survey of Techniques for Optimizing Transformer Inference. (arXiv:2307.07982v1 [cs.LG])
• Transformers are Universal Predictors. (arXiv:2307.07843v1 [cs.LG])
• Complexity Matters: Rethinking the Latent Space for Generative Modeling. (arXiv:2307.08283v2 [cs.LG] UPDATED)
• Variational Inference with Gaussian Score Matching. (arXiv:2307.07849v1 [stat.ML])
• Training Discrete Energy-Based Models with Energy Discrepancy. (arXiv:2307.07595v1 [stat.ML])
• The Future of Fundamental Science Led by Generative Closed-Loop Artificial Intelligence. (arXiv:2307.07522v3 [cs.AI] UPDATED)
• Control of neural transport for normalizing flows. (arXiv:2307.07817v2 [math.OC] UPDATED)
• Optimal contract design via relaxation: application to the problem of brokerage fee for a client with private signal. (arXiv:2307.07010v1 [q-fin.MF])
• Embracing the chaos: analysis and diagnosis of numerical instability in variational flows. (arXiv:2307.06957v2 [stat.ML] UPDATED)
• Accelerated gradient methods for nonconvex optimization: Escape trajectories from strict saddle points and convergence to local minima. (arXiv:2307.07030v1 [math.OC])
• Tensor Decompositions Meet Control Theory: Learning General Mixtures of Linear Dynamical Systems. (arXiv:2307.06538v2 [cs.LG] UPDATED)
• Energy Discrepancies: A Score-Independent Loss for Energy-Based Models. (arXiv:2307.06431v2 [stat.ML] UPDATED)
• Optimal Algorithms for Numerical Integration: Recent Results and Open Problems. (arXiv:2307.06787v1 [math.NA])
• Deep Generative Models for Decision-Making and Control. (arXiv:2306.08810v2 [cs.LG] UPDATED)
• DDGM: Solving inverse problems by Diffusive Denoising of Gradient-based Minimization. (arXiv:2307.04946v1 [cs.CV])
• Geometric Neural Diffusion Processes. (arXiv:2307.05431v1 [stat.ML])
• On the randomized Euler algorithm under inexact information. (arXiv:2307.04718v1 [math.NA])
• Stability Analysis for Electromagnetic Waveguides. Part 1: Acoustic and Homogeneous Electromagnetic Waveguides. (arXiv:2307.04521v1 [math.NA])
• A generative flow for conditional sampling via optimal transport. (arXiv:2307.04102v1 [stat.ML])
• Revisiting the Two-Filter Formula for Smoothing for State-Space Models. (arXiv:2307.03428v1 [stat.CO])
• Strategic Distribution Shift of Interacting Agents via Coupled Gradient Flows. (arXiv:2307.01166v3 [cs.LG] UPDATED)
• Adaptive Strategies in Non-convex Optimization. (arXiv:2306.10278v2 [cs.LG] UPDATED)
• Differentiable Turbulence. (arXiv:2307.03683v1 [physics.flu-dyn])
• Large Deviations and Metastability Analysis for Heavy-Tailed Dynamical Systems. (arXiv:2307.03479v1 [math.PR])
• On the convergence of dynamic implementations of Hamiltonian Monte Carlo and No U-Turn Samplers. (arXiv:2307.03460v1 [stat.CO])
• A Journey into Matrix Analysis. (arXiv:2307.03064v1 [math.FA])
• Convergence and concentration properties of constant step-size SGD through Markov chains. (arXiv:2306.11497v2 [stat.ML] UPDATED)
• DiffFlow: A Unified SDE Framework for Score-Based Diffusion Models and Generative Adversarial Networks. (arXiv:2307.02159v1 [stat.ML])
• Training Energy-Based Models with Diffusion Contrastive Divergences. (arXiv:2307.01668v1 [cs.LG])
• Reverse Diffusion Monte Carlo. (arXiv:2307.02037v2 [stat.ML] UPDATED)
• Abide by the Law and Follow the Flow: Conservation Laws for Gradient Flows. (arXiv:2307.00144v1 [cs.LG])
• Transport meets Variational Inference: Controlled Monte Carlo Diffusions. (arXiv:2307.01050v5 [stat.ML] UPDATED)
• Solving Linear Inverse Problems Provably via Posterior Sampling with Latent Diffusion Models. (arXiv:2307.00619v1 [cs.LG])
• An Introduction to Stochastic PDEs. (arXiv:0907.4178v2 [math.PR] UPDATED)
• Improved sampling via learned diffusions. (arXiv:2307.01198v1 [cs.LG])
• On Higher Order Drift and Diffusion Estimates for Stochastic SINDy. (arXiv:2306.17814v2 [math.NA] UPDATED)
• Proximal Langevin Sampling With Inexact Proximal Mapping. (arXiv:2306.17737v1 [stat.CO])
• Practical and Asymptotically Exact Conditional Sampling in Diffusion Models. (arXiv:2306.17775v1 [stat.ML])
• Designing Stable Neural Networks using Convex Analysis and ODEs. (arXiv:2306.17332v1 [cs.LG])
• Approximate Inference via Fibrations of Statistical Games. (arXiv:2306.17009v2 [math.CT] UPDATED)
• The Underlying Scaling Laws and Universal Statistical Structure of Complex Datasets. (arXiv:2306.14975v2 [cs.LG] UPDATED)
• Recent Advances in Optimal Transport for Machine Learning. (arXiv:2306.16156v1 [cs.LG])
• The curse of dimensionality in operator learning. (arXiv:2306.15924v1 [cs.LG])
• Improved error estimate for the order of strong convergence of the Euler method for random ordinary differential equations. (arXiv:2306.15418v4 [math.PR] UPDATED)
• Automating Steady and Unsteady Adjoints: Efficiently Utilizing Implicit and Algorithmic Differentiation. (arXiv:2306.15243v1 [math.OC])
• Linearizability of flows by embeddings. (arXiv:2305.18288v4 [math.DS] UPDATED)
• On Scalable Testing of Samplers. (arXiv:2306.13958v1 [cs.DS])
• Efficient preconditioned stochastic gradient descent for estimation in latent variable models. (arXiv:2306.12841v1 [math.ST])
• Balanced Training of Energy-Based Models with Adaptive Flow Sampling. (arXiv:2306.00684v3 [cs.LG] UPDATED)
• Thermodynamics of Information. (arXiv:2306.12447v1 [cond-mat.stat-mech])
• On the log-Sobolev constant of log-concave measures. (arXiv:2306.12997v1 [math.FA])
• Any Deep ReLU Network is Shallow. (arXiv:2306.11827v1 [cs.LG])
• Open Problem: Learning with Variational Objectives on Measures. (arXiv:2306.11928v2 [stat.ML] UPDATED)
• No Wrong Turns: The Simple Geometry Of Neural Networks Optimization Paths. (arXiv:2306.11922v1 [cs.LG])
• Convergence and concentration properties of constant step-size SGD through Markov chains. (arXiv:2306.11497v2 [stat.ML] UPDATED)
• Towards Stability of Autoregressive Neural Operators. (arXiv:2306.10619v2 [cs.LG] UPDATED)
• Fast Conditional Mixing of MCMC Algorithms for Non-log-concave Distributions. (arXiv:2306.10506v2 [cs.LG] UPDATED)
• Trained Transformers Learn Linear Models In-Context. (arXiv:2306.09927v3 [stat.ML] UPDATED)
• Adjoint and Its roles in Sciences, Engineering, and Mathematics: A Tutorial. (arXiv:2306.09917v1 [math.FA])
• Nonlinear Fokker--Planck--Kolmogorov equations as gradient flows on the space of probability measures. (arXiv:2306.09530v2 [math.AP] UPDATED)
• Second order quantitative bounds for unadjusted generalized Hamiltonian Monte Carlo. (arXiv:2306.09513v1 [math.PR])
• Evolutionary Algorithms in the Light of SGD: Limit Equivalence, Minima Flatness, and Transfer Learning. (arXiv:2306.09991v1 [cs.NE])
• Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisited. (arXiv:2306.08494v2 [math.ST] UPDATED)
• Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models. (arXiv:2306.09251v2 [stat.ML] UPDATED)
• New Methods for Parametric Optimization via Differential Equations. (arXiv:2306.08812v1 [math.OC])
• Fit Like You Sample: Sample-Efficient Generalized Score Matching from Fast Mixing Diffusions. (arXiv:2306.09332v3 [cs.DS] UPDATED)
• Beyond Implicit Bias: The Insignificance of SGD Noise in Online Learning. (arXiv:2306.08590v1 [cs.LG])
• Contraction Rate Estimates of Stochastic Gradient Kinetic Langevin Integrators. (arXiv:2306.08592v1 [math.NA])
• Noise Stability Optimization for Flat Minima with Tight Rates. (arXiv:2306.08553v2 [cs.LG] UPDATED)
• Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisited. (arXiv:2306.08494v2 [math.ST] UPDATED)
• Differentiating Metropolis-Hastings to Optimize Intractable Densities. (arXiv:2306.07961v3 [stat.ML] UPDATED)
• Learning Unnormalized Statistical Models via Compositional Optimization. (arXiv:2306.07485v1 [cs.LG])
• Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning. (arXiv:2306.04815v1 [cs.LG] CROSS LISTED)
• Stability estimates for initial data in general Ornstein-Uhlenbeck equations. (arXiv:2306.06763v1 [math.AP])
• Quadratic models for understanding neural network dynamics. (arXiv:2205.11787v2 [cs.LG] CROSS LISTED)
• Convergence of mean-field Langevin dynamics: Time and space discretization, stochastic gradient, and variance reduction. (arXiv:2306.07221v1 [cs.LG])
• Latent Dynamical Implicit Diffusion Processes. (arXiv:2306.07077v2 [cs.LG] UPDATED)
• Can Forward Gradient Match Backpropagation?. (arXiv:2306.06968v1 [cs.LG])
• On Kinetic Optimal Probability Paths for Generative Models. (arXiv:2306.06626v1 [cs.LG])
• Markov bases: a 25 year update. (arXiv:2306.06270v3 [stat.ME] UPDATED)
• Asymptotically efficient one-step stochastic gradient descent. (arXiv:2306.05896v1 [math.ST])
• Data-Adaptive Probabilistic Likelihood Approximation for Ordinary Differential Equations. (arXiv:2306.05566v2 [stat.ML] UPDATED)
• Beyond Vanilla Variational Autoencoders: Detecting Posterior Collapse in Conditional and Hierarchical Variational Autoencoders. (arXiv:2306.05023v2 [stat.ML] UPDATED)
• Causal normalizing flows: from theory to practice. (arXiv:2306.05415v2 [cs.LG] UPDATED)
• Interpreting and Improving Diffusion Models Using the Euclidean Distance Function. (arXiv:2306.04848v2 [cs.LG] UPDATED)
• Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion models. (arXiv:2306.04675v2 [cs.LG] UPDATED)
• Unscented Autoencoder. (arXiv:2306.05256v1 [cs.LG])
• Stochastic Collapse: How Gradient Noise Attracts SGD Dynamics Towards Simpler Subnetworks. (arXiv:2306.04251v2 [cs.LG] UPDATED)
• Probabilistic Unrolling: Scalable, Inverse-Free Maximum Likelihood Estimation for Latent Gaussian Models. (arXiv:2306.03249v1 [cs.LG])
• Provable convergence guarantees for black-box variational inference. (arXiv:2306.03638v3 [cs.LG] UPDATED)
• Sequential Monte Carlo Steering of Large Language Models using Probabilistic Programs. (arXiv:2306.03081v2 [cs.AI] UPDATED)
• Introduction to Latent Variable Energy-Based Models: A Path Towards Autonomous Machine Intelligence. (arXiv:2306.02572v1 [cs.LG])
• Gradient-free optimization of highly smooth functions: improved analysis and a new algorithm. (arXiv:2306.02159v1 [math.ST])
• Correcting auto-differentiation in neural-ODE training. (arXiv:2306.02192v1 [cs.LG])
• Averaging principle for McKean-Vlasov SDEs driven by multiplicative fractional noise with highly oscillatory drift coefficient. (arXiv:2306.02028v1 [math.PR])
• GFlowNet-EM for learning compositional latent variable models. (arXiv:2302.06576v2 [cs.LG] UPDATED)
• Lifting Architectural Constraints of Injective Flows. (arXiv:2306.01843v3 [cs.LG] UPDATED)
• Entropic mean-field min-max problems via Best Response and Fisher-Rao flows. (arXiv:2306.03033v1 [math.OC])
• Curvature and complexity: Better lower bounds for geodesically convex optimization. (arXiv:2306.02959v2 [math.OC] UPDATED)
• Aiming towards the minimizers: fast convergence of SGD for overparametrized problems. (arXiv:2306.02601v1 [cs.LG])
• KL-Divergence Guided Temperature Sampling. (arXiv:2306.01286v2 [cs.CL] UPDATED)
• TIES-Merging: Resolving Interference When Merging Models. (arXiv:2306.01708v2 [cs.LG] UPDATED)
• Learning Transformer Programs. (arXiv:2306.01128v2 [cs.LG] UPDATED)
• The Fisher Geometry and Geodesics of the Multivariate Normals, without Differential Geometry. (arXiv:2306.01278v1 [math.ST])
• Convex and Non-convex Optimization Under Generalized Smoothness. (arXiv:2306.01264v2 [math.OC] UPDATED)
• Conditionally Strongly Log-Concave Generative Models. (arXiv:2306.00181v1 [stat.ML])
• From Perception to Programs: Regularize, Overparameterize, and Amortize. (arXiv:2206.05922v2 [cs.AI] UPDATED)
• The Implicit Regularization of Dynamical Stability in Stochastic Gradient Descent. (arXiv:2305.17490v2 [stat.ML] UPDATED)
• Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspective. (arXiv:2305.15408v5 [cs.LG] UPDATED)
• Parameterized Wasserstein Hamiltonian Flow. (arXiv:2306.00191v2 [math.NA] UPDATED)
• Generalized Implicit Follow-The-Regularized-Leader. (arXiv:2306.00201v1 [cs.LG])
• Fast global convergence of gradient descent for low-rank matrix approximation. (arXiv:2305.19206v1 [math.OC])
• Forensic analysis of the Turkey 2023 presidential election reveals extreme vote swings in remote areas. (arXiv:2305.19168v2 [stat.AP] UPDATED)
• On the Role of Noise in the Sample Complexity of Learning Recurrent Neural Networks: Exponential Gaps for Long Sequences. (arXiv:2305.18423v1 [stat.ML])
• A Heat Diffusion Perspective on Geodesic Preserving Dimensionality Reduction. (arXiv:2305.19043v1 [cs.LG])
• The Curse of Recursion: Training on Generated Data Makes Models Forget. (arXiv:2305.17493v2 [cs.LG] UPDATED)
• Spontaneous Symmetry Breaking in Generative Diffusion Models. (arXiv:2305.19693v3 [cs.LG] UPDATED)
• A Unified Framework for U-Net Design and Analysis. (arXiv:2305.19638v2 [stat.ML] UPDATED)
• Chain of Log-Concave Markov Chains. (arXiv:2305.19473v2 [stat.ML] UPDATED)
• Resampling schemes in population annealing: Numerical and theoretical results. (arXiv:2305.19994v2 [cond-mat.stat-mech] UPDATED)
• Conditional score-based diffusion models for Bayesian inference in infinite dimensions. (arXiv:2305.19147v2 [stat.ML] UPDATED)
• A Measure-Theoretic Axiomatisation of Causality. (arXiv:2305.17139v2 [cs.AI] UPDATED)
• Efficiency of reversible MCMC methods: elementary derivations and applications to composite methods. (arXiv:2305.18268v1 [math.PR])
• Fast and Minimax Optimal Estimation of Low-Rank Matrices via Non-Convex Gradient Descent. (arXiv:2305.17224v1 [math.OC])
• Stochastic resetting in interacting particle systems: A review. (arXiv:2305.16955v2 [cond-mat.stat-mech] UPDATED)
• Kaczmarz-Type Method for Solving Matrix Equation $AXB=C$. (arXiv:2305.16684v1 [math.NA])
• Unifying GANs and Score-Based Diffusion as Generative Particle Models. (arXiv:2305.16150v3 [cs.LG] UPDATED)
• How many samples are needed to leverage smoothness?. (arXiv:2305.16014v3 [stat.ML] UPDATED)
• Contracting Dynamics for Time-Varying Convex Optimization. (arXiv:2305.15595v1 [math.OC])
• CoinEM: Tuning-Free Particle-Based Variational Inference for Latent Variable Models. (arXiv:2305.14916v1 [stat.ML])
• Training Energy-Based Normalizing Flow with Score-Matching Objectives. (arXiv:2305.15267v2 [cs.LG] UPDATED)
• Subsampling Error in Stochastic Gradient Langevin Diffusions. (arXiv:2305.13882v1 [stat.ML])
• On the Convergence of Black-Box Variational Inference. (arXiv:2305.15349v4 [cs.LG] UPDATED)
• A Rigorous Link between Deep Ensembles and (Variational) Bayesian Methods. (arXiv:2305.15027v2 [stat.ML] UPDATED)
• On progressive sharpening, flat minima and generalisation. (arXiv:2305.14683v4 [cs.LG] UPDATED)
• One-step differentiation of iterative algorithms. (arXiv:2305.13768v1 [math.OC])
• Improved rates of convergence for the multivariate Central Limit Theorem in Wasserstein distance. (arXiv:2305.14248v3 [math.PR] UPDATED)
• Towards Understanding the Dynamics of Gaussian-Stein Variational Gradient Descent. (arXiv:2305.14076v4 [math.ST] UPDATED)
• Uniform-in-Time Wasserstein Stability Bounds for (Noisy) Stochastic Gradient Descent. (arXiv:2305.12056v2 [stat.ML] UPDATED)
• Gradient Descent Monotonically Decreases the Sharpness of Gradient Flow Solutions in Scalar Networks and Beyond. (arXiv:2305.13064v1 [cs.LG])
• Variational Diffusion Auto-encoder: Latent Space Extraction from Pre-trained Diffusion Models. (arXiv:2304.12141v2 [cs.LG] UPDATED)
• The probability flow ODE is provably fast. (arXiv:2305.11798v1 [cs.LG])
• Moment Matching Denoising Gibbs Sampling. (arXiv:2305.11650v5 [stat.ML] UPDATED)
• Sampling, Diffusions, and Stochastic Localization. (arXiv:2305.10690v1 [cs.LG])
• Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces. (arXiv:2305.11089v1 [cs.LG])
• A Theory of General Difference in Continuous and Discrete Domain. (arXiv:2305.08098v2 [cs.DM] UPDATED)
• Common Diffusion Noise Schedules and Sample Steps are Flawed. (arXiv:2305.08891v4 [cs.CV] UPDATED)
• On the connections between optimization algorithms, Lyapunov functions, and differential equations: theory and insights. (arXiv:2305.08658v1 [math.OC])
• A Dynamical Systems Perspective on Discrete Optimization. (arXiv:2305.08536v1 [math.OC])
• Generative AI: Implications and Applications for Education. (arXiv:2305.07605v3 [cs.CY] UPDATED)
• From Denoising Diffusions to Denoising Markov Models. (arXiv:2211.03595v2 [stat.ML] UPDATED)
• The Compositional Structure of Bayesian Inference. (arXiv:2305.06112v2 [math.CT] UPDATED)
• UAdam: Unified Adam-Type Algorithmic Framework for Non-Convex Stochastic Optimization. (arXiv:2305.05675v1 [cs.LG])
• The emergence of clusters in self-attention dynamics. (arXiv:2305.05465v4 [cs.LG] UPDATED)
• A Variational Perspective on Solving Inverse Problems with Diffusion Models. (arXiv:2305.04391v2 [cs.LG] UPDATED)
• Gradient descent with a general cost. (arXiv:2305.04917v2 [math.OC] UPDATED)
• Accelerated Stochastic Optimization Methods under Quasar-convexity. (arXiv:2305.04736v2 [math.OC] UPDATED)
• The complexity of first-order optimization methods from a metric perspective. (arXiv:2305.03208v1 [math.OC])
• A categorical treatment of the Radon-Nikodym theorem and martingales. (arXiv:2305.03421v2 [math.CT] UPDATED)
• On a Unified and Simplified Proof for the Ergodic Convergence Rates of PPM, PDHG and ADMM. (arXiv:2305.02165v2 [math.OC] UPDATED)
• The Pseudoinverse of $A=CR$ is $A^+=R^+C^+$ (?). (arXiv:2305.01716v2 [math.NA] UPDATED)
• Hessian-informed Hamiltonian Monte Carlo for high-dimensional problems. (arXiv:2305.01576v1 [stat.CO])
• Blended Latent Diffusion. (arXiv:2206.02779v2 [cs.CV] UPDATED)
• Class-Balancing Diffusion Models. (arXiv:2305.00562v2 [cs.CV] UPDATED)
• Predictions Based on Pixel Data: Insights from PDEs and Finite Differences. (arXiv:2305.00723v1 [math.NA])
• Generative Diffusion Models on Graphs: Methods and Applications. (arXiv:2302.02591v3 [cs.LG] UPDATED)
• On Underdamped Nesterov's Acceleration. (arXiv:2304.14642v1 [math.OC])
• Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be. (arXiv:2304.13960v1 [cs.LG])
• Categorical Foundations of Explainable AI: A Unifying Theory. (arXiv:2304.14094v3 [cs.AI] UPDATED)
• Statistical Learning Theory for Control: A Finite Sample Perspective. (arXiv:2209.05423v2 [eess.SY] UPDATED)
• Convergence of Adam Under Relaxed Assumptions. (arXiv:2304.13972v3 [math.OC] UPDATED)
• Score-based Generative Modeling Through Backward Stochastic Differential Equations: Inversion and Generation. (arXiv:2304.13224v1 [cs.LG])
• Energy-Based Sliced Wasserstein Distance. (arXiv:2304.13586v3 [stat.ML] UPDATED)
• Latent Traversals in Generative Models as Potential Flows. (arXiv:2304.12944v2 [cs.LG] UPDATED)
• The secret life of matrix factorizations: how matrix decompositions reveal and keep secrets of linear equations and what we can do about it. (arXiv:2304.12451v1 [math.NA])
• Fast Diffusion Probabilistic Model Sampling through the lens of Backward Error Analysis. (arXiv:2304.11446v1 [cs.CV])
• An Introduction to Transformers. (arXiv:2304.10557v4 [cs.LG] UPDATED)
• Analysis of a Computational Framework for Bayesian Inverse Problems: Ensemble Kalman Updates and MAP Estimators Under Mesh Refinement. (arXiv:2304.09933v1 [math.NA])
• A Latent Space Theory for Emergent Abilities in Large Language Models. (arXiv:2304.09960v3 [cs.CL] UPDATED)
• Understanding Accelerated Gradient Methods: Lyapunov Analyses and Hamiltonian Assisted Interpretations. (arXiv:2304.10063v1 [math.OC])
• A Theory on Adam Instability in Large-Scale Machine Learning. (arXiv:2304.09871v2 [cs.LG] UPDATED)
• Analysis of a Computational Framework for Bayesian Inverse Problems: Ensemble Kalman Updates and MAP Estimators Under Mesh Refinement. (arXiv:2304.09933v1 [math.NA])
• Weak Convergence Of Tamed Exponential Integrators for Stochastic Differential Equations. (arXiv:2304.09496v1 [math.NA])
• Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models. (arXiv:2304.09842v3 [cs.CL] UPDATED)
• Convergence of stochastic gradient descent under a local Lojasiewicz condition for deep neural networks. (arXiv:2304.09221v2 [cs.LG] UPDATED)
• Particle-based Variational Inference with Preconditioned Functional Gradient Flow. (arXiv:2211.13954v2 [stat.ML] UPDATED)
• Sliced Optimal Transport on the Sphere. (arXiv:2304.09092v2 [math.NA] UPDATED)
• Bayes Hilbert Spaces for Posterior Approximation. (arXiv:2304.09053v1 [math.ST])
• Learning in latent spaces improves the predictive accuracy of deep neural operators. (arXiv:2304.07599v1 [cs.LG])
• Non-asymptotic convergence bounds for Sinkhorn iterates and their gradients: a coupling approach. (arXiv:2304.06549v2 [math.PR] UPDATED)
• Delta Denoising Score. (arXiv:2304.07090v1 [cs.CV])
• What does self-attention learn from Masked Language Modelling?. (arXiv:2304.07235v2 [cond-mat.dis-nn] UPDATED)
• Energy-guided Entropic Neural Optimal Transport. (arXiv:2304.06094v3 [cs.LG] UPDATED)
• Forward-backward Gaussian variational inference via JKO in the Bures-Wasserstein Space. (arXiv:2304.05398v1 [math.ST])
• Diffusion models with location-scale noise. (arXiv:2304.05907v1 [cs.LG])
• Regulatory Markets: The Future of AI Governance. (arXiv:2304.04914v4 [cs.AI] UPDATED)
• Binary Latent Diffusion. (arXiv:2304.04820v1 [cs.CV])
• Diffusion Models for Constrained Domains. (arXiv:2304.05364v1 [cs.LG])
• Bayesian Optimization of Catalysts With In-context Learning. (arXiv:2304.05341v1 [physics.chem-ph])
• Simulated Annealing in Early Layers Leads to Better Generalization. (arXiv:2304.04858v1 [cs.LG])
• Criticality versus uniformity in deep neural networks. (arXiv:2304.04784v1 [cs.LG])
• Local Conditions for Global Convergence of Gradient Flows and Proximal Point Sequences in Metric Spaces. (arXiv:2304.05239v1 [math.OC])
• Gradient flows of interacting Laguerre cells as discrete porous media flows. (arXiv:2304.05069v1 [math.NA])
• A Family of Iteration Functions for General Linear Systems. (arXiv:2304.04940v2 [math.NA] UPDATED)
• A Simple Proof of the Mixing of Metropolis-Adjusted Langevin Algorithm under Smoothness and Isoperimetry. (arXiv:2304.04095v2 [stat.ML] UPDATED)
• Reflected Diffusion Models. (arXiv:2304.04740v3 [stat.ML] UPDATED)
• When does Metropolized Hamiltonian Monte Carlo provably outperform Metropolis-adjusted Langevin algorithm?. (arXiv:2304.04724v2 [stat.CO] UPDATED)
• Deep Generative Modeling with Backward Stochastic Differential Equations. (arXiv:2304.04049v1 [cs.LG])
• Interpretable statistical representations of neural population dynamics and geometry. (arXiv:2304.03376v2 [cs.LG] UPDATED)
• Transforming Butterflies into Graphs: Statistics of Chaotic and Turbulent Systems. (arXiv:2304.03362v1 [physics.flu-dyn])
• Deep linear networks can benignly overfit when shallow ones do
• Causal inference is not just a statistics problem. (arXiv:2304.02683v3 [stat.ME] UPDATED)
• Convergence Rates for Non-Log-Concave Sampling and Log-Partition Estimation. (arXiv:2303.03237v3 [stat.ML] UPDATED)
• Towards Efficient MCMC Sampling in Bayesian Neural Networks by Exploiting Symmetry. (arXiv:2304.02902v1 [stat.ML])
• GenPhys: From Physical Processes to Generative Models. (arXiv:2304.02637v1 [cs.LG])
• Query lower bounds for log-concave sampling. (arXiv:2304.02599v2 [math.ST] UPDATED)
• Solidarity of Gibbs Samplers: the spectral gap. (arXiv:2304.02109v1 [stat.CO])
• Effective Theory of Transformers at Initialization. (arXiv:2304.02034v1 [cs.LG])
• Diffusion Bridge Mixture Transports, Schr\"odinger Bridge Problems and Generative Modeling. (arXiv:2304.00917v2 [stat.ML] UPDATED)
• Diffusion map particle systems for generative modeling. (arXiv:2304.00200v2 [stat.ML] UPDATED)
• DRIP: Deep Regularizers for Inverse Problems. (arXiv:2304.00015v2 [cs.LG] UPDATED)
• On the Sample Complexity of the Linear Quadratic Gaussian Regulator. (arXiv:2304.00381v2 [math.OC] UPDATED)
• Universal approximation of flows of control systems by recurrent neural networks. (arXiv:2304.00352v2 [eess.SY] UPDATED)
• Optimal Strategies to Steer and Control Water Waves. (arXiv:2304.00376v1 [math.OC])
• Optimal Transport Particle Filters. (arXiv:2304.00392v1 [math.OC])
• Speeding up Langevin Dynamics by Mixing. (arXiv:2303.18168v2 [math.PR] UPDATED)
• Fluctuation without dissipation: Microcanonical Langevin Monte Carlo. (arXiv:2303.18221v2 [hep-lat] UPDATED)
• Diffusion Schr\"odinger Bridge Matching. (arXiv:2303.16852v3 [stat.ML] UPDATED)
• Unified analysis of SGD-type methods. (arXiv:2303.16502v1 [math.OC])
• Diffusion Schr\"odinger Bridge Matching. (arXiv:2303.16852v3 [stat.ML] UPDATED)
• Speeding up backpropagation of gradients through the Kalman filter via closed-form expressions. (arXiv:2303.16846v2 [math.OC] UPDATED)
• Unified analysis of SGD-type methods. (arXiv:2303.16502v1 [math.OC])
• Uniform in time convergence of numerical schemes for stochastic differential equations via Strong Exponential stability: Euler methods, Split-Step and Tamed Schemes. (arXiv:2303.15463v1 [math.NA])
• Noisy dynamical systems evolve error correcting codes and modularity. (arXiv:2303.14448v1 [q-bio.PE])
• Particle Mean Field Variational Bayes. (arXiv:2303.13930v2 [stat.CO] UPDATED)
• How averaged is the composition of two linear projections?. (arXiv:2303.13738v1 [math.OC])
• Symmetries, flat minima, and the conserved quantities of gradient flow. (arXiv:2210.17216v2 [cs.LG] UPDATED)
• Stability is Stable: Connections between Replicability, Privacy, and Adaptive Generalization. (arXiv:2303.12921v2 [cs.LG] UPDATED)
• Non-asymptotic analysis of Langevin-type Monte Carlo algorithms. (arXiv:2303.12407v4 [math.ST] UPDATED)
• Seven open problems in applied combinatorics. (arXiv:2303.11464v1 [math.CO])
• Speech Modeling with a Hierarchical Transformer Dynamical VAE. (arXiv:2303.09404v2 [eess.AS] UPDATED)
• Variational Principles for Mirror Descent and Mirror Langevin Dynamics. (arXiv:2303.09532v1 [math.OC])
• Accelerated Gradient and Skew-Symmetric Splitting Methods for a Class of Monotone Operator Equations. (arXiv:2303.09009v1 [math.OC])
• High order spatial discretization for variational time implicit schemes: Wasserstein gradient flows and reaction-diffusion systems. (arXiv:2303.08950v1 [math.NA])
• Diffusion Models in NLP: A Survey. (arXiv:2303.07576v1 [cs.CL])
• General Loss Functions Lead to (Approximate) Interpolation in High Dimensions. (arXiv:2303.07475v1 [stat.ML])
• Generalised Scale-Space Properties for Probabilistic Diffusion Models. (arXiv:2303.07900v4 [eess.IV] UPDATED)
• Physics-driven machine learning models coupling PyTorch and Firedrake. (arXiv:2303.06871v3 [cs.LG] UPDATED)
• L\'evy Langevin Monte Carlo. (arXiv:2303.07743v1 [math.PR])
• Variational Gaussian filtering via Wasserstein gradient flows. (arXiv:2303.06398v2 [stat.CO] UPDATED)
• Decomposed Diffusion Sampler for Accelerating Large-Scale Inverse Problems. (arXiv:2303.05754v2 [cs.LG] UPDATED)
• Optimal foraging strategies can be learned. (arXiv:2303.06050v3 [cond-mat.stat-mech] UPDATED)
• Controllable Video Generation by Learning the Underlying Dynamical System with Neural ODE. (arXiv:2303.05323v2 [cs.CV] UPDATED)
• Unifying Layout Generation with a Decoupled Diffusion Model. (arXiv:2303.05049v1 [cs.CV])
• A Categorical Framework of General Intelligence. (arXiv:2303.04571v2 [cs.AI] UPDATED)
• Computing with Categories in Machine Learning. (arXiv:2303.04156v1 [cs.LG])
• Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI. (arXiv:2303.03758v1 [eess.IV])
• Towards a Complete Analysis of Langevin Monte Carlo: Beyond Poincar\'e Inequality. (arXiv:2303.03589v2 [math.ST] UPDATED)
• Properties of Marginal Sequential Monte Carlo Methods. (arXiv:2303.03498v1 [stat.CO])
• Global convergence of the gradient method for functions definable in o-minimal structures. (arXiv:2303.03534v4 [math.OC] UPDATED)
• Extending the Wasserstein metric to positive measures. (arXiv:2303.02183v1 [math.MG])
• Diffusion Models Generate Images Like Painters: an Analytical Theory of Outline First, Details Later. (arXiv:2303.02490v1 [cs.CV])
• Prompt, Generate, then Cache: Cascade of Foundation Models makes Strong Few-shot Learners. (arXiv:2303.02151v1 [cs.CV])
• Diffusion Models are Minimax Optimal Distribution Estimators. (arXiv:2303.01861v1 [stat.ML])
• A Complete Recipe for Diffusion Generative Models. (arXiv:2303.01748v2 [cs.LG] UPDATED)
• Bayesian Posterior Perturbation Analysis with Integral Probability Metrics. (arXiv:2303.01512v1 [stat.ML])
• Training neural networks with structured noise improves classification and generalization. (arXiv:2302.13417v4 [cond-mat.dis-nn] UPDATED)
• Consistency Models. (arXiv:2303.01469v2 [cs.LG] UPDATED)
• Continuous-Time Functional Diffusion Processes. (arXiv:2303.00800v3 [cs.LG] UPDATED)
• Understanding Diffusion Objectives as the ELBO with Simple Data Augmentation. (arXiv:2303.00848v7 [cs.LG] UPDATED)
• Understanding Diffusion Objectives as the ELBO with Simple Data Augmentation. (arXiv:2303.00848v7 [cs.LG] UPDATED)
• On the existence of minimizers in shallow residual ReLU neural network optimization landscapes. (arXiv:2302.14690v1 [math.OC])
• The Inverse of Exact Renormalization Group Flows as Statistical Inference. (arXiv:2212.11379v1 [hep-th] CROSS LISTED)
• Stochastic Gradient Descent under Markovian Sampling Schemes. (arXiv:2302.14428v3 [math.OC] UPDATED)
• Injectivity of ReLU networks: perspectives from statistical physics. (arXiv:2302.14112v1 [cond-mat.dis-nn])
• Denoising Diffusion Samplers. (arXiv:2302.13834v2 [cs.LG] UPDATED)
• Compositional Law Parsing with Latent Random Functions. (arXiv:2209.09115v2 [cs.CV] UPDATED)
• Revisiting LQR Control from the Perspective of Receding-Horizon Policy Gradient. (arXiv:2302.13144v2 [math.OC] UPDATED)
• A Counterexample to the L\'evy Flight Foraging Hypothesis in the Narrow Capture Framework. (arXiv:2302.13976v2 [cond-mat.stat-mech] UPDATED)
• Direct Estimation of Parameters in ODE Models Using WENDy: Weak-form Estimation of Nonlinear Dynamics. (arXiv:2302.13271v1 [cs.LG])
• Asymptotic convergence of iterative optimization algorithms. (arXiv:2302.12544v1 [stat.ML])
• Graph signal processing with categorical perspective. (arXiv:2302.12421v1 [eess.SP])
• Efficiently handling constraints with Metropolis-adjusted Langevin algorithm. (arXiv:2302.11971v2 [stat.CO] UPDATED)
• An Explicit Expansion of the Kullback-Leibler Divergence along its Fisher-Rao Gradient Flow. (arXiv:2302.12229v1 [math.OC])
• Composer: Creative and Controllable Image Synthesis with Composable Conditions. (arXiv:2302.09778v2 [cs.CV] UPDATED)
• From Optimization to Sampling Through Gradient Flows. (arXiv:2302.11449v1 [stat.CO])
• Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMC. (arXiv:2302.11552v4 [cs.LG] UPDATED)
• Gradient Flows for Sampling: Mean-Field Models, Gaussian Approximations and Affine Invariance. (arXiv:2302.11024v6 [stat.ML] UPDATED)
• Contraction and Convergence Rates for Discretized Kinetic Langevin Dynamics. (arXiv:2302.10684v4 [math.NA] UPDATED)
• On Robust Numerical Solver for ODE via Self-Attention Mechanism. (arXiv:2302.10184v1 [cs.LG])
• Variational Autoencoding Neural Operators. (arXiv:2302.10351v1 [cs.LG])
• Faster high-accuracy log-concave sampling via algorithmic warm starts. (arXiv:2302.10249v1 [math.ST])
• On Equivalent Optimization of Machine Learning Methods. (arXiv:2302.09160v1 [cs.LG])
• The Generalization Error of Stochastic Mirror Descent on Over-Parametrized Linear Models. (arXiv:2302.09433v1 [cs.LG])
• Parameter Averaging for SGD Stabilizes the Implicit Bias towards Flat Regions. (arXiv:2302.09376v1 [stat.ML])
• Over-Parameterization Exponentially Slows Down Gradient Descent for Learning a Single Neuron. (arXiv:2302.10034v2 [cs.LG] UPDATED)
• Convergence rate in $\mathcal{L}^p$ sense of tamed EM scheme for highly nonlinear neutral multiple-delay stochastic McKean-Vlasov equations. (arXiv:2302.09724v1 [math.NA])
• SGD with AdaGrad Stepsizes: Full Adaptivity with High Probability to Unknown Parameters, Unbounded Gradients and Affine Variance. (arXiv:2302.08783v2 [cs.LG] UPDATED)
• Deterministic Nonsmooth Nonconvex Optimization. (arXiv:2302.08300v1 [cs.LG])
• Improved Discretization Analysis for Underdamped Langevin Monte Carlo. (arXiv:2302.08049v1 [math.ST])
• Where to Diffuse, How to Diffuse, and How to Get Back: Automated Learning for Multivariate Diffusions. (arXiv:2302.07261v2 [cs.LG] UPDATED)
• Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent. (arXiv:2302.07125v1 [math.PR])
• Universal Guidance for Diffusion Models. (arXiv:2302.07121v1 [cs.CV])
• A Modern Look at the Relationship between Sharpness and Generalization. (arXiv:2302.07011v2 [cs.LG] UPDATED)
• Score-based Diffusion Models in Function Space. (arXiv:2302.07400v2 [cs.LG] UPDATED)
• The Geometry of Neural Nets' Parameter Spaces Under Reparametrization. (arXiv:2302.07384v3 [cs.LG] UPDATED)
• Linearized Wasserstein dimensionality reduction with approximation guarantees. (arXiv:2302.07373v1 [cs.LG])
• Covariance-modulated optimal transport and gradient flows. (arXiv:2302.07773v1 [math.AP])
• A new unified framework for designing convex optimization methods with prescribed theoretical convergence estimates: A numerical analysis approach. (arXiv:2302.07404v1 [math.OC])
• Beyond Statistical Similarity: Rethinking Metrics for Deep Generative Models in Engineering Design. (arXiv:2302.02913v4 [cs.LG] UPDATED)
• Vector Quantized Wasserstein Auto-Encoder. (arXiv:2302.05917v2 [cs.LG] UPDATED)
• From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks. (arXiv:2302.05882v1 [stat.ML])
• Verifying Generalization in Deep Learning. (arXiv:2302.05745v2 [cs.LG] UPDATED)
• Automated tight Lyapunov analysis for first-order methods. (arXiv:2302.06713v1 [math.OC])
• Symbolic Discovery of Optimization Algorithms. (arXiv:2302.06675v4 [cs.LG] UPDATED)
• Where to Diffuse, How to Diffuse, and How to Get Back: Automated Learning for Multivariate Diffusions. (arXiv:2302.07261v2 [cs.LG] UPDATED)
• Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Data. (arXiv:2302.07194v1 [cs.LG])
• Breaking the Lower Bound with (Little) Structure: Acceleration in Non-Convex Stochastic Optimization with Heavy-Tailed Noise. (arXiv:2302.06763v2 [cs.LG] UPDATED)
• Transport map unadjusted Langevin algorithms: learning and discretizing perturbed samplers. (arXiv:2302.07227v3 [stat.ME] UPDATED)
• Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent. (arXiv:2302.07125v1 [math.PR])
• A Unified View of Long-Sequence Models towards Modeling Million-Scale Dependencies. (arXiv:2302.06218v3 [cs.LG] UPDATED)
• Star-Shaped Denoising Diffusion Probabilistic Models. (arXiv:2302.05259v3 [stat.ML] UPDATED)
• The Monge Gap: A Regularizer to Learn All Transport Maps. (arXiv:2302.04953v1 [cs.LG])
• Heckerthoughts. (arXiv:2302.05449v5 [cs.AI] UPDATED)
• GFlowNet-EM for learning compositional latent variable models. (arXiv:2302.06576v2 [cs.LG] UPDATED)
• Achieving acceleration despite very noisy gradients. (arXiv:2302.05515v2 [stat.ML] UPDATED)
• Bregman-Wasserstein divergence: geometry and applications. (arXiv:2302.05833v1 [math.PR])
• DynGFN: Towards Bayesian Inference of Gene Regulatory Networks with GFlowNets. (arXiv:2302.04178v4 [cs.LG] UPDATED)
• UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Models. (arXiv:2302.04867v4 [cs.LG] UPDATED)
• On Sampling with Approximate Transport Maps. (arXiv:2302.04763v2 [stat.ML] UPDATED)
• Geometry of Score Based Generative Models. (arXiv:2302.04411v1 [cs.LG])
• On a continuous time model of gradient descent dynamics and instability in deep learning. (arXiv:2302.01952v3 [stat.ML] UPDATED)
• Wasserstein-$1$ distance between SDEs driven by Brownian motion and stable processes. (arXiv:2302.03372v1 [math.PR])
• Sharp Lower Bounds on Interpolation by Deep ReLU Neural Networks at Irregularly Spaced Data. (arXiv:2302.00834v1 [cs.LG])
• A Theoretical Justification for Image Inpainting using Denoising Diffusion Probabilistic Models. (arXiv:2302.01217v1 [stat.ML])
• High-Probability Bounds for Stochastic Optimization and Variational Inequalities: the Case of Unbounded Variance. (arXiv:2302.00999v2 [math.OC] UPDATED)
• Implicit regularization in Heavy-ball momentum accelerated stochastic gradient descent. (arXiv:2302.00849v1 [cs.LG])
• Stable Target Field for Reduced Variance Score Estimation in Diffusion Models. (arXiv:2302.00670v2 [cs.LG] UPDATED)
• Accelerated First-Order Optimization under Nonlinear Constraints. (arXiv:2302.00316v2 [math.OC] UPDATED)
• ERA-Solver: Error-Robust Adams Solver for Fast Sampling of Diffusion Probabilistic Models. (arXiv:2301.12935v3 [cs.LG] UPDATED)
• On the Stability of General Bayesian Inference. (arXiv:2301.13701v1 [stat.ME])
• Unifying Generative Models with GFlowNets and Beyond. (arXiv:2209.02606v2 [cs.LG] UPDATED)
• Dissecting the Effects of SGD Noise in Distinct Regimes of Deep Learning. (arXiv:2301.13703v2 [cs.LG] UPDATED)
• Continuous Spatiotemporal Transformers. (arXiv:2301.13338v2 [cs.LG] UPDATED)
• GFlowNets and variational inference. (arXiv:2210.00580v3 [cs.LG] UPDATED)
• Don't Play Favorites: Minority Guidance for Diffusion Models. (arXiv:2301.12334v1 [cs.LG])
• On the Lipschitz Constant of Deep Networks and Double Descent. (arXiv:2301.12309v4 [cs.LG] UPDATED)
• A theory of continuous generative flow networks. (arXiv:2301.12594v2 [cs.LG] UPDATED)
• Minimizing Trajectory Curvature of ODE-based Generative Models. (arXiv:2301.12003v3 [cs.LG] UPDATED)
• Accelerating Guided Diffusion Sampling with Splitting Numerical Methods. (arXiv:2301.11558v1 [cs.CV])
• Image Restoration with Mean-Reverting Stochastic Differential Equations. (arXiv:2301.11699v3 [cs.LG] UPDATED)
• A Denoising Diffusion Model for Fluid Field Prediction. (arXiv:2301.11661v2 [cs.LG] UPDATED)
• Simple diffusion: End-to-end diffusion for high resolution images. (arXiv:2301.11093v2 [cs.CV] UPDATED)
• On the Importance of Noise Scheduling for Diffusion Models. (arXiv:2301.10972v4 [cs.CV] UPDATED)
• Handbook of Convergence Theorems for (Stochastic) Gradient Methods. (arXiv:2301.11235v2 [math.OC] UPDATED)
• Simple diffusion: End-to-end diffusion for high resolution images. (arXiv:2301.11093v2 [cs.CV] UPDATED)
• On the Mathematics of Diffusion Models. (arXiv:2301.11108v3 [cs.LG] UPDATED)
• The Backpropagation algorithm for a math student. (arXiv:2301.09977v3 [cs.LG] UPDATED)
• A New Approach to Learning Linear Dynamical Systems. (arXiv:2301.09519v1 [math.OC])
• Deep Learning Meets Sparse Regularization: A Signal Processing Perspective. (arXiv:2301.09554v3 [stat.ML] UPDATED)
• On Investigating the Conservative Property of Score-Based Generative Models. (arXiv:2209.12753v3 [cs.LG] UPDATED)
• Latent Autoregressive Source Separation. (arXiv:2301.08562v1 [cs.LG])
• Discrete Variational Calculus for Accelerated Optimization
• A Nonstochastic Control Approach to Optimization. (arXiv:2301.07902v3 [cs.LG] UPDATED)
• Mathematical analysis of singularities in the diffusion model under the submanifold assumption. (arXiv:2301.07882v3 [cs.LG] UPDATED)
• On backpropagating Hessians through ODEs. (arXiv:2301.08085v1 [math.OC])
• Kinetic Langevin MCMC Sampling Without Gradient Lipschitz Continuity -- the Strongly Convex Case. (arXiv:2301.08039v1 [math.PR])
• Discrete Latent Structure in Neural Networks. (arXiv:2301.07473v1 [cs.LG])
• Image Embedding for Denoising Generative Models. (arXiv:2301.07485v1 [cs.CV])
• Transformers as Algorithms: Generalization and Stability in In-context Learning. (arXiv:2301.07067v2 [cs.LG] UPDATED)
• Word Embeddings as Statistical Estimators. (arXiv:2301.06710v1 [stat.ME])
• Geometric ergodicity of SGLD via reflection coupling. (arXiv:2301.06769v1 [math.PR])
• Computability of Optimizers. (arXiv:2301.06148v1 [math.OC])
• An Accelerated Lyapunov Function for Polyak's Heavy-Ball on Convex Quadratics. (arXiv:2301.05799v1 [math.OC])
• Min-Max Optimization Made Simple: Approximating the Proximal Point Method via Contraction Maps. (arXiv:2301.03931v2 [cs.GT] UPDATED)
• Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generation. (arXiv:2301.03396v2 [cs.CV] UPDATED)
• Sharper Analysis for Minibatch Stochastic Proximal Point Methods: Stability, Smoothness, and Deviation. (arXiv:2301.03125v1 [stat.ML])
• Stochastic Langevin Monte Carlo for (weakly) log-concave posterior distributions. (arXiv:2301.03077v1 [stat.ML])
• Perron-Frobenius operator filter for stochastic dynamical systems. (arXiv:2301.03080v1 [math.NA])
• Training trajectories, mini-batch losses and the curious role of the learning rate. (arXiv:2301.02312v2 [cs.LG] UPDATED)
• Optimal Scaling Results for a Wide Class of Proximal MALA Algorithms. (arXiv:2301.02446v2 [stat.CO] UPDATED)
• Convergence rates of the stochastic alternating algorithm for bi-objective optimization. (arXiv:2203.10605v2 [math.OC] UPDATED)
• Restarts subject to approximate sharpness: A parameter-free and optimal scheme for first-order methods. (arXiv:2301.02268v1 [math.OC])
• Deep Learning and Computational Physics (Lecture Notes). (arXiv:2301.00942v1 [cs.LG])
• A Tutorial on Parametric Variational Inference. (arXiv:2301.01236v1 [stat.ML])
• A Survey of Feedback Particle Filter and related Controlled Interacting Particle Systems (CIPS). (arXiv:2301.00935v2 [eess.SY] UPDATED)
• Exploring Complex Dynamical Systems via Nonconvex Optimization. (arXiv:2301.00923v1 [cs.LG])
• Fast convex optimization via closed-loop time scaling of gradient dynamics. (arXiv:2301.00701v1 [math.OC])
• Posterior Collapse and Latent Variable Non-identifiability. (arXiv:2301.00537v1 [stat.ML])
• Pruning Before Training May Improve Generalization, Provably. (arXiv:2301.00335v3 [cs.LG] UPDATED)
• The Stable Artist: Steering Semantics in Diffusion Latent Space. (arXiv:2212.06013v3 [cs.CV] UPDATED)
• A Dynamics Theory of Implicit Regularization in Deep Low-Rank Matrix Factorization. (arXiv:2212.14150v2 [cs.LG] UPDATED)
• Hungry Hungry Hippos: Towards Language Modeling with State Space Models. (arXiv:2212.14052v3 [cs.LG] UPDATED)
• Can Direct Latent Model Learning Solve Linear Quadratic Gaussian Control?. (arXiv:2212.14511v1 [cs.LG])
• Gaussian Process Priors for Systems of Linear Partial Differential Equations with Constant Coefficients. (arXiv:2212.14319v4 [stat.ML] UPDATED)