Optimization methods form the backbone of numerical analysis, enabling the efficient solution of problems across engineering, data science, physics and beyond. At their core lie gradient-based ...