Geometric Adam: A Ray Tracing-Inspired Approach to Neural Network Optimization
Based on the paper: Geometric Adam: Ray Tracing-Inspired Adaptive Optimization by Jaepil Jeong, Cognica Inc. Introduction In the pursuit of stable neural network optimization, we often look to mathematics for inspiration. But what if the answer lies in physics? This research essay explores Geometric Adam, a novel optimizer that draws