2024 LLVM Dev Mtg - When unsafe code is slow - Automatic Differentiation in Rust

2024 LLVM Developers' Meeting https://llvm.org/devmtg/2024-10/ ------ When unsafe code is slow - Automatic Differentiation in Rust Speaker: Manuel Drehwald ------ Slides: https://llvm.org/devmtg/2024-10/slides/techtalk/Drehwald-AutomaticDifferentiation-in-Rust.pdf ----- Automatic Differentiation was accepted as an experimental Rust feature for HPC, ML, and Scientific Computing applications. We present Rust-Enzyme, an LLVM-based autodiff tool and show that differentiating idiomatic Rust can lead to significantly better performance than differentiating similar C++ code. We will discuss rustc, LLVM, JAX, Enzyme and C++ limitations to explain benchmark differences and prove that old performance assumptions for libraries and languages won't hold when compiler-based automatic differentiation is applied. ----- Videos Edited by Bash Films: http://www.BashFilms.com