Automatic Differentiation of Tensor Expressions
Automatic Differentiation of Tensor Expressions
- Datum: 19.06.2019
- Uhrzeit: 11:30
- Vortragende(r): Dr. Sören Laue
- Fakultät für Mathematik und Informatik, Universität Jena, Germany
- Ort: Max Planck Institute of Quantum Optics
- Raum: Herbert Walther Lecture Hall
Automatic differentiation is a powerful tool that allows to compute derivatives not only of mathematical expressions but also of functions that are given as a computer program.
While it has been used successfully in many areas it has recently gained considerable attention in the area of machine learning, especially in deep learning. In this talk, I will provide an introduction into the concept of automatic differentiation, explain the different algorithms for computing derivatives of computer programs, and provide examples. I will then focus on computing derivatives of problems involving not only scalars, but also vectors, matrices, and higher-order tensors. Finally, I will highlight the application of automatic differentiation to tensor networks.