Equivariant Neural Networks | Part 3/3 - Transformers and GNNs

▬▬ Papers / Resources ▬▬▬ SchNet: https://arxiv.org/abs/1706.08566 SE(3) Transformer: https://arxiv.org/abs/2006.10503 Tensor Field Network: https://arxiv.org/abs/1802.08219 Spherical Harmonics Youtube Video: https://www.youtube.com/watch?v=EcKgJhFdtEY&ab_channel=BJBodner Spherical Harmonics Formula: https://www.youtube.com/watch?v=5PMqf3Hj-Aw&ab_channel=ProfessorMdoesScience Tensor Field Network Jupyter Notebook: https://github.com/UPEIChemistry/tensor-field-networks/blob/master/tutorials/tutorial.ipynb SE(3) Repo: https://github.com/FabianFuchsML/se3-transformer-public/ NVIDIA Updated Version: https://developer.nvidia.com/blog/accelerating-se3-transformers-training-using-an-nvidia-open-source-model-implementation/ ▬▬ Used Music ▬▬▬▬▬▬▬▬▬▬▬ Music from #Uppbeat (free for Creators!): https://uppbeat.io/t/yokonap/birds License code: WXVHOOZRRWDUCKIU ▬▬ Used Icons ▬▬▬▬▬▬▬▬▬▬ All Icons are from flaticon: https://www.flaticon.com/authors/freepik ▬▬ Timestamps ▬▬▬▬▬▬▬▬▬▬▬ 00:00 Introduction 00:43 Points, Graphs and Sets 01:11 Inductive Biases & Equivariance 03:15 3D is not commutative 04:38 SchNet 05:48 Tensor Field Networks 07:17 Math Terminology 12:47 Hands on TFNs 13:08 SE(3) Transformer 15:24 Hands on SE(3) Transf ▬▬ Support me if you like 🌟 ►Link to this channel: https://bit.ly/3zEqL1W ►Support me on Patreon: https://bit.ly/2Wed242 ►Buy me a coffee on Ko-Fi: https://bit.ly/3kJYEdl ►E-Mail: [email protected] ▬▬ My equipment 💻 - Microphone: https://amzn.to/3DVqB8H - Microphone mount: https://amzn.to/3BWUcOJ - Monitors: https://amzn.to/3G2Jjgr - Monitor mount: https://amzn.to/3AWGIAY - Height-adjustable table: https://amzn.to/3aUysXC - Ergonomic chair: https://amzn.to/3phQg7r - PC case: https://amzn.to/3jdlI2Y - GPU: https://amzn.to/3AWyzwy - Keyboard: https://amzn.to/2XskWHP - Bluelight filter glasses: https://amzn.to/3pj0fK2