Deepmind released overview of transformer architecture and algorithm

This describes what they are, how they are trained and what they are used for. Also key architectural components.

https://arxiv.org/abs/2207.09238