Author: Guido Visser

Transformers: AI with attention

AI is a fast growing field. New techniques are developed every day and also those techniques are being applied in many fields in new and creative ways. Historically, AI has known bursts of extremely fast innovation when new and powerful techniques came to light. We are at the start of one of those bursts because of the development of the Transformer architecture for neural networks. GPT-3 has shown the impact that this new technique can have on the field of Natural Language Processing. In this blog I will give you some intuition into what sets this architecture apart from other architectures and help you understand why I think we will see a new revolution across many fields of AI because of the Transformer.


This website uses cookies to ensure you get the best experience on our website.