word
Transformer model
trans-FOR-mer MOD-ul
/trænsˈfɔːrmər ˈmɒdəl/Listen
Hear it in a clear American voice. Slow it down to catch each syllable.
Syllable breakdown
transformermodel
Dictionary meaning
A deep learning architecture introduced in 2017 that uses self-attention mechanisms to process sequential data, enabling models to capture long-range dependencies in text without relying on recurrence, and forming the foundation of modern large language models such as BERT and GPT.
Examples
- The transformer model revolutionised NLP by allowing parallel processing of entire sequences.
- Most state-of-the-art language models today are built on the transformer architecture.
Synonyms: attention model, self-attention model
Pronunciation tips
The original transformer paper is titled 'Attention Is All You Need' (Vaswani et al., 2017).
Learn one new pronunciation a day
Get a word, name or idiom like “Transformer model” in your inbox — daily or weekly, free. Unsubscribe any time.
Something wrong? Suggest a correction