Attention Is All You Need book
5 mentions · across 2 shows
As an Amazon Associate we earn from qualifying purchases.
"Attention Is All You Need" is a 2017 research paper on machine learning authored by eight scientists and engineers working at Google. The paper introduced a new deep learning architecture known as the transformer, based on the attention mechanism proposed in 2014 by Bahdanau et al. The transformer approach it describes has become the main architecture of a wide variety of artificial intelligence systems, including large language models. At the time, the focus of the research was on improving Seq2seq techniques for machine translation, but the authors went further in the paper, foreseeing the technique's potential for other tasks like question answering and what is now known as multimodal ge
https://en.wikipedia.org/wiki/Attention_Is_All_You_Need
Relationship map
Connections 4
mentioned 2
-
0.72 · ×2
evidence rules-v4
co-author of Attention Is All You Need
Can Open Source Keep AI Power From Concentrating? · 2026-09-07 -
0.72 · ×2
evidence rules-v4
co-author of "Attention Is All You Need"
authored 2
-
0.62 · ×2
evidence rules-v4
co-author of Attention Is All You Need
Can Open Source Keep AI Power From Concentrating? · 2026-09-07 -
0.62 · ×2
evidence rules-v4
co-author of "Attention Is All You Need"
Heard in
- The a16z Show1 episode
- "The Cognitive Revolution"1 episode
Mentioned in episodes
-
2026-09-07 · The a16z Show · via authored · 0.62
co-author of Attention Is All You Need
-
2026-09-07 · The a16z Show · via mentioned · 0.72
co-author of Attention Is All You Need
-
2025-10-25 · "The Cognitive Revolution" · via authored · 0.62
co-author of "Attention Is All You Need"
-
2025-10-25 · "The Cognitive Revolution" · via mentioned · 0.72
co-author of "Attention Is All You Need"
All extracted evidence for this entity (4)
co-author of Attention Is All You Need
co-author of "Attention Is All You Need"
co-author of Attention Is All You Need
co-author of "Attention Is All You Need"