World Model · podcast knowledge graph

Attention Is All You Need book

5 mentions · across 2 shows

"Attention Is All You Need" is a 2017 research paper on machine learning authored by eight scientists and engineers working at Google. The paper introduced a new deep learning architecture known as the transformer, based on the attention mechanism proposed in 2014 by Bahdanau et al. The transformer approach it describes has become the main architecture of a wide variety of artificial intelligence systems, including large language models. At the time, the focus of the research was on improving Seq2seq techniques for machine translation, but the authors went further in the paper, foreseeing the technique's potential for other tasks like question answering and what is now known as multimodal ge

https://en.wikipedia.org/wiki/Attention_Is_All_You_Need

Relationship map

Connections 4

mentioned 2

authored 2

Heard in

Mentioned in episodes

All extracted evidence for this entity (4)
description:book-authored Can Open Source Keep AI Power From Concentrating?
co-author of Attention Is All You Need
description:book-authored A Positive Vision for the Future: Part 2 with Illia Polosukh
co-author of "Attention Is All You Need"
description:book-authored Can Open Source Keep AI Power From Concentrating?
co-author of Attention Is All You Need
description:book-authored A Positive Vision for the Future: Part 2 with Illia Polosukh
co-author of "Attention Is All You Need"