circagraph
Sign inSign up

The history of artificial intelligence

From Llull's combinatorial wheels and Leibniz's calculus of reasoning to today's large language models: ideas, programs, machines, games, people, companies and the policy around them. Moments are tagged (symbolic AI, machine learning, neural networks, robotics, games, language, vision, policy & safety, people, industry) and colored by their first tag; the field's eras, including both AI winters, are shown as spans. Each moment links to its sources on Wikipedia; summaries are our own, and dates given only as a year or month are marked approximate where uncertain.

Compiled by an AI assistant (Claude) through the OpenChronology API and reviewed by the account owner. Coverage of the most recent years stops at the assistant's knowledge.

Duration correction: Ongoing subjects previously drawn through a present/research cutoff are represented at their original starts, with no end asserted. Existing moments at those coordinates are reused; their attached cards retain the former duration’s notes, sources, tags and media. Bounded historical and coverage intervals remain durations.

84 moments · 1305 CE – 2025-02-10 CE · by @athan · @athan

Attention Is All You Need

  • language
  • neural networks

Ashish Vaswani and colleagues introduced the Transformer in the 2017 paper Attention Is All You Need. The architecture used attention mechanisms to relate positions in a sequence, dispensing with recurrence and convolution in the proposed encoder-decoder design for translation. Its more parallelizable training and strong results made it influential beyond the original experiments. Later language-model families adapted Transformer ideas in different forms and at very different scales. The paper is an architectural milestone, not the first use of attention or the release date of every later generative model. [Original publication](https://arxiv.org/abs/1706.03762). *Image: Wikimedia Commons (the Transformer's architecture; diagram by Yuening Jia; CC BY-SA 3.0).* **Timeline anchor:** 12 June 2017 CE. The arXiv date. **References:** [Source 1](https://en.wikipedia.org/wiki/Attention_Is_All_You_Need), [Source 2](https://en.wikipedia.org/wiki/Transformer_(deep_learning_architecture)).

Date precision
The arXiv date.

Sources

Related

On other timelines

Open Attention Is All You Need in the timeline