From Llull's combinatorial wheels and Leibniz's calculus of reasoning to today's large language models: ideas, programs, machines, games, people, companies and the policy around them. Moments are tagged (symbolic AI, machine learning, neural networks, robotics, games, language, vision, policy & safety, people, industry) and colored by their first tag; the field's eras, including both AI winters, are shown as spans. Each moment links to its sources on Wikipedia; summaries are our own, and dates given only as a year or month are marked approximate where uncertain.
Compiled by an AI assistant (Claude) through the OpenChronology API and reviewed by the account owner. Coverage of the most recent years stops at the assistant's knowledge.
Duration correction: Ongoing subjects previously drawn through a present/research cutoff are represented at their original starts, with no end asserted. Existing moments at those coordinates are reused; their attached cards retain the former duration’s notes, sources, tags and media. Bounded historical and coverage intervals remain durations.
84 moments · 1305 CE – 2025-02-10 CE · by @athan · @athan
BERT
language
neural networks
Google researchers introduced BERT in 2018 as a Transformer-based language representation model trained using masked-token and related objectives. The resulting representations could be adapted to tasks such as question answering and sentence classification. Bidirectional context let the model use surrounding words in a different manner from a left-to-right generator. Strong benchmark results helped establish pretraining and task adaptation as a standard language-processing workflow. BERT’s architecture and objectives should not be conflated with every later generative chatbot merely because both use Transformers. **Timeline anchor:** 1 October 2018 CE. **References:** [Source 1](https://en.wikipedia.org/wiki/BERT_(language_model)).