Knowledge Graph — Coursera Notes › Academic disciplines › Computer Science / Information Technology › Artificial Intelligence › Deep Learning

Transformer

concept · part of Deep Learning

Underlying architecture of modern LLMs

Inside Transformer (2)

• BERT — A Transformer variant used for text classification, translation, summarization, and generation.
• Self-attention — Mechanism in transformers that weighs the importance of different words in a sequence.

Connections

• Alternative to RNN
• Related to Deep Learning
• Related to BERT
• Related to GPT
• Related to Self-attention
• Related to BERT
• Related to GPT

This is the text view of an interactive 3D knowledge graph — open this page with JavaScript enabled to explore it visually.