AI glossary
Attention Mechanism
A model component that weighs the relevance of different parts of an input while producing an output.
Definition
A model component that weighs the relevance of different parts of an input while producing an output.
Reviewed 2026-08-05