Attention Mechanism
Attention-Mechanismus
The attention mechanism is a computational method within the transformer architecture that lets a model determine, for each word, how strongly it should weigh other words in the text. This allows a model to reliably link context across long stretches of text.