Skip to content

Attention

[!question]+ What is attention? Attention Mechanism is an attempt to implement the same action of selectively concentrating on a few relevant things while ignoring others in deep neural networks

[!question]+ Why is Attention needed in deep learning ?

Self-Attention

  • intra-attention