How a transformer model actually works

Attention is not the model reading your text like a person. It is a weighted lookup that lets every word pull context from every other word at once.