Why do smells bring back memories?

Because smell takes a shortcut. Most senses pass through a relay station in the brain before reaching the areas that handle memory and emotion. Smell arrives there almost directly.

So a scent can reach the feeling before it reaches the thought, and you are somewhere else before you have worked out why. Each smell is real molecules of the thing itself, drifting in and landing in your nose like tiny letters.