Prompt Caching, Explained: Why Your AI Chatbot Gets Cheaper and Faster the Longer You Talk to It

AI models have no memory, so you resend the whole conversation on every message and the model re-reads it from scratch. Prompt caching is the fix — reuse the computation for the unchanged prefix and cut API costs 50–90%. Here's what's actually being cached, and the attention math behind why it works.