Prompt Caching Doesn't Just Save Money. It Lets You Run 20K-Token System Prompts. | HackerNoon

2 weeks ago

Prompt caching on Claude and GPT cuts costs 10x. The bigger win: you stop trimming system prompts and start writing them the way you'd write a …