Anthropic just told us where the inference money is going, and it's not where most people expected.
Three years ago, running a GPT-4-class model cost roughly 20 per million tokens. Today the same caliber of output runs at 0.