Token-Maxxing and Inference Ops: The New FinOps Frontier
A Head of Product at a major sportswear retailer has a brilliant idea: let’s build an app that sales staff on the shop floor can have on their tablets, and ask their questions there and then, where they serve customers. They set about building. In order for the app to answer questions, it needs to have the information from the 2026 Spring/Summer Catalogue, a mammoth manual, let’s say 300k tokens.