Optimize token usage and reduce API costs for long-running AI agent workflows
By compressing and summarizing conversation history using configurable summarizer models, Context Gateway reduces the number of tokens sent to the LLM API on each request, lowering overall API costs while maintaining conversation context
