The Batch API processes large sets of requests asynchronously at lower cost than real-time calls.
You submit many prompts at once and collect the results later, trading latency for throughput and savings. It suits evaluations, bulk generation, and offline pipelines. It complements streaming, which is for interactive use.