TL;DR of the paper, generated automatically.

Flide is an inference engine that speeds up decision-model LLM agents.

• Speed: up to 9.5x faster than vLLM and SGLang, the paper says.
• Exact: branch results match an isolated forward pass, in exact arithmetic.
• Models: 30+ open-source decision models, per the authors.