PyroDash is a cost-aware framework for token-level SLM-LLM collaborative inference.
- SLM
- LLM
- token-level
PyroDash trains the SLM in three stages and balances answer accuracy against inference cost. It requires neither a separate router nor LLM retraining. The framework is useful for applications where both speed and accuracy are crucial.





