Otoroshi 17.8 is available, with budget management for AI models

Otoroshi v17.8 is available with multiple improvements and bug fixes. It comes with LLM extension 0.0.55 which introduces inline functions in all models and budget management for AI services. Thus, you can now defines limits to AI provider usage per API key, user, kind of models, etc.

You can update through add-on’s dashboard in the Clever Cloud Console. You can also set CC_OTOROSHI_VERSION of the underlying Java application to v17.8.0_1762533533 and rebuild it, or use Clever Tools:

clever features enable operators

clever otoroshi version check yourOtoroshiNameOrId
clever otoroshi version update yourOtoroshiNameOrId
clever otoroshi version update yourOtoroshiNameOrId v17.8.0_1762533533

• Learn more about Otoroshi with LLM on Clever Cloud
• Learn more about Budget management for AI models in Otoroshi