furiosa-llm
OpenAI-compatible LLM serving stack for FuriosaAI RNGD accelerators
Community-submitted · content unverified. This organization has not verified ownership or the information in this profile.
About
furiosa-llm is FuriosaAI's inference serving software for RNGD hardware. Installed via pip, it serves pre-compiled models behind an OpenAI-compatible endpoint and a Python API, so existing clients can point at a new base URL without rewriting code. It is part of the Furiosa SDK and documentation, which also cover deployment and lower-level programming of the accelerators.
- Website
- furiosa.ai/developers
- Added via
- web
- Ownership
- unclaimed
Where to go
For people
- Homepagefuriosa.ai/developers
For agents
Nothing listed yet.
Product details
- Product kind
- Developer Tool