All Serving Listings
Loading
...
Loading
...
Loading
...
Loading
...
Loading
...
Loading
...
Internal link to /explore/gateway
gateway
A Blazing Fast AI Gateway with integrated Guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Internal link to /explore/gptcache
GPTCache
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
Internal link to /explore/vllm
VLLM
A high-throughput and memory-efficient inference and serving engine for LLMs
Internal link to /explore/text-generation-inference
text-generation-inference
Large Language Model Text Generation Inference
Internal link to /explore/inference
inference
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
Internal link to /explore/lmdeploy
lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Internal link to /explore/text-embeddings-inference
text-embeddings-inference
A blazing fast inference solution for text embeddings models
Internal link to /explore/openvino
openvino
OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
Internal link to /explore/openllm
OpenLLM
Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
Listings per page
Showing1 - 11of11listings
Page 1 of 1