> ## Documentation Index
> Fetch the complete documentation index at: https://agno-v2-studio-tools-doc.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Vllm

> vLLM is a fast and easy-to-use library for running LLM models locally.

| Example                                                              | Description                                                                                                                      |
| -------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------- |
| [Vllm Basic](/examples/models/vllm/basic)                            | Cookbook example for `vllm/basic.py`.                                                                                            |
| [Code Generation](/examples/models/vllm/code-generation)             | Run vLLM model: vllm serve deepseek-ai/deepseek-coder-6.7b-instruct         --dtype float32         --tool-call-parser pythonic. |
| [Db](/examples/models/vllm/db)                                       | Vllm model example.                                                                                                              |
| [Memory](/examples/models/vllm/memory)                               | Prerequisites: 1.                                                                                                                |
| [Retry](/examples/models/vllm/retry)                                 | Example demonstrating how to set up retries with vLLM.                                                                           |
| [Vllm Structured Output](/examples/models/vllm/structured-output)    | Cookbook example for `vllm/structured_output.py`.                                                                                |
| [Build a Web Search Agent using xAI](/examples/models/vllm/tool-use) | Build a web search agent using vLLM.                                                                                             |