#production

2 entries with this tag

📚 wiki2026-06-18T00:00:00.000Z

HOW-TO: Deploy a Local LLM API Server with vLLM

Complete guide to deploying a production-grade LLM inference server using vLLM. Covers installation, Docker deployment, multi-GPU tensor parallelism, quantization, performance tuning, and OpenAI-compatible API integration.

#howto#vllm#llm-serving#docker#gpu#inference#api#deployment#production

🔬 research2026-04-13T00:00:00.000Z

Open-Source LLM Deployment Architectures (2026)

Practical architectures for deploying open-source LLMs at scale. Covers local development, multi-GPU scaling, cloud-native deployment, managed services, and serverless approaches with performance benchmarks and TCO analysis.

#ai#llm#deployment#infrastructure#mlops#open-source#production#kubernetes