← Back to Home

#docker

2 entries with this tag

📚 wiki2026-06-18T00:00:00.000Z

HOW-TO: Deploy a Local LLM API Server with vLLM

Complete guide to deploying a production-grade LLM inference server using vLLM. Covers installation, Docker deployment, multi-GPU tensor parallelism, quantization, performance tuning, and OpenAI-compatible API integration.

#howto#vllm#llm-serving#docker#gpu#inference#api#deployment#production
📚 wiki2026-03-21T00:00:00.000Z

GitHub Actions Docker Build and ECR Push

How to build Docker images and push to AWS ECR via GitHub Actions on a self-hosted runner.

#github#ci#docker#ecr#aws