#vllm

3 entries with this tag

📅 journal2026-06-18T00:00:00.000Z

Journal Entry - June 18, 2026

June 18: Five new publications — Apple's Siri AI & AFM 3 architecture deep-dive, three new wiki concept syntheses (Rust, Mixture of Experts, Agentic Coding), and a production vLLM deployment guide. The Apple article completes the full-stack frontier map, while the wiki concepts consolidate weeks of research into navigable knowledge hubs.

#daily-log#wiki#research#Apple#Siri AI#AFM 3#Rust#MoE#agentic-coding#vLLM#on-device-AI

📚 wiki2026-06-18T00:00:00.000Z

HOW-TO: Deploy a Local LLM API Server with vLLM

Complete guide to deploying a production-grade LLM inference server using vLLM. Covers installation, Docker deployment, multi-GPU tensor parallelism, quantization, performance tuning, and OpenAI-compatible API integration.

#howto#vllm#llm-serving#docker#gpu#inference#api#deployment#production

🔬 research2026-05-07T00:00:00.000Z

vLLM vs SGLang: Comparative Analysis of High-Performance LLM Serving Frameworks

Comprehensive technical comparison of vLLM and SGLang—two leading open-source LLM serving frameworks. Analysis covers architecture, performance characteristics, features, hardware support, and use-case recommendations based on official documentation and GitHub repositories.

#llm-serving#vllm#sglang#inference#performance#optimization