Skip to content
Scan a barcode
Scan
Paperback Vllm Projects Handbook: Build, Serve, Optimize, and Scale Open LLMs with PagedAttention, Continuous Batching, Quantization, Multi-GPU Inference, OpenA Book

ISBN: B0HM6X94NY

ISBN13: 9798160701707

Vllm Projects Handbook: Build, Serve, Optimize, and Scale Open LLMs with PagedAttention, Continuous Batching, Quantization, Multi-GPU Inference, OpenA

vLLM PROJECTS HANDBOOK

Build, Serve, Optimize, and Scale Open LLMs with PagedAttention, Continuous Batching, Quantization, Multi-GPU Inference, OpenAI-Compatible APIs, and Kubernetes

Running an LLM is easy. Serving it efficiently, reliably, and at scale is the real challenge.

vLLM Projects Handbook is a practical, project-driven guide to building high-performance LLM inference systems with vLLM. Instead of isolated commands and unexplained tuning flags, you build one evolving system called RelayServe, taking it from a single-GPU inference engine to a production-ready platform.

Inside this book, you will learn how to:

Build OpenAI-compatible LLM APIs with vLLMUnderstand PagedAttention and continuous batchingMeasure TTFT, inter-token latency, throughput, queueing, and saturationOptimize KV-cache usage, prefix caching, and chunked prefillQuantize models and evaluate real performance trade-offsApply speculative decoding and hardware-aware tuningScale across multiple GPUs and multiple nodesUse tensor, pipeline, data, and expert parallelismServe LoRA adapters, embeddings, rerankers, structured outputs, tools, and multimodal modelsSecure and harden production inference servicesAdd metrics, logs, traces, SLOs, alerts, and capacity planningDeploy with containers and KubernetesImplement routing, autoscaling, rolling updates, and rollback

The book follows a clear engineering path:

RUN - SERVE - MEASURE - OPTIMIZE - SCALE - INTEGRATE - HARDEN - OBSERVE - DEPLOY

Every major improvement is measured against a baseline, helping you understand not only what to configure, but why it works and when it should be used.

Whether you are a Python developer, AI or ML engineer, DevOps professional, SRE, platform engineer, or technical learner, this book gives you a practical path from "the model runs" to a system you can benchmark, optimize, scale, secure, observe, deploy, and troubleshoot with confidence.

Build faster LLM inference. Measure what matters. Scale with evidence.

Recommended

Format: Paperback

Condition: New

$38.64
Save $1.35!
List Price $39.99
Ships within 2-3 days
Save to List

Customer Reviews

0 rating
Copyright © 2026 Thriftbooks.com Terms of Use | Privacy Policy | Do Not Sell/Share My Personal Information | Cookie Notice | Cookie Preferences | Accessibility Statement
ThriftBooks ® and the ThriftBooks ® logo are registered trademarks of Thrift Books Global, LLC
GoDaddy Verified and Secured