Skip to content
ISBN: B0HGTKNN58
ISBN13: 9798194836192

llama.cpp Projects Handbook: Run, Quantize, Optimize, and Deploy Local Large Language Models with GGUF, CPU and GPU Acceleration, APIs, RAG, Agents, a

$34.39List Price: $34.98
Save $0.59!
ISBN: B0HGTKNN58
ISBN13: 9798194836192
Formats

Conditions

A brand-new, unused copy in perfect condition.

Formats

Conditions

A brand-new, unused copy in perfect condition.

See all 1 editionsfrom $34.39

Book Overview

Run powerful large language models locally-and turn llama.cpp into practical, private AI systems you can actually deploy.

llama.cpp Projects Handbook is a hands-on guide to running, optimizing, and building applications with local large language models using llama.cpp and GGUF. Instead of stopping at basic model execution, this book takes you from your first local inference session to a complete private AI platform with APIs, retrieval-augmented generation, controlled agents, performance tuning, security, monitoring, and deployment.

You will learn how to choose models that fit your hardware, understand GGUF, convert and quantize models, optimize inference across CPUs and GPUs, configure hybrid and multi-GPU workloads, benchmark performance, and serve models through llama-server.

Through five connected projects, you will build:

  • A private local AI assistant
  • A browser-based local chat application
  • A private document assistant using RAG, embeddings, semantic search, and reranking
  • A controlled tool-using AI agent with permissions and approval boundaries
  • A production-ready private AI platform with authentication, observability, testing, and rollback

Along the way, you will master chat templates, tokenization, sampling, context windows, KV cache management, structured JSON output, function calling, model adapters, CPU optimization, GPU acceleration, and model benchmarking.

Every important command, configuration, script, prompt, schema, and project component is included in the book, so you can follow the projects without depending on a companion repository.

Whether you are a developer, AI engineer, systems professional, researcher, DevOps engineer, or local AI enthusiast, this book gives you the practical skills to move beyond simply running a model and start engineering local AI systems that are measurable, secure, reproducible, and useful.

Build local AI on your hardware. Control your models. Protect your data. Measure performance. Deploy with confidence.

Format:
Paperback
Language:
English
ISBN:
B0HGTKNN58
ISBN13:
9798194836192
Release Date:
August 2026
Publisher:
Independently Published
Length:
450 Pages
Weight:
2.28 lbs.
Dimensions:
0.9″ × 8.5″ × 11.0″
ComputersComputers & Technology

More by Tavian Rellor

Customer Reviews

0 customer ratings | 0 reviews
Write a Review

There are currently no reviews. Be the first to review this work.