My Wish Lists Login / Join

ONNX Runtime GenAI

Portable Inference Across CPU, GPU, and Edge

By: Trex Team

Write A Review

Paperback | 24 June 2026

At a Glance

Format
Paperback

Dimensions(cm)
22.9 x 15.2 x 1.39

Paperback

$75.99

or 4 interest-free payments of $19.00 with

Ships in 10 to 15 business days

"ONNX Runtime GenAI: Portable Inference Across CPU, GPU, and Edge"

Modern AI systems rarely live on a single hardware target. They must run correctly and efficiently across CPUs, GPUs, mobile devices, and specialized edge accelerators-often while serving increasingly demanding generative workloads. This book is written for experienced practitioners who already know the basics of model deployment and now need a rigorous, architecture-level guide to making ONNX Runtime and ONNX Runtime GenAI work reliably in heterogeneous environments.

Readers will build a deep understanding of ONNX Runtime's execution model, inference sessions, execution providers, graph partitioning, and optimization pipeline, then apply that knowledge to real deployment decisions: choosing between ONNX and ORT formats, tuning CPU and GPU backends, diagnosing fallback and operator gaps, engineering reproducible environments, and optimizing performance under production constraints. The book also covers edge and mobile deployment, quantization, and the full GenAI packaging and generation workflow for portable large-model inference.

Rather than treating portability as a marketing promise, this book treats it as an engineering discipline shaped by compatibility boundaries, hardware capabilities, memory behavior, and version-sensitive tooling. Its focus is practical and advanced: not just how to run a model, but how to design, measure, debug, and evolve portable inference systems that remain dependable as runtimes, providers, and model artifacts change.

Shipping

	Standard Shipping	Express Shipping
Metro postcodes:	$9.99	$14.95
Regional postcodes:	$9.99	$14.95
Rural postcodes:	$9.99	$14.95

How to return your order

At Booktopia, we offer hassle-free returns in accordance with our returns policy. If you wish to return an item, please get in touch with Booktopia Customer Care.

Additional postage charges may be applicable.