Optimization Algorithms for Distributed Machine Learning - Gauri Joshi

Optimization Algorithms for Distributed Machine Learning

By: Gauri Joshi

Paperback | 26 November 2022

At a Glance

Paperback


$130.75

or 4 interest-free payments of $32.69 with

 or 

Ships in 10 to 15 business days

This book discusses state-of-the-art stochastic optimization algorithms for distributed machine learning and analyzes their convergence speed. The book first introduces stochastic gradient descent (SGD) and its distributed version, synchronous SGD, where the task of computing gradients is divided across several worker nodes. The author discusses several algorithms that improve the scalability and communication efficiency of synchronous SGD, such as asynchronous SGD, local-update SGD, quantized and sparsified SGD, and decentralized SGD. For each of these algorithms, the book analyzes its error versus iterations convergence, and the runtime spent per iteration. The author shows that each of these strategies to reduce communication or synchronization delays encounters a fundamental trade-off between error and runtime.

More in Algorithms & Data Structures

Learning Algorithms : A Programmer's Guide to Writing Better Code - George Heineman
Python for Algorithmic Trading : From Idea to Cloud Deployment - Yves Hilpisch
Python Using GPT-5 and Gemini - Oswald Campesato
Fundamentals of Data Structures and Algorithms - Elvis C. Foster

RRP $380.00

$325.99

14%
OFF
Fundamentals of Data Structures and Algorithms - Elvis C. Foster

RRP $158.00

$141.75

10%
OFF
Hacker's Delight - Henry Warren

RRP $97.60

$74.75

23%
OFF
Quick Data Structures : Quick Programming - David Matuszek
AI Development : How Tech Leaders Can Build and Deploy Useful AI - Eva-Marie Muller-Stuler
Ciphers, Fractals, and Fibonacci : Exploring Math with Python - John Lehet
Computational Intractability : A Guide to Algorithmic Lower Bounds - MohammadTaghi Hajiaghayi
Deep Learning with R, Third Edition - Tomasz Kalinowski