Adaptive Machine Learning Algorithms with Python

​Chapter 1. Introducing Data Representation FeaturesSet the context for the reader with important data representation features, present the need for adaptive algorithms to compute them and demonstrate how these algorithms are important in multiple disciplines. Additionally, discuss a common methodology adopted to derive all our algorithms.Sub-topics: 1. Data representation features2. Computational models for time-varying multi-dimensional data3. Multi-disciplinary origin of adaptive algorithms4. Common Methodology for Derivations of Algorithms5. Outline of The Book
Chapter 2. General Theories and NotationsIntroduce the reader to types of data in real-world streaming applications, discuss practical use cases and derive adaptive algorithms for mean, normalized mean, median, and covariances. Support the results with experiments on real data.Sub-topics: 1. Introduction2. Stationary and Non-Stationary Sequences3. Use Cases for Algorithms Covered in this Chapter 4. Adaptive Mean and Covariance of Nonstationary Sequences5. Adaptive Covariance and Inverses6. Adaptive Normalized Mean Algorithm7. Adaptive Median Algorithm8. Experimental Results
Chapter 3. Square Root and Inverse Square RootIntroduce readers to practical applications of square roots and inverse square roots of streaming data matrices, then present algorithms to compute them. Support the algorithms with real data.Sub-topics: 1. Introduction and Use Cases2. Adaptive Square Root Algorithms3. Adaptive Inverse Square Root Algorithms4. Experimental Results
Chapter 4. First Principal EigenvectorIntroduce the reader to adaptive computation of first principal component of streaming data, discuss the use cases with examples, derive ten algorithms with the common methodology adopted here. Demonstrate the algorithms with real-world non-stationary streaming data examples.Sub-topics: 1. Introduction and Use Cases2. Algorithms and Objective Functions3. OJA Algorithm4. RQ, OJAN, and LUO Algorithms5. IT and XU Algorithms6. Penalty Function Algorithm 7. Augmented Lagrangian Algorithms8. Summary of Algorithms9. Experimental Results
Chapter 5. Principal and Minor EigenvectorsIntroduce the reader to adaptive computation of all principal components, discuss powerful use cases with examples, derive 21 adaptive algorithms and demonstrate the algorithms on real-world time-varying data.Sub-topics: 1. Introduction and Use Cases2. Algorithms and Objective Functions3. OJA Algorithms4. XU Algorithms5. PF Algorithms6. AL1 Algorithms7. AL2 Algorithms8. IT Algorithms9. RQ Algorithms10. Summary of Adaptive Eigenvector Algorithms11. Experimental Results
Chapter 6. Accelerated Computation eigenvectorsIntroduce the reader to methods to speed up the adaptive algorithms presented in this book. Help the reader speed up a few algorithms and demonstrate their usefulness and acceleration on real-world stationery and non-stationary data.Sub-topics: 1. Introduction2. Gradient Descent Algorithm3. Steepest Descent Algorithm4. Conjugate Direction Algorithm5. Newton-Raphson Algorithm6. Experimental Results
Chapter 7. Generalized EigenvectorsIntroduce the reader to the adaptive computation of generalized eigenvectors of streaming data matrices in real-time applications. Dis