Information and Coding Theory

By: Gareth A. Jones, J.Mary Jones

Write A Review

Paperback | 1 July 2000

At a Glance

Paperback
228 Pages

Dimensions(cm)
24.3 x 17.3 x 1.3

Paperback

$64.99

or 4 interest-free payments of $16.25 with

or

Ships in 5 to 7 business days

This book provides an elementary introduction to Information Theory and Coding Theory - two related aspects of the problem of how to transmit information efficiently and accurately. The first part of the book focuses on Information Theory, covering uniquely decodable and instantaneous codes, Huffman coding, entropy, information channels, and Shannon's Fundamental Theorem. In the second part, on Coding Theory, linear algebra is used to construct examples of such codes, such as the Hamming, Hadamard, Golay and Reed-Muller codes.The book emphasises carefully explained proofs and worked examples; exercises (with solutions) are integrated into the text as part of the learning process. Only some basic probability theory and linear algebra, together with a little calculus (as covered in most first-year university syllabuses), is assumed, making it suitable for second- and third-year undergraduates in mathematics, electronics and computer science.

Shipping

	Standard Shipping	Express Shipping
Metro postcodes:	$9.99	$14.95
Regional postcodes:	$9.99	$14.95
Rural postcodes:	$9.99	$14.95

Orders over $49.00 qualify for free shipping.

How to return your order

At Booktopia, we offer hassle-free returns in accordance with our returns policy. If you wish to return an item, please get in touch with Booktopia Customer Care.

Additional postage charges may be applicable.

Defective items

If there is a problem with any of the items received for your order then the Booktopia Customer Care team is ready to assist you.

For more info please visit our Help Centre.

More in Information theory

Psycho-Cybernetics (Updated and Expanded)

Psycho-cybernetics

Paperback

RRP $26.99

$22.99

15%
OFF

Nexus

A Brief History of Information Networks from the Stone Age to AI

Paperback

RRP $29.99

$24.99

17%
OFF

Thinking in Systems

A Primer

Paperback

RRP $55.00

$30.75

44%
OFF

Spectra of Signed Graphs

London Mathematical Society Lecture Note Series

Paperback

RRP $99.95

$89.75

10%
OFF

Advances in Nonlinear Dynamics : Proceedings of the Fourth International Nonlinear Dynamics Conference (NODYCON 2025) , Volume 1 - Walter Lacarbonara

$28.75

18%
OFF

The Laws of Thought

The Quest for a Mathematical Theory of the Mind

Paperback

RRP $34.99

$28.75

18%
OFF

How to Prove It

A Structured Approach

Paperback

RRP $73.95

$70.75

The Infinite Alphabet

And the Laws of Knowledge

Hardcover

RRP $59.99

$45.75

24%
OFF

Effective Machine Learning Teams

Best Practices for ML Practitioners

Paperback

RRP $152.00

$121.60

20%
OFF

The Black Swan : The Impact of the Highly Improbable - Nassim Nicholas Taleb

$271.99

14%
OFF

Brain-Inspired AI for Sustainable Development

Knowledge-based Engineering for Innovation

Hardcover

RRP $294.00

$254.75

13%
OFF

Intelligent Manufacturing Systems

Digitalization of Industrial Production

Hardcover

RRP $315.00

$271.99

14%
OFF

An Introduction to Systems Biology

Design Principles of Biological Circuits

Paperback

RRP $133.00

$110.75

17%
OFF

Handbook of Systems Thinking Methods

Paperback

RRP $105.00

$88.75

15%
OFF

Handbook of Intelligent Robots

Theory, Methods and Applications

Hardcover

RRP $368.00

$315.99

14%
OFF

Preface	p. v
Notes to the Reader	p. xiii
Source Coding	p. 1
Definitions and Examples	p. 1
Uniquely Decodable Codes	p. 4
Instantaneous Codes	p. 9
Constructing Instantaneous Codes	p. 11
Kraft's Inequality	p. 13
McMillan's Inequality	p. 14
Comments on Kraft's and McMillan's Inequalities	p. 16
Supplementary Exercises	p. 17
Optimal Codes	p. 19
Optimality	p. 19
Binary Huffman Codes	p. 22
Average Word-length of Huffman Codes	p. 26
Optimality of Binary Huffman Codes	p. 27
r-ary Huffman Codes	p. 28
Extensions of Sources	p. 30
Supplementary Exercises	p. 32
Entropy	p. 35
Information and Entropy	p. 35
Properties of the Entropy Function	p. 40
Entropy and Average Word-length	p. 42
Shannon-Fano Coding	p. 45
Entropy of Extensions and Products	p. 47
Shannon's First Theorem	p. 48
An Example of Shannon's First Theorem	p. 49
Supplementary Exercises	p. 51
Information Channels	p. 55
Notation and Definitions	p. 55
The Binary Symmetric Channel	p. 60
System Entropies	p. 62
System Entropies for the Binary Symmetric Channel	p. 64
Extension of Shannon's First Theorem to Information Channels	p. 67
Mutual Information	p. 70
Mutual Information for the Binary Symmetric Channel	p. 72
Channel Capacity	p. 73
Supplementary Exercises	p. 76
Using an Unreliable Channel	p. 79
Decision Rules	p. 79
An Example of Improved Reliability	p. 82
Hamming Distance	p. 85
Statement and Outline Proof of Shannon's Theorem	p. 88
The Converse of Shannon's Theorem	p. 90
Comments on Shannon's Theorem	p. 93
Supplementary Exercises	p. 94
Error-correcting Codes	p. 97
Introductory Concepts	p. 97
Examples of Codes	p. 100
Minimum Distance	p. 104
Hamming's Sphere-packing Bound	p. 107
The Gilbert-Varshamov Bound	p. 111
Hadamard Matrices and Codes	p. 114
Supplementary Exercises	p. 118
Linear Codes	p. 121
Matrix Description of Linear Codes	p. 121
Equivalence of Linear Codes	p. 127
Minimum Distance of Linear Codes	p. 131
The Hamming Codes	p. 133
The Golay Codes	p. 136
The Standard Array	p. 141
Syndrome Decoding	p. 143
Supplementary Exercises	p. 146
Suggestions for Further Reading	p. 149
Proof of the Sardinas-Patterson Theorem	p. 153
The Law of Large Numbers	p. 157
Proof of Shannon's Fundamental Theorem	p. 159
Solutions to Exercises	p. 165
Bibliography	p. 191
Index of Symbols and Abbreviations	p. 195
Index	p. 201
Table of Contents provided by Syndetics. All Rights Reserved.

Information and Coding Theory

At a Glance

Paperback

Shipping

How to return your order

Defective items

You Can Find This Book In

More in Information theory

Psycho-Cybernetics (Updated and Expanded)

Psycho-cybernetics

Nexus

A Brief History of Information Networks from the Stone Age to AI

Thinking in Systems

A Primer

Spectra of Signed Graphs

London Mathematical Society Lecture Note Series

Advances in Nonlinear Dynamics

Proceedings of the Fourth International Nonlinear Dynamics Conference (NODYCON 2025) , Volume 1

Psycho-Cybernetics 365

Thrive and Grow Every Day of the Year

The Laws of Thought

The Quest for a Mathematical Theory of the Mind

How to Prove It

A Structured Approach

The Infinite Alphabet

And the Laws of Knowledge

Effective Machine Learning Teams

Best Practices for ML Practitioners

The Black Swan

The Impact of the Highly Improbable

Computational Intelligence Applications in Cyber Security

The Law of Complex Earth and Outer Space Systems

The Cosmolegal Proposal

Data and Model Centric Artificial Intelligence for Industry 5.0

Brain-Inspired AI for Sustainable Development

Knowledge-based Engineering for Innovation

Intelligent Manufacturing Systems

Digitalization of Industrial Production

An Introduction to Systems Biology

Design Principles of Biological Circuits

Handbook of Systems Thinking Methods

Handbook of Intelligent Robots

Theory, Methods and Applications

Advanced Techniques and Applications of Cybersecurity and Forensics

Emerging Technologies

Multimodal Biometric Identification System

Case Study of Real-Time Implementation

Nature Inspired Robotics

Proper Time and Mass as Dynamical Variables

Why it's Possible and Some Consequences

Deep Learning with R, Third Edition

This product is categorised by