Information and Coding Theory

By: Gareth A. Jones, J.Mary Jones

Write A Review

Paperback | 1 July 2000

At a Glance

Paperback
228 Pages

Dimensions(cm)
24.3 x 17.3 x 1.3

Paperback

$64.99

or 4 interest-free payments of $16.25 with

or

Ships in 5 to 7 business days

As this Preface is being written, the twentieth century is coming to an end. Historians may perhaps come to refer to it as the century of information, just as its predecessor is associated with the process of industrialisation. Successive technological developments such as the telephone, radio, television, computers and the Internet have had profound effects on the way we live. We can see pic tures of the surface of Mars or the early shape of the Universe. The contents of a whole shelf-load of library books can be compressed onto an almost weight less piece of plastic. Billions of people can watch the same football match, or can keep in instant touch with friends around the world without leaving home. In short, massive amounts of information can now be stored, transmitted and processed, with surprising speed, accuracy and economy. Of course, these developments do not happen without some theoretical ba sis, and as is so often the case, much of this is provided by mathematics. Many of the first mathematical advances in this area were made in the mid-twentieth century by engineers, often relying on intuition and experience rather than a deep theoretical knowledge to lead them to their discoveries. Soon the math ematicians, delighted to see new applications for their subject, joined in and developed the engineers' practical examples into wide-ranging theories, com plete with definitions, theorems and proofs.

Shipping

	Standard Shipping	Express Shipping
Metro postcodes:	$9.99	$14.95
Regional postcodes:	$9.99	$14.95
Rural postcodes:	$9.99	$14.95

Orders over $79.00 qualify for free shipping.

How to return your order

At Booktopia, we offer hassle-free returns in accordance with our returns policy. If you wish to return an item, please get in touch with Booktopia Customer Care.

Additional postage charges may be applicable.

Defective items

If there is a problem with any of the items received for your order then the Booktopia Customer Care team is ready to assist you.

For more info please visit our Help Centre.

More in Information theory

Thinking in Systems

A Primer

Paperback

RRP $60.01

$30.99

48%
OFF

Innovative Computing and Communications : Proceedings of ICICC 2026, Volume 1 - Aboul Ella Hassanien

$22.99

15%
OFF

Psycho-Cybernetics (Updated and Expanded) : Psycho-cybernetics - Maxwell Maltz

$28.75

18%
OFF

Nexus

A Brief History of Information Networks from the Stone Age to AI

Paperback

RRP $29.99

$24.99

17%
OFF

Psycho-Cybernetics 365

Thrive and Grow Every Day of the Year

Paperback

RRP $34.99

$28.75

18%
OFF

The Infinite Alphabet

And the Laws of Knowledge

Hardcover

RRP $59.99

$45.75

24%
OFF

How to Prove It

A Structured Approach

Paperback

RRP $73.95

$70.75

Effective Machine Learning Teams

Best Practices for ML Practitioners

Paperback

RRP $152.00

$121.60

20%
OFF

Complex Networks and Control Theory : An Introduction to Structural Controllability and Its Biological Applications - Jose C. Nacher

$314.75

Brain-Inspired AI for Sustainable Development : Knowledge-based Engineering for Innovation - Nuzhat Faiz Shaikh

$314.75

Handbook of Systems Thinking Methods

Paperback

RRP $109.99

$87.75

20%
OFF

An Introduction to Systems Biology : Design Principles of Biological Circuits - Uri Alon

$50.75

18%
OFF

Deep Learning with R, Third Edition - Tomasz Kalinowski

$48.75

16%
OFF

Preface	p. v
Notes to the Reader	p. xiii
Source Coding	p. 1
Definitions and Examples	p. 1
Uniquely Decodable Codes	p. 4
Instantaneous Codes	p. 9
Constructing Instantaneous Codes	p. 11
Kraft's Inequality	p. 13
McMillan's Inequality	p. 14
Comments on Kraft's and McMillan's Inequalities	p. 16
Supplementary Exercises	p. 17
Optimal Codes	p. 19
Optimality	p. 19
Binary Huffman Codes	p. 22
Average Word-length of Huffman Codes	p. 26
Optimality of Binary Huffman Codes	p. 27
r-ary Huffman Codes	p. 28
Extensions of Sources	p. 30
Supplementary Exercises	p. 32
Entropy	p. 35
Information and Entropy	p. 35
Properties of the Entropy Function	p. 40
Entropy and Average Word-length	p. 42
Shannon-Fano Coding	p. 45
Entropy of Extensions and Products	p. 47
Shannon's First Theorem	p. 48
An Example of Shannon's First Theorem	p. 49
Supplementary Exercises	p. 51
Information Channels	p. 55
Notation and Definitions	p. 55
The Binary Symmetric Channel	p. 60
System Entropies	p. 62
System Entropies for the Binary Symmetric Channel	p. 64
Extension of Shannon's First Theorem to Information Channels	p. 67
Mutual Information	p. 70
Mutual Information for the Binary Symmetric Channel	p. 72
Channel Capacity	p. 73
Supplementary Exercises	p. 76
Using an Unreliable Channel	p. 79
Decision Rules	p. 79
An Example of Improved Reliability	p. 82
Hamming Distance	p. 85
Statement and Outline Proof of Shannon's Theorem	p. 88
The Converse of Shannon's Theorem	p. 90
Comments on Shannon's Theorem	p. 93
Supplementary Exercises	p. 94
Error-correcting Codes	p. 97
Introductory Concepts	p. 97
Examples of Codes	p. 100
Minimum Distance	p. 104
Hamming's Sphere-packing Bound	p. 107
The Gilbert-Varshamov Bound	p. 111
Hadamard Matrices and Codes	p. 114
Supplementary Exercises	p. 118
Linear Codes	p. 121
Matrix Description of Linear Codes	p. 121
Equivalence of Linear Codes	p. 127
Minimum Distance of Linear Codes	p. 131
The Hamming Codes	p. 133
The Golay Codes	p. 136
The Standard Array	p. 141
Syndrome Decoding	p. 143
Supplementary Exercises	p. 146
Suggestions for Further Reading	p. 149
Proof of the Sardinas-Patterson Theorem	p. 153
The Law of Large Numbers	p. 157
Proof of Shannon's Fundamental Theorem	p. 159
Solutions to Exercises	p. 165
Bibliography	p. 191
Index of Symbols and Abbreviations	p. 195
Index	p. 201
Table of Contents provided by Syndetics. All Rights Reserved.

Information and Coding Theory

At a Glance

Paperback

Shipping

How to return your order

Defective items

You Can Find This Book In

More in Information theory

Thinking in Systems

A Primer

Innovative Computing and Communications

Proceedings of ICICC 2026, Volume 1

Innovative Computing and Communications

Proceedings of ICICC 2026, Volume 3

Generative AI and Stochastic Thermodynamics

A Tale of Free Energies

Generative AI and Stochastic Thermodynamics

A Tale of Free Energies

The Black Swan

The Impact of the Highly Improbable

Psycho-Cybernetics (Updated and Expanded)

Psycho-cybernetics

The Laws of Thought

The Quest for a Mathematical Theory of the Mind

Nexus

A Brief History of Information Networks from the Stone Age to AI

Psycho-Cybernetics 365

Thrive and Grow Every Day of the Year

The Infinite Alphabet

And the Laws of Knowledge

How to Prove It

A Structured Approach

Effective Machine Learning Teams

Best Practices for ML Practitioners

Complex Networks and Control Theory

An Introduction to Structural Controllability and Its Biological Applications

Data and Model Centric Artificial Intelligence for Industry 5.0

Brain-Inspired AI for Sustainable Development

Knowledge-based Engineering for Innovation

Intelligent Manufacturing Systems

Digitalization of Industrial Production

Handbook of Systems Thinking Methods

An Introduction to Systems Biology

Design Principles of Biological Circuits

The Movement of Knowledge

Thinking with Infrastructure

Deep Learning with R, Third Edition

Proper Time and Mass as Dynamical Variables

Why it's Possible and Some Consequences

Build Python Web Apps with Streamlit

AI and Data Applications in Minutes

Making Statistics Work

Information Theory and Bayesian Inference

This product is categorised by