Information Theory


Probability Theory is the basis for another framework called Information Theory which quantifies the information present in a dataset. Information Theory turns out to be of central importance to the field of Machine Learning.