Talk:Redundancy (information theory)

Latest comment: 1 year ago by 37.201.147.172 in topic A lot of missing context

A lot of missing context

edit
  • what is an ensemble X?
  • where does   come from?
  • what is  ? - I assume the alphabet of the sender, but it does not say.

This is a pattern in many of the information theory articles. — Preceding unsigned comment added by 37.201.147.172 (talk) 02:01, 18 July 2023 (UTC)Reply

Definition of rate

edit

Definition of rate (here and at Information theory#Rate) should agree with Entropy rate. 198.145.196.71 23:19, 13 September 2007 (UTC)Reply

Done (by me). 198.145.196.71 01:12, 15 September 2007 (UTC)Reply

Other notions of Redundancy

edit

This paragraph:

Redundancy of compressed data refers to the difference between the expected compressed data length of   messages   (or expected data rate  ) and the entropy   (or entropy rate  ). (Here we assume the data is ergodic and stationary, e.g., a memoryless source.) Although the rate difference   can be arbitrarily small as   increased, the actual difference  , cannot, although it can be theoretically upper-bounded by 1 in the case of finite-entropy memoryless sources.

actually seems to describe redundancy as the difference between the absolute rate and the rate as defined above is the article. As such, it should perhaps be more fully explained in the main part of the article, or in its own section, since it is not really "another notion of redundancy". It needs to be explained more clearly, too. 198.145.196.71 16:22, 18 September 2007 (UTC)Reply