Timeline for Numerical example of theoretical diff file size using Kullback Leibler?

8 events

when toggle format	what		by	license	comment
Jan 4, 2017 at 0:32	answer	added	D.W.♦		timeline score: -1
Dec 28, 2016 at 0:59	history	edited	Paul Uszak	CC BY-SA 3.0	Further info regarding P to R (a totally random file)
Dec 27, 2016 at 16:07	history	edited	Paul Uszak	CC BY-SA 3.0	Details of my working added
Dec 13, 2016 at 23:09	history	edited	D.W.♦	CC BY-SA 3.0	deleted 15 characters in body
Dec 13, 2016 at 22:47	comment	added	Paul Uszak		@D.W. the theoretical patch file size via KL is as Shannon entropy is to the minimum compressed file size. The two distributions are the byte value probabilities of the original and target files.
Dec 13, 2016 at 22:41	history	edited	Paul Uszak	CC BY-SA 3.0	Wikipedia reference added
Dec 13, 2016 at 17:41	comment	added	D.W.♦		What do you mean by "the theoretical size"? Where did you come to that understanding? Did you read that somewhere, and if so, where? I think you need to explain the claim more carefully, as I don't think it's true in the broad form you laid out. There might be a narrower claim that is true but it needs more care to state correctly. For one thing, the K-L divergence can only be applied to two distributions, not to two files or two samples from two distributions. Can you edit the question to provide more context?
Dec 12, 2016 at 23:46	history	asked	Paul Uszak	CC BY-SA 3.0