# Search Results

Results tagged with Search options user 84399
4 results

Questions about Information theory, entropy, and information content of various sources

Entropy is the randomness collected by an operating system or application for use in Cryptography or other uses that require random data. The formula for Entropy is $$H(p_1, ..., p_k)=-\sum_{i=1}^{k} … asked Mar 28 '18 by Ski Mask 1answer I have the phrase "abracadabra" and I want to encode it through the Huffman method. I first took the frequencies of each letters;$$a=5b=3c=1d=2r=2$$But I'm not sure as to how the … asked Mar 30 '18 by Ski Mask 1answer I want to calculate the Entropy of the phrase "Eile mit Weile". I found the probability of each letter as the following$$P(e)=\frac{4}{12}P(i)=\frac{3}{12}P(l)=\frac{2}{12}P(m)=\frac{ …
I know that the answer is no but I'm not sure why. Here's where I started. We know that all data with length $n$ Bits and minimum $1$ Bit can be compressed, either lossless or lossy. But how do I cont …