Tuesday, April 17, 2007

Shannon vs Hartley Entropy

I left the flowchart from Lab 10 in the excel file so I hope that is a sufficient to posted it on my blog. The difference between Shannon and Hartley entropy is that Shannon includes probabilities into this entropy calculation and Hartley does not. Hartley just uses the log of the total amount of whatever he is calculating, in this case there were 21 grades, and uses a base 2. Hartley's entropy calculation seems to be a much greater number compared to Shannon's entropy.

No comments: