Skip to main content
2 of 3
deleted 27 characters in body; edited title
Raphael
  • 72.9k
  • 30
  • 181
  • 393

Mutual information and moment generating functions

I went to listen to a workshop and some audience asked the presenter how the moments can improve the mutual information. I am learning the MI (Mutual Information) so didn't have enough knowledge to understand what it means. Then, I have done some research but still have some confusions. I am wondering if anyone has more knowledge about this can clarify for me. Here are my questions.

  • Mutual information is usually calculated by bin functions to estimate the probability of two random variable which can be a case of two vectors X and Y. Is the moment generating function another way to estimate probability?

  • If moment generating functions can present the probability of X and Y, how do we calculate it?

  • Does a MI have a moments generating function?

  • If MI has a moments generating function, how can we present a MI of X and Y by its moments functions?

Cassie
  • 305
  • 1
  • 5