Guesswork and Entropy
Malone, David and Sullivan, Wayne G. (2004) Guesswork and Entropy. IEEE Transactions on Information Theory, 50 (3). pp. 525-526. ISSN 0018-9448 AbstractAbstract—We derive the moments of the guesswork, the number of attempts required to correctly guess the output of a random source, for a source determined by a Markov chain
via a large deviations type estimate. These moments are related to the Perron–Frobenius eigenvalue of the matrix formed by element-wise powers of the Markov chain’s transition matrix. | Additional Information: | Copyright Notice "©2004 IEEE. Reprinted from IEEE Transactions on Information Theory. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE." http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=1273661&isnumber=28501 |
|---|
| Keywords: | Markov processes; Eigenvalues and eigenfunctions; Entropy; Matrix algebra; Markov chain transition matrix; Perron-Frobenius eigenvalue; Renyi entropy; Deviation; Estimation; Element-wise power; Guesswork; Matrix formation. |
|---|
| Subjects: | Science & Engineering > Hamilton Institute
Science & Engineering > Computer Science |
|---|
| ID Code: | 1462 |
|---|
| Deposited By: | Dr. David Malone |
|---|
| Deposited On: | 30 Jun 2009 17:45 |
|---|
| Journal or Publication Title: | IEEE Transactions on Information Theory |
|---|
| Publisher: | IEEE |
|---|
| Refereed: | Yes |
|---|
| URL: | http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=18 |
|---|
Repository Staff Only: item control page
|
![[img]](http://eprints.nuim.ie/style/images/fileicons/application_pdf.png)