Author of the publication

A Maximum Entropy Approach to Recovering Information From Multinomial Response Data

, , and . Journal of the American Statistical Association, 91 (434): 841--853 (June 1996)The classical maximum entropy (ME) approach to estimating the unknown parameters of a multinomial discrete choice problem, which is equivalent to the maximum likelihood multinomial logit (ML) estimator, is generalized. The generalized maximum entropy (GME) model includes noise terms in the multinomial information constraints. Each noise term is modeled as the mean of a finite set of a priori known points in the interval -1, 1 with unknown probabilities where no parametric assumptions about the error distribution are made. A GME model for the multinomial probabilities and for the distributions associated with the noise terms is derived by maximizing the joint entropy of multinomial and noise distributions, under the assumption of independence. The GME formulation reduces to the ME in the limit as the sample grows large or when no noise is included in the entropy maximization. Further, even though the GME and the logit estimators are conceptually different, the dual GME model is related to a generalized class of logit models. In finite samples, modeling the noise terms along with the multinomial probabilities results in a gain of efficiency of the GME over the ME and ML. In addition to analytical results, some extensions, sampling experiments, and an example based on real-world data are presented..

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

 

Other publications of authors with the same name

What May Visualization Processes Optimize?, and . IEEE Trans. Vis. Comput. Graph., 22 (12): 2619-2632 (2016)Interpreting Social Accounting Matrix (SAM) as an Information Channel., , , , and . Entropy, 22 (12): 1346 (2020)Comparison of maximum entropy and higher-order entropy estimators, and . Journal of Econometrics, 107 (1-2): 195--211 (March 2002)Maximum entropy econometrics, , and . Series in financial economics and quantitative analysis Wiley, Chichester u.a., Repr edition, (1996)Recovering information in the case of underdetermined problems and incomplete economic data, and . Journal of Statistical Planning and Inference, 49 (1): 127--136 (Jan 1, 1996)An Entropic Estimator for Linear Inverse Problems., and . Entropy, 14 (5): 892-923 (2012)On the Foundations and Philosophy of Info-metrics.. CiE, volume 7318 of Lecture Notes in Computer Science, page 237-244. Springer, (2012)Auto-Inflatables: Chemical Inflation for Pop-Up Fabrication., , , and . CHI Extended Abstracts, ACM, (2019)Digital Gastronomy: Methods & Recipes for Hybrid Cooking., , , , , and . UIST, page 541-552. ACM, (2016)Estimation and inference with censored and ordered multinomial response data, , and . Journal of Econometrics, 79 (1): 23--51 (July 1997)