The Equivalence of Logistic Regression and Maximum Entropymodels. Mount, J. In Win-Vector LLC Data Science Consulting. ![The Equivalence of Logistic Regression and Maximum Entropymodels [link]](https://bibbase.org/img/filetypes/link.svg "link")
Paper abstract bibtex As our colleague so aptly demonstrated ( http://www.win-vector.com/blog/2011/09/the-simpler- derivation-of-logistic-regression/ ) there is one derivation of Logistic Regression that is particularly beautiful. It is not as general as that found in Agresti[Agresti, 1990] (which deals with generalized linear models in their full generality), but gets to the important balance equations very quickly. We will pursue this further to re-derive multi-category logistic regression in both its standard (sigmoid) phrasing and also in its equivalent maximum entropy clothing. It is well known that logistic regression and maximum entropy modeling are equivalent (for example see [Klein and Manning, 2003])- but we will show that the simpler derivation already given is a very good way to demonstrate the equivalence (and points out that logistic regression is actually special- not just one of many equivalent GLMs).
@incollection{mountEquivalenceLogisticRegression2011,
title = {The Equivalence of Logistic Regression and Maximum Entropymodels},
author = {Mount, John},
date = {2011-09},
publisher = {{Win-Vector LLC Data Science Consulting}},
url = {https://scholar.google.com/scholar?cluster=8900605637623791351},
abstract = {As our colleague so aptly demonstrated ( http://www.win-vector.com/blog/2011/09/the-simpler- derivation-of-logistic-regression/ ) there is one derivation of Logistic Regression that is particularly beautiful. It is not as general as that found in Agresti[Agresti, 1990] (which deals with generalized linear models in their full generality), but gets to the important balance equations very quickly. We will pursue this further to re-derive multi-category logistic regression in both its standard (sigmoid) phrasing and also in its equivalent maximum entropy clothing. It is well known that logistic regression and maximum entropy modeling are equivalent (for example see [Klein and Manning, 2003])- but we will show that the simpler derivation already given is a very good way to demonstrate the equivalence (and points out that logistic regression is actually special- not just one of many equivalent GLMs).},
keywords = {*imported-from-citeulike-INRMM,~INRMM-MiD:c-12013393,entropy,mathematics,regression,statistics}
}
Downloads: 0
{"_id":"qKgb82tBwPXeuHMFg","bibbaseid":"mount-theequivalenceoflogisticregressionandmaximumentropymodels","authorIDs":[],"author_short":["Mount, J."],"bibdata":{"bibtype":"incollection","type":"incollection","title":"The Equivalence of Logistic Regression and Maximum Entropymodels","author":[{"propositions":[],"lastnames":["Mount"],"firstnames":["John"],"suffixes":[]}],"date":"2011-09","publisher":"Win-Vector LLC Data Science Consulting","url":"https://scholar.google.com/scholar?cluster=8900605637623791351","abstract":"As our colleague so aptly demonstrated ( http://www.win-vector.com/blog/2011/09/the-simpler- derivation-of-logistic-regression/ ) there is one derivation of Logistic Regression that is particularly beautiful. It is not as general as that found in Agresti[Agresti, 1990] (which deals with generalized linear models in their full generality), but gets to the important balance equations very quickly. We will pursue this further to re-derive multi-category logistic regression in both its standard (sigmoid) phrasing and also in its equivalent maximum entropy clothing. It is well known that logistic regression and maximum entropy modeling are equivalent (for example see [Klein and Manning, 2003])- but we will show that the simpler derivation already given is a very good way to demonstrate the equivalence (and points out that logistic regression is actually special- not just one of many equivalent GLMs).","keywords":"*imported-from-citeulike-INRMM,~INRMM-MiD:c-12013393,entropy,mathematics,regression,statistics","bibtex":"@incollection{mountEquivalenceLogisticRegression2011,\n title = {The Equivalence of Logistic Regression and Maximum Entropymodels},\n author = {Mount, John},\n date = {2011-09},\n publisher = {{Win-Vector LLC Data Science Consulting}},\n url = {https://scholar.google.com/scholar?cluster=8900605637623791351},\n abstract = {As our colleague so aptly demonstrated ( http://www.win-vector.com/blog/2011/09/the-simpler- derivation-of-logistic-regression/ ) there is one derivation of Logistic Regression that is particularly beautiful. It is not as general as that found in Agresti[Agresti, 1990] (which deals with generalized linear models in their full generality), but gets to the important balance equations very quickly. We will pursue this further to re-derive multi-category logistic regression in both its standard (sigmoid) phrasing and also in its equivalent maximum entropy clothing. It is well known that logistic regression and maximum entropy modeling are equivalent (for example see [Klein and Manning, 2003])- but we will show that the simpler derivation already given is a very good way to demonstrate the equivalence (and points out that logistic regression is actually special- not just one of many equivalent GLMs).},\n keywords = {*imported-from-citeulike-INRMM,~INRMM-MiD:c-12013393,entropy,mathematics,regression,statistics}\n}\n\n","author_short":["Mount, J."],"key":"mountEquivalenceLogisticRegression2011","id":"mountEquivalenceLogisticRegression2011","bibbaseid":"mount-theequivalenceoflogisticregressionandmaximumentropymodels","role":"author","urls":{"Paper":"https://scholar.google.com/scholar?cluster=8900605637623791351"},"keyword":["*imported-from-citeulike-INRMM","~INRMM-MiD:c-12013393","entropy","mathematics","regression","statistics"],"downloads":0},"bibtype":"incollection","biburl":"https://tmpfiles.org/dl/58794/INRMM.bib","creationDate":"2020-07-02T22:41:16.474Z","downloads":0,"keywords":["*imported-from-citeulike-inrmm","~inrmm-mid:c-12013393","entropy","mathematics","regression","statistics"],"search_terms":["equivalence","logistic","regression","maximum","entropymodels","mount"],"title":"The Equivalence of Logistic Regression and Maximum Entropymodels","year":null,"dataSources":["DXuKbcZTirdigFKPF"]}