Revisiting Kappa to account for change in the accuracy assessment of land-use change models. van Vliet, J., Bregt, A. K., & Hagen-Zanker, A. Ecological Modelling, 222(8):1367–1375, April, 2011. ![Revisiting Kappa to account for change in the accuracy assessment of land-use change models [link]](https://bibbase.org/img/filetypes/link.svg "link")
Paper doi abstract bibtex Land-use change models are typically calibrated to reproduce known historic changes. Calibration results can then be assessed by comparing two datasets: the simulated land-use map and the actual land-use map at the same time. A common method for this is the Kappa statistic, which expresses the agreement between two categorical datasets corrected for the expected agreement. This expected agreement is based on a stochastic model of random allocation given the distribution of class sizes. However, when a model starts from an initial land-use map and makes changes to it, that stochastic model does not pose a meaningful reference level. This paper introduces KSimulation, a statistic that is identical in form to the Kappa statistic but instead applies a more appropriate stochastic model of random allocation of class transitions relative to the initial map. The new method is illustrated on a simple example and then the results of the Kappa statistic and KSimulation are compared using the results of a land-use model. It is found that only KSimulation truly tests models in their capacity to explain land-use changes over time, and unlike Kappa it does not inflate results for simulations where little change takes place over time.
@article{van_vliet_revisiting_2011,
title = {Revisiting {Kappa} to account for change in the accuracy assessment of land-use change models},
volume = {222},
issn = {0304-3800},
url = {http://www.sciencedirect.com/science/article/pii/S0304380011000494},
doi = {10.1016/j.ecolmodel.2011.01.017},
abstract = {Land-use change models are typically calibrated to reproduce known historic changes. Calibration results can then be assessed by comparing two datasets: the simulated land-use map and the actual land-use map at the same time. A common method for this is the Kappa statistic, which expresses the agreement between two categorical datasets corrected for the expected agreement. This expected agreement is based on a stochastic model of random allocation given the distribution of class sizes. However, when a model starts from an initial land-use map and makes changes to it, that stochastic model does not pose a meaningful reference level. This paper introduces KSimulation, a statistic that is identical in form to the Kappa statistic but instead applies a more appropriate stochastic model of random allocation of class transitions relative to the initial map. The new method is illustrated on a simple example and then the results of the Kappa statistic and KSimulation are compared using the results of a land-use model. It is found that only KSimulation truly tests models in their capacity to explain land-use changes over time, and unlike Kappa it does not inflate results for simulations where little change takes place over time.},
number = {8},
urldate = {2014-01-10TZ},
journal = {Ecological Modelling},
author = {van Vliet, J. and Bregt, A. K. and Hagen-Zanker, A.},
month = apr,
year = {2011},
keywords = {Accuracy assessment, Kappa statistic, Land-use change, Model calibration, map comparison},
pages = {1367--1375}
}
Downloads: 0
{"_id":"3kkvDjg3oo24EEfAx","bibbaseid":"vanvliet-bregt-hagenzanker-revisitingkappatoaccountforchangeintheaccuracyassessmentoflandusechangemodels-2011","author_short":["van Vliet, J.","Bregt, A. K.","Hagen-Zanker, A."],"bibdata":{"bibtype":"article","type":"article","title":"Revisiting Kappa to account for change in the accuracy assessment of land-use change models","volume":"222","issn":"0304-3800","url":"http://www.sciencedirect.com/science/article/pii/S0304380011000494","doi":"10.1016/j.ecolmodel.2011.01.017","abstract":"Land-use change models are typically calibrated to reproduce known historic changes. Calibration results can then be assessed by comparing two datasets: the simulated land-use map and the actual land-use map at the same time. A common method for this is the Kappa statistic, which expresses the agreement between two categorical datasets corrected for the expected agreement. This expected agreement is based on a stochastic model of random allocation given the distribution of class sizes. However, when a model starts from an initial land-use map and makes changes to it, that stochastic model does not pose a meaningful reference level. This paper introduces KSimulation, a statistic that is identical in form to the Kappa statistic but instead applies a more appropriate stochastic model of random allocation of class transitions relative to the initial map. The new method is illustrated on a simple example and then the results of the Kappa statistic and KSimulation are compared using the results of a land-use model. It is found that only KSimulation truly tests models in their capacity to explain land-use changes over time, and unlike Kappa it does not inflate results for simulations where little change takes place over time.","number":"8","urldate":"2014-01-10TZ","journal":"Ecological Modelling","author":[{"propositions":["van"],"lastnames":["Vliet"],"firstnames":["J."],"suffixes":[]},{"propositions":[],"lastnames":["Bregt"],"firstnames":["A.","K."],"suffixes":[]},{"propositions":[],"lastnames":["Hagen-Zanker"],"firstnames":["A."],"suffixes":[]}],"month":"April","year":"2011","keywords":"Accuracy assessment, Kappa statistic, Land-use change, Model calibration, map comparison","pages":"1367–1375","bibtex":"@article{van_vliet_revisiting_2011,\r\n\ttitle = {Revisiting {Kappa} to account for change in the accuracy assessment of land-use change models},\r\n\tvolume = {222},\r\n\tissn = {0304-3800},\r\n\turl = {http://www.sciencedirect.com/science/article/pii/S0304380011000494},\r\n\tdoi = {10.1016/j.ecolmodel.2011.01.017},\r\n\tabstract = {Land-use change models are typically calibrated to reproduce known historic changes. Calibration results can then be assessed by comparing two datasets: the simulated land-use map and the actual land-use map at the same time. A common method for this is the Kappa statistic, which expresses the agreement between two categorical datasets corrected for the expected agreement. This expected agreement is based on a stochastic model of random allocation given the distribution of class sizes. However, when a model starts from an initial land-use map and makes changes to it, that stochastic model does not pose a meaningful reference level. This paper introduces KSimulation, a statistic that is identical in form to the Kappa statistic but instead applies a more appropriate stochastic model of random allocation of class transitions relative to the initial map. The new method is illustrated on a simple example and then the results of the Kappa statistic and KSimulation are compared using the results of a land-use model. It is found that only KSimulation truly tests models in their capacity to explain land-use changes over time, and unlike Kappa it does not inflate results for simulations where little change takes place over time.},\r\n\tnumber = {8},\r\n\turldate = {2014-01-10TZ},\r\n\tjournal = {Ecological Modelling},\r\n\tauthor = {van Vliet, J. and Bregt, A. K. and Hagen-Zanker, A.},\r\n\tmonth = apr,\r\n\tyear = {2011},\r\n\tkeywords = {Accuracy assessment, Kappa statistic, Land-use change, Model calibration, map comparison},\r\n\tpages = {1367--1375}\r\n}\r\n\r\n","author_short":["van Vliet, J.","Bregt, A. K.","Hagen-Zanker, A."],"key":"van_vliet_revisiting_2011","id":"van_vliet_revisiting_2011","bibbaseid":"vanvliet-bregt-hagenzanker-revisitingkappatoaccountforchangeintheaccuracyassessmentoflandusechangemodels-2011","role":"author","urls":{"Paper":"http://www.sciencedirect.com/science/article/pii/S0304380011000494"},"keyword":["Accuracy assessment","Kappa statistic","Land-use change","Model calibration","map comparison"],"metadata":{"authorlinks":{}},"html":""},"bibtype":"article","biburl":"https://eeci.soc.srcf.net/EECI_bib.bib","dataSources":["FsJcoLZCraa6x6YQE"],"keywords":["accuracy assessment","kappa statistic","land-use change","model calibration","map comparison"],"search_terms":["revisiting","kappa","account","change","accuracy","assessment","land","use","change","models","van vliet","bregt","hagen-zanker"],"title":"Revisiting Kappa to account for change in the accuracy assessment of land-use change models","year":2011}