Sampling methods for archaeological predictive modeling: Spatial autocorrelation and model performance

Sampling methods for archaeological predictive modeling: Spatial autocorrelation and model performance. Comer, J. A., Comer, D. C., Dumitru, I. A., Priebe, C. E., & Patsolic, J. L. Journal of Archaeological Science: Reports, 48:103824, April, 2023.

Paper doi abstract bibtex

With a case study of a direct detection model (DDM) designed for Fort Irwin, in southern California, we compare models that are identical except for the sampling methods that draw the data used to train and test them. We find that models trained and tested with a random cell sampling strategy perform better than do models that implement a kind of leave-one-out cross-validation (LOOCV) that focuses on discrete sites and non-site areas. We argue that this difference in measured predictive performance is due to spatial autocorrelation, and that it underscores the importance of clarity and specificity in describing the sampling methods used in archaeological predictive modeling and site detection. Different sampling methods are not necessarily superior or inferior, but they generate models that may be more or less appropriate for different tasks. Different sampling methods can also yield calculations of predictive ability that over- or understate a model’s performance at the task for which it was designed.

@article{comer_sampling_2023,
	title = {Sampling methods for archaeological predictive modeling: {Spatial} autocorrelation and model performance},
	volume = {48},
	issn = {2352-409X},
	shorttitle = {Sampling methods for archaeological predictive modeling},
	url = {https://www.sciencedirect.com/science/article/pii/S2352409X22004874},
	doi = {10.1016/j.jasrep.2022.103824},
	abstract = {With a case study of a direct detection model (DDM) designed for Fort Irwin, in southern California, we compare models that are identical except for the sampling methods that draw the data used to train and test them. We find that models trained and tested with a random cell sampling strategy perform better than do models that implement a kind of leave-one-out cross-validation (LOOCV) that focuses on discrete sites and non-site areas. We argue that this difference in measured predictive performance is due to spatial autocorrelation, and that it underscores the importance of clarity and specificity in describing the sampling methods used in archaeological predictive modeling and site detection. Different sampling methods are not necessarily superior or inferior, but they generate models that may be more or less appropriate for different tasks. Different sampling methods can also yield calculations of predictive ability that over- or understate a model’s performance at the task for which it was designed.},
	language = {en},
	urldate = {2023-06-23},
	journal = {Journal of Archaeological Science: Reports},
	author = {Comer, Jacob A. and Comer, Douglas C. and Dumitru, Ioana A. and Priebe, Carey E. and Patsolic, Jesse L.},
	month = apr,
	year = {2023},
	keywords = {Terrestrial Ecoregions (Wiken 2011)},
	pages = {103824},
}

Downloads: 0

{"_id":"z9AuCMMLLhu7ifwsN","bibbaseid":"comer-comer-dumitru-priebe-patsolic-samplingmethodsforarchaeologicalpredictivemodelingspatialautocorrelationandmodelperformance-2023","author_short":["Comer, J. A.","Comer, D. C.","Dumitru, I. A.","Priebe, C. E.","Patsolic, J. L."],"bibdata":{"bibtype":"article","type":"article","title":"Sampling methods for archaeological predictive modeling: Spatial autocorrelation and model performance","volume":"48","issn":"2352-409X","shorttitle":"Sampling methods for archaeological predictive modeling","url":"https://www.sciencedirect.com/science/article/pii/S2352409X22004874","doi":"10.1016/j.jasrep.2022.103824","abstract":"With a case study of a direct detection model (DDM) designed for Fort Irwin, in southern California, we compare models that are identical except for the sampling methods that draw the data used to train and test them. We find that models trained and tested with a random cell sampling strategy perform better than do models that implement a kind of leave-one-out cross-validation (LOOCV) that focuses on discrete sites and non-site areas. We argue that this difference in measured predictive performance is due to spatial autocorrelation, and that it underscores the importance of clarity and specificity in describing the sampling methods used in archaeological predictive modeling and site detection. Different sampling methods are not necessarily superior or inferior, but they generate models that may be more or less appropriate for different tasks. Different sampling methods can also yield calculations of predictive ability that over- or understate a model’s performance at the task for which it was designed.","language":"en","urldate":"2023-06-23","journal":"Journal of Archaeological Science: Reports","author":[{"propositions":[],"lastnames":["Comer"],"firstnames":["Jacob","A."],"suffixes":[]},{"propositions":[],"lastnames":["Comer"],"firstnames":["Douglas","C."],"suffixes":[]},{"propositions":[],"lastnames":["Dumitru"],"firstnames":["Ioana","A."],"suffixes":[]},{"propositions":[],"lastnames":["Priebe"],"firstnames":["Carey","E."],"suffixes":[]},{"propositions":[],"lastnames":["Patsolic"],"firstnames":["Jesse","L."],"suffixes":[]}],"month":"April","year":"2023","keywords":"Terrestrial Ecoregions (Wiken 2011)","pages":"103824","bibtex":"@article{comer_sampling_2023,\n\ttitle = {Sampling methods for archaeological predictive modeling: {Spatial} autocorrelation and model performance},\n\tvolume = {48},\n\tissn = {2352-409X},\n\tshorttitle = {Sampling methods for archaeological predictive modeling},\n\turl = {https://www.sciencedirect.com/science/article/pii/S2352409X22004874},\n\tdoi = {10.1016/j.jasrep.2022.103824},\n\tabstract = {With a case study of a direct detection model (DDM) designed for Fort Irwin, in southern California, we compare models that are identical except for the sampling methods that draw the data used to train and test them. We find that models trained and tested with a random cell sampling strategy perform better than do models that implement a kind of leave-one-out cross-validation (LOOCV) that focuses on discrete sites and non-site areas. We argue that this difference in measured predictive performance is due to spatial autocorrelation, and that it underscores the importance of clarity and specificity in describing the sampling methods used in archaeological predictive modeling and site detection. Different sampling methods are not necessarily superior or inferior, but they generate models that may be more or less appropriate for different tasks. Different sampling methods can also yield calculations of predictive ability that over- or understate a model’s performance at the task for which it was designed.},\n\tlanguage = {en},\n\turldate = {2023-06-23},\n\tjournal = {Journal of Archaeological Science: Reports},\n\tauthor = {Comer, Jacob A. and Comer, Douglas C. and Dumitru, Ioana A. and Priebe, Carey E. and Patsolic, Jesse L.},\n\tmonth = apr,\n\tyear = {2023},\n\tkeywords = {Terrestrial Ecoregions (Wiken 2011)},\n\tpages = {103824},\n}\n\n\n\n\n\n\n\n","author_short":["Comer, J. A.","Comer, D. C.","Dumitru, I. A.","Priebe, C. E.","Patsolic, J. L."],"key":"comer_sampling_2023","id":"comer_sampling_2023","bibbaseid":"comer-comer-dumitru-priebe-patsolic-samplingmethodsforarchaeologicalpredictivemodelingspatialautocorrelationandmodelperformance-2023","role":"author","urls":{"Paper":"https://www.sciencedirect.com/science/article/pii/S2352409X22004874"},"keyword":["Terrestrial Ecoregions (Wiken 2011)"],"metadata":{"authorlinks":{}},"downloads":0},"bibtype":"article","biburl":"https://bibbase.org/zotero/NAAtlas2024","dataSources":["qLjf8q88GSLZ5dAmC"],"keywords":["terrestrial ecoregions (wiken 2011)"],"search_terms":["sampling","methods","archaeological","predictive","modeling","spatial","autocorrelation","model","performance","comer","comer","dumitru","priebe","patsolic"],"title":"Sampling methods for archaeological predictive modeling: Spatial autocorrelation and model performance","year":2023}