Observer bias and random variation in vegetation monitoring data. Milberg, P., Bergstedt, J., Fridman, J., Odell, G., & Westerberg, L. Journal of Vegetation Science, 19(5):633-644, 2008.
Observer bias and random variation in vegetation monitoring data [link]Paper  doi  abstract   bibtex   
Question: Detecting species presence in vegetation and making visual assessment of abundances involve a certain amount of skill, and therefore subjectivity. We evaluated the magnitude of the error in data, and its consequences for evaluating temporal trends. Location: Swedish forest vegetation. Methods: Vegetation data were collected independently by two observers in 342 permanent 100-m2 plots in mature boreal forests. Each plot was visited by one observer from a group of 36 and one of two quality assessment observers. The cover class of 29 taxa was recorded, and presence/absence for an additional 50. Results: Overall, one third of each occurrence was missed by one of the two observers, but with large differences among species. There were more missed occurrences at low abundances. Species occurring at low abundance when present tended to be frequently overlooked. Variance component analyses indicated that cover data on 5 of 17 species had a significant observer bias. Observer-explained variance was < 10% in 15 of 17 species. Conclusion: The substantial number of missed occurrences suggests poor power in detecting changes based on presence/absence data. The magnitude of observer bias in cover estimates was relatively small, compared with random error, and therefore potentially analytically tractable. Data in this monitoring system could be improved by a more structured working model during field work.
@article{RN617,
   author = {Milberg, Per and Bergstedt, Johan and Fridman, Jonas and Odell, Gunnar and Westerberg, Lars},
   title = {Observer bias and random variation in vegetation monitoring data},
   journal = {Journal of Vegetation Science},
   volume = {19},
   number = {5},
   pages = {633-644},
   abstract = {Question: Detecting species presence in vegetation and making visual assessment of abundances involve a certain amount of skill, and therefore subjectivity. We evaluated the magnitude of the error in data, and its consequences for evaluating temporal trends. Location: Swedish forest vegetation. Methods: Vegetation data were collected independently by two observers in 342 permanent 100-m2 plots in mature boreal forests. Each plot was visited by one observer from a group of 36 and one of two quality assessment observers. The cover class of 29 taxa was recorded, and presence/absence for an additional 50. Results: Overall, one third of each occurrence was missed by one of the two observers, but with large differences among species. There were more missed occurrences at low abundances. Species occurring at low abundance when present tended to be frequently overlooked. Variance component analyses indicated that cover data on 5 of 17 species had a significant observer bias. Observer-explained variance was < 10% in 15 of 17 species. Conclusion: The substantial number of missed occurrences suggests poor power in detecting changes based on presence/absence data. The magnitude of observer bias in cover estimates was relatively small, compared with random error, and therefore potentially analytically tractable. Data in this monitoring system could be improved by a more structured working model during field work.},
   keywords = {Forest
Observer error
Permanent plot
Statistical power
Sweden},
   ISSN = {1654-1103},
   DOI = {10.3170/2008-8-18423},
   url = {https://doi.org/10.3170/2008-8-18423},
   year = {2008},
   type = {Journal Article}
}

Downloads: 0