Model selection and model averaging in behavioural ecology: The utility of the IT-AIC framework. Richards, S. A., Whittingham, M. J., & Stephens, P. A. Behavioral Ecology and Sociobiology, 65(1):77--89, October, 2010.
Model selection and model averaging in behavioural ecology: The utility of the IT-AIC framework [link]Paper  doi  abstract   bibtex   
Behavioural ecologists often study complex systems in which multiple hypotheses could be proposed to explain observed phenomena. For some systems, simple controlled experiments can be employed to reveal part of the complexity; often, however, observational studies that incorporate a multitude of causal factors may be the only (or preferred) avenue of study. We assess the value of recently advocated approaches to inference in both contexts. Specifically, we examine the use of information theoretic (IT) model selection using Akaike’s information criterion (AIC). We find that, for simple analyses, the advantages of switching to an IT-AIC approach are likely to be slight, especially given recent emphasis on biological rather than statistical significance. By contrast, the model selection approach embodied by IT approaches offers significant advantages when applied to problems of more complex causality. Model averaging is an intuitively appealing extension to model selection. However, we were unable to demonstrate consistent improvements in prediction accuracy when using model averaging with IT-AIC; our equivocal results suggest that more research is needed on its utility. We illustrate our arguments with worked examples from behavioural experiments.
@article{ richards_model_2010,
  title = {Model selection and model averaging in behavioural ecology: {The} utility of the {IT}-{AIC} framework},
  volume = {65},
  issn = {0340-5443, 1432-0762},
  shorttitle = {Model selection and model averaging in behavioural ecology},
  url = {http://link.springer.com/article/10.1007/s00265-010-1035-8},
  doi = {10.1007/s00265-010-1035-8},
  abstract = {Behavioural ecologists often study complex systems in which multiple hypotheses could be proposed to explain observed phenomena. For some systems, simple controlled experiments can be employed to reveal part of the complexity; often, however, observational studies that incorporate a multitude of causal factors may be the only (or preferred) avenue of study. We assess the value of recently advocated approaches to inference in both contexts. Specifically, we examine the use of information theoretic (IT) model selection using Akaike’s information criterion (AIC). We find that, for simple analyses, the advantages of switching to an IT-AIC approach are likely to be slight, especially given recent emphasis on biological rather than statistical significance. By contrast, the model selection approach embodied by IT approaches offers significant advantages when applied to problems of more complex causality. Model averaging is an intuitively appealing extension to model selection. However, we were unable to demonstrate consistent improvements in prediction accuracy when using model averaging with IT-AIC; our equivocal results suggest that more research is needed on its utility. We illustrate our arguments with worked examples from behavioural experiments.},
  language = {English},
  number = {1},
  urldate = {2015-01-21TZ},
  journal = {Behavioral Ecology and Sociobiology},
  author = {Richards, Shane A. and Whittingham, Mark J. and Stephens, Philip A.},
  month = {October},
  year = {2010},
  keywords = {Behavioural Sciences, Effect size, Inference, Model weighting, Null hypotheses, Process-based models, Statistics, Zoology, evolutionary biology, statistics},
  pages = {77--89}
}

Downloads: 0