Evaluating Integrated Assessment Tools for Policy Support. Bergez, J.; Kuiper, M.; Thérond, O.; Taverne, M.; Belhouchette, H.; and Wery, J. In Brouwer, F. M. and Ittersum, M. K., editors, Environmental and Agricultural Modelling, pages 237–256. Springer Netherlands.
Evaluating Integrated Assessment Tools for Policy Support [link]Paper  doi  abstract   bibtex   
Integrated Assessment Modelling tools are complex tools requiring specific evaluation methodologies. Based on the example of the SEAMLESS-Integrated framework, we show how the conceptual, technical and system evaluation steps of the different components (procedures, quantitative models, graphic user interfaces) were performed by a multidisciplinary team. To make the not-yet-available tool real, mock-up and test cases were mobilized throughout the development process in order to integrate final end-users in the evaluation process. The main lessons from the project are that the evaluation required: (i) the use of prototypes to advance properly in the design and testing (spiral methodology); (ii) the use of case studies to stick to the end-users requirements; (iii) a proper timing of development and delivery in order to keep on schedule and leave time to the evaluation process; (iv) a multidisciplinary team of evaluators as tools are of diverse types; and (v) that it is difficult to keep independence between testers, end-users and modellers in order to guaranty transparency in the development and evaluation process.
@incollection{bergezEvaluatingIntegratedAssessment2010,
  title = {Evaluating Integrated Assessment Tools for Policy Support},
  booktitle = {Environmental and {{Agricultural Modelling}}},
  author = {Bergez, Jacques-Eric and Kuiper, Marijke and Thérond, Olivier and Taverne, Marie and Belhouchette, Hatem and Wery, Jacques},
  editor = {Brouwer, Floor M. and Ittersum, Martin K.},
  date = {2010},
  pages = {237--256},
  publisher = {{Springer Netherlands}},
  doi = {10.1007/978-90-481-3619-3\\_10},
  url = {https://doi.org/10.1007/978-90-481-3619-3_10},
  abstract = {Integrated Assessment Modelling tools are complex tools requiring specific evaluation methodologies. Based on the example of the SEAMLESS-Integrated framework, we show how the conceptual, technical and system evaluation steps of the different components (procedures, quantitative models, graphic user interfaces) were performed by a multidisciplinary team. To make the not-yet-available tool real, mock-up and test cases were mobilized throughout the development process in order to integrate final end-users in the evaluation process. The main lessons from the project are that the evaluation required: (i) the use of prototypes to advance properly in the design and testing (spiral methodology); (ii) the use of case studies to stick to the end-users requirements; (iii) a proper timing of development and delivery in order to keep on schedule and leave time to the evaluation process; (iv) a multidisciplinary team of evaluators as tools are of diverse types; and (v) that it is difficult to keep independence between testers, end-users and modellers in order to guaranty transparency in the development and evaluation process.},
  keywords = {*imported-from-citeulike-INRMM,~INRMM-MiD:c-13384223,assessment,integrated-modelling,science-policy-interface}
}
Downloads: 0