Simulation testing the robustness of stock assessment models to error: some results from the ICES strategic initiative on stock assessment methods. Deroba, J. J., Butterworth, D. S., Methot, De Oliveira, J. A. A., Fernandez, C., Nielsen, A., Cadrin, S. X., Dickey-Collas, M., Legault, C. M., Ianelli, J., Valero, J. L., Needle, C. L., O'Malley, J. M., Chang, Y., Thompson, G. G., Canales, C., Swain, D. P., Miller, D. C. M., Hintzen, N. T., Bertignac, M., Ibaibarriaga, L., Silva, A., Murta, A., Kell, L. T., de Moor, C. L., Parma, A. M., Dichmont, C. M., Restrepo, V. R., Ye, Y., Jardim, E., Spencer, P. D., Hanselman, D. H., Blaylock, J., Mood, M., & Hulson, P. -. F. ICES JOURNAL OF MARINE SCIENCE, 72(1):19-30, OXFORD UNIV PRESS, GREAT CLARENDON ST, OXFORD OX2 6DP, ENGLAND, JAN, 2015. World Conference on Stock Assessment Methods for Sustainable Fisheries, Boston, MA, JUL, 2013
doi  abstract   bibtex   
The World Conference on Stock Assessment Methods (July 2013) included a workshop on testing assessment methods through simulations. The exercise was made up of two steps applied to datasets from 14 representative fish stocks from around the world. Step 1 involved applying stock assessments to datasets with varying degrees of effort dedicated to optimizing fit. Step 2 was applied to a subset of the stocks and involved characteristics of given model fits being used to generate pseudo-data with error. These pseudo-data were then provided to assessment modellers and fits to the pseudo-data provided consistency checks within (self-tests) and among (cross-tests) assessment models. Although trends in biomass were often similar across models, the scaling of absolute biomass was not consistent across models. Similar types of models tended to perform similarly (e.g. age based or production models). Self-testing and cross-testing of models are a useful diagnostic approach, and suggested that estimates in the most recent years of time-series were the least robust. Results from the simulation exercise provide a basis for guidance on future large-scale simulation experiments and demonstrate the need for strategic investments in the evaluation and development of stock assessment methods.
@article{ ISI:000350153200003,
Author = {Deroba, J. J. and Butterworth, D. S. and Methot, Jr., R. D. and De
   Oliveira, J. A. A. and Fernandez, C. and Nielsen, A. and Cadrin, S. X.
   and Dickey-Collas, M. and Legault, C. M. and Ianelli, J. and Valero, J.
   L. and Needle, C. L. and O'Malley, J. M. and Chang, Y-J. and Thompson,
   G. G. and Canales, C. and Swain, D. P. and Miller, D. C. M. and Hintzen,
   N. T. and Bertignac, M. and Ibaibarriaga, L. and Silva, A. and Murta, A.
   and Kell, L. T. and de Moor, C. L. and Parma, A. M. and Dichmont, C. M.
   and Restrepo, V. R. and Ye, Y. and Jardim, E. and Spencer, P. D. and
   Hanselman, D. H. and Blaylock, J. and Mood, M. and Hulson, P. -J. F.},
Title = {{Simulation testing the robustness of stock assessment models to error:
   some results from the ICES strategic initiative on stock assessment
   methods}},
Journal = {{ICES JOURNAL OF MARINE SCIENCE}},
Year = {{2015}},
Volume = {{72}},
Number = {{1}},
Pages = {{19-30}},
Month = {{JAN}},
Note = {{World Conference on Stock Assessment Methods for Sustainable Fisheries,
   Boston, MA, JUL, 2013}},
Abstract = {{The World Conference on Stock Assessment Methods (July 2013) included a
   workshop on testing assessment methods through simulations. The exercise
   was made up of two steps applied to datasets from 14 representative fish
   stocks from around the world. Step 1 involved applying stock assessments
   to datasets with varying degrees of effort dedicated to optimizing fit.
   Step 2 was applied to a subset of the stocks and involved
   characteristics of given model fits being used to generate pseudo-data
   with error. These pseudo-data were then provided to assessment modellers
   and fits to the pseudo-data provided consistency checks within
   (self-tests) and among (cross-tests) assessment models. Although trends
   in biomass were often similar across models, the scaling of absolute
   biomass was not consistent across models. Similar types of models tended
   to perform similarly (e.g. age based or production models). Self-testing
   and cross-testing of models are a useful diagnostic approach, and
   suggested that estimates in the most recent years of time-series were
   the least robust. Results from the simulation exercise provide a basis
   for guidance on future large-scale simulation experiments and
   demonstrate the need for strategic investments in the evaluation and
   development of stock assessment methods.}},
Publisher = {{OXFORD UNIV PRESS}},
Address = {{GREAT CLARENDON ST, OXFORD OX2 6DP, ENGLAND}},
Type = {{Article; Proceedings Paper}},
Language = {{English}},
Affiliation = {{Deroba, JJ (Reprint Author), NOAA NMFS, 166 Water St, Woods Hole, MA 02543 USA.
   Deroba, J. J.; Legault, C. M., NOAA NMFS, Woods Hole, MA 02543 USA.
   Butterworth, D. S.; de Moor, C. L., Univ Cape Town, Dept Math \& Appl Math, Marine Resource Assessment \& Management Grp MARAM, ZA-7701 Rondebosch, South Africa.
   Methot, R. D., Jr.; Ianelli, J.; Thompson, G. G.; Spencer, P. D., NOAA NMFS, Seattle, WA USA.
   De Oliveira, J. A. A., Lowestoft Lab, Cefas, Lowestoft NR33 OHT, Suffolk, England.
   Fernandez, C.; Dickey-Collas, M., ICES, Copenhagen V, Denmark.
   Nielsen, A., Tech Univ Denmark, Natl Inst Aquat Resources, DK-2920 Charlottenlund, Denmark.
   Cadrin, S. X., Univ Massachusetts, Sch Marine Sci \& Technol, Fairhaven, MA USA.
   Dickey-Collas, M.; Miller, D. C. M., Wageningen Inst Marine Resources \& Ecosyst Studie, NL-1976 Ijmuiden, Netherlands.
   Valero, J. L., CAPAM, La Jolla, CA USA.
   Needle, C. L., Marine Scotland Sci, Marine Lab, Aberdeen AB11 9DB, Scotland.
   O'Malley, J. M., NOAA NMFS, Honolulu, HI USA.
   Chang, Y-J., Univ Hawaii, Pacific Isl Fisheries Sci Ctr, Joint Inst Marine \& Atmospher Res, Honolulu, HI 96822 USA.
   Canales, C., Inst Fomento Pesquero IFOP, Valparaiso, Chile.
   Swain, D. P., Fisheries \& Oceans Canada, Gulf Fisheries Ctr, Moncton, NB E1C 9B6, Canada.
   Hintzen, N. T., Wageningen UR, Inst Marine Resources \& Ecosyst Studies IMARES, NL-1970 AB Ijmuiden, Netherlands.
   Bertignac, M., IFREMER, Unite Sci \& Technol Halieut, F-29280 Plouzane, France.
   Ibaibarriaga, L., AZTI Tecnalia, Marine Res Div, E-48395 Sukarrieta, Bizkaia, Spain.
   Silva, A.; Murta, A., IPMA Inst Portugues Mar \& Atmosfera, P-1449006 Lisbon, Portugal.
   Kell, L. T., ICCAT Secretariat, Madrid 28002, Spain.
   Parma, A. M., Ctr Nacl Patagon, RA-9120 Puerto Madryn, Chugut, Argentina.
   Dichmont, C. M., CSIRO Wealth Oceans Flagship, Queensland Biosci Precinct, St Lucia, Qld 4067, Australia.
   Restrepo, V. R., Int Seafood Sustainabil Fdn, Washington, DC 20005 USA.
   Ye, Y., Food \& Agr Org United Nations, I-00153 Rome, Italy.
   Jardim, E., European Commiss Joint Res Ctr, I-21027 Ispra, VA, Italy.
   Hanselman, D. H.; Hulson, P. -J. F., NOAA NMFS, Juneau, AK USA.
   Blaylock, J.; Mood, M., Integrated Stat, Falmouth, MA USA.}},
DOI = {{10.1093/icesjms/fst237}},
ISSN = {{1054-3139}},
EISSN = {{1095-9289}},
Keywords = {{cross-test; model comparison; pseudo data; self-test; time-series
   analysis; vpa}},
Keywords-Plus = {{AT-AGE ANALYSIS; MANAGEMENT PROCEDURES; NATURAL MORTALITY; PERFORMANCE;
   UNCERTAINTY; FISHERY}},
Research-Areas = {{Fisheries; Marine \& Freshwater Biology; Oceanography}},
Web-of-Science-Categories  = {{Fisheries; Marine \& Freshwater Biology; Oceanography}},
Author-Email = {{jonathan.deroba@noaa.gov}},
ResearcherID-Numbers = {{Dickey-Collas, Mark/A-8036-2008
   Silva, Alexandra/I-4326-2017
   Ibaibarriaga, Leire/C-2483-2009
   }},
ORCID-Numbers = {{Silva, Alexandra/0000-0002-2950-1429
   Ibaibarriaga, Leire/0000-0001-5619-1174
   Chang, Yi-Jay/0000-0002-7472-4672}},
Number-of-Cited-References = {{26}},
Times-Cited = {{28}},
Usage-Count-Last-180-days = {{2}},
Usage-Count-Since-2013 = {{20}},
Journal-ISO = {{ICES J. Mar. Sci.}},
Doc-Delivery-Number = {{CC2CT}},
Unique-ID = {{ISI:000350153200003}},
OA = {{No}},
ESI-Highly-Cited-Paper = {{Y}},
ESI-Hot-Paper = {{N}},
DA = {{2017-08-17}},
}

Downloads: 0