Simulation testing the robustness of stock assessment models to error: some results from the ICES strategic initiative on stock assessment methods. Deroba, J. J., Butterworth, D. S., Methot, De Oliveira, J. A. A., Fernandez, C., Nielsen, A., Cadrin, S. X., Dickey-Collas, M., Legault, C. M., Ianelli, J., Valero, J. L., Needle, C. L., O'Malley, J. M., Chang, Y., Thompson, G. G., Canales, C., Swain, D. P., Miller, D. C. M., Hintzen, N. T., Bertignac, M., Ibaibarriaga, L., Silva, A., Murta, A., Kell, L. T., de Moor, C. L., Parma, A. M., Dichmont, C. M., Restrepo, V. R., Ye, Y., Jardim, E., Spencer, P. D., Hanselman, D. H., Blaylock, J., Mood, M., & Hulson, P. -. F. ICES JOURNAL OF MARINE SCIENCE, 72(1):19-30, OXFORD UNIV PRESS, GREAT CLARENDON ST, OXFORD OX2 6DP, ENGLAND, JAN, 2015. World Conference on Stock Assessment Methods for Sustainable Fisheries, Boston, MA, JUL, 2013doi abstract bibtex The World Conference on Stock Assessment Methods (July 2013) included a workshop on testing assessment methods through simulations. The exercise was made up of two steps applied to datasets from 14 representative fish stocks from around the world. Step 1 involved applying stock assessments to datasets with varying degrees of effort dedicated to optimizing fit. Step 2 was applied to a subset of the stocks and involved characteristics of given model fits being used to generate pseudo-data with error. These pseudo-data were then provided to assessment modellers and fits to the pseudo-data provided consistency checks within (self-tests) and among (cross-tests) assessment models. Although trends in biomass were often similar across models, the scaling of absolute biomass was not consistent across models. Similar types of models tended to perform similarly (e.g. age based or production models). Self-testing and cross-testing of models are a useful diagnostic approach, and suggested that estimates in the most recent years of time-series were the least robust. Results from the simulation exercise provide a basis for guidance on future large-scale simulation experiments and demonstrate the need for strategic investments in the evaluation and development of stock assessment methods.
@article{ ISI:000350153200003,
Author = {Deroba, J. J. and Butterworth, D. S. and Methot, Jr., R. D. and De
Oliveira, J. A. A. and Fernandez, C. and Nielsen, A. and Cadrin, S. X.
and Dickey-Collas, M. and Legault, C. M. and Ianelli, J. and Valero, J.
L. and Needle, C. L. and O'Malley, J. M. and Chang, Y-J. and Thompson,
G. G. and Canales, C. and Swain, D. P. and Miller, D. C. M. and Hintzen,
N. T. and Bertignac, M. and Ibaibarriaga, L. and Silva, A. and Murta, A.
and Kell, L. T. and de Moor, C. L. and Parma, A. M. and Dichmont, C. M.
and Restrepo, V. R. and Ye, Y. and Jardim, E. and Spencer, P. D. and
Hanselman, D. H. and Blaylock, J. and Mood, M. and Hulson, P. -J. F.},
Title = {{Simulation testing the robustness of stock assessment models to error:
some results from the ICES strategic initiative on stock assessment
methods}},
Journal = {{ICES JOURNAL OF MARINE SCIENCE}},
Year = {{2015}},
Volume = {{72}},
Number = {{1}},
Pages = {{19-30}},
Month = {{JAN}},
Note = {{World Conference on Stock Assessment Methods for Sustainable Fisheries,
Boston, MA, JUL, 2013}},
Abstract = {{The World Conference on Stock Assessment Methods (July 2013) included a
workshop on testing assessment methods through simulations. The exercise
was made up of two steps applied to datasets from 14 representative fish
stocks from around the world. Step 1 involved applying stock assessments
to datasets with varying degrees of effort dedicated to optimizing fit.
Step 2 was applied to a subset of the stocks and involved
characteristics of given model fits being used to generate pseudo-data
with error. These pseudo-data were then provided to assessment modellers
and fits to the pseudo-data provided consistency checks within
(self-tests) and among (cross-tests) assessment models. Although trends
in biomass were often similar across models, the scaling of absolute
biomass was not consistent across models. Similar types of models tended
to perform similarly (e.g. age based or production models). Self-testing
and cross-testing of models are a useful diagnostic approach, and
suggested that estimates in the most recent years of time-series were
the least robust. Results from the simulation exercise provide a basis
for guidance on future large-scale simulation experiments and
demonstrate the need for strategic investments in the evaluation and
development of stock assessment methods.}},
Publisher = {{OXFORD UNIV PRESS}},
Address = {{GREAT CLARENDON ST, OXFORD OX2 6DP, ENGLAND}},
Type = {{Article; Proceedings Paper}},
Language = {{English}},
Affiliation = {{Deroba, JJ (Reprint Author), NOAA NMFS, 166 Water St, Woods Hole, MA 02543 USA.
Deroba, J. J.; Legault, C. M., NOAA NMFS, Woods Hole, MA 02543 USA.
Butterworth, D. S.; de Moor, C. L., Univ Cape Town, Dept Math \& Appl Math, Marine Resource Assessment \& Management Grp MARAM, ZA-7701 Rondebosch, South Africa.
Methot, R. D., Jr.; Ianelli, J.; Thompson, G. G.; Spencer, P. D., NOAA NMFS, Seattle, WA USA.
De Oliveira, J. A. A., Lowestoft Lab, Cefas, Lowestoft NR33 OHT, Suffolk, England.
Fernandez, C.; Dickey-Collas, M., ICES, Copenhagen V, Denmark.
Nielsen, A., Tech Univ Denmark, Natl Inst Aquat Resources, DK-2920 Charlottenlund, Denmark.
Cadrin, S. X., Univ Massachusetts, Sch Marine Sci \& Technol, Fairhaven, MA USA.
Dickey-Collas, M.; Miller, D. C. M., Wageningen Inst Marine Resources \& Ecosyst Studie, NL-1976 Ijmuiden, Netherlands.
Valero, J. L., CAPAM, La Jolla, CA USA.
Needle, C. L., Marine Scotland Sci, Marine Lab, Aberdeen AB11 9DB, Scotland.
O'Malley, J. M., NOAA NMFS, Honolulu, HI USA.
Chang, Y-J., Univ Hawaii, Pacific Isl Fisheries Sci Ctr, Joint Inst Marine \& Atmospher Res, Honolulu, HI 96822 USA.
Canales, C., Inst Fomento Pesquero IFOP, Valparaiso, Chile.
Swain, D. P., Fisheries \& Oceans Canada, Gulf Fisheries Ctr, Moncton, NB E1C 9B6, Canada.
Hintzen, N. T., Wageningen UR, Inst Marine Resources \& Ecosyst Studies IMARES, NL-1970 AB Ijmuiden, Netherlands.
Bertignac, M., IFREMER, Unite Sci \& Technol Halieut, F-29280 Plouzane, France.
Ibaibarriaga, L., AZTI Tecnalia, Marine Res Div, E-48395 Sukarrieta, Bizkaia, Spain.
Silva, A.; Murta, A., IPMA Inst Portugues Mar \& Atmosfera, P-1449006 Lisbon, Portugal.
Kell, L. T., ICCAT Secretariat, Madrid 28002, Spain.
Parma, A. M., Ctr Nacl Patagon, RA-9120 Puerto Madryn, Chugut, Argentina.
Dichmont, C. M., CSIRO Wealth Oceans Flagship, Queensland Biosci Precinct, St Lucia, Qld 4067, Australia.
Restrepo, V. R., Int Seafood Sustainabil Fdn, Washington, DC 20005 USA.
Ye, Y., Food \& Agr Org United Nations, I-00153 Rome, Italy.
Jardim, E., European Commiss Joint Res Ctr, I-21027 Ispra, VA, Italy.
Hanselman, D. H.; Hulson, P. -J. F., NOAA NMFS, Juneau, AK USA.
Blaylock, J.; Mood, M., Integrated Stat, Falmouth, MA USA.}},
DOI = {{10.1093/icesjms/fst237}},
ISSN = {{1054-3139}},
EISSN = {{1095-9289}},
Keywords = {{cross-test; model comparison; pseudo data; self-test; time-series
analysis; vpa}},
Keywords-Plus = {{AT-AGE ANALYSIS; MANAGEMENT PROCEDURES; NATURAL MORTALITY; PERFORMANCE;
UNCERTAINTY; FISHERY}},
Research-Areas = {{Fisheries; Marine \& Freshwater Biology; Oceanography}},
Web-of-Science-Categories = {{Fisheries; Marine \& Freshwater Biology; Oceanography}},
Author-Email = {{jonathan.deroba@noaa.gov}},
ResearcherID-Numbers = {{Dickey-Collas, Mark/A-8036-2008
Silva, Alexandra/I-4326-2017
Ibaibarriaga, Leire/C-2483-2009
}},
ORCID-Numbers = {{Silva, Alexandra/0000-0002-2950-1429
Ibaibarriaga, Leire/0000-0001-5619-1174
Chang, Yi-Jay/0000-0002-7472-4672}},
Number-of-Cited-References = {{26}},
Times-Cited = {{28}},
Usage-Count-Last-180-days = {{2}},
Usage-Count-Since-2013 = {{20}},
Journal-ISO = {{ICES J. Mar. Sci.}},
Doc-Delivery-Number = {{CC2CT}},
Unique-ID = {{ISI:000350153200003}},
OA = {{No}},
ESI-Highly-Cited-Paper = {{Y}},
ESI-Hot-Paper = {{N}},
DA = {{2017-08-17}},
}
Downloads: 0
{"_id":"QMFscvBs3zDeHZmfw","bibbaseid":"deroba-butterworth-methot-deoliveira-fernandez-nielsen-cadrin-dickeycollas-etal-simulationtestingtherobustnessofstockassessmentmodelstoerrorsomeresultsfromtheicesstrategicinitiativeonstockassessmentmethods-2015","downloads":0,"creationDate":"2017-08-17T14:08:07.531Z","title":"Simulation testing the robustness of stock assessment models to error: some results from the ICES strategic initiative on stock assessment methods","author_short":["Deroba, J. J.","Butterworth, D. S.","Methot","De Oliveira, J. A. A.","Fernandez, C.","Nielsen, A.","Cadrin, S. X.","Dickey-Collas, M.","Legault, C. M.","Ianelli, J.","Valero, J. L.","Needle, C. L.","O'Malley, J. M.","Chang, Y.","Thompson, G. G.","Canales, C.","Swain, D. P.","Miller, D. C. M.","Hintzen, N. T.","Bertignac, M.","Ibaibarriaga, L.","Silva, A.","Murta, A.","Kell, L. T.","de Moor, C. L.","Parma, A. M.","Dichmont, C. M.","Restrepo, V. R.","Ye, Y.","Jardim, E.","Spencer, P. D.","Hanselman, D. H.","Blaylock, J.","Mood, M.","Hulson, P. -. F."],"year":2015,"bibtype":"article","biburl":"http://flr-project.org/flr.bib","bibdata":{"bibtype":"article","type":"Article; Proceedings Paper","author":[{"propositions":[],"lastnames":["Deroba"],"firstnames":["J.","J."],"suffixes":[]},{"propositions":[],"lastnames":["Butterworth"],"firstnames":["D.","S."],"suffixes":[]},{"firstnames":[],"propositions":[],"lastnames":["Methot"],"suffixes":["Jr.",",","R.","D."]},{"propositions":[],"lastnames":["De","Oliveira"],"firstnames":["J.","A.","A."],"suffixes":[]},{"propositions":[],"lastnames":["Fernandez"],"firstnames":["C."],"suffixes":[]},{"propositions":[],"lastnames":["Nielsen"],"firstnames":["A."],"suffixes":[]},{"propositions":[],"lastnames":["Cadrin"],"firstnames":["S.","X."],"suffixes":[]},{"propositions":[],"lastnames":["Dickey-Collas"],"firstnames":["M."],"suffixes":[]},{"propositions":[],"lastnames":["Legault"],"firstnames":["C.","M."],"suffixes":[]},{"propositions":[],"lastnames":["Ianelli"],"firstnames":["J."],"suffixes":[]},{"propositions":[],"lastnames":["Valero"],"firstnames":["J.","L."],"suffixes":[]},{"propositions":[],"lastnames":["Needle"],"firstnames":["C.","L."],"suffixes":[]},{"propositions":[],"lastnames":["O'Malley"],"firstnames":["J.","M."],"suffixes":[]},{"propositions":[],"lastnames":["Chang"],"firstnames":["Y-J."],"suffixes":[]},{"propositions":[],"lastnames":["Thompson"],"firstnames":["G.","G."],"suffixes":[]},{"propositions":[],"lastnames":["Canales"],"firstnames":["C."],"suffixes":[]},{"propositions":[],"lastnames":["Swain"],"firstnames":["D.","P."],"suffixes":[]},{"propositions":[],"lastnames":["Miller"],"firstnames":["D.","C.","M."],"suffixes":[]},{"propositions":[],"lastnames":["Hintzen"],"firstnames":["N.","T."],"suffixes":[]},{"propositions":[],"lastnames":["Bertignac"],"firstnames":["M."],"suffixes":[]},{"propositions":[],"lastnames":["Ibaibarriaga"],"firstnames":["L."],"suffixes":[]},{"propositions":[],"lastnames":["Silva"],"firstnames":["A."],"suffixes":[]},{"propositions":[],"lastnames":["Murta"],"firstnames":["A."],"suffixes":[]},{"propositions":[],"lastnames":["Kell"],"firstnames":["L.","T."],"suffixes":[]},{"propositions":["de"],"lastnames":["Moor"],"firstnames":["C.","L."],"suffixes":[]},{"propositions":[],"lastnames":["Parma"],"firstnames":["A.","M."],"suffixes":[]},{"propositions":[],"lastnames":["Dichmont"],"firstnames":["C.","M."],"suffixes":[]},{"propositions":[],"lastnames":["Restrepo"],"firstnames":["V.","R."],"suffixes":[]},{"propositions":[],"lastnames":["Ye"],"firstnames":["Y."],"suffixes":[]},{"propositions":[],"lastnames":["Jardim"],"firstnames":["E."],"suffixes":[]},{"propositions":[],"lastnames":["Spencer"],"firstnames":["P.","D."],"suffixes":[]},{"propositions":[],"lastnames":["Hanselman"],"firstnames":["D.","H."],"suffixes":[]},{"propositions":[],"lastnames":["Blaylock"],"firstnames":["J."],"suffixes":[]},{"propositions":[],"lastnames":["Mood"],"firstnames":["M."],"suffixes":[]},{"propositions":[],"lastnames":["Hulson"],"firstnames":["P.","-J.","F."],"suffixes":[]}],"title":"Simulation testing the robustness of stock assessment models to error: some results from the ICES strategic initiative on stock assessment methods","journal":"ICES JOURNAL OF MARINE SCIENCE","year":"2015","volume":"72","number":"1","pages":"19-30","month":"JAN","note":"World Conference on Stock Assessment Methods for Sustainable Fisheries, Boston, MA, JUL, 2013","abstract":"The World Conference on Stock Assessment Methods (July 2013) included a workshop on testing assessment methods through simulations. The exercise was made up of two steps applied to datasets from 14 representative fish stocks from around the world. Step 1 involved applying stock assessments to datasets with varying degrees of effort dedicated to optimizing fit. Step 2 was applied to a subset of the stocks and involved characteristics of given model fits being used to generate pseudo-data with error. These pseudo-data were then provided to assessment modellers and fits to the pseudo-data provided consistency checks within (self-tests) and among (cross-tests) assessment models. Although trends in biomass were often similar across models, the scaling of absolute biomass was not consistent across models. Similar types of models tended to perform similarly (e.g. age based or production models). Self-testing and cross-testing of models are a useful diagnostic approach, and suggested that estimates in the most recent years of time-series were the least robust. Results from the simulation exercise provide a basis for guidance on future large-scale simulation experiments and demonstrate the need for strategic investments in the evaluation and development of stock assessment methods.","publisher":"OXFORD UNIV PRESS","address":"GREAT CLARENDON ST, OXFORD OX2 6DP, ENGLAND","language":"English","affiliation":"Deroba, JJ (Reprint Author), NOAA NMFS, 166 Water St, Woods Hole, MA 02543 USA. Deroba, J. J.; Legault, C. M., NOAA NMFS, Woods Hole, MA 02543 USA. Butterworth, D. S.; de Moor, C. L., Univ Cape Town, Dept Math & Appl Math, Marine Resource Assessment & Management Grp MARAM, ZA-7701 Rondebosch, South Africa. Methot, R. D., Jr.; Ianelli, J.; Thompson, G. G.; Spencer, P. D., NOAA NMFS, Seattle, WA USA. De Oliveira, J. A. A., Lowestoft Lab, Cefas, Lowestoft NR33 OHT, Suffolk, England. Fernandez, C.; Dickey-Collas, M., ICES, Copenhagen V, Denmark. Nielsen, A., Tech Univ Denmark, Natl Inst Aquat Resources, DK-2920 Charlottenlund, Denmark. Cadrin, S. X., Univ Massachusetts, Sch Marine Sci & Technol, Fairhaven, MA USA. Dickey-Collas, M.; Miller, D. C. M., Wageningen Inst Marine Resources & Ecosyst Studie, NL-1976 Ijmuiden, Netherlands. Valero, J. L., CAPAM, La Jolla, CA USA. Needle, C. L., Marine Scotland Sci, Marine Lab, Aberdeen AB11 9DB, Scotland. O'Malley, J. M., NOAA NMFS, Honolulu, HI USA. Chang, Y-J., Univ Hawaii, Pacific Isl Fisheries Sci Ctr, Joint Inst Marine & Atmospher Res, Honolulu, HI 96822 USA. Canales, C., Inst Fomento Pesquero IFOP, Valparaiso, Chile. Swain, D. P., Fisheries & Oceans Canada, Gulf Fisheries Ctr, Moncton, NB E1C 9B6, Canada. Hintzen, N. T., Wageningen UR, Inst Marine Resources & Ecosyst Studies IMARES, NL-1970 AB Ijmuiden, Netherlands. Bertignac, M., IFREMER, Unite Sci & Technol Halieut, F-29280 Plouzane, France. Ibaibarriaga, L., AZTI Tecnalia, Marine Res Div, E-48395 Sukarrieta, Bizkaia, Spain. Silva, A.; Murta, A., IPMA Inst Portugues Mar & Atmosfera, P-1449006 Lisbon, Portugal. Kell, L. T., ICCAT Secretariat, Madrid 28002, Spain. Parma, A. M., Ctr Nacl Patagon, RA-9120 Puerto Madryn, Chugut, Argentina. Dichmont, C. M., CSIRO Wealth Oceans Flagship, Queensland Biosci Precinct, St Lucia, Qld 4067, Australia. Restrepo, V. R., Int Seafood Sustainabil Fdn, Washington, DC 20005 USA. Ye, Y., Food & Agr Org United Nations, I-00153 Rome, Italy. Jardim, E., European Commiss Joint Res Ctr, I-21027 Ispra, VA, Italy. Hanselman, D. H.; Hulson, P. -J. F., NOAA NMFS, Juneau, AK USA. Blaylock, J.; Mood, M., Integrated Stat, Falmouth, MA USA.","doi":"10.1093/icesjms/fst237","issn":"1054-3139","eissn":"1095-9289","keywords":"cross-test; model comparison; pseudo data; self-test; time-series analysis; vpa","keywords-plus":"AT-AGE ANALYSIS; MANAGEMENT PROCEDURES; NATURAL MORTALITY; PERFORMANCE; UNCERTAINTY; FISHERY","research-areas":"Fisheries; Marine & Freshwater Biology; Oceanography","web-of-science-categories":"Fisheries; Marine & Freshwater Biology; Oceanography","author-email":"jonathan.deroba@noaa.gov","researcherid-numbers":"Dickey-Collas, Mark/A-8036-2008 Silva, Alexandra/I-4326-2017 Ibaibarriaga, Leire/C-2483-2009 ","orcid-numbers":"Silva, Alexandra/0000-0002-2950-1429 Ibaibarriaga, Leire/0000-0001-5619-1174 Chang, Yi-Jay/0000-0002-7472-4672","number-of-cited-references":"26","times-cited":"28","usage-count-last-180-days":"2","usage-count-since-2013":"20","journal-iso":"ICES J. Mar. Sci.","doc-delivery-number":"CC2CT","unique-id":"ISI:000350153200003","oa":"No","esi-highly-cited-paper":"Y","esi-hot-paper":"N","da":"2017-08-17","bibtex":"@article{ ISI:000350153200003,\nAuthor = {Deroba, J. J. and Butterworth, D. S. and Methot, Jr., R. D. and De\n Oliveira, J. A. A. and Fernandez, C. and Nielsen, A. and Cadrin, S. X.\n and Dickey-Collas, M. and Legault, C. M. and Ianelli, J. and Valero, J.\n L. and Needle, C. L. and O'Malley, J. M. and Chang, Y-J. and Thompson,\n G. G. and Canales, C. and Swain, D. P. and Miller, D. C. M. and Hintzen,\n N. T. and Bertignac, M. and Ibaibarriaga, L. and Silva, A. and Murta, A.\n and Kell, L. T. and de Moor, C. L. and Parma, A. M. and Dichmont, C. M.\n and Restrepo, V. R. and Ye, Y. and Jardim, E. and Spencer, P. D. and\n Hanselman, D. H. and Blaylock, J. and Mood, M. and Hulson, P. -J. F.},\nTitle = {{Simulation testing the robustness of stock assessment models to error:\n some results from the ICES strategic initiative on stock assessment\n methods}},\nJournal = {{ICES JOURNAL OF MARINE SCIENCE}},\nYear = {{2015}},\nVolume = {{72}},\nNumber = {{1}},\nPages = {{19-30}},\nMonth = {{JAN}},\nNote = {{World Conference on Stock Assessment Methods for Sustainable Fisheries,\n Boston, MA, JUL, 2013}},\nAbstract = {{The World Conference on Stock Assessment Methods (July 2013) included a\n workshop on testing assessment methods through simulations. The exercise\n was made up of two steps applied to datasets from 14 representative fish\n stocks from around the world. Step 1 involved applying stock assessments\n to datasets with varying degrees of effort dedicated to optimizing fit.\n Step 2 was applied to a subset of the stocks and involved\n characteristics of given model fits being used to generate pseudo-data\n with error. These pseudo-data were then provided to assessment modellers\n and fits to the pseudo-data provided consistency checks within\n (self-tests) and among (cross-tests) assessment models. Although trends\n in biomass were often similar across models, the scaling of absolute\n biomass was not consistent across models. Similar types of models tended\n to perform similarly (e.g. age based or production models). Self-testing\n and cross-testing of models are a useful diagnostic approach, and\n suggested that estimates in the most recent years of time-series were\n the least robust. Results from the simulation exercise provide a basis\n for guidance on future large-scale simulation experiments and\n demonstrate the need for strategic investments in the evaluation and\n development of stock assessment methods.}},\nPublisher = {{OXFORD UNIV PRESS}},\nAddress = {{GREAT CLARENDON ST, OXFORD OX2 6DP, ENGLAND}},\nType = {{Article; Proceedings Paper}},\nLanguage = {{English}},\nAffiliation = {{Deroba, JJ (Reprint Author), NOAA NMFS, 166 Water St, Woods Hole, MA 02543 USA.\n Deroba, J. J.; Legault, C. M., NOAA NMFS, Woods Hole, MA 02543 USA.\n Butterworth, D. S.; de Moor, C. L., Univ Cape Town, Dept Math \\& Appl Math, Marine Resource Assessment \\& Management Grp MARAM, ZA-7701 Rondebosch, South Africa.\n Methot, R. D., Jr.; Ianelli, J.; Thompson, G. G.; Spencer, P. D., NOAA NMFS, Seattle, WA USA.\n De Oliveira, J. A. A., Lowestoft Lab, Cefas, Lowestoft NR33 OHT, Suffolk, England.\n Fernandez, C.; Dickey-Collas, M., ICES, Copenhagen V, Denmark.\n Nielsen, A., Tech Univ Denmark, Natl Inst Aquat Resources, DK-2920 Charlottenlund, Denmark.\n Cadrin, S. X., Univ Massachusetts, Sch Marine Sci \\& Technol, Fairhaven, MA USA.\n Dickey-Collas, M.; Miller, D. C. M., Wageningen Inst Marine Resources \\& Ecosyst Studie, NL-1976 Ijmuiden, Netherlands.\n Valero, J. L., CAPAM, La Jolla, CA USA.\n Needle, C. L., Marine Scotland Sci, Marine Lab, Aberdeen AB11 9DB, Scotland.\n O'Malley, J. M., NOAA NMFS, Honolulu, HI USA.\n Chang, Y-J., Univ Hawaii, Pacific Isl Fisheries Sci Ctr, Joint Inst Marine \\& Atmospher Res, Honolulu, HI 96822 USA.\n Canales, C., Inst Fomento Pesquero IFOP, Valparaiso, Chile.\n Swain, D. P., Fisheries \\& Oceans Canada, Gulf Fisheries Ctr, Moncton, NB E1C 9B6, Canada.\n Hintzen, N. T., Wageningen UR, Inst Marine Resources \\& Ecosyst Studies IMARES, NL-1970 AB Ijmuiden, Netherlands.\n Bertignac, M., IFREMER, Unite Sci \\& Technol Halieut, F-29280 Plouzane, France.\n Ibaibarriaga, L., AZTI Tecnalia, Marine Res Div, E-48395 Sukarrieta, Bizkaia, Spain.\n Silva, A.; Murta, A., IPMA Inst Portugues Mar \\& Atmosfera, P-1449006 Lisbon, Portugal.\n Kell, L. T., ICCAT Secretariat, Madrid 28002, Spain.\n Parma, A. M., Ctr Nacl Patagon, RA-9120 Puerto Madryn, Chugut, Argentina.\n Dichmont, C. M., CSIRO Wealth Oceans Flagship, Queensland Biosci Precinct, St Lucia, Qld 4067, Australia.\n Restrepo, V. R., Int Seafood Sustainabil Fdn, Washington, DC 20005 USA.\n Ye, Y., Food \\& Agr Org United Nations, I-00153 Rome, Italy.\n Jardim, E., European Commiss Joint Res Ctr, I-21027 Ispra, VA, Italy.\n Hanselman, D. H.; Hulson, P. -J. F., NOAA NMFS, Juneau, AK USA.\n Blaylock, J.; Mood, M., Integrated Stat, Falmouth, MA USA.}},\nDOI = {{10.1093/icesjms/fst237}},\nISSN = {{1054-3139}},\nEISSN = {{1095-9289}},\nKeywords = {{cross-test; model comparison; pseudo data; self-test; time-series\n analysis; vpa}},\nKeywords-Plus = {{AT-AGE ANALYSIS; MANAGEMENT PROCEDURES; NATURAL MORTALITY; PERFORMANCE;\n UNCERTAINTY; FISHERY}},\nResearch-Areas = {{Fisheries; Marine \\& Freshwater Biology; Oceanography}},\nWeb-of-Science-Categories = {{Fisheries; Marine \\& Freshwater Biology; Oceanography}},\nAuthor-Email = {{jonathan.deroba@noaa.gov}},\nResearcherID-Numbers = {{Dickey-Collas, Mark/A-8036-2008\n Silva, Alexandra/I-4326-2017\n Ibaibarriaga, Leire/C-2483-2009\n }},\nORCID-Numbers = {{Silva, Alexandra/0000-0002-2950-1429\n Ibaibarriaga, Leire/0000-0001-5619-1174\n Chang, Yi-Jay/0000-0002-7472-4672}},\nNumber-of-Cited-References = {{26}},\nTimes-Cited = {{28}},\nUsage-Count-Last-180-days = {{2}},\nUsage-Count-Since-2013 = {{20}},\nJournal-ISO = {{ICES J. Mar. Sci.}},\nDoc-Delivery-Number = {{CC2CT}},\nUnique-ID = {{ISI:000350153200003}},\nOA = {{No}},\nESI-Highly-Cited-Paper = {{Y}},\nESI-Hot-Paper = {{N}},\nDA = {{2017-08-17}},\n}\n\n","author_short":["Deroba, J. J.","Butterworth, D. S.","Methot","De Oliveira, J. A. A.","Fernandez, C.","Nielsen, A.","Cadrin, S. X.","Dickey-Collas, M.","Legault, C. M.","Ianelli, J.","Valero, J. L.","Needle, C. L.","O'Malley, J. M.","Chang, Y.","Thompson, G. G.","Canales, C.","Swain, D. P.","Miller, D. C. M.","Hintzen, N. T.","Bertignac, M.","Ibaibarriaga, L.","Silva, A.","Murta, A.","Kell, L. T.","de Moor, C. L.","Parma, A. M.","Dichmont, C. M.","Restrepo, V. R.","Ye, Y.","Jardim, E.","Spencer, P. D.","Hanselman, D. H.","Blaylock, J.","Mood, M.","Hulson, P. -. F."],"key":"ISI:000350153200003","id":"ISI:000350153200003","bibbaseid":"deroba-butterworth-methot-deoliveira-fernandez-nielsen-cadrin-dickeycollas-etal-simulationtestingtherobustnessofstockassessmentmodelstoerrorsomeresultsfromtheicesstrategicinitiativeonstockassessmentmethods-2015","role":"author","urls":{},"keyword":["cross-test; model comparison; pseudo data; self-test; time-series analysis; vpa"],"metadata":{"authorlinks":{}},"downloads":0},"search_terms":["simulation","testing","robustness","stock","assessment","models","error","results","ices","strategic","initiative","stock","assessment","methods","deroba","butterworth","methot","de oliveira","fernandez","nielsen","cadrin","dickey-collas","legault","ianelli","valero","needle","o'malley","chang","thompson","canales","swain","miller","hintzen","bertignac","ibaibarriaga","silva","murta","kell","de moor","parma","dichmont","restrepo","ye","jardim","spencer","hanselman","blaylock","mood","hulson"],"keywords":["cross-test; model comparison; pseudo data; self-test; time-series analysis; vpa"],"authorIDs":[],"dataSources":["WA8XYs6LQoFRqHaQt","NDGPxX9hJs9BdrF52"]}