Purported flaws in management strategy evaluation: basic problems or misinterpretations?. Butterworth, D. S., Bentley, N., De Oliveira, J. A. A., Donovan, G. P., Kell, L. T., Parma, A. M., Punt, A. E., Sainsbury, K. J., Smith, A. D. M., & Stokes, T. K. ICES JOURNAL OF MARINE SCIENCE, 67(3):567-574, OXFORD UNIV PRESS, GREAT CLARENDON ST, OXFORD OX2 6DP, ENGLAND, APR, 2010. doi abstract bibtex Rochet and Rice, while recognizing management strategy evaluation (MSE) as an important step forward in fisheries management, level a number of criticisms at its implementation. Some of their points are sound, such as the need for care in representing uncertainties and for thorough documentation of the process. However, others evidence important misunderstandings. Although the difficulties in estimating tail probabilities and risks, as discussed by Rochet and Rice, are well known, their arguments that Efron's nonparametric bootstrap re-sampling method underestimates the probabilities of low values are flawed. In any case, though, the focus of MSEs is primarily on comparing performance and robustness across alternative management procedures (MPs), rather than on estimating absolute levels of risk. Qualitative methods can augment MSE, but their limitations also need to be recognized. Intelligence certainly needs to play a role in fisheries management, but not at the level of tinkering in the provision of annual advice, which Rochet and Rice apparently advocate, inter alia because this runs the risk of advice following noise rather than signal. Instead, intelligence should come into play in the exercise of oversight through the process of multiannual reviews of MSE and associated MPs. A number of examples are given of the process of interaction with stakeholders which should characterize MSE.
@article{ ISI:000275818300018,
Author = {Butterworth, Douglas S. and Bentley, Nokome and De Oliveira, Jose A. A.
and Donovan, Gregory P. and Kell, Laurence T. and Parma, Ana M. and
Punt, Andre E. and Sainsbury, Keith J. and Smith, Anthony D. M. and
Stokes, T. Kevin},
Title = {{Purported flaws in management strategy evaluation: basic problems or
misinterpretations?}},
Journal = {{ICES JOURNAL OF MARINE SCIENCE}},
Year = {{2010}},
Volume = {{67}},
Number = {{3}},
Pages = {{567-574}},
Month = {{APR}},
Abstract = {{Rochet and Rice, while recognizing management strategy evaluation (MSE)
as an important step forward in fisheries management, level a number of
criticisms at its implementation. Some of their points are sound, such
as the need for care in representing uncertainties and for thorough
documentation of the process. However, others evidence important
misunderstandings. Although the difficulties in estimating tail
probabilities and risks, as discussed by Rochet and Rice, are well
known, their arguments that Efron's nonparametric bootstrap re-sampling
method underestimates the probabilities of low values are flawed. In any
case, though, the focus of MSEs is primarily on comparing performance
and robustness across alternative management procedures (MPs), rather
than on estimating absolute levels of risk. Qualitative methods can
augment MSE, but their limitations also need to be recognized.
Intelligence certainly needs to play a role in fisheries management, but
not at the level of tinkering in the provision of annual advice, which
Rochet and Rice apparently advocate, inter alia because this runs the
risk of advice following noise rather than signal. Instead, intelligence
should come into play in the exercise of oversight through the process
of multiannual reviews of MSE and associated MPs. A number of examples
are given of the process of interaction with stakeholders which should
characterize MSE.}},
Publisher = {{OXFORD UNIV PRESS}},
Address = {{GREAT CLARENDON ST, OXFORD OX2 6DP, ENGLAND}},
Type = {{Article}},
Language = {{English}},
Affiliation = {{Butterworth, DS (Reprint Author), Univ Cape Town, Dept Math \& Appl Math, ZA-7701 Rondebosch, South Africa.
Butterworth, Douglas S., Univ Cape Town, Dept Math \& Appl Math, ZA-7701 Rondebosch, South Africa.
Bentley, Nokome, Trophia Ltd, Kaikoura 7300, New Zealand.
De Oliveira, Jose A. A., Ctr Environm Fisheries \& Aquaculture Sci, Lowestoft NR33 0HT, Suffolk, England.
Donovan, Gregory P., Int Whaling Commiss, Cambridge CB24 9NP, England.
Kell, Laurence T., ICCAT Secretariat, Madrid 280002, Spain.
Parma, Ana M., Ctr Nacl Patagon, Puerto Madryn, Chubut, Argentina.
Punt, Andre E., Univ Washington, Sch Aquat \& Fishery Sci, Seattle, WA 98195 USA.
Punt, Andre E.; Smith, Anthony D. M., CSIRO Marine \& Atmospher Res, Hobart, Tas 7001, Australia.
Sainsbury, Keith J., Univ Tasmania, Hobart, Tas 7001, Australia.}},
DOI = {{10.1093/icesjms/fsq009}},
ISSN = {{1054-3139}},
Keywords = {{management procedure; management strategy evaluation; Monte Carlo
simulation; risk estimation; uncertainty}},
Keywords-Plus = {{SOUTHERN BLUEFIN TUNA; FISHERIES-MANAGEMENT; PRECAUTIONARY APPROACH;
FLOUNDERING ATTEMPT; HARVEST POLICIES; IMPLEMENTATION; UNCERTAINTY;
LESSONS; STOCKS; PRODUCTIVITY}},
Research-Areas = {{Fisheries; Marine \& Freshwater Biology; Oceanography}},
Web-of-Science-Categories = {{Fisheries; Marine \& Freshwater Biology; Oceanography}},
Author-Email = {{doug.butterworth@uct.ac.za}},
ResearcherID-Numbers = {{Smith, Tony/A-4017-2012
}},
ORCID-Numbers = {{Punt, Andre/0000-0001-8489-2488}},
Number-of-Cited-References = {{63}},
Times-Cited = {{25}},
Usage-Count-Last-180-days = {{1}},
Usage-Count-Since-2013 = {{12}},
Journal-ISO = {{ICES J. Mar. Sci.}},
Doc-Delivery-Number = {{572HI}},
Unique-ID = {{ISI:000275818300018}},
OA = {{No}},
DA = {{2017-08-17}},
}
Downloads: 0
{"_id":"SCTwFBixMbfDprdcW","bibbaseid":"butterworth-bentley-deoliveira-donovan-kell-parma-punt-sainsbury-etal-purportedflawsinmanagementstrategyevaluationbasicproblemsormisinterpretations-2010","downloads":0,"creationDate":"2017-08-17T14:08:07.633Z","title":"Purported flaws in management strategy evaluation: basic problems or misinterpretations?","author_short":["Butterworth, D. S.","Bentley, N.","De Oliveira, J. A. A.","Donovan, G. P.","Kell, L. T.","Parma, A. M.","Punt, A. E.","Sainsbury, K. J.","Smith, A. D. M.","Stokes, T. K."],"year":2010,"bibtype":"article","biburl":"http://flr-project.org/flr.bib","bibdata":{"bibtype":"article","type":"Article","author":[{"propositions":[],"lastnames":["Butterworth"],"firstnames":["Douglas","S."],"suffixes":[]},{"propositions":[],"lastnames":["Bentley"],"firstnames":["Nokome"],"suffixes":[]},{"propositions":[],"lastnames":["De","Oliveira"],"firstnames":["Jose","A.","A."],"suffixes":[]},{"propositions":[],"lastnames":["Donovan"],"firstnames":["Gregory","P."],"suffixes":[]},{"propositions":[],"lastnames":["Kell"],"firstnames":["Laurence","T."],"suffixes":[]},{"propositions":[],"lastnames":["Parma"],"firstnames":["Ana","M."],"suffixes":[]},{"propositions":[],"lastnames":["Punt"],"firstnames":["Andre","E."],"suffixes":[]},{"propositions":[],"lastnames":["Sainsbury"],"firstnames":["Keith","J."],"suffixes":[]},{"propositions":[],"lastnames":["Smith"],"firstnames":["Anthony","D.","M."],"suffixes":[]},{"propositions":[],"lastnames":["Stokes"],"firstnames":["T.","Kevin"],"suffixes":[]}],"title":"Purported flaws in management strategy evaluation: basic problems or misinterpretations?","journal":"ICES JOURNAL OF MARINE SCIENCE","year":"2010","volume":"67","number":"3","pages":"567-574","month":"APR","abstract":"Rochet and Rice, while recognizing management strategy evaluation (MSE) as an important step forward in fisheries management, level a number of criticisms at its implementation. Some of their points are sound, such as the need for care in representing uncertainties and for thorough documentation of the process. However, others evidence important misunderstandings. Although the difficulties in estimating tail probabilities and risks, as discussed by Rochet and Rice, are well known, their arguments that Efron's nonparametric bootstrap re-sampling method underestimates the probabilities of low values are flawed. In any case, though, the focus of MSEs is primarily on comparing performance and robustness across alternative management procedures (MPs), rather than on estimating absolute levels of risk. Qualitative methods can augment MSE, but their limitations also need to be recognized. Intelligence certainly needs to play a role in fisheries management, but not at the level of tinkering in the provision of annual advice, which Rochet and Rice apparently advocate, inter alia because this runs the risk of advice following noise rather than signal. Instead, intelligence should come into play in the exercise of oversight through the process of multiannual reviews of MSE and associated MPs. A number of examples are given of the process of interaction with stakeholders which should characterize MSE.","publisher":"OXFORD UNIV PRESS","address":"GREAT CLARENDON ST, OXFORD OX2 6DP, ENGLAND","language":"English","affiliation":"Butterworth, DS (Reprint Author), Univ Cape Town, Dept Math & Appl Math, ZA-7701 Rondebosch, South Africa. Butterworth, Douglas S., Univ Cape Town, Dept Math & Appl Math, ZA-7701 Rondebosch, South Africa. Bentley, Nokome, Trophia Ltd, Kaikoura 7300, New Zealand. De Oliveira, Jose A. A., Ctr Environm Fisheries & Aquaculture Sci, Lowestoft NR33 0HT, Suffolk, England. Donovan, Gregory P., Int Whaling Commiss, Cambridge CB24 9NP, England. Kell, Laurence T., ICCAT Secretariat, Madrid 280002, Spain. Parma, Ana M., Ctr Nacl Patagon, Puerto Madryn, Chubut, Argentina. Punt, Andre E., Univ Washington, Sch Aquat & Fishery Sci, Seattle, WA 98195 USA. Punt, Andre E.; Smith, Anthony D. M., CSIRO Marine & Atmospher Res, Hobart, Tas 7001, Australia. Sainsbury, Keith J., Univ Tasmania, Hobart, Tas 7001, Australia.","doi":"10.1093/icesjms/fsq009","issn":"1054-3139","keywords":"management procedure; management strategy evaluation; Monte Carlo simulation; risk estimation; uncertainty","keywords-plus":"SOUTHERN BLUEFIN TUNA; FISHERIES-MANAGEMENT; PRECAUTIONARY APPROACH; FLOUNDERING ATTEMPT; HARVEST POLICIES; IMPLEMENTATION; UNCERTAINTY; LESSONS; STOCKS; PRODUCTIVITY","research-areas":"Fisheries; Marine & Freshwater Biology; Oceanography","web-of-science-categories":"Fisheries; Marine & Freshwater Biology; Oceanography","author-email":"doug.butterworth@uct.ac.za","researcherid-numbers":"Smith, Tony/A-4017-2012 ","orcid-numbers":"Punt, Andre/0000-0001-8489-2488","number-of-cited-references":"63","times-cited":"25","usage-count-last-180-days":"1","usage-count-since-2013":"12","journal-iso":"ICES J. Mar. Sci.","doc-delivery-number":"572HI","unique-id":"ISI:000275818300018","oa":"No","da":"2017-08-17","bibtex":"@article{ ISI:000275818300018,\nAuthor = {Butterworth, Douglas S. and Bentley, Nokome and De Oliveira, Jose A. A.\n and Donovan, Gregory P. and Kell, Laurence T. and Parma, Ana M. and\n Punt, Andre E. and Sainsbury, Keith J. and Smith, Anthony D. M. and\n Stokes, T. Kevin},\nTitle = {{Purported flaws in management strategy evaluation: basic problems or\n misinterpretations?}},\nJournal = {{ICES JOURNAL OF MARINE SCIENCE}},\nYear = {{2010}},\nVolume = {{67}},\nNumber = {{3}},\nPages = {{567-574}},\nMonth = {{APR}},\nAbstract = {{Rochet and Rice, while recognizing management strategy evaluation (MSE)\n as an important step forward in fisheries management, level a number of\n criticisms at its implementation. Some of their points are sound, such\n as the need for care in representing uncertainties and for thorough\n documentation of the process. However, others evidence important\n misunderstandings. Although the difficulties in estimating tail\n probabilities and risks, as discussed by Rochet and Rice, are well\n known, their arguments that Efron's nonparametric bootstrap re-sampling\n method underestimates the probabilities of low values are flawed. In any\n case, though, the focus of MSEs is primarily on comparing performance\n and robustness across alternative management procedures (MPs), rather\n than on estimating absolute levels of risk. Qualitative methods can\n augment MSE, but their limitations also need to be recognized.\n Intelligence certainly needs to play a role in fisheries management, but\n not at the level of tinkering in the provision of annual advice, which\n Rochet and Rice apparently advocate, inter alia because this runs the\n risk of advice following noise rather than signal. Instead, intelligence\n should come into play in the exercise of oversight through the process\n of multiannual reviews of MSE and associated MPs. A number of examples\n are given of the process of interaction with stakeholders which should\n characterize MSE.}},\nPublisher = {{OXFORD UNIV PRESS}},\nAddress = {{GREAT CLARENDON ST, OXFORD OX2 6DP, ENGLAND}},\nType = {{Article}},\nLanguage = {{English}},\nAffiliation = {{Butterworth, DS (Reprint Author), Univ Cape Town, Dept Math \\& Appl Math, ZA-7701 Rondebosch, South Africa.\n Butterworth, Douglas S., Univ Cape Town, Dept Math \\& Appl Math, ZA-7701 Rondebosch, South Africa.\n Bentley, Nokome, Trophia Ltd, Kaikoura 7300, New Zealand.\n De Oliveira, Jose A. A., Ctr Environm Fisheries \\& Aquaculture Sci, Lowestoft NR33 0HT, Suffolk, England.\n Donovan, Gregory P., Int Whaling Commiss, Cambridge CB24 9NP, England.\n Kell, Laurence T., ICCAT Secretariat, Madrid 280002, Spain.\n Parma, Ana M., Ctr Nacl Patagon, Puerto Madryn, Chubut, Argentina.\n Punt, Andre E., Univ Washington, Sch Aquat \\& Fishery Sci, Seattle, WA 98195 USA.\n Punt, Andre E.; Smith, Anthony D. M., CSIRO Marine \\& Atmospher Res, Hobart, Tas 7001, Australia.\n Sainsbury, Keith J., Univ Tasmania, Hobart, Tas 7001, Australia.}},\nDOI = {{10.1093/icesjms/fsq009}},\nISSN = {{1054-3139}},\nKeywords = {{management procedure; management strategy evaluation; Monte Carlo\n simulation; risk estimation; uncertainty}},\nKeywords-Plus = {{SOUTHERN BLUEFIN TUNA; FISHERIES-MANAGEMENT; PRECAUTIONARY APPROACH;\n FLOUNDERING ATTEMPT; HARVEST POLICIES; IMPLEMENTATION; UNCERTAINTY;\n LESSONS; STOCKS; PRODUCTIVITY}},\nResearch-Areas = {{Fisheries; Marine \\& Freshwater Biology; Oceanography}},\nWeb-of-Science-Categories = {{Fisheries; Marine \\& Freshwater Biology; Oceanography}},\nAuthor-Email = {{doug.butterworth@uct.ac.za}},\nResearcherID-Numbers = {{Smith, Tony/A-4017-2012\n }},\nORCID-Numbers = {{Punt, Andre/0000-0001-8489-2488}},\nNumber-of-Cited-References = {{63}},\nTimes-Cited = {{25}},\nUsage-Count-Last-180-days = {{1}},\nUsage-Count-Since-2013 = {{12}},\nJournal-ISO = {{ICES J. Mar. Sci.}},\nDoc-Delivery-Number = {{572HI}},\nUnique-ID = {{ISI:000275818300018}},\nOA = {{No}},\nDA = {{2017-08-17}},\n}\n\n","author_short":["Butterworth, D. S.","Bentley, N.","De Oliveira, J. A. A.","Donovan, G. P.","Kell, L. T.","Parma, A. M.","Punt, A. E.","Sainsbury, K. J.","Smith, A. D. M.","Stokes, T. K."],"key":"ISI:000275818300018","id":"ISI:000275818300018","bibbaseid":"butterworth-bentley-deoliveira-donovan-kell-parma-punt-sainsbury-etal-purportedflawsinmanagementstrategyevaluationbasicproblemsormisinterpretations-2010","role":"author","urls":{},"keyword":["management procedure; management strategy evaluation; Monte Carlo simulation; risk estimation; uncertainty"],"metadata":{"authorlinks":{}},"downloads":0},"search_terms":["purported","flaws","management","strategy","evaluation","basic","problems","misinterpretations","butterworth","bentley","de oliveira","donovan","kell","parma","punt","sainsbury","smith","stokes"],"keywords":["management procedure; management strategy evaluation; monte carlo simulation; risk estimation; uncertainty"],"authorIDs":[],"dataSources":["WA8XYs6LQoFRqHaQt","NDGPxX9hJs9BdrF52"]}