Protocol
3.1
To synthesise available evidence on the effect of non-spatial fisheries management measures under the CFP, the Fisheries Act 2020 and the Prohibition of Fishing for Scallops (Scotland) Order 2003, a systematic literature review was conducted. To enable a rapid assessment, the review was limited to primary research published in peer-reviewed academic literature.
3.2
The review followed the principles set out in the Collaboration for Environmental Evidence (CEE) Guidelines and Standards for Evidence Synthesis in Environmental Management.[1] These guidelines provide a robust, evidence-based framework for the conduct of systematic reviews addressing environmental topics. The CEE protocol was selected because it has been specifically developed for application in environmental management and is widely endorsed as best practice for producing rigorous and transparent evidence syntheses in this field.
3.3
To ensure the credibility of findings, systematic reviews must follow clearly defined methodological standards, including the systematic identification and mitigation of potential sources of bias within both the evidence base and the review process itself. The CEE protocol promotes transparency through the clear documentation of key methodological components such as inclusion and exclusion criteria, search strategies, data extraction procedures, and synthesis methods. By supporting methodological rigour and transparency, the CEE protocol’s structured framework strengthens the reliability of findings and conclusions, encouraging consistency and clarity in the reporting methods and results. In doing so, it enables independent replication of the review and provides a solid foundation for future updates or extensions that build on its evidence base.
3.4
The CEE protocol is subject to ongoing development, with continuous efforts to refine and improve the guidelines and standards in evidence synthesis methodology. This report specifically follows the principles set out in Version 5.1 of the CEE Guidelines and Standards for Evidence Synthesis in Environmental Management.[1]
Limitations
3.5
While the CEE protocol offers a structured and reproducible approach that improves the reporting quality of systematic reviews, certain limitations are nonetheless inherent to the process. Publication bias is a well-recognised limitation in systematic reviews, arising from the tendency for studies with positive or statistically significant findings to be published more frequently than those reporting negative or null results. This selective availability of evidence can skew the overall understanding of a topic by overrepresenting favourable outcomes and underrepresenting studies that report little, no or negative results. Consequently, the evidence base may present an unbalanced view, potentially leading to biased conclusions even when a systematic review is conducted rigorously.
3.6
Grey literature can help address publication bias by capturing evidence that may not be published through traditional academic channels, such as government reports, technical reports, policy documents and environmental assessments. However, due to project time constraints, this review was restricted to peer-reviewed academic literature and did not include a systematic search for grey literature. Consequently, relevant evidence contained within government reports, technical documents and other non-academic sources may not have been captured, representing a potential limitation of the evidence base and increasing the risk of publication bias.
3.7
Another important limitation concerns the quality and validity of the included studies. Even when studies meet the pre-defined eligibility criteria, they may still contain methodological flaws – such as weak study design, poor reporting, or insufficient detail on data collection and analysis – which can affect the strength and reliability of their findings. These weaknesses, if not accounted for, have the potential to influence the overall conclusions of the review. Where such flaws are evident, they will be noted and discussed within the synthesis to provide context and ensure transparency in how the evidence has been interpreted.
3.8
A further challenge in conducting systematic reviews across environmental topics is the heterogeneity of study designs, methodologies, and outcome measures. Studies often vary widely in terms of spatial and temporal scale, data collection methods, ecological indicators, and how outcomes are measured and reported. This diversity reflects the complex, context-specific nature of environmental systems but can significantly reduce the ability to draw clear, comparable conclusions across studies. To address this challenge, this review applies a standardised framework for data extraction and categorisation, grouping studies by shared characteristics (e.g. geographic region, or methodological approach), and explicitly accounting for differences in study quality and design in the interpretation of results.
3.9
The protocol requires detailed documentation at every stage of the review process and recommends independent double screening of all records during both the title and abstract screening, full-text screening, and data extraction stages. This is designed to maximise consistency, reduce bias, and enhance the overall reliability of the review. However, due to the practical constraints of this project, full double screening and data extraction were not feasible. Instead, a subset of 10% of studies were independently screened by a second reviewer at both the title and abstract stage, and again at the full-text stage. This served as a consistency check to ensure that the inclusion and exclusion criteria were being applied and interpreted consistently. Any discrepancies that arose during this process were resolved through discussions between reviewers to reach a consensus. This approach represents a pragmatic compromise which maintains a reasonable level of rigour under constrained conditions.
3.10
Finally, systematic reviews provide a snapshot in time, capturing the state of knowledge up to the point when the final searches are completed. In rapidly evolving fields, such as marine conservation and management, the evidence base is dynamic and continually expanding, meaning that new and potentially relevant studies may emerge after this review has been conducted. Without regular updates, the conclusions of this review may eventually become outdated, particularly given the time lag between conducting this review and its eventual publication, which could result in the exclusion of recent findings. This could limit the report’s usefulness as a source of evidence for informing policy or management decisions over the longer term (e.g. 5 to 10 years). To maintain relevance, this systematic review should ideally be revisited and updated as new evidence becomes available.
Research question
3.11
This report addresses the following question, expressed using the PICO (Population, Intervention, Comparator, Outcome) framework:
Within benthic ecosystems subject to fishing pressure [P], to what extent are non-spatial fisheries management measures implemented under the Common Fisheries Policy, Fisheries Act 2020 and the Prohibition of Fishing for Scallops (Scotland) Order 2003 [I] associated with reduced benthic habitat impacts and improved seafloor integrity [O]?
Eligibility criteria
3.12
Eligibility criteria for the inclusion of studies are detailed in Table 3.1.
Table 3.1: Inclusion and exclusion criteria
| Criteria |
Inclusion/Exclusion Rule |
| Language |
Only literature published in the English language was included in the review. |
| Publication Type |
From academic sources, peer-reviewed journal articles and review articles were included, while standalone data sets were excluded. |
| Geographical Scope |
Studies were included if they were conducted in marine environments around the UK and Continental Europe. These regions were included because each region’s legislation governing marine protection has been derived from the EU Marine Strategy Framework Directive, and/or they have a comparable marine environment to Scotland
Studies conducted outside of this geographic scope – including those based in the Americas, Asia, Africa, Oceania, or European overseas territories (e.g. St. Helena, Azores, Madeira, and the Canary Islands) – were not included. |
| Study Focus |
Studies were included if they evaluated the effects of non-spatial fisheries management measures on benthic habitats, benthic communities, seafloor integrity, seabed disturbance, or related indicators of benthic impact. Studies reporting direct ecological responses, pressure-based indicators, or management measures intended to reduce benthic impacts were eligible.
Studies focusing exclusively on spatial fisheries restrictions, or on economic, social, governance or fish stock outcomes without a benthic habitat-related outcome, were excluded. |
Search strategy
3.13
The search strategy was developed through an iterative process. Initial search terms were identified from the fisheries management measures relevant to the review question, including terms relating to effort controls, catch limits, gear restrictions and modifications, seasonal closures, and MSY. These terms were refined through exploratory searches to identify additional terminology used within the literature and to improve the relevance and sensitivity of the final search strategy.
3.14
Search terms representing benthic habitats and seafloor integrity were adapted from those developed for ESS’ previous systematic review of the effects of Marine Protected Areas on seafloor integrity [2]. The list included broad terms relating to benthic habitats, seabed habitats, benthic communities and seafloor integrity, alongside relevant habitat-specific terminology. Terms were reviewed and refined during testing to remove those that consistently returned irrelevant results and to improve the precision of the final search strategy.
3.15
Search terms were developed to represent the population and intervention components of the review question, ensuring the search captured studies examining non-spatial fisheries management measures and their effects on benthic habitats and associated biological communities. Search terms for the comparator and outcome elements were not included. Comparators were often implicit (e.g. before–after comparisons, alternative management regimes or the absence of management measures) and could not be readily translated into searchable terms. Similarly, outcomes of interest encompassed a wide range of ecological and pressure-based indicators, including benthic habitat condition, benthic communities, seabed disturbance and seafloor integrity. Restricting the search to specific outcome terms risked excluding relevant studies that used different terminology or assessed benthic impacts indirectly. To maximise search sensitivity, the search strategy therefore focused on the population and intervention components only. Final search terms are provided in Appendix 1.
3.16
Within each category, search terms were combined using the Boolean operator OR. The population and intervention categories were then combined using the Boolean operator AND so that only studies addressing both components were retrieved. The wildcard operator (*) was used where appropriate to capture variations in word endings and alternative spellings, increasing the sensitivity of the search. The full search string is provided in Appendix 2.
Academic database search
3.17
Searches were conducted using the Web of Science platform, accessed through the National Library of Scotland. The search was undertaken within the Web of Science Core Collection, which indexes peer-reviewed literature across the natural and social sciences and contains records dating from 1900 onwards.
3.18
Application of the final search string returned 272 records. Following export of records and the removal of duplicates, 251 unique records remained for title and abstract screening.
Study/evidence selection
3.19
The systematic review platform CADIMA was used to manage the title and abstract screening process [3]. Bibliographic records were exported as .ris files and imported into the platform, where both automatic and manual de-duplication were performed. Titles and abstract screening were carried out within CADIMA using predefined inclusion and exclusion criteria. All records were initially screened by a single reviewer. In line with the CEE protocol, a subset of 10% of records was independently screened by a second reviewer to assess consistency in the application of the inclusion and exclusion criteria. Any discrepancies in decisions were automatically flagged by the system. These differences were resolved through discussion between the screeners to reach a consensus, ensuring a consistent interpretation of the pre-defined inclusion and exclusion criteria.
3.20
Following the completion of title and abstract screening, all articles meeting the inclusion criteria at that stage were retrieved for full-text screening. Again, a subset of 10% of full texts was independently screened by a second reviewer to assess consistency in the application of the inclusion and exclusion criteria.
3.21
After all stages of screening were completed, a total of 12 studies met the inclusion criteria and were retained for full analysis in the review.
Data extraction
3.22
A standardised data extraction form was developed to capture relevant information from the included studies. In addition to CADIMA’s default bibliographic fields, such as author details, title, and publication year, the following data items were extracted from each study where available:
- study location:
- water body: named marine or coastal feature (e.g. North Sea)
- general region: broader geographic area (e.g. western Scotland)
- fisheries and management characteristics:
- fishery type and target species
- fishing gear or fleet characteristics
- fisheries management intervention(s) assessed (e.g. effort controls, catch limits, gear restrictions, gear modifications, seasonal closures, certification schemes, or MSY-based management)
- study setting and design:
- study aim (primary research objective e.g. assess recovery, evaluate biodiversity change)
- study design (e.g. Before After Control Impact (BACI), observational, modelling or scenario analysis)
- study period
- comparator or reference condition
- benthic response and outcomes:
- benthic response variable(s) assessed
- response type (measured, assessed, modelled or proxy indicator)
- direction of effect (positive, negative, mixed or no effect)
- effect size or quantitative findings, where reported
- evidence category (direct ecological response, pressure-based response, or management proxy)
- interpretation and implications
- key findings
- study limitations and sources of uncertainty
- management implications
- additional notes relevant to interpretation of results
- additional information
- references identified through snowball searching
- internal validity, assessed as high, moderate or low
- external validity, assessed as high, moderate or low
Critical appraisal
3.23
A formal, risk-of-bias assessment was not undertaken for this review. Instead, critical appraisal was embedded within the data extraction process. All included studies were assessed by an experienced researcher with domain expertise, who assessed study methodology, design, and reporting as part of the extraction process. Where potential limitations or concerns relating to study validity (e.g. lack of appropriate controls, limited replication, or unclear analytical methods) were identified, these were recorded qualitatively in the data extraction framework. These observations were subsequently considered during evidence synthesis and interpretation of findings but were not used as formal exclusion criteria or to generate quantitative study quality scores.