It is important to carefully check for comprehensiveness, effectiveness and errors. Some key steps might be:
Once you have formulated a draft search strategy you will need to seek evidence of the effectiveness of the search. This can be done by testing the ability of your search in retrieving known articles that represent your research question. This testing process requires you to have a gold set of relevant articles that should undoubtedly be picked up by your search. The steps for testing on a gold set of articles is below:
How many articles should you have in your gold set?
The more articles you have, the more evidence and confidence that you will have in the strength and appropriateness of your search strategy. For example, testing on 10 articles will let you know that you are on the right track. Testing on 25 articles from a variety of sources will give you much better assurance that you are not going to miss relevant papers due to the chosen terms and parameters of your search.
You may like to use the Smart Searching tool to evaluate your strategy.
Searching one database is inadequate and will find an unrepresentative set of studies. Create and test your search strategy in one core database, then move on to running it in other databases or sources you've selected as suitable for your review.
|It is important to be mindful of inclusivity and diversity (of populations and contexts) when conducting secondary research, as much published research is not representative of all peoples. For example, you might choose to include national or regional sources, those that include non-western journals or peer reviewed literature from developing countries.|
If there are subject-specific databases relevant to the topic of the review, these will typically be included. Some examples include CINAHL plus or Ovid Emcare for nursing/allied health, PsycInfo for psychological sciences, or PEDro or AMED or SPORTDiscus for physiotherapy.
A list of databases available to Monash researchers can be found at the Databases by subject page.
Cochrane Central Register of Controlled Trials (CENTRAL) is searchable via the Ovid platform. CENTRAL contains WHO International Clinical Trials Registry Platform (ICTRP) which contains 17 registers, and ClinicalTrials.gov.
These two sources are considered to be the most important trial registers, making CENTRAL an excellent choice to include in your intervention-based review:
"Although there are many other trials registers, ClinicalTrials.gov and the WHO International Clinical Trials Registry Platform (ICTRP) portal are considered to be the most important for searching to identify studies for a systematic review (Pansieri et al 2017). Research has shown that even though ClinicalTrials.gov is included in the WHO ICTRP Search Portal, not all ClinicalTrials.gov records can be successfully retrieved via searches of the ICTRP Search Portal (Glanville et al 2014, Knelangen et al 2018)". Cochrane Handbook 4.3.3 Trials registers and trials results registers #section-4-3-3.
For a full curated list of registries and information on searching registries see:
Handsearching is now commonly known as manual searching. While manual searching can still mean actually hand-searching print copies of journals for relevant studies, it more often involves browsing the online table-of-contents of relevant issues, or reference lists of relevant papers.
In SRs, manual searching is considered an important method of uncovering papers that may not have been picked up in your database searches. This can include studies in journals not indexed by core databases, or papers not retrieved by your search strategy due to being poorly described or incorrectly indexed.
Manual searching can encompass Citation searching which is a search method that can be done forward or backward in time.
The main citation databases are Scopus, Web of Science and Google Scholar.
Finding grey literature, searching it systematically and documenting your searches is time consuming and challenging.
See the Grey literature library guide for further information on searching specific grey literature sources to identify relevant material, as well as using search engines such as Google/Google Scholar.
See the Moodle book MNHS: Systematically searching the grey literature for a comprehensive module on grey literature for systematic reviews.
Many databases feature a built-in set of limiters that may be used to limit search results by age group, publication type, English language, and more. Typically, these can be selected by ticking a box to apply the limits from the database interface. The use of limits can result in the exclusion of relevant studies, so the use of a search filter is usually preferred for SRs. An example of limits in Ovid Medline is displayed below:
A search filter (also known as a hedge), is a search strategy which can be incorporated into your search to restrict the results. Commonly used filters include RCT filters, observational and diagnostic studies filters, elderly and children filters and adverse effects filters.
Filters are often developed by experts and are the most effective way of restricting a search. A search filter that has been tested, validated against a gold set of standard articles and the results published, is known as a 'validated filter'. If you make any changes to a validated filter (to translate it into another database for example), it is no longer a validated filter.
Filters can be categorised into two main groups:
Links to available filters can be found on the next two tabs for study types and by topic.
The following filters are for specific study types and designs:
The following filters are for specific topics or subjects:
The following example is a filter used to identify randomised trials in Ovid Medline. This and filters for other databases can be found in the Cochrane handbook, Chapter 4. Search filters 3.6.
Box 3.d Cochrane Highly Sensitive Search Strategy for identifying randomized trials in MEDLINE: sensitivity-and-precision-maximising version (2008 revision); Ovid format
For CINAHL Plus see:
We acknowledge and pay respects to the Elders and Traditional Owners of the land on which our four Australian campuses stand. Information for Indigenous Australians