Systematic review searches performed 40 35 30 25 20 15 10 5 - PowerPoint PPT Presentation

Systematic review searches performed 40 35 30 25 20 15 10 5 0 04-2013 07-2013 10-2013 01-2014 04-2014 07-2014 10-2014 01-2015 1

Time needed to search 100% 92% Cumulative percentage of SRs 75% 70% (N=165) 50% 41% 25% 0% 0 30 60 90 120 150 180 210 Minutes needed to create search 2

Major problems with systematic searching Term completeness • the right terms to describe the topic • enough terms to be sensitive • not too much terms to lose precision Translation to other databases • different syntax • different thesaurus terms • different number of thesaurus terms 3

Time not depending on # of terms / databases 200 Time needed for searching 180 160 140 120 100 80 60 40 20 0 200 0 50 100 150 200 250 300 minutes needed to create # search terms used in embase 150 search 100 50 0 2 4 6 8 10 # of databases 4

Term completeness Optimization: ("brassica"[mh] NOT (brassica[tiab] OR broccoli[tiab])) AND ("neoplasms"[mh] OR neoplas*[tiab] OR cancer*[tiab])  cruciferous vegetable*[tiab]

Translation between databases

Are these searches good enough? Compared to a random set of 100 recent SRs from PubMed, my searches: Were more complex 49 terms 15 terms Used more databases 7 4 Found more includes 43 17 Less extreme # hits 108-10068 9-52046 Precision (50% interval) 1,1% - 3,2% 0,6%-5,1% 7

‘ Median ’ search strategy for an SR Embase.com 2093 2085 Cochrane 10 Medline (OvidSP) 1641 787 ((((rna OR mrna OR mirna OR microrna OR dna OR cdna OR exome OR genom* OR gene OR genes OR 'next-generation') NEAR/6 (sequenc* OR Web-of-science 1471 709 rearrange*))):ab,ti) AND (((colon* OR colorect* OR rect* OR sigmoid) NEAR/3 PubMed (publisher) 49 32 (cancer* OR neoplas* OR carcino* OR adenocarcino* OR tumo* OR Cochrane 10 0 malign*)):ab,ti) AND ((prognos* OR predict* OR marker* OR biomarker* OR Google Scholar 200 176 surviv* OR Mortalit*):ab,ti) Totaal 5464 3789 Web-of-science 1471 TS=(((((rna OR mrna OR mirna OR microrna OR dna OR cdna OR exome OR Embase.com 2093 genom* OR gene OR genes OR "next-generation") NEAR/6 (sequenc* OR ('RNA sequence'/de OR 'DNA sequence'/de OR 'gene sequence'/de OR 'gene rearrange*)))) AND (((colon* OR colorect* OR rect* OR sigmoid) NEAR/3 rearrangement'/de OR (((rna OR mrna OR mirna OR microrna OR dna OR cdna OR (cancer* OR neoplas* OR carcino* OR adenocarcino* OR tumo* OR malign*))) exome OR genom* OR gene OR genes OR 'next-generation') NEAR/6 (sequenc* OR AND ((prognos* OR predict* OR marker* OR biomarker* OR surviv* OR rearrange*))):ab,ti) AND ('colon cancer'/exp OR 'colon tumor'/de OR 'colorectal Mortalit*))) tumor'/de OR 'rectum tumor'/de OR 'rectum cancer'/exp OR ((colon* OR colorect* OR rect* OR sigmoid) NEAR/3 (cancer* OR neoplas* OR carcino* OR adenocarcino* PubMed (publisher) 49 OR tumo* OR malign*)):ab,ti) AND (prognosis/exp OR 'predictive value'/de OR ((((rna[tiab] OR mrna[tiab] OR mirna[tiab] OR microrna[tiab] OR dna[tiab] OR 'biological marker'/de OR 'tumor marker'/exp OR survival/exp OR Mortality/exp OR cdna[tiab] OR exome[tiab] OR genom*[tiab] OR gene[tiab] OR genes[tiab] OR (prognos* OR predict* OR marker* OR biomarker* OR surviv* OR Mortalit*):ab,ti) next-generation[tiab]) AND (sequenc*[tiab] OR rearrange*[tiab])))) AND (((colon*[tiab] OR colorect*[tiab] OR rect*[tiab] OR sigmoid) AND (cancer*[tiab] Medline (OvidSP) 1641 OR neoplas*[tiab] OR carcino*[tiab] OR adenocarcino*[tiab] OR tumo*[tiab] OR ("Sequence Analysis, RNA"/ OR exp "Sequence Analysis, DNA"/ OR "gene malign*[tiab]))) AND ((prognos*[tiab] OR predict*[tiab] OR marker*[tiab] OR rearrangement"/ OR (((rna OR mrna OR mirna OR microrna OR dna OR cdna OR biomarker*[tiab] OR surviv*[tiab] OR Mortalit*[tiab])) AND publisher[sb] exome OR genom* OR gene OR genes OR "next-generation") ADJ6 (sequenc* OR rearrange*))).ab,ti.) AND ("Colorectal Neoplasms"/ OR exp "Colonic Neoplasms"/ OR Google Scholar "Rectal Neoplasms"/ OR ((colon* OR colorect* OR rect* OR sigmoid) ADJ3 (cancer* "rna|mrna|mirna|microrna|dna|cdna|exome|genome|gene|genes OR neoplas* OR carcino* OR adenocarcino* OR tumo* OR malign*)).ab,ti.) AND sequence|rearrangement" "colonic|colorectal|rectal (prognosis/ OR "Predictive Value of Tests"/ OR exp "biological markers"/ OR Survival/ cancer|neoplasms|carcinoma|tumor" OR "Disease-Free Survival"/ OR exp Mortality/ OR Mortality.xs. OR (prognos* OR prognosis|predictive|marker|biomarker|markers|biomarkers|survival|Mortalit predict* OR marker* OR biomarker* OR surviv* OR Mortalit*).ab,ti.) y 8

Succes factors The succes of our methodology is dependent of a few factors, most of which are controllable) 1. Experience (hardly controllable) 2. Interface choice and database order (habit / management decision) 3. Optimization techniques (shared today) 4. Single-line search strategies (just a habit) 5. Macros (shared today) 6. The researcher immediately providing feedback on the results (just a habit) 7. Good management 9

Disclaimer for managers Performing systematic review searches within 2 hours is not the norm, nor is it the goal of this method. This method helps in creating confidence in searching for SRs, and is aiming at improving overall quality of searching. Attending a masterclass by some Kenyans does not make amateur marathon runners finish in 2 hours.