JBI SUMARI. The Joanna Briggs Institute System for the Unified Management, Assessment and Review of Information. Research School April 2017

Size: px

Start display at page:

Download "JBI SUMARI. The Joanna Briggs Institute System for the Unified Management, Assessment and Review of Information. Research School April 2017"

Gwenda Bond
5 years ago
Views:

1 JBI SUMARI The Joanna Briggs Institute System for the Unified Management, Assessment and Review of Information Research School April 2017

2 To discuss 1. SUMARI Introduction 2. Demonstration 3. Limitations and future plans

3 Our challenge The challenge for us was to create a new system, which will allow the user to appraise and synthesise evidence from an even broader spectrum of sources, once again creating a world first in systematic review software.

4 Features > Incorporate all of the existing functionality plus more > New review types > Address each of steps in the systematic review process

5 Systematic Review Software Steps 1. Formulate review question 2. Define inclusion and exclusion criteria 3. Finalise and export protocol 4. Locate studies (searching) 5. Collate studies and discard duplicates 6. Screen studies Ti/Ab (independently and review [I&R]) 7. Select based on full text reasons for exclusion [I&R] 8. Assess study quality [I&R] 9. Extract data [I&R] 10. Analysis/summary and synthesis of relevant studies 11. Present results 12. Interpret results/establish confidence in body of evidence (GRADE, ConQual) 13. Finalise and export report

6 Types of Systematic Reviews 1. Effectiveness Reviews 2. Qualitative Reviews 3. Costs/Economics Reviews 4. Prevalence or Incidence Reviews 5. Diagnostic Test Accuracy Reviews 6. Etiology and Risk Reviews 7. Textual Synthesis Reviews 8. Mixed Methods Reviews 9. Umbrella Reviews 10. Scoping Reviews

7 JBI SUMARI > Aims to support the entire review process Protocol templates Review team management 10 review types Critical Appraisal Data Extraction Synthesis

8 Purpose of this demo > Warts and all presentation > Highlight current features and the current limitations > Highlight some future work > Remember this is the 1 st release (non commercial) > Regular, rolling updates are planned

9 > SUMARI Sites

10 User registration > Features Forgotten username/password features Change password Secure website (https)

11 Project creation > Features Can create 10 project types and an additional custom project Can filter projects on dashboard Can view when the project was last updated Can jump straight to a certain page within a project from the project bar Can delete a project

12 Overview and participants page > Features Can export protocol (note: can do this on the protocol page as well) Can view review progress Can modify project title Can invite as many participants as you wish to the review > Future plans Notification system (potentially)

13 Protocol page > Features Import citations form endnote XML Add studies manually Drag and drop studies Automatic updating of reference order (Vancouver) Add new sections Reposition Proforma administration page enables simple updates and ensures always up to date Simple formatting Export RTF document Allows multiple contributors if permissions are correct Automatic saving

14 Protocol page > Future plans Insert citation into text via other means Import other citation formats Include default citations based on review type No superscript formatting available Export word document Ensure references with relevant information in export (if feasible) Lock out for multiple editing Initiate version control (if feasible) Submit to JBISRIR (if feasible) Add DOIs to citations

15 Studies > Features Can import studies via endnote XML Can create studies manually Can export results into docx with PRISMA flowchart Can filter studies Can do full text study selection > Future plans Title and abstract screening (if feasible), similar to systems such as Covidence, Rayaan, Clinical Guideline Services etc Import searches from PubMed +other databases Import other reference formats Dual screening PRISMA for entire process

16 > Features Critical appraisal Select from 14 critical appraisal tools Tools ordered by default project type Dual screening Flexible appraisal process (people can log in and begin) View both comments during final decision making Export results in a rtf Filter appraisals > Future plans Create your own critical appraisal tools Enable single critical appraisal or 3+ critical appraisal Export into a docx Upload PDFs into system and highlight (if feasible)

17 Data extraction > Features Default data extraction tool based on study design Single data extraction Ability to add multiple groups where necessary Export into RTF with tables > Limitations Option to perform dual data extraction Creation of individualised data extraction forms Export into docx Code studies using structured ontologies (throughout system, including MA and recommendations etc)

18 Qualitative synthesis > Features Enter findings per study and assign level of credibility Assign findings to categories Assign categories to synthesised findings Streamlined user interface and design > Future plans Build in ConQual automatically Highlight findings on uploaded pdf/text docs automatically Export list of findings into docx Implement coding system so findings can be tagged and grouped

19 > Features: Meta analysis Head to head comparisons Choose meta analysis parameters Flexible can add additional citations > Future plans Improve plot visual output Additional options Proportional MA SROC curves Economic decision matrix Export into docx Subgroup analyses Funnel plots and publication bias tests

20 > Still to come! Report builder

21 What is next? > Short term Many changes expected from feedback now we are in production Prioritise updates Prepare for commercial release Maintain and continually update the system > Medium Term Ensure interoperability with similar systems and evidence ecosystem > Long term (all hypothetical at the moment) SR automation, machine learning, automated RoB, study selection and extraction Publish living SRs Integrate SUMARI and JBISRIR

22 You can't always get what you want But if you try sometimes well you just might find You get what you need

23 Other software > RevMan, particularly for meta analysis, head to head comparisons > OpenMeta[analyst] > openmetaanalysis > SR Toolbox

24 Any questions?

Covidence A tool for systematic reviews. Berit Elisabeth Alving

Covidence A tool for systematic reviews Berit Elisabeth Alving Agenda: 1. Covidence 2. Step by step - EndNote and Covidence 3. Duplication check in EndNote 4. Make an account in Covidence 5. Create a review