Skip to Main Content

Systematic Review Service

Partnering with MSK community members interested in systematic and related reviews

Use of AI in the Review Process

Artificial intelligence (AI) is an evolving field with a lot of interest. There is the promise that it can cut down on the amount of time it takes to complete a review, and it can! But you have to know the strengths and limits of the tool you are using.

AI can be helpful for generating ideas that you vet and adapt for your review. For example, something like ChatGPT might be beneficial to inform your research question and help you brainstorm inclusion and exclusion criteria and what terms you want in your search strategy. 

Generative AI (GenAI) cannot:

  • Give you a list of the most important articles for your topic.
  • Build a systematic search strategy.

GenAI tools have a difficult time being comprehensive and will often suggest fake articles or Medical Subject Headings (MeSH). These issues are popularly known as hallucinations (i.e., it is making things up).

Keep in mind that while ChatGPT and other similar tools are often described with human-like terms, what they are designed to do is process your question by predicting the next word. This is not thinking, and they are not able to actually understand what you are researching.

AI can also be built into software. For example, Covidence, an online software platform used for systematic and other related reviews, uses machine learning to sort records by relevance and classify randomized controlled trials. Covidence is also beta testing using team-entered inclusion and exclusion criteria to auto-remove records.

Before using an AI tool, explore its parameters, and be skeptical about anything that seems too good to be true or removes all human intervention from a task.