10 min read

GRADE Framework

Evidence certainty assessment with automated profiles

GRADE Framework

Grading of Recommendations, Assessment, Development and Evaluation (GRADE) provides a systematic approach to rating evidence certainty.

What is GRADE?

GRADE assesses:

  • Certainty in evidence (confidence in estimates)
  • Strength of recommendations
  • Quality across outcomes

Certainty Levels

High Certainty

  • Very confident in estimate
  • Further research unlikely to change
  • Strong basis for recommendations

Moderate Certainty

  • Moderately confident
  • Further research may change estimate
  • Generally reliable for recommendations

Low Certainty

  • Limited confidence
  • Further research likely to change
  • Recommendations made cautiously

Very Low Certainty

  • Very little confidence
  • Estimate very uncertain
  • Recommendations uncertain

Factors Affecting Certainty

Downgrading Factors

1. Risk of Bias

  • Study quality issues
  • Domain-specific concerns
  • Overall bias assessment

2. Inconsistency

  • Heterogeneity in results
  • Unexplained variation
  • Conflicting findings

3. Indirectness

  • Population differences
  • Intervention variations
  • Outcome substitutions
  • Indirect comparisons

4. Imprecision

  • Wide confidence intervals
  • Small sample sizes
  • Crossing decision thresholds

5. Publication Bias

  • Funnel plot asymmetry
  • Missing studies
  • Selective reporting

Upgrading Factors

Large Effect

  • Very large magnitude
  • Dose-response relationship

Plausible Confounding

  • Would reduce effect (but effect remains)
  • Strengthens conclusions

EvidAI GRADE Features

Automated Assessment

The AI evaluates:

  • Risk of bias summary
  • Statistical heterogeneity
  • Indirectness indicators
  • Precision measures
  • Publication bias tests

Suggested Ratings

For each outcome:

  • Preliminary certainty rating
  • Factors for downgrading/upgrading
  • Supporting evidence
  • Your final judgment

Evidence Profiles

Automatic generation of:

  • Summary of Findings tables
  • Evidence profiles
  • GRADE summary tables

Summary of Findings Tables

Auto-Generated Content

Tables include:

  • Outcome descriptions
  • Relative effects (RR, OR)
  • Absolute effects
  • Number of participants
  • Number of studies
  • Certainty rating
  • Comments

Customization

Adjust:

  • Outcomes included
  • Effect measures displayed
  • Baseline risk assumptions
  • Plain language summaries

Best Practices

During Assessment

  • Consider all domains systematically
  • Document reasoning
  • Be consistent across outcomes
  • Engage clinical expertise

Reporting

  • Be transparent about judgments
  • Explain uncertainty clearly
  • Provide plain language summaries
  • Include all domains assessed
Did this article help?
Still stuck?