Journal club is a common teaching format used within academic programs to review recently published literature or other key articles selected within a specific domain. Journal clubs tend to be fairly informal and are amenable to small group in-person sessions, or they can be conducted virtually. An innovative hybrid format combining the traditional in-person departmental discussion with input from participants on social media has also been described. While there is no “right way” to run a journal club, it is helpful for moderators and presenters to use a structured approach to tackle a scientific article strategically and facilitate discussion.
The following tips are only suggestions. Clinical research has been my focus area, but this structure for interpreting a journal article may apply to other areas of research as well.
Background: Do the authors summarize previously published studies leading up to the present study? What don’t we already know about this topic?
- Do the authors do a good job justifying the reason for the study? This should not be lengthy if there is clearly a need for the study.
- Do the authors present a hypothesis? What is it?
- What is the primary aim/objective of the study? Do the authors specific secondary aims/objectives?
Study Design: Do the authors explicitly state the design used in the present study? If so, what is it?
Retrospective (“case-control study”): Starts with the outcome then looks back in time for exposure to risk factors or interventions.
- Can calculate odds ratios to estimate relative risk.
- Cannot calculate risk/incidence (not prospective).
Cross-sectional (“prevalence study”): Takes a snapshot of risk factors and outcome of interest at one point in time or over a specific period of time.
- Can calculate prevalence.
- Cannot calculate risk/incidence (not longitudinal).
Prospective: Considered the gold standard for clinical research. Studies may be observational or interventional/experimental. Check if the study is prospectively registered (e.g., clinicaltrials.gov) because most journals expect this. Even systematic reviews are encouraged to register prospectively now. the site PROSPERO is based in the United Kingdom.
Observational (“cohort study”).
- May or may not have a designated control group (can start with defined group and risk factors are discovered over time such as the Framingham Study).
- Can calculate incidence and relative risk for certain risk factors.
- Identify potential causal associations.
Interventional/Experimental (“clinical trial”).
- What is the intervention or experiment?
- Is there blinding? If so, who is blinded: single, double, or triple (statistician blinded)?
- Are the groups randomized? How is this performed?
- Is there a sample size estimate and what is it based on (alpha and beta error, population mean and SD, expected effect size)? This should be centered around the primary outcome.
- What are the study groups? Are the groups independent or related?
- Is there a control group such as a placebo (for efficacy studies) or active comparator (standard of care)?
Measurements: How are the outcome variables operationalized? Check the validity, precision, and accuracy of the measurement tools (e.g., survey or measurement scale).
- Validity: Has the tool been used before? Is it reliable? Does the tool make sense (face validity)? Is the tool designed to measure the outcome of interest (construct validity)?
- Precision: Does the tool hit the target?
- Accuracy: Are the results reproducible?
Analysis: What statistical tests are used and are they appropriate? How do the authors define statistical significance (p-value or confidence intervals)? How are the results presented in the paper and are they clear?
- Categorical variables with independent groups: for 1 outcome and 2 groups, investigators commonly use the Chi square test (exact tests are used when n<5 in any field); for multiple outcomes or multiple groups, Kruskal Wallis with pairwise comparisons may be used although there are other options.
- Continuous variables with independent groups: for 1 outcome and 2 groups, investigators commonly use Student’s t test (if normal distribution) or Mann-Whitney U test (if distribution not normal); for multiple outcomes or multiple groups, analysis of variance (ANOVA) with post-hoc multiple comparisons testing; for multiple outcomes and multiple groups, especially with retrospective cohorts, regression modeling is often employed.
- Continuous variables with related groups (not independent): paired t test or repeated-measures ANOVA depending on the number of outcomes and groups.
- Are the results statistically significant? Clinically significant? Did the authors explain what they considered the minimal clinically important difference?
- Do the results make sense? Anything surprising or noteworthy?
Conclusions: I personally tend to skip the discussion section of the paper at first and come up with my own conclusions based on the study results; then I read what the authors have to say later.
- Did the authors succeed in proving what they set out to prove?
- Read the discussion section. Do you agree with the authors’ conclusions?
- What are possible future studies based on the results of the present study, and how would you design the next study?
