user avatar
Gary Collins
@GSCollins
Statistician • Professor • University of Birmingham • NIHR Senior Investigator • On BlueSky: bsky.app/profile/gscoll…
Joined May 2011
817
Following
10.3K
Followers
Posts
  • Pinned
    user avatar
    Gary Collins
    @GSCollins
    Apr 16, 2024
    NEW PAPER out today in @bmj_latest TRIPOD+AI: reporting recommendations for studies developing or validating prediction models for use in healthcare that use #machinelearning methods bmj.com/content/385/bm… #ArtificialIntelligence #AIstandards #OpenAccess Please share 🙏
    Screenshot of a new paper published in the BMJ "TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods"
    148K
  • user avatar
    Gary Collins
    @GSCollins
    Nov 16, 2021
    "A billion-dollar donation: estimating the cost of researchers’ time spent on peer review" --> bit.ly/3wQxp5o
  • user avatar
    Gary Collins
    @GSCollins
    Feb 19, 2022
    Spinning p-values in randomized controlled trials: "Analysis of 567,758 randomized controlled trials published over 30 years reveals trends in phrases used to discuss results that do not reach statistical significance" (tinyurl.com/2w9n6me6) #statstwitter
  • user avatar
    Gary Collins
    @GSCollins
    Apr 7, 2023
    We have just completed & published a large set of 8 focussed reviews looking at the design/methods, reporting, risk of bias and spin/overinterpretation of #machinelearning based prediction model studies in healthcare. The findings don’t paint a good picture. A little summary 🧵
    144K
  • user avatar
    Gary Collins
    @GSCollins
    Apr 7, 2022
    From a published paper. Not sure I've ever seen a ROC curve like this before! Hmmm....🤔 #bitweird #whatsgoingon
  • user avatar
    Gary Collins
    @GSCollins
    Jan 22, 2024
    All 3 papers (#openaccess) now out in the @bmj_latest on the **Evaluation of clinical prediction models** part 1: tinyurl.com/3h4zfvfw part 2: tinyurl.com/ynytrpmx part 3: tinyurl.com/2cfc9uj3 #stats #MachineLearning #predictiveanalytics
    44K
  • user avatar
    Gary Collins
    @GSCollins
    Nov 1, 2021
    REMINDER: A systematic review shows no performance benefit of #machinelearning over logistic regression for clinical prediction models (tinyurl.com/dnayhrms) -> "Improvements in methodology and reporting are needed" #keepitreal #dontbelievethehype #mlwtitter #statstwitter
  • user avatar
    Gary Collins
    @GSCollins
    Aug 15, 2022
    We've collated many reporting guidelines for various study designs, some of the main ones are listed below. But search our database for reporting guidelines for other study designs. Good reporting is part of responsible research. equator-network.org #researchintegrity
  • user avatar
    Gary Collins
    @GSCollins
    Dec 22, 2022
    👇The abridged 1-page print version now out in the #ChristmasBMJ --> tinyurl.com/yzpv2uu6 "The @bmj_latest wants to publish the gold not the mould, the frankincense not the makes-no-sense, & the myrrh not the urrgghh" longer version-> tinyurl.com/4jbe8rvr #statstwitter
    New paper in the Christmas edition of the BMJ light heartedly listing some red flags statisticians see during peer review of manuscripts in the style of the song, 12 days to Christmas
    user avatar
    Gary Collins
    @GSCollins
    Dec 20, 2022
    NEW PAPER in Xmas edition of the @bmj_latest - 'On the 12th day of Christmas, a Statistician sent to me...' --> tinyurl.com/4jbe8rvr This #buckletlist paper was such fun to write, highlighting some red flags we see during peer review at the BMJ. #statstwitter #epitwitter
    102K
  • user avatar
    Gary Collins
    @GSCollins
    Sep 14, 2021
    Have we now ran out of peer reviewers? Just been invited to review a paper I'm an author on - happened twice now in 2021.🙄
  • user avatar
    Gary Collins
    @GSCollins
    May 19, 2022
    REMINDER: Professional biostatisticians go through 3-4 years of undergraduate training, then maybe a 1 year Masters degree, then maybe 3-4 years of a PhD. Biostatistics is a profession, not a hobby. #subtweet #statstwitter #medtwitter
  • user avatar
    Gary Collins
    @GSCollins
    Aug 6, 2018
    …and here is a screen shot of two slides from a talk I gave a couple of years ago on the topic - I think says it all (full slides available from here bit.ly/2OKs3Sy). x.com/f2harrell/stat…
    user avatar
    Frank Harrell
    @f2harrell
    Aug 6, 2018
    Replying to @GSCollins
    The Royston article is in my view the best ever article on this subject. More articles here: biostat.mc.vanderbilt.edu/CatContinuous
  • user avatar
    Gary Collins
    @GSCollins
    Sep 28, 2021
    Some red flags when reading a prediction model paper - no sample size calc - no mention of missing data - dichotomania - any mention of class imbalance/smote/classifier - no assessment of calibration - AUC > 0.95 - no internal validation - no model or link to code #statstwitter
  • user avatar
    Gary Collins
    @GSCollins
    Nov 10, 2021
    Dichotomising continuous measurements (also known as throwing away precious information - that someone has consented for you to use) is still disappointingly common today. Many papers on this, but a good starting point is -> bit.ly/31Pwhn9 #statstwitter #epitwitter