Intended for healthcare professionals

Letters

Logistic regression models used in medical research are poorly presented

BMJ 1996; 313 doi: https://doi.org/10.1136/bmj.313.7057.628 (Published 07 September 1996) Cite this as: BMJ 1996;313:628
  1. Ralf Bender,
  2. Ulrich Grouven
  1. Statistician Department of Metabolic Diseases and Nutrition, Heinrich-Heine-University Dusseldorf, PO Box 10 10 07, D-40001 Dusseldorf, Germany
  2. Statistician Department of Anaesthesiology, Research Group Informatics and Biometry, Hanover Medical School, Hospital Oststadt, Podbielskistrasse 380, D-30659 Hanover, Germany

    EDITOR,—The application of multiple regression models in medical research has greatly increased during the past years.1 Nevertheless, assessing the accuracy of regression models in describing the data (goodness of fit) is almost unknown in medical research. Hence, medical journals may be publishing papers in which regression models are misused or results are misinterpreted.

    We investigated the use of logistic regression in papers published in the BMJ, JAMA, the Lancet, and the New England Journal of Medicine during 1991-4. A Medline search using the strings logistic regression and proportional odds model yielded 111 papers. Of these, two articles stated the use of logistic regression in the abstract but the Cox model had been used instead. The remaining 109 papers used some kind of logistic regression. We investigated which kind of logistic regression was used (binary, polytomous, ordinal), whether a statistical reference and the computer software were specified, and whether a valid assessment of the goodness of fit of the logistic models2 was reported.

    Only one paper used the proportional odds model for ordinal response; the other 108 articles used binary logistic regression. A reference for logistic regression was specified in 48 papers, for the software in 57, and for both in only 26 papers. This is not in line with the guidelines of the International Committee of Medical Journal Editors.3 The most frequently specified reference was the book by Hosmer and Lemeshow,2 followed by the book by Breslow and Day4 and various SAS manuals, while the most popular software packages in descending order were SAS, SPSS, BMDP, EGRET, and GLIM.

    Goodness of fit was rarely assessed. Three papers stated the use of the Hosmer-Lemeshow test,2 two compared the predicted and observed outcomes, and two reported the analysis of residuals. A further two reported the use of likelihood ratio statistics, but as the models contained continuous covariates the likelihood ratio test was inadequate.2 Thus only seven papers reported a valid assessment of the adequacy of their regression model.

    As the validity of all results and conclusions strongly depends on the goodness of fit of the models used, this practice of reporting is unsatisfactory and should be changed. We agree with Campillo that clear standardised publication criteria are needed to improve the current poor presentation of regression models in biomedical journals.5 We recommend that authors should always report the goodness of fit of regression models to avoid invalid results.

    References

    1. 1.
    2. 2.
    3. 3.
    4. 4.
    5. 5.