Empowering research: Statistical power in general practice research

Nick Fox, Nigel Mathers

Research output: Contribution to journalArticle

27 Citations (Scopus)

Abstract

Background. Statistical power is a measure of the extent to which a study is capable of discerning differences or associations which exist within the population under investigation, and is of critical importance whenever a hypothesis is tested by statistics. Conventionally, studies should reach a power level of 0.8, such that four times out of five a false null hypothesis will be rejected by a study. Statistical power may most easily be increased by increasing sample size. Objective, We aimed to assess the level of statistical power of general practice research. Methods. A total of 1422 statistical tests in 85 quantitative original papers in the British Journal of General Practice were analysed for statistical power. Results. The median power of tests analysed was 0.71, representing a slightly greater than two-thirds likelihood of rejecting false null hypotheses. Of 85 studies, 37 (44%) attained power of 0.8 or more. Ten studies had power of more than 0.99 suggesting 'over-powering'. Twenty-one of the papers surveyed (25%) had a likelihood of gaining significant results poorer than that obtained by tossing a coin when a null hypothesis is false. Conclusion. While achieving higher power than studies in similar surveys of other disciplines, the power of general practice research falls short of the 0.8 convention. Adequate power is essential so that effects which exist are not missed. Recommendations are made concerning power calculations prior to the start of research and reporting of results in journal articles.
LanguageEnglish
Pages324-329
Number of pages6
JournalFamily Practice
Volume14
Issue number4
DOIs
Publication statusPublished - 1 Aug 1997
Externally publishedYes

Fingerprint

General Practice
Research
Numismatics
Sample Size
Population
Surveys and Questionnaires

Cite this

Fox, Nick ; Mathers, Nigel. / Empowering research : Statistical power in general practice research. In: Family Practice. 1997 ; Vol. 14, No. 4. pp. 324-329.
@article{17abae5e29994c769a920baea4456d2e,
title = "Empowering research: Statistical power in general practice research",
abstract = "Background. Statistical power is a measure of the extent to which a study is capable of discerning differences or associations which exist within the population under investigation, and is of critical importance whenever a hypothesis is tested by statistics. Conventionally, studies should reach a power level of 0.8, such that four times out of five a false null hypothesis will be rejected by a study. Statistical power may most easily be increased by increasing sample size. Objective, We aimed to assess the level of statistical power of general practice research. Methods. A total of 1422 statistical tests in 85 quantitative original papers in the British Journal of General Practice were analysed for statistical power. Results. The median power of tests analysed was 0.71, representing a slightly greater than two-thirds likelihood of rejecting false null hypotheses. Of 85 studies, 37 (44{\%}) attained power of 0.8 or more. Ten studies had power of more than 0.99 suggesting 'over-powering'. Twenty-one of the papers surveyed (25{\%}) had a likelihood of gaining significant results poorer than that obtained by tossing a coin when a null hypothesis is false. Conclusion. While achieving higher power than studies in similar surveys of other disciplines, the power of general practice research falls short of the 0.8 convention. Adequate power is essential so that effects which exist are not missed. Recommendations are made concerning power calculations prior to the start of research and reporting of results in journal articles.",
keywords = "General practice research, Research publication, Sampling, Statistical power",
author = "Nick Fox and Nigel Mathers",
year = "1997",
month = "8",
day = "1",
doi = "10.1093/fampra/14.4.324",
language = "English",
volume = "14",
pages = "324--329",
journal = "Family Practice",
issn = "0263-2136",
publisher = "Oxford University Press",
number = "4",

}

Empowering research : Statistical power in general practice research. / Fox, Nick; Mathers, Nigel.

In: Family Practice, Vol. 14, No. 4, 01.08.1997, p. 324-329.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Empowering research

T2 - Family Practice

AU - Fox, Nick

AU - Mathers, Nigel

PY - 1997/8/1

Y1 - 1997/8/1

N2 - Background. Statistical power is a measure of the extent to which a study is capable of discerning differences or associations which exist within the population under investigation, and is of critical importance whenever a hypothesis is tested by statistics. Conventionally, studies should reach a power level of 0.8, such that four times out of five a false null hypothesis will be rejected by a study. Statistical power may most easily be increased by increasing sample size. Objective, We aimed to assess the level of statistical power of general practice research. Methods. A total of 1422 statistical tests in 85 quantitative original papers in the British Journal of General Practice were analysed for statistical power. Results. The median power of tests analysed was 0.71, representing a slightly greater than two-thirds likelihood of rejecting false null hypotheses. Of 85 studies, 37 (44%) attained power of 0.8 or more. Ten studies had power of more than 0.99 suggesting 'over-powering'. Twenty-one of the papers surveyed (25%) had a likelihood of gaining significant results poorer than that obtained by tossing a coin when a null hypothesis is false. Conclusion. While achieving higher power than studies in similar surveys of other disciplines, the power of general practice research falls short of the 0.8 convention. Adequate power is essential so that effects which exist are not missed. Recommendations are made concerning power calculations prior to the start of research and reporting of results in journal articles.

AB - Background. Statistical power is a measure of the extent to which a study is capable of discerning differences or associations which exist within the population under investigation, and is of critical importance whenever a hypothesis is tested by statistics. Conventionally, studies should reach a power level of 0.8, such that four times out of five a false null hypothesis will be rejected by a study. Statistical power may most easily be increased by increasing sample size. Objective, We aimed to assess the level of statistical power of general practice research. Methods. A total of 1422 statistical tests in 85 quantitative original papers in the British Journal of General Practice were analysed for statistical power. Results. The median power of tests analysed was 0.71, representing a slightly greater than two-thirds likelihood of rejecting false null hypotheses. Of 85 studies, 37 (44%) attained power of 0.8 or more. Ten studies had power of more than 0.99 suggesting 'over-powering'. Twenty-one of the papers surveyed (25%) had a likelihood of gaining significant results poorer than that obtained by tossing a coin when a null hypothesis is false. Conclusion. While achieving higher power than studies in similar surveys of other disciplines, the power of general practice research falls short of the 0.8 convention. Adequate power is essential so that effects which exist are not missed. Recommendations are made concerning power calculations prior to the start of research and reporting of results in journal articles.

KW - General practice research

KW - Research publication

KW - Sampling

KW - Statistical power

UR - http://www.scopus.com/inward/record.url?scp=0030770196&partnerID=8YFLogxK

U2 - 10.1093/fampra/14.4.324

DO - 10.1093/fampra/14.4.324

M3 - Article

VL - 14

SP - 324

EP - 329

JO - Family Practice

JF - Family Practice

SN - 0263-2136

IS - 4

ER -