Brown reported the Research Quality Score for evaluating primary clinical studies. The method is adapted from one reported by Sackett and Haynes.
Variables:
(1) study design
(2) selection and specification of study sample
(3) specification of illness or condition
(4) description of educational condition
(5) construct definition of outcome
(6) outcome measure (most direct measure only)
Variable |
Findings |
Points |
study design |
randomized trial |
3 |
|
nonrandomized control group |
2 |
|
pretest/posttest |
1 |
selection and specification of study sample |
random population sample |
3 |
|
random population sample but inadequate demographic description |
2 |
|
not randomized population sample but randomized to groups only with adequate demographic description |
2 |
|
grab sample or single clinic, including adequate description of demographic features of sample |
1 |
|
grab sample or single clinic not otherwise specified |
0 |
specification of illness or condition |
replicable diagnostic criteria stated with inclusion/exclusion criteria |
3 |
|
diagnostic criteria stated |
2 |
|
diagnosis only |
1 |
|
diagnosis can only be inferred |
0 |
|
no diagnosis |
0 |
description of educational condition |
complete description which would permit the reader to replicate the intervention |
2 |
|
incomplete description (no description of 2 or more of the features of the intervention) |
1 |
|
intervention can only be inferred |
0 |
|
no description |
0 |
construct definition of outcome |
replicable by reader in own setting |
2 |
|
vague definitions |
1 |
|
no definition |
0 |
outcome measure |
objective direct measures taken longitudinally |
4 |
|
immediate direct measures |
3 |
|
objective indirect measures |
2 |
|
subjective measures |
1 |
|
not stated |
0 |
from Table 1, page 353
where:
• objective direct measures: test such as glycosylated hemoglobin measured on more than 1 occasion
• immediate direct measures: blood levels, direct observation of behavioral change, etc.
• objective indirect measures: includes test of knowledge or performance accuracy, keeping of appointments, etc.
• subjective measures: interview of patient, self-reporting or record review
Bonus Points
Variable |
Findings |
Bonus Points |
selection and specification of study sample |
any of the following (1) description of patient access to clinic/referral; (2) indication of proportion of patients excluded; (3) indication of consecutive admissions or all patients during stated time period or a random sample of single clinic population with at least 80% followup |
1 |
specification of illness or condition |
co-morbidity described |
1 |
description of educational condition |
if co-intervention with a second regimen is precluded by study design or is noted when it occurs |
1 |
outcome measure |
if measure scored 1, 2 or 3 AND (random as proposed to scheduled determination OR when patient is unaware of purpose of determination) |
1 |
total score =
= SUM(points for all variables) + SUM(bonus points)
Interpretation:
• minimum score: 1
• maximum score: 21
• The higher the score the better the quality of the study.
ICD-10: ,