Appraisal Tool For Cross-Sectional Studies: (AXIS)
Appraisal Tool For Cross-Sectional Studies: (AXIS)
Appraisal Tool For Cross-Sectional Studies: (AXIS)
Critical appraisal (CA) is used to systematically assess research papers and to judge the reliability of the study being presented in
the paper. CA also helps in assessing the worth and relevance of the study [1]. There are many key areas to CA including assessing
suitability of the study to answer the hypothesised question and the possibility of introducing bias into the study. Identifying these
key areas in CA requires good reporting of the study, if the study is poorly reported the appraisal of suitability and bias becomes
difficult.
The following appraisal tool was developed for use in appraising observational cross-sectional studies. It is designed to address
issues that are often apparent in cross-sectional studies and to aid the reader when assessing the quality of the study that they are
appraising. The questions on the following pages are presented in the order that they should generally appear in a paper. The aim of
the tool is to aid systematic interpretation of a cross-sectional study and to inform decisions about the quality of the study being
appraised.
The appraisal tool comes with an explanatory help text which gives some background knowledge and explanation as to what the
questions are asking. The explanations are designed to inform why the questions are important. Clicking on a question will
automatically take you to the relevant section in the help text. The appraisal tool has areas to record a “yes”, “no” or “don’t know”
answer for each question and there is room for short comments as well.
If using this tool please cite the peer review publication: Development of a critical appraisal tool to assess the quality of cross-sectional studies (AXIS);
Martin J Downes, Marnie L Brennan, Hywel C Williams, Rachel S Dean; BMJ Open 2016;6:12 e011458 doi:10.1136/bmjopen-2016-011458
This work is licensed under the Creative Commons Attribution-ShareAlike 4.0 International License.
To view a copy of this license, visit http://creativecommons.org/licenses/by-sa/4.0/.
Contents
Appraisal of Cross-sectional Studies .................................................................................................................................................. 3
Introduction ......................................................................................................................................................................................... 4
Aims ................................................................................................................................................................................................ 4
Methods .............................................................................................................................................................................................. 4
Study Design ................................................................................................................................................................................... 4
Sample Size Justification ................................................................................................................................................................ 4
Target (Reference) Population ........................................................................................................................................................ 4
Sampling Frame .............................................................................................................................................................................. 4
Census ......................................................................................................................................................................................... 5
Sample Selection............................................................................................................................................................................. 5
Non-responders ............................................................................................................................................................................... 5
Measurement Validity & Reliability ............................................................................................................................................... 5
Statistics .......................................................................................................................................................................................... 6
Overall Methods.............................................................................................................................................................................. 6
Results................................................................................................................................................................................................. 6
Basic Data ....................................................................................................................................................................................... 6
Response Rate ................................................................................................................................................................................. 6
Internally Consistent Results .......................................................................................................................................................... 6
Justified Discussions and Conclusions............................................................................................................................................ 7
Aim ............................................................................................................................................................................................. 7
Selection Bias ............................................................................................................................................................................. 7
Non-response .............................................................................................................................................................................. 7
Confounding ............................................................................................................................................................................... 7
Non-significant Results ............................................................................................................................................................... 7
Limitations ...................................................................................................................................................................................... 8
Other ................................................................................................................................................................................................... 8
Conflicts of Interest......................................................................................................................................................................... 8
Ethical Approval ............................................................................................................................................................................. 8
References:.......................................................................................................................................................................................... 8
This work is licensed under the Creative Commons Attribution-ShareAlike 4.0 International License.
To view a copy of this license, visit http://creativecommons.org/licenses/by-sa/4.0/.
Appraisal of Cross-sectional Studies
Don’t know/
Question Yes No
Comment
Introduction
1 Were the aims/objectives of the study clear?
Methods
2 Was the study design appropriate for the stated aim(s)?
Was the target/reference population clearly defined? (Is it clear who the
4
research was about?)
Was the sample frame taken from an appropriate population base so that it
5
closely represented the target/reference population under investigation?
Were the risk factor and outcome variables measured appropriate to the aims
8
of the study?
Were the risk factor and outcome variables measured correctly using
9 instruments/measurements that had been trialled, piloted or published
previously?
Results
12 Were the basic data adequately described?
16 Were the results presented for all the analyses described in the methods?
Discussion
17 Were the authors' discussions and conclusions justified by the results?
Other
Were there any funding sources or conflicts of interest that may affect the
19
authors’ interpretation of the results?
Taken from Table 2 of: Development of a critical appraisal tool to assess the quality of cross-sectional studies (AXIS); Martin J Downes, Marnie L
Brennan, Hywel C Williams, Rachel S Dean; BMJ Open 2016;6:12 e011458 doi:10.1136/bmjopen-2016-011458
Introduction Question 3 asks if sample size justification was reported, but
it should also be clear what methods were used to determine
The introduction serves to establish the context of the work the sample size. In some cases clustering of observations
that is about to be presented in the text of the paper. Relevant within groups can occur (e.g. patients within hospitals or
primary literature should be discussed and referenced livestock within herds) and this should be taken into account
throughout the introduction. The history and current if sample size has been determined. It should be clear whether
understanding of the problem being researched should be the inferences drawn actually relate to the attributes for which
presented. This should be concluded giving a rational as to the sample size was calculated [7]. If sample size justification
why the current study is being presented and what the aims isn’t given or restrictions make it difficult to reach the desired
and/or hypothesis under investigated are [2,3]. sample size then this should be declared in the text.
The methods section is used to present the experimental study Sampling Frame
design of the paper. The methods should be described clearly
As a reader you need to determine if the sample frame being
in easy to understand language and clearly identify measures,
used is representative of the target population. The study
exposures and outcomes being used in the study [4]. More
population should be taken from the target population; units
specific issues are addressed below.
from this study population have information that is accessible
Study Design and available which allows them to be placed in the study.
The sampling frame is the list or source of the study
Question 2 is used to assess the appropriateness of using a population that the researcher has used when trying to recruit
cross-sectional study to achieve the aim(s) of the study. participants into the study (Figure 1). Ideally it should be
Cross-sectional studies are observational studies that provide exactly the same composition or structure as the target
a description of a population at a given time, and are useful in population. In practice it is generally much smaller, but
assessing prevalence and for testing for associations and should still be representative of the target population.
differences between groups [5]. Examples of cross-sectional Generally, for convenience, the sampling frame is a list of
designs include point-in-time surveys, analysis of records and units that are within the target population e.g. list of telephone
audits of practice [6]. The reader should try and decipher if a owning households, computerised patient records etc. A
cross-sectional study design is appropriate for the questions
being asked by the researcher. Figure 1