Developing a questionnaire in occupational
epidemiological research: Some common sense guidelines
Rezaeian
M, PhD
- Professor,
Epidemiologist, Social Medicine Department, Occupational Environmental Research
Center, Rafsanjan Medical School, Rafsanjan University of Medical Sciences, Rafsanjan,
Iran.
Abstract
Received: September 2013, Accepted: May 2014
Background:
The most common method of collecting data in any area of human health
research is to apply a questionnaire. However, if extreme cautiousness is not
taking into account while designing a questionnaire, the gathered data might
be ineffective. Therefore, the aim of the present article is to discuss some
of the most important set of guidelines in designing a questionnaire. Materials
and methods: To fulfil the aim of the study, it has been
tried to search the relevant literature by looking at different search
engines and also carry out hand searching. It has also been tried to
elaborate any selected guidelines by examples relevant to occupational epidemiology.
Results:
The literature highlights that there are at the very least ten common-sense
guidelines that one should take into account for designing a valid and
reliable questionnaire. Conclusions:
By following the proposed guidelines it is hoped that a deigned questionnaire
is able to elicit the responses that one might need. |
Key
words: Questionnaire, Design, Guidelines,
Occupational Epidemiology
Introduction
There are diverse methods
available to collect data in health research. However, the most common method
in any area of human health research including occupational epidemiology is filling out a questionnaire. For example, when one sets out to
gather relevant information on exposure assessment, the best way is to apply a
valid and reliable questionnaire (1-5). Experiences suggest that in order to
apply a questionnaire for collecting data one should consider some common-sense
guidelines to obtain relevant information (6-13). Otherwise the gathered data
is no more than a pile of unreliable and imprecise one. The aim of the present
article is therefore to discuss some of the most important of these guidelines,
taking into account the related issues within the area of occupational epidemiology.
Always in the first step, determine
the aims of your study and formulate them into well-written questions or
hypotheses
First and foremost* you should determine the aims of
your study. Then you should formulate those aims into well-written questions or
hypotheses depending on the type of your study. For example, if your aims are
achievable by descriptive epidemiological studies, e.g. you are going to
estimate the prevalence of an occupational related disorder such as work-related
musculoskeletal disorders (WMSDs) (14) then you should formulate your aims into
answerable questions.
However, if your aims are achievable by analytic
epidemiological studies, e.g. you are going to estimate the reasons behind an
occupational related disorder, such as work-related disorders of neck and the
upper limb (15), or the effect of psychosocial factors on WMSDs (16) then you
should formulate your aims into testable hypotheses.
These are very important issues since clarification of aims and
formulation of them into either answerable questions or testable hypotheses will
help researchers to better define their targeted populations. It also helps
them to exactly define those variables which should be collected from the
population under study. These variables then carefully are converted into the questions
of the research questionnaire.
Never commence to design a
questionnaire before carrying out an extensive review of the literature
After completing the aims of your study, it is wise to carry
out a wide review of literature before designing a questionnaire. The reason
for this activity is that you may find an already designed questionnaire which
fulfils your aims. You should always bear in mind that designing a standard
questionnaire is a time consuming and difficult task. Therefore, if other
people have already done this painstaking activity you would apply their
questionnaire and save your time and energy.
Furthermore, using an already standard designed questionnaire
will help you to compare your results with others whom have applied the same
questionnaire before. It means that you also have a valid base for comparison
purposes, which is an essential element in any scientific research.
Back to our previous example, if you are going to determine
the WMSDs among the targeted population, by a wide extensive review of
literature you will find that there are some previously validated questionnaires
on WMSDs among different workers, such as physical therapists (17), athletic
trainer (18) farm operators (19) and brick field workers (20). Most of these
studies have applied a modified version of self-reporting Nordic Questionnaire,
which is a standardized musculoskeletal questionnaire (21).
Similarly, suppose you are going to investigate occupational
exposure to needle-stick injuries among medical and nursing staff, which is a
universal problem (22-24). It is vitally important that you to recognize that there
is an already standard questionnaire developed for this purpose (25).
Always apply a standard questionnaire
Irrespective of applying an already designed questionnaire or
applying your own designed questionnaire, you should make sure that you utilize
a standard one in your study. The term standard means that your questionnaire
must be valid and reliable.
A valid questionnaire will measure exactly the topic under the
study. For example, if you are going to measure work-related depression among
the targeted population such as police officers (26) your questionnaire should
measure depression and nothing else. A questionnaire that measures work-related
anxiety (27) is not a valid questionnaire one for your study.
Moreover, a reliable questionnaire is a questionnaire that if
it is carried out twice in a short period of time, say after one week on the
same targeted population, it would give the same results. If your questionnaire
does not encompass these two vital components, it is not a standard
questionnaire. This implies that by applying such a questionnaire in your
study, you will only collect some deficient data.
As it has been mentioned earlier Nordic Questionnaire can be
considered as a self-reporting standardized musculoskeletal questionnaire (21)
in this regard.
Never use long questions and a long
questionnaire
If you decide to design your own questionnaire you should
never design long questions and apply a long questionnaire. Experiences
show that a long
questionnaire carries a high risk of non-responsiveness. Similarly, long and
ambiguous questions within the questionnaire also carry the same risk. In order
to get rid of such unwanted risks you should always consider some guiding
principles in designing your questionnaire.
For example, always use simple and understandable words in
your questions and only collect those variables that you vitally need. Similarly,
never ask double-barreled questions (28). For example, instead of asking: “Have
you ever experienced work-related anxiety or depression during the past twelve
months?” you should ask two separate questions as follows: “1. Have you ever experienced
work-related anxiety during the past twelve months?” and “2. Have you ever
experienced work-related depression during the past twelve months?”
Always remember that designing a
questionnaire is a tradeoff between “open ended” and “closed ended” questions
There are usually two types of questions used within a
questionnaire i.e. “open ended” and “closed ended” questions. Designing a
questionnaire is therefore, a tradeoff between these two types of questions’.
“Closed ended” questions provide the necessary responses for the participants
and they should only select the correct response. “Open ended” questions on the
contrary, provide the necessary room for the participants to express their
responses without any restrictions.
The analysis of “closed ended” questions is much easier and
they are usually applied when the designer knows all the possible answers. The
“open ended” questions are applied when the designer does not know all the
possible answers and the analysis of this kind of question is a little awkward
since the responses need to be grouped before any analysis is carried out.
However, all quantitative variables such as “age”, “height”,
“weight” and “years of professional experience” should always be answerable as
“open ended” questions. The reason for doing so is that you will be able to
analyze them as real quantitative variables by calculating their measures of central
tendency and spread, such as mean and standard deviation. Moreover, with the
use of a user-friendly statistical package such as SPSS you will be able to
group and re-group such variables based on the aim of your study.
Never begin your questionnaire with
sensitive questions
The order of the questions within a questionnaire is also a
vital issue that should be dealt with carefully. For a high rate of response
never begin your questionnaire with sensitive questions. Sensitive issues
change from one culture to another so you might need to be judicious in choosing
the questions you might ask a particular cultural group.
For example, studying the issue of “sexual harassment” among
workers (29) or students (30) could be categorized as a very sensitive issue. Sensitive
issues might be asked later in the questionnaire by explaining why these personal
questions are important to be asked.
Always use an introductory paragraph
in your questionnaire
An introductory paragraph is an essential part of any
questionnaire which should help to increase the response rate. You might
prepare this introductory paragraph in the format of an opening letter. In this
introductory part you should introduce yourself and your research team. You should
also explain the importance and aims of your study and provide the respondents
with the necessary information on how to fill out the questionnaire.
You might also explain how the honest cooperation of the
respondents is important for you to achieve the aim of the study. Additionally,
you should always select a concise, attractive and comprehensive title for your
questionnaire, avoiding any abbreviations and jargons.
Never end your questionnaire without
acknowledging the respondents
Similarly, you should end your questionnaire acknowledging
the cooperation of the respondents. They put in time and effort to fill out
your questionnaire and therefore, you should express your gratitude. You should
also tell your respondents what to do with the completed questionnaire and the closing
paragraph is the best place for doing so.
Always use an attractive format for
your questionnaire
If you have followed the previous steps in designing your
questionnaire then you have nearly finished your highly difficult and
complicated task. Now you should use an attractive format for the final draft
of your questionnaire. Evidence suggests that an attractive format in terms of
font type and size, questionnaire layout, the quality of paper and print and
even the color of paper and print could have substantial effects on the
response rate (31 & 32).
For ease of filling out, you might also categorize your
questions under various sub-headings using bold sub-titles, according to the
nature of your questionnaire. For example, the questions of a questionnaire on
WMSDs might be categorized into the four following sections (33):
“Section A: Demographic characteristics”, “Section B: Occupational
health”, “Section C: Perceptions on job risk factors that may contribute to
development of WMSDs” and “SECTION D: Coping strategies toward reducing the
risk of development of WMSDs”.
Never use your designed questionnaire
without “pretesting” it
Pre-testing and pilot testing a designed questionnaire before
actually using it for the targeted populations is an extremely advisable
activity (34). To do so you might take some diverse strategies (35). For
example, you might first ask your colleagues or some other experts in the area
of study, to read through your designed questionnaire and provide you with some
comments regarding quality and quantity of the questions.
Then you might ask some potential respondents to go through your
designed questionnaire and determine any ambiguities. You might also ask the
potential respondents about sensitive questions and how they feel about answering
them.
These activities will help you to check your designed
questionnaire to identify any parts that need alteration. By revising your
questionnaire based on the received comments you are now coming to the end of
your intricate and complicated task.
Conclusion
Applying a questionnaire is
the most common method of collecting data in any area of human health research.
The present article provided some common-sense guidelines to make the most of a
questionnaire.
Conflict of interest: Non declared
References
1.
Wilson A, Williams M, Hancock B. Research Approaches in Primary Care. Radcliffe
Medical Press Ltd 2000; 17(6):577.
2.
McColl E, Thomas R. (2000). The Use and Design of Questionnaires.
London: Royal College of General Practitioners.
3.
Coggon D. Questionnaire based exposure assessment methods. Sci Total
Environ 1995; 168(2):175-8.
4.
Nieuwenhuijsen MJ (2003). Exposure assessment in occupational and
environmental epidemiology. Oxford: Oxford University Press.
5.
Nieuwenhuijsen MJ. Design of exposure questionnaires for epidemiological
studies. Occup Environ Med 2005; 62(4):272-80, 212-4.
6.
Stone DH. Design a questionnaire. BMJ 1993; 307(6914):1264–6.
7.
Leung WC. How to design a questionnaire. Student BMJ 2001; 9:187-9.
8.
Boynton PM. Administering,
analysing, and reporting your questionnaire. BMJ 2004; 328(7452):1372-5.
9.
Boynton PM, Greenhalgh T. Selecting, designing, and developing your questionnaire.
BMJ 2004; 328(7451):1312-5.
10. Ng CJ. Designing a questionnaire.
Malaysian Family Physician 2006; 1(1):32-5.
11. Rattray J, Jones MC. Essential
elements of questionnaire design and development. J Clin Nurs 2007;
16(2):234-43.
12. Kazi AM, Khalid W. Questionnaire
designing and validation. J Pak Med Assoc 2012; 62(5):514-6.
13. Rezaeian,
M. How to design a questionnaire:
Introducing a ten-item checklist. Middle East
Journal of Business 2014; 9(1):55.
14. Punnett L, Wegman DH. Work-related
musculoskeletal disorders: the epidemiologic evidence and the debate. J
Electromyogr Kinesiol 2004; 14(1):13-23.
15. Buckle PW, Devereux JJ. The nature
of work-related neck and upper limb musculoskeletal disorders. Appl Ergon 2002;
33(3):207-17.
16. Yue P, Xu G, Li L, Wang S.
Prevalence of musculoskeletal symptoms in relation to psychosocial factors.
Occup Med (Lond) 2014; 64(3):211-6.
17. Cromie JE, Robertson VJ, Best MO.
Work-related musculoskeletal disorders in physical therapists: prevalence,
severity, risks, and responses. Phys Ther 2000; 80(4):336-51.
18. Ju YY, Cheng HY, Hsieh YJ, Fu LL.
Work-related musculoskeletal disorders in athletic trainer. J Occup Rehabil
2011; 21(2):190-8.
19. Osborne A, Blake C, Meredith D,
Kinsella A, Phelan J, McNamara J, et al. Work-related musculoskeletal disorders
among Irish farm operators. Am J Ind Med 2013; 56(2):235-42.
20. Das B. Prevalence of work-related musculoskeletal
disorders among the brick field workers of West Bengal, India. Arch Environ
Occup Health 2014; 69(4):231-40.
21. Dickinson CE, Campion K, Foster AF,
Newman SJ, O'Rourke AM, Thomas PG. Questionnaire development: an examination of
the Nordic Musculoskeletal questionnaire. Appl Ergon 1992; 23(3):197-201.
22. Wicker S, Stirn AV, Rabenau HF,
von Gierke L, Wutzler S, Stephan C. Needlestick injuries: causes, preventability
and psychological impact. Infection 2014; [Epub ahead of print]
23. Marković-Denić L,
Branković M, Maksimović N, Jovanović B, Petrović I,
Simić M, et al. Occupational exposures to blood and body fluids among
health care workers at university hospitals. Srp Arh Celok Lek 2013; 141(11-12):789-93.
24. Rezaeian
M, Asadpour M, Khademrezaeian H. Epidemiology
of occupational exposure to needlestick injuries and body fluids among doctors
and medical students in Rafsanjan University of Medical Sciences. J Occu Health Epidemiol 2012; 1(1):44-9.
25. Rowe PM, Giuffre M. Evaluating
needlestick injuries in nursing personnel. Development of a questionnaire.
AAOHN J 1991; 39(11):503-7.
26. Lawson KJ, Rodwell JJ, Noblet AJ.
Mental health of a police force: estimating prevalence of work-related
depression in Australia without a direct national measure. Psychol Rep 2012;
110(3):743-52.
27. Tan SM, Jong SC, Chan LF,
Jamaludin NA, Phang CK, Jamaluddin NS, et al. Physician, heal thyself: the paradox of anxiety amongst house officers and work
in a teaching hospital. Asia Pac Psychiatry 2013; Suppl(1):74-81.
28. Choi BC, Pak AW. A catalog of
biases in questionnaires. Prev Chronic Dis 2005; 2(1):A13.
29. Wang LJ, Chen CK, Sheng YC, Lu PW,
Chen YT, Chen HJ, et al. Workplace sexual harassment in two general hospitals
in Taiwan: the incidence, perception, and gender differences. J Occup Health
2012; 54(1):56-63.
30. Warren DP, Henson HA, Turner SD,
O'Neill PN. Diversity, cultural sensitivity, unequal treatment, and sexual
harassment in a school of dental hygiene. J Dent Hyg 2004; 78(4):9.
31. Teschke K, Kennedy SM, Olshan AF.
Effect
of different questionnaire formats on reporting of occupational exposures. Am J
Ind Med 1994; 26(3):327–37.
32. Keeter S, Kennamer JD, Ellis JM,
Green RG. Does the use of colored paper improve response rates to mail surveys?
A multivariate experimental evaluation. J Soc Serv Res 2002; 28(1):69-78.
33. Tinubu BM, Mbada CE, Oyeyemi AL,
Fabunmi AA. Work-related musculoskeletal disorders among nurses in Ibadan,
South-west Nigeria: a cross-sectional survey. BMC Musculoskelet Disord 2010;
11:12.
34. Del Greco L, Walop W.
Questionnaire development: 5. The pretest. CMAJ 1987;
136(10):1025-6.
35. Oremus M, Cosby JL, Wolfson C. A
hybrid qualitative method for pretesting questionnaires: the example of a questionnaire
to caregivers of Alzheimer disease patients. Res Nurs Health 2005;
28(5):419-30.
* Corresponding author: Mohsen Rezaeian, School
of Medicine, Occupational Environmental Reseaech Center, Rafsanjan University
of Medical Sciences, Rafsanjan, Iran.
Email: moeygmr2@yahoo.co.uk