Research Methods - Surveys & Questionnaires
Friday 26 November 2010
Thanking the Respondent
Thursday 25 November 2010
Tips for creating a good survey or questionnaire
• Include instructions on how to complete the survey- To ensure you collect the data you need correctly you need to make sure the recipient knows exactly how to fill out the questionnaire. What may seem obvious to you may not seem obvious to someone else.
• Keep the questions short and concise- The easier it is for the recipient to answer the questionnaire the more likely it is that the answers you receive will be honest and genuine.
• Don’t ask for personal information unless you need it- By asking individuals to provide sensitive data may irritate some respondents and prevent them from completing the questionnaires. If you need to ask personal information it is best to place them at the end of the questionnaire.
• Make sure the questions are unbiased- All questions in the questionnaire must be unbiased to prevent the recipient from giving a bias answer. If the questions are bias the results you receive will also be bias.
• Present the questions in a clean and organised layout- A simple layout will make it easier for people to respond to the questions and for you to collect the data you need.
• Clearly state your intentions with your research- Some people are hesitant to answer questions about themselves until they know exactly what they are answering questions for. To gain the best responses it is therefore important to clearly state your intentions on the questionnaire.
Hopefully the above points will help when looking at how to make a good questionnaire.
References:
http://www.sciencebuddies.org/science-fair-projects/project_ideas/Soc_survey.shtml
What are response rates within surveys and issues associated with them?
What is response rate and why is it used ?
Response rates are the number of people who have answered the survey from the given number of people asked to conduct the survey.
It is usually represented as a percentage by dividing the number of people who answered by the sample number (overall total asked to conduct survey) then multiplying by a hundred.
Response Rate = People who answered X 100
Sample size
There are two issues when it comes to response rate, one being the nonresponse issue and the other being the response issues.
Nonresponse Issues
Nonresponsive issues also known as nonresponsive bias is usually always a problem for all surveys carried out as most of the time there is a difference between the sample size and the sample that actually respond to the survey.
Nonresponse bias usually cannot be avoided and so inevitably negatively affects most survey research by creating errors in a statistical measurement. Researchers must therefore account for nonresponse either during the planning of their survey or during the analysis of their survey results. If you create a larger sample during the planning stage, confidence limits may be based on the actual number of responses themselves.
Response Issues
As well as nonresponsive bias issues researchers should also take into account responsive bias.
These can be down to
· When respondents give false information to save time.
· When there are too many options to pick from and they select the first thing that enters their mind.
·When respondents do not read the questions and are not bothered with the survey so they select the same answer for all questions e.g. neutral, no or disagree.
· Respondents miss out questions.
Response bias can seriously affect the results of the survey when they are statistically represented.
It is difficult to completely eliminate response bias but can be reduced through careful consideration of the types of questions and answers offered to respondents during the design stage of the survey.
References
Response Rate Issues. Retrieved 24th November 2010 from
http://writing.colostate.edu/guides/research/survey/com2d4.cfm
Email or Printed Questionnaires
When your target population has access to email, it is very tempting to send them through email as it is a quicker option and it cost less. However, emails can be seen as junk especially if you do not know the sender. This shows that it depends on who your target market is and what makes it easier for the user to fill in. I have listed some advantages and disadvantages of using email or printed questionnaires.
| |
Advantages
Disadvantages
|
|
Statistical Surveys
Statistical surveys are used to collect quantitative information on population. These surveys are particularly used for political, governmental, health and social research. It can also be used as a marketing tool for business to identify what products people prefer and their change in tastes. From the surveys the main focus it to receive opinion depending on its purpose. Questions that are administrated are normally referred to a self-administrative or a questionnaire survey.
http://en.wikipedia.org/wiki/Statistical_survey#Serial_surveys
Wednesday 24 November 2010
Types of Survey/Questionnaire Questions
1. Contingency questions - A question that is answered only if the respondent gives a particular response to a previous question. This avoids asking questions of people that do not apply to them (for example, asking men if they have ever been pregnant).
2. Matrix questions - Identical response categories are assigned to multiple questions. The questions are placed one under the other, forming a matrix with response categories along the top and a list of questions down the side. This is an efficient use of page space and respondents’ time.
3. Closed ended questions - Respondents’ answers are limited to a fixed set of responses. Most scales are closed ended. Other types of closed ended questions include:
Yes/no questions - The respondent answers with a “yes” or a “no”.
Multiple choice - The respondent has several option from which to choose.
Scaled questions - Responses are graded on a continuum (example : rate the appearance of the product on a scale from 1 to 10, with 10 being the most preferred appearance). Examples of types of scales include the Likert scale, semantic differential scale, and rank-order scale (See scale for a complete list of scaling techniques.).
4. Open ended questions - No options or predefined categories are suggested. The respondent supplies their own answer without being constrained by a fixed set of possible responses. Examples of types of open ended questions include:
Completely unstructured - For example, “What is your opinion of questionnaires?”
Word association - Words are presented and the respondent mentions the first word that comes to mind.
Sentence completion - Respondents complete an incomplete sentence. For example, “The most important consideration in my decision to buy a new house is . . .”
Story completion - Respondents complete an incomplete story.
Picture completion - Respondents fill in an empty conversation balloon.
Thematic apperception test - Respondents explain a picture or make up a story about what they think is happening in the picture
Wikipedia, 2010. Questionnaire Construction. [online] Available at: < http://en.wikipedia.org/wiki/Questionnaire_construction#Types_of_questions> [Accessed 21 November 2010].
The Advantages & Disadvantages of Questionnaires & Surveys
Surveys are normally used for statistical purposes by gathering information. Most surveys use questionnaires for a base of their research. Surveys can help decide what needs changing, where money should be spent, what products to purchase, what problems there might be, or lots of other questions you may have at any time.
Surveys can be useful in some cases when the questions asked are specific and if the questions asked affect them. Sometimes surveys and questionnaires are not taken seriously leading the participant to write anything to make it less time consuming. If the survey/questionnaire is very long most people decide to ignore it which would make it useless.
Advantages of a Survey
- Surveys can be inexpensive especially if they are self administrated.
- They can be used sent to different locations by using mail, email or telephone.
- You can ask many questions over a given topic
- It is an effective way to get opinions of a large number of people.
Disadvantages of a Survey
- Structured surveys normally use closed ended questions which makes opinions limited.
- Can be time consuming and hard to structure at times.
- If it is an anonymous survey people may not give a valid answer.
- The researcher must ensure that a large number of the selected sample will reply.
Advantages of a Questionnaire
- Very cost effective compared to face to face interviews
- Very familiar with people almost everyone has completed one so no guidance needed.
- They can be completed easily and quickly
- They should be simple and quick for the respondent to complete
Disadvantages
- Some people may not be willing to answer the questions. They might not wish to reveal the information or they might think that they will not benefit from responding perhaps even be penalised by giving their real opinion.
- Questionnaires also invite people to lie and answer the questions very vaguely which they would not do in an interview.
- You forget to ask a question, you cannot usually go back to respondents, especially if they are anonymous
Referencing
Paul Barribeau, Bonnie Butler, Jeff Corney, Megan Doney, Jennifer Gault, Jane Gordon, Randy Fetzer, Allyson Klein, Cathy Ackerson Rogers, Irene F. Stein, Carroll Steiner, Heather Urschel, Theresa Waggoner, and Mike Palmquist. (2005). Survey Research.Writing@CSU. Colorado State University Department of English. Retrieved [November, 20th 2010] from http://writing.colostate.edu/guides/research/survey/.
http://en.wikipedia.org/wiki/Survey
Milne, John (1999). Questionnaires: Advantages and Disadvantages, Centre for CBL in Land Use and Environmental Sciences, Aberdeen University, Retrieved [November, 20th 2010] from
http://www.icbl.hw.ac.uk/ltdi/cookbook/info_questionnaires/