Documente Academic
Documente Profesional
Documente Cultură
PW Committee 2016
Research Methods
An important process of project work is research and the use of data/information. Data can be classified as
primary and secondary data. You are required to carry out BOTH primary and secondary research for
your project.
Primary data refers to information collected by the researcher himself. For example, data collected by
the immediate user through a survey and observation.
Secondary data refers to information obtained from previous research done by other people. The most
significant secondary data sources include official (primarily government departments and statutory
authorities) and unofficial sources (research carried out by private firms, academic research papers,
market research etc.).
PW Committee 2016
A) Surveys
Useful for:
o gathering statistical information
o getting a general idea of a situation
o establishing trends about a population / community
o getting a total count of specific aspects concerning a population / community
The information gathered is limited and easier to analyse, but with little or no explanation of the reasons behind
the results. A census is an example of a survey.
Type of information best gathered: standardised, written, brief, simple, self-reported. Either quantitative
(numerical) or limited qualitative (attitudes, behaviours, beliefs, activities, etc.)
Best type of respondents: literate, willing to take the time to answer truthfully and to return the survey.
Types of Surveys
The common types of surveys are:
i.
mail surveys
ii.
interview surveys
iii.
online surveys
iv.
telephone surveys
i) Mail Surveys
Mail surveys are more appropriate for dealing with sensitive issues.
Advantages
Wide
coverage,
less
costly,
easier
to
analyse, can be anonymous
Greater
uniformity
in
the
manner
questions are posed
Eliminates interviewer bias
Detailed written answers are possible
Disadvantages
Sometimes difficult to get people to complete and
return surveys
Lacks flexibility
Some questions may be unanswered
Cannot record spontaneous answers
Disadvantages
More costly and time consuming
May involve interviewer bias
Less anonymity
3. Telephone Surveys
A quick way to obtain data from open-ended questions without face-to-face interview
Advantages
Flexible
Can ask open-ended questions
Fast response time
Disadvantages
Sometimes difficult to get people to do telephone
surveys
Could be costly if done on large scale
Visual presentation of questions not possible
2
PW Committee 2016
4. Online Surveys
Uses technology to collate data easily.
Advantages
Sampling of respondents can be done quickly.
Hundreds or thousands of respondents can be
recruited in one day, compared with weeks for a
traditional survey.
Less costly compared to live telephone or mail
interviews
Disadvantages
The nature of 'anonymity' of online users adds to the
difficulty of evaluating the quality of the respondents
and obtaining representative results
Difficulty of conducting long or complex surveys as
respondents tend to lose interest after 25 to 30
questions
PW Committee 2016
PW Committee 2016
Disadvantages
Difficult to code and analyse
Closed-ended questions
E.g.
What is the most important reason for students being stressed?
a.
Too many parties
b.
Too many exams
c.
Too long school days
d.
Project work
Advantages
Quick and easy for respondents to answer
Quick and easy for you to code and analyse
Disadvantages
Manipulated answers, forced choices
Simplistic responses to complex issues
PW Committee 2016
PW Committee 2016
PW Committee 2016
interview 360 students. If each interview takes 20 minutes, each of you will need to interview for 6 hours a
day, for 20 days! This illustrates the very high cost, in time certainly, of census. For the type of information
desired, a small wisely selected sample of NJC students may be the only way to get the information required.
A sample may actually be more accurate than a census. A sloppily conducted census can provide less reliable
information than a carefully obtained sample.
5. Sample size
Before deciding how large a sample should be, you have to define your study population. The question of how
large a sample should be is a difficult one. Sample size can be determined by various constraints. As a
general rule of thumb, a sample of less than 50 is not likely to be of use for drawing convincing conclusions.
Sample size depends on the nature of the analysis to be performed, the desired precision of the estimates
one wishes to achieve, the kind and number of comparisons that will be made, the number of variables that
have to be examined simultaneously and how heterogeneous a population is sampled.
6. Errors in Sampling
What can make a sample unrepresentative of its population? One of the most frequent causes is sampling
error. You get a sampling error if the group you choose for your sample is different in some way from the
general population; in other words, they are not truly representative. For example, suppose that you select a
sample of 100 American women, measure them and find all of them are over six feet tall. It is very clear, even
without any statistical proof, that this would be a highly unrepresentative sample, and any conclusions you
then drew about the height of American women would be invalid.
The second cause of sampling error is sampling bias. Sampling bias is a tendency to favour/select people
who have particular characteristics. Sampling bias is usually the result of a poor sampling plan. For example,
you would like to know the average income of a diversified community and you decide to use a sample taken
from a locality where only the rich and middle class live. You will end up with high average income levels that
will lead to the wrong conclusions.
Students have an understandable tendency to only sample other students. Thus, unless they are working on
a project that focuses on youngsters or teens, their conclusions will all be invalid. For example, a group
studying marriage patterns, interviews their fellow JC students and concludes that marriage is no longer
popular because none of their respondents are married.
Another potential problem area is the bias of non- response. If a fair portion of your sample does not answer
your questions, then you no longer have a representative sample.
7. Non sampling error (measurement error)
A non-sampling error is an error that results solely from the manner in which the observations are made largely
due to poor measuring instruments for example, making errors when compiling the results from the surveys.
8. The respondent effect
Respondents might also give incorrect answers, for example, to impress the interviewer. This type of error is
the most difficult to prevent because it results from outright deceit on the part of the respondents. Individuals
tend to provide false answers to particular questions. For example, some people who want to feel younger will
tend to lie to you by understating their age, or some who want to impress you may lie about their occupations.
PW Committee 2016
No.
1
Question
Which
government
body/
statutory board do you work in?
a. MOE
b. HDB
c. MOM
d. MOF
Possible Problem
Use of abbreviations
Question
asks
for
information that is too
precise
Question is leading a
view
Question
asks
for
sensitive information
Two subjects
question
in
about
body
PW Committee 2016
10
Question is demanding
Curriculum Planning and Development Division. Ministry of Education, Singapore.PW (Sec & Pre-U)
Learning Package. 2004
10
PW Committee 2016
Drawing Valid Conclusions from Survey Data 1: Case Study on Filial Piety
Exercise
A survey was conducted to identify the attitudes of different age groups in Singapore towards filial piety. The
data collected was tabulated and presented in the two bar graphs below.
Data: Children should take care of their parents when their parents are old.
Rating Scale:
Strongly
agree
Strongly
disagree
80
70
60
50
40
4
30
20
10
0
Rating (%)
Conclusion
Family ties in Singapore are still
strong.
Valid/Not Valid
Not valid
Reasons
The word still implies some historical
comparison which is not available. Without
the word still the statement would be valid as the
survey shows Strongly Agree across all age
groups. That would be a reasonable conclusion.
There is no information from the data to support
this conclusion.
Not Valid
Valid
Not Valid
Guidelines on Referencing Survey Data with Research Article Data: Case Study
Curriculum Planning and Development Division. Ministry of Education, Singapore.PW (Sec & Pre-U)
Learning Package. 2004
11
PW Committee 2016
Using the Case Study on Filial Piety, the table below shows how secondary research may verify some of the
ideas that the group had, but was unable to conclude based solely on their survey data.
Conclusion
Valid/ Not
Valid
Not valid
Reasons
Research
data
can
provide
historical data, so that a comparison
may be made with current survey
data.
Not Valid
Majority of respondents
surveyed agree that
children should take
care of elderly parents.
Valid
Not Valid
B) Interviews
12
PW Committee 2016
Advantages
Allows for the use of more complex and open-ended questions
Allows for longer, more detailed answers/information from the respondent
Allows you to select a sample for more detailed responses
Allows you to get on the spot feedback
Allows for direct, personal contact
Preparation Required
1. Select your target group/individual
Choose people whose knowledge/experience will be useful for your project. You will be putting a lot of
time and effort into this, and you do not want these to be wasted. Rather than targeting specific individuals,
you may select some sample households for door-to-door mini interviews. Many studies require
respondents who meet specific criteria. For instance your project may require that you speak with a male
head-of-household, between the ages of 30 and 40, who has children under 18 living in the same
household. Therefore you may have to ask a series of filtering questions before determining whether the
respondent fits your sampling needs.
2. Formulate your questions with care
Focus your questions. They should not be too broad or general.
3. Do not plan too many questions
Your respondents time is valuable. Do not take up too much of it.
4. Organise in detail
Things to know before you start:
o Previous work done in your project area
o Why your study is important/useful
o If you have selected a specific individual, know something about his basic background
5. Rehearse
You must be very familiar with the entire interview before facing a respondent.
6. The Interviewers Kit:
o A professional-looking notebook (ideal if you have one with the school logo clearly visible)
o A clipboard, pen
o Clear, easy to skim copies of the questions
o Official identification
o A cover letter of introduction from your Supervising Tutor
o Your full school uniform
13
PW Committee 2016
PW Committee 2016
Practice the art of silence and patience. Silence is one of the most effective ways of encouraging people
to talk. If you finish the sentence for them, you imply that what they have to say is transparent or obvious,
or that you dont want to give them the time to express themselves in their own way.
9. Be non-judgmental
Do not reveal your opinions, either verbally or non-verbally. For example, do not reveal your feelings in
your facial expression or body language, even if what the person says horrifies you or seems idiotic. Treat
every answer in a matter-of-fact manner. If the respondent asks for your opinion, redirect him Right
now Im interested in what you think. If the person persists, give a totally non-committal answer, such as
I find the whole topic very interesting.
10. Obtaining adequate responses
If the respondent has given you a brief answer, inadequate for your purposes, there are several methods
you can use to get a more thorough response:
o Use silence pause and wait
o Ask for elaboration Would you like to elaborate on that?; Is there anything else you would like
to add?
o Ask for clarification
Repetition What Im hearing you say is . Then you should pause.
Examples of a probe: Respondents answer - I work at .
Probe What is your job; what type of work do you do there?
11. Record responses immediately
Note that taping their responses often makes people feel uncomfortable or inhibited. Using pen and paper
is best. Write while the person is talking. It conveys the point that you are interested in what he is saying.
You do not need to write down every word. You may want to write certain key phrases verbatim. Use
abbreviations where possible to help you capture more.
12. Concluding the interview:
Thank the respondent for his time and cooperation (even if he was not helpful!)
Do not rush the ending allow a few minutes of conversation while you pack up your writing materials.
The respondent may want to know a little about you, or how you plan to use his responses, for example.
Immediately after leaving, write down anything important, any observations you did not have time for
during the interview itself.
Record the time, date, place of the interview, and any information about the respondent that you feel
is important.
Potential Problems
1. Do not conduct an interview by yourself
Firstly, having 2 people will help in the recording of answers. Secondly, it is a matter of safety, for both
you and the respondent. The only exception is if you know the respondent well.
2. Interviewer bias
Interviewer bias can inadvertently influence the results. This is especially a problem if you are investigating
political or moral issues on which people have strongly held convictions. While you may think you are
helping society by slanting results in favour of what you believe to be the right answer, this will jeopardise
the validity of the entire project.
15
PW Committee 2016
16
PW Committee 2016
C) Observations
Overview
Observation is most useful when the researcher wants to document actual behaviour. The main purpose of
direct observation is to obtain a thorough description of the programme including programme activities,
participants and the meaning they attach to the programme. It involves careful identification and accurate
description of relevant human interactions and processes.
Observational evaluation is hard work that requires a skilled, trained and competent evaluator to ensure good
quality data. There are a number of variations in observational methods. The most fundamental difference
among them refers to the role of the evaluation observer either as a full programme participant, a detached
spectator or somewhere in between.
Types of Observations
1. Participant Observation
Participant observation consists of the evaluation observer becoming a member of the community or
population being studied. The researcher participates in activities of the community, observes how people
behave and interact with each other and outside organisations. The evaluator tries to become accepted as a
neighbour or participant rather than as an outsider. The purpose of such participation is not only to see what
is happening but also to feel what it is like to be part of the group. The extent to which this is possible depends
on the characteristics of programme participants, the type of questions being studied and the socio-political
context of the setting.
Advantages
Offers data when subjects are unable or unwilling to
offer information
Studies events as they evolve.
Offers first-hand information.
Allows collection of wide range of data even when
this information is thought to be, at the time of study,
irrelevant.
Economical way of obtaining basic socio-economic
information on households or communities.
If participants are not aware that they are being
observed, then they are less likely to change their
behaviour and compromise the validity of the
evaluation.
Disadvantages
Cannot be employed when large groups or extensive
events are studied.
Cannot provide information about the past, future, or
unpredictable events.
Cannot study opinions or attitudes directly.
Relatively laborious and time consuming.
17
PW Committee 2016
18
PW Committee 2016
2016
National
Junior
College
All Rights Reserved. No part of this publication
may be produced or transmitted in any form or
by any means, electronic or mechanical,
including photocopy, recording or any other
information storage and retrieval system,
without prior permission in writing from the
copyright owner.
19