Documente Academic
Documente Profesional
Documente Cultură
Research
Methodology
Notes
Karan Veer
Singh
Research Methodology 5 th Semester
Table of Contents
I. Research Design 3
A.Research Process 3
B.The research Design 4
II. Sampling 7
A.Important statistical terms 7
B.Sampling Process 7
C.Types Of sampling 8
1. Probability sampling 8
2. Non probability sampling 9
D. Sampling Errors 10
I. Research Design
A. Research Process
1.1.Observation
Observation
Broad
Broadarea
areaofof
research
researchinterest
interest
identified
identified 4.4.
Theoretical
Theoretical
Framework
Framework
3.3.Problem
Problem 5.5. 6.6.
Definition
Definition Generation
Generation Scientifi
Scientif
Variables
Variables
Research
Researchproblem
problem ofof Researc
Resear
clearly
clearly
delineated
delineated Hypothesis
Hypothesis Design
Design
identified
identified
and
and
labelled
labelled
2.2.Preliminary
Preliminary
Data
DataGathering
Gathering
Interviewing
Interviewing 8
Literature
Literaturesurvey
survey H
R
No
No Yes
Yes
9.9.Report
Report 10.
10.Re
Re
Writing
Writing Present
Presen
1. Observation ✔ Interviewing
✔ First Step of the Research Process ✔ Literature surveys
✔ area of attention realized ✔ Usually costly
Exploratory study
The research is exploratory if it is the following:
▪ Situation is unknown
▪ Exclusively based on Preliminary information
▪ Comprehensive study of the topic
▪ Focus groups and comprehensive interviews are appropriate
Descriptive Study
The research is said to be descriptive if the following occurs:
▪ Understand characteristics
▪ Think systematically
▪ Offer ideas for further probe and research
▪ Helps in decision making
Testing Hypothesis
▪ Explain nature of relationships among the variables and their dimensions
▪ Differences and interdependences among factors
Case Study
▪ conceptual analysis of similar situations for generalization
▪ Difficult to find same type of problem in comparable setting
2. Type of Investigation
3. Researcher Interference
Minimal Interference
When research studies in natural settings without changing or altering any factor whatsoever
4. Study Setting
▪ Controlled settings
Example: to study relationship of rate of interest on inclination to save the rates of interest in various
branches are changed
5. Units of Analysis
1. Individuals 4. Organizations
Study motivation of employees
Differences among functions of management in
2. Dyads various organizations
Interaction of supervisor-subordinate pair
5. Cultures
3. Group Nations as unit of analysis
Pattern of misuse by various departments
6. Time Horizon
Cross Sectional
One shot study-one time or period
Longitudinal
Study of information at more than one period of time e.g.: change in behavior of employees before and
after management change.
C. Types Of sampling
1. Probability sampling
A probability sample is one in which each element of the population has a known non-zero probability
of selection. Each subject has a known probability of being selected.
▪ Each element in the population has an equal probability of selection AND each combination of
elements has an equal probability of selection
▪ Names drawn out of a hat
▪ Random numbers to select
▪ elements from an ordered list
Systematic sampling
Developing a pattern to select the sample, every 4th element or every tenth element etc
▪ Involves drawing every nth element in the population starting with a randomly chosen element
between 1 and n
Stratified sampling
▪ Probability sampling procedure in which simple random sub samples that are more or less equal
on some characteristics are drawn from within each stratum of the population
▪ Each group is internally homogenous but there are comparative differences between groups.
Double sampling
Selection of a sample for research and then a subset of the sample for further research
▪ A sampling design where initially a sample is used in a study to collect some preliminary
information of interest and later a subsample of this primary sample is used to examine the
matter in more detail.
Multi-stage sampling
▪ First step cluster sampling (for geographical location); next particular area would be chosen and
at third stage particular units would be chosen.
Cluster sampling
▪ Groups that have heterogeneous members are first identified, and then some are chosen at
random.
▪ Each group is internally heterogeneous but groups are homogeneous on some characteristic.
▪ All the members in each of the randomly chosen groups are studied.
▪ Target population is first divided into clusters and then random sample of clusters is drawn
❖ Judgemental
▪ Select subjects who are in the best position to give the required information.
▪ Experts etc
❖ Quota sample
▪ Predetermined proportions of subjects are sampled from different groups.
D. Sampling Errors
1. Error 1
Random Sampling Error
This is defined as the “difference between the sample result and the result of a census conducted using
identical procedures” and is the result of chance variation in the selection of sampling units
2. Error 2
Systematic (Non-Sampling) Errors
Both Random sampling errors and systematic (non-sampling) errors reduce the representativeness of a
sample and consequently the value of the information which is derived by business researchers from it
Questionnaire Design
(1) Definition
▪ A reformulated, written set of questions to which the respondent records his answers, usually
within rather closely defined alternatives
❖ Measurement
❖ Word content
❖ Advantages
▪ Wide geographic coverage
▪ No face to face interaction awkwardness
▪ Can be answered at home and at own pace
❖ Disadvantages
▪ Low return rates
▪ Clarifications can’t be made
▪ Respondents can’t be observed at all
▪ Representatives of samples difficult to establish because return rates are low
Guidelines
(1) Purpose
▪ To get at objective facts or subjective feelings and perceptions
❖ Open ended
▪ Freedom to answer a question any way ▪ Could be a problem for the researcher
the respondent wants to encode the response
❖ Closed ended
▪ Easy to interpret the code ▪ Alternatives that are mutually exclusive
▪ Respondents can make quick decision and collectively exhaustive are given.
2. Interviews
Structured Unstructured
▪ Saves times ▪ Useful during exploratory states of a
▪ helps to code information better research
▪ inter-rater reliability could be ▪ helps develop better theoretical
established through trained framework
interviewers ▪ helps develop better questionnaires
and structured interviews
Telephonic interviews
(1) Advantages
▪ Discomfort of face to face interviews avoided
▪ Number of calls per day could be high
(2) Disadvantages
▪ Time may be limited for the respondent.
▪ Interviewee could put the phone down and refuse to answer
2. Observation
Types of observation
(1) Participant
Participates in the environment and makes an observation.
Advantages
▪ Sample size could be increased at less costs
▪ Respondent bias could be avoided
▪ Both bevavirual and non-verbal reactions could be studied
Disadvantages
▪ Observer fatigue could set in ▪ Inter-observer reliability problems
▪ Observer bias ▪ Costs of observer training could be high
3. Motivational Research
4. Panel Studies
Mostly used in Market Research
Advantages
▪ Panel gains expertise and can give ‘good’ data
▪ Longitudinal study could establish cause-effect relations
Disadvantages
▪ Could be expensive
▪ Attrition of members with time
▪ Panel could lose interest after a while
B. Multi Methods
Data from different sources and through different methods could improve the ‘goodness’ of the data.
● Interview
● Observation
● Questionnaire
● Same-source and other-source data
● Objective measure ( physical measurement, counting, etc)
Example: Performance data get from all the above sources. See how they correlate
Example: Gender
❑ Male
❑ Female
2. Ordinal
Allows researcher to characterize the variables in such a way so as to
denote differences among various categories and also rank them in some
order.
3. Interval
An interval scale allows us to perform certain arithmetic operations on the
data collected from the respondents
4. Ratio
The ratio scale overcomes the disadvantage of the arbitrary origin point of the interval scale, in that it
has an absolute (in contrast to arbitrary) zero point, which is meaningful measurement point
Example: how many organizations did you work for before joining this system?
B. Rating Scales
▪ Asks the respondent to estimate the magnitude of a characteristic, or quality, that an object
possesses
▪ The respondent’s position on a scale(s) is where he or she would rate an object
1. Category Scale
A category scale is a more sensitive measure than a scale having only two response categories - it
provides more information.
How important were the following in your decision to visit Switzerland? (Check one for each item)
2. Likert Scale
It is an extremely popular means for measuring attitudes. Respondents indicate their own attitudes by
checking how strongly they agree or disagree with statements.
Response alternatives: “strongly agree”, “agree”, “uncertain”, “disagree”, and “strongly disagree”.
3. Numerical Scale
Numerical scales have numbers as response options, rather than “semantic space’ or verbal
descriptions, to identify categories (response positions).
A weight is assigned to each position on the rating scale. Traditionally, scores are 7, 6, 5, 4, 3, 2, 1, or +3,
+2, +1, 0, -1, -2, -3.
Divide 100 points among each of the following brands according to your preference for the brand:
1. Brand A _________
2. Brand B _________
3. Brand C _________
▪ Magnitude of each alternative known
▪ Equal value can be indicated.
▪ Too many can confuse
7. Staple Scale
Modern versions of the Staple scale place a single adjective as a substitute for the semantic differential
when it is difficult to create pairs of bipolar adjectives.
The advantage and disadvantages of a Staple scale, as well as the results, are very similar to those for a
semantic differential. However, the staple scale tends to be easier to conduct and administer.
C. Ranking scales
Ranking tasks require that the respondent rank order a small number of objects in overall performance
on the basis of some characteristic or stimulus.
Rank the following in order of preference, 1 being the most preferred and 3 the least:
▪ Brand A _________
▪ Brand B _________
▪ Brand C _________
Paired comparison
In paired comparisons the respondents are presented with two objects at a time and asked to pick the
one they prefer.
Ranking objects with respect to one attribute is not difficult if only a few products are compared, but as
the number of items increases, the number of comparisons increases geometrically (n*(n -1)/2).
Example: Which support provides you more motivation to complete your task?
Comparative scaling
▪ Provides a benchmark to assess attitudes toward current object, event or situation
understudy.
Example: Please indicate how the amount of authority in your present position compares with the
amount of authority that would be ideal for this position.
Forced choice
A Forced Choice enables respondents to rank objects relative to one another, among the alternatives
provided.
Example: Rank the following channels you like to watch in the order of preference, assigning 1 to the
most preferred choice and 5 to the least preferred.
▪ Duniya ▪ Express
▪ Geo ▪ Samaa
D. Questions format
▪ Need to decide how “what is to be asked” should be phrased
▪ Alternative question formats are shown below
▪ Each format has its advantages and disadvantages
1. Open ended
Respondent answers in his own words
Example : Why do you like studying at UCP?
2. Closed ended
Respondent selects one or more options from pre-determined set of responses.
Simple dichotomy 🡪 Closed ended question with only two response alternatives
Multiple Choice 🡪 Closed ended question with more than two response alternatives
❖ Mutually Exclusive
Response categories must be such that the same respondent cannot be classified into more
than one category.
Example: the categories $1,000-5,000 and $5,000-10,000 are not mutually exclusive.
❖ Mutually Exhaustive
Response categories should include all possible response options. Sometimes this is achieved
by including a response option like “Other (Please specify)….”
E. ‘Bad Questions’
▪ Avoid complexity: use simple, conversational language.
▪ Avoid leading and loaded questions.
▪ Avoid ambiguity: be as specific as possible.
▪ Avoid double barreled items.
▪ Avoid making assumptions.
▪ Avoid burdensome questions.
1. Leading
A question that suggests or implies a certain answer
2. Loaded
A question that is designed to suggest a socially desirable answer, usually it is emotionally charged.
▪ Choice of words
Using emotionally-charged words,
Example: In your opinion is it fair that the Security Dept should be harassing students with parking
tickets?
▪ Framing question such that honest answer is painful or embarrassing 🡪 use counter biasing
statement.
Example: There are pros and cons to retaining senior citizens in the workforce. To what extent do you
think firms should continue to keep the elderly on their payroll?
3. Double barreled
Introduces bias because it covers two issues at once
F. Question sequence
Two related issues:
1. Order of questions in questionnaire.
2. Order of answer alternatives for specific questions.
Order of questions
▪ Use simple, interesting opening questions
G. Questionnaire layout
▪ Keep questionnaire short if possible, but not too short that you sacrifice needed information
▪ Do not over crowd questionnaire
▪ Provide decent margin space
▪ Use multiple- grid layout for questions with similar responses
▪ Use good quality print paper.
▪ Use booklet form if possible
▪ Carefully craft the questionnaire title:
1. Captures respondent’s interest.
2. Shows importance of the study.
3. Shows interesting nature of the study.
H. Questionnaire pretesting
1. Pretesting Process
Seeks to determine whether respondents have any difficulty understanding the questionnaire and
whether there are any ambiguous or biased questions.
2. Preliminary Tabulation
A tabulation of the results of a pretest to help determine whether the questionnaire will meet the
objectives of the research
I. Questionnaire translation
1. Back Translation
▪ Taking a questionnaire that has previously been translated into another language and
having a second, independent translator translate it back to the original language.
▪ A questionnaire developed in one country may be difficult to translate because equivalent
language concepts do not exist or because of differences in idiom and language
A. Measuring Reliability
Internal consistency represents a measure’s homogeneity or the extent to which each indicator of a
concept converges on a common meaning.
Split half
A method for assessing internal consistency by checking the results of one-half of a set of scaled items
against the results of the other half
Coefficient alpha
The most commonly applied estimate of a multiple-item scale’s reliability
B. Measuring Validity
The 4 basic approaches to establish validity are:
1. Face Validity
A scale’s content logically appears to reflect what was intended to be measured.
2. Content Validity
Is the degree that a measure covers the breadth of the domain of interest?
3. Criterion Validity
The ability of a measure to correlate with other standard measures of similar constructs or established
criteria
4. Construct Validity
Exists when a measure reliably measures and truthfully represents a unique concept; consists of several
components including face, content and criterion validity.