Documente Academic
Documente Profesional
Documente Cultură
INTRODUCTION
Data collection begins after a research problem has been selected and research design has been planned out.
SOURCE OF INFORMATION
Primary and secondary data
From where or from whom will you get the information? Existing information records, reports, program documents, logs, journals People participants, parents, volunteers, teachers Pictorial records and observations video or photos, observations of events, artwork
Observation Methods
No interaction with respondents Letting them behave naturally and drawing conclusions from their actions
Testimonials
Tests Photograph, videotape, slides Diaries, journals, logs Document review and analysis
Observation
Group assessment Expert or peer reviews
Portfolio reviews
Survey Research
Most common type of research in the social sciences. When to use:
Used when researcher wants to get at underlying attitudes and disposition surrounding a piece of information. Used when researcher wants to look at broad patters of social life or to discuss widespread social reactions(not necessarily the case for in-depth interview). Used to gather information to describe characteristics of a specific population.
Quality
The quality of a survey depends on its design, including questions and sample selection of population
The ability to use statistical techniques and to aggregate data so can discuss general characteristics of a social group.
The ability to test reliability of indicators (questions) The ability in panel studies to establish a time dimension to carry-out causal analysis.
Disadvantages of Surveys
Difficult to find out in-depth information about a cultural or social group. Difficult to use when unfamiliar with the population of interest. (ethnography better) Inappropriate when interested in establishing causes and processes for specific behaviors or attitudes. (experiments better)
Self Administered
Mail Group or in person administration Mail or internet
Types of questions
Open-ended Closed response
Interviews
Structured Interviews
Similar to self administered questionnaire.
Administer an interview schedule with specific question with mostly forced choice responses.
Focus Groups
Similar to interview in that a moderator or facilitator interview group or leads discussion. When to use
To get a focused reaction of a small group to a specific issue, item, product To get impressionistic responses about something or someone To dig deeply into one topic or area To get background information for other research method
Explore possible hypotheses Interpret findings
Types of questions
Different types of questions are used for different purposes and are appropriate at different times during a focus group (See p227 in text)
Tests
Existing databases
Unstructured interviews
Unstructured observations
Quantitative data collection methods produce numbers. Qualitative data collection methods produce words. Quantitative and qualitative each has its strengths and weaknesses. Quantitative methods are more structured and allow for aggregation and generalization. Qualitative methods are more open and provide for depth and richness.
The respondents What is the most appropriate method, considering how the respondents can best be reached, how they might best respond, literacy, cultural considerations, etc.?
Consider
What kind of data your professionals will find most credible and useful Resources available. Time, money, and staff to design, implement, and analyze the information. What can you afford? Type of information you need. Numbers, percents, comparisons, stories, examples, etc.
Consider
Interruptions to program or participants. Which method is likely to be least intrusive? Advantages and disadvantages of each method. .The importance of ensuring cultural appropriateness.
When we use several methods we say we are triangulating. Triangulation is important in evaluation because we want accurate and trustworthy information.
Triangulation means the use of multiple sources and methods to gain a better understanding. Each source and each method has inherent biases so using more than one source and/or method provides a more accurate picture.
How might you mix sources of information in your evaluation? How might you mix data collection methods to evaluate your program?
The term, instrument , sounds like we are talking about a dental office, a cockpit or an orchestra.
Actually, we use the term instrument to mean the tool on which the data is actually recorded: the questionnaire, the recording form, the video or audio tape, for example. If you have selected a survey as your method, you automatically know that you will need a questionnaire. But, if you choose a method such as focus group or interview or observation, think about what you will use for recording the information.
Choices: Timing
When Will Data be Collected? Before and after the program At one time At various times during the course of the program Continuously through the program Over time - longitudinally
Reflection time
What is one thing you learned (or had reinforced) from going through this presentation that you hope not to forget? Good luck with your data collection efforts!