Documente Academic
Documente Profesional
Documente Cultură
Exploring Data
+
Data Analysis: Making Sense of Data
Learning Objectives
After this section, you should be able to…
DEFINE “Distribution”
Learning Objectives
After this section, you should be able to…
Learning Objectives
After this section, you should be able to…
COMPARE distributions
Learning Objectives
After this section, you should be able to…
IDENTIFY outliers
Data Analysis
Data Analysis is the process of collecting,
organizing, displaying, summarizing, and asking
questions about data.
Definitions:
Individuals – objects (people, animals, things)
described by a set of data
+
In data analysis, we are interested in how often a
Data Analysis
variable takes on each value.
Definition:
Population- The entire group of interest in a
study
Sample- A segment of the population
Distribution – tells us what values a variable
Example takes and how often it takes those values
2009 Fuel Economy Guide 2009 Fuel Economy Guide 2009 Fuel Economy Guide
MODEL MPG MODEL MPG MODEL
<new> MPG <new>
1 Acura RL 922 Dodge Avenger 1630 Mercedes-Benz E350 24
2 Audi A6 Quattro 1023 Hyundai Elantra 1733 Mercury Milan 29
3 Bentley Arnage 1114 Jaguar XF 1825 Mitsubishi Galant 27
4 BMW 5281 1228 Kia Optima 1932 Nissan Maxima 26
5 Buick Lacrosse 1328 Lexus GS 350 2026 Rolls Royce Phantom 18
6 Cadillac CTS 1425 Lincolon MKZ 2128 Saturn Aura 33
7 Chevrolet Malibu 1533 Mazda 6 2229 Toyota Camry 31
8 Chrysler Sebring 1630 Mercedes-Benz E350 2324 Volkswagen Passat 29
Dotplot of MPG
9 Dodge Avenger 1730 Mercury Milan 2429 Volvo S80 25
Distribution
Variable of Interest:
MPG
Categorical Variables place individuals into one of
+
several groups or categories
Example, p. 12
Young adults by gender and chance of getting rich
Female Male Total What are the variables
Almost no chance 96 98 194 described by this two-
Some chance, but probably not 426 286 712 way table?
A 50-50 chance 696 720 1416 How many young
A good chance 663 758 1421 adults were surveyed?
Almost certain 486 597 1083
Total 2367 2459 4826
+
Two-Way Tables and Marginal Distributions
Response Percent
Almost no chance 194/4826 =
4.0%
35
Some chance 712/4826 =
30
14.8%
25
A 50-50 chance 1416/4826 =
Percent
20
29.3%
15
A good chance 1421/4826 = 10
29.4%
5
Almost certain 1083/4826 = 0
22.4% Almost none Some chance 50-50 chance Good chance Almost certain
+
Relationships Between Categorical Variables
20
29.3% 29.4% 40%
15 Good chance
A good chance 758/2459 = 663/2367
10=
30% Males
30.8% 28.0% 5 50-50 chance Males
20%
Almost certain 597/2459 = 486/23670= Females
Almost no
Almost no Some chance
Some 50-50 chance
chance 50-50 Good chance
chance Good Almost certain
chance Almost certain
24.3% 20.5% 10% chance
chance
Some chance
0%
Dotplots
+
One of the simplest graphs to construct and interpret is a
Number of Goals Scored Per Game by the 2004 US Women’s Soccer Team
3 0 2 7 8 2 4 3 5 1 1 4 5 3 1 1 3
3 3 2 1 2 2 2 4 3 5 6 1 5 5 1 1 5
+
Examining the Distribution of a Quantitative Variable
In any graph, look for the overall pattern and for striking
departures from that pattern.
•Shape
•Outliers
Don’t forget your
SOCS!
•Center
•Spread
2009 Fuel Economy Guide 2009 Fuel Economy Guide 2009 Fuel Economy Guide
MODEL MPG MODEL MPG <new>MODEL MPG <new>
1 Acura RL 922 Dodge Avenger 1630 Mercedes-Benz E350 24
2 Audi A6 Quattro 1023 Hyundai Elantra 1733 Mercury Milan 29
3 Bentley Arnage 1114 Jaguar XF 1825 Mitsubishi Galant 27
4 BMW 5281 1228 Kia Optima 1932 Nissan Maxima 26
5 Buick Lacrosse 1328 Lexus GS 350 2026 Rolls Royce Phantom 18
6 Cadillac CTS 1425 Lincolon MKZ 2128 Saturn Aura 33
7 Chevrolet Malibu 1533 Mazda 6 2229 Toyota Camry 31
8 Chrysler Sebring 1630 Mercedes-Benz E350 2324 Volksw agen Passat 29
9 Dodge Avenger 1730 Mercury Milan 2429 Volvo S80 25
+
When you describe a distribution’s shape, concentrate on
+
Some of the most interesting statistics questions
your SOCS!
U.K
Stemplots (Stem-and-Leaf Plots)
+
Another simple graphical display for small data sets is a
+
These data represent the responses of 20 female AP
+
When data values are “bunched up”, we can get a better picture of
Females Males
0 0 4
0 0 555677778
1 333 1 0000124
1 95 1
2 4332 2 2
2 “split stems” 66 2
3 410 3 Key: 4|9
3 8 3 58 represents a
4 4 student who
4 9 4 reported
5 100 5 having 49
5 7 5 pairs of shoes.
Using the class data, make a Dot
Plot and a split stem plot of the
ages in months of the students in
the class and describe the
distribution using the acronym
SOCS.
The distribution of ages in
months for the class is roughly
symmetric and mound shaped
with a center about 216 months
and a range of 23. The age of
231 months is a potential
outlier
Histograms
+
Quantitative variables often take many values. A graph of the
Frequency Table
Class Count
Number of States
0 to <5 20
5 to <10 13
10 to <15 9
15 to <20 5
20 to <25 2
25 to <30 1
Total 50
Percent of foreign-born residents
Using Histograms Wisely
+
Here are several cautions based on common mistakes
Cautions
1)Don’t confuse histograms and bar graphs.
2)Don’t use counts (in a frequency table) or percents (in a
relative frequency table) as data.
3)Use percents instead of counts on the vertical axis when
comparing distributions with different numbers of
observations.
4)Just because a graph looks nice, it’s not necessarily a
meaningful display of data.
+
Using the class data and a graphing
calculator, calculate the numerical
summaries for the number of contacts.
The numerical summaries include
Mean, Standard Deviation, Sample
Size, Minimum, First Quartile, Median,
Third Quartile, Maximum, range, and
Interquartile Range
+
Measuring Center: The Median
+
Another common measure of center is the median. In
Definition:
The median M is the midpoint of a distribution, the number such that
half of the observations are smaller and the other half are larger.
To find the median of a distribution:
1)Arrange all observations from smallest to largest.
2)If the number of observations n is odd, the median M is the center
observation in the ordered list.
3)If the number of observations n is even, the median M is the average
of the two center observations in the ordered list.
Measuring Spread: The Interquartile Range (IQR)
+
A measure of center alone can be misleading.
IQR = Q3 – Q1
Find and Interpret the IQR
+
Describing Quantitative Data
Travel times to work for 20 randomly selected New Yorkers
10 30 5 25 40 20 10 15 30 20 15 20 85 15 65 15 60 60 40 45
5 10 10 15 15 15 15 20 20 20 25 30 30 40 40 45 60 60 65 85
IQR = Q3 – Q1
= 42.5 – 15
= 27.5 minutes
Interpretation: The range of the middle half of travel times for the
New Yorkers in the sample is 27.5 minutes.
+
The Five-Number Summary
Definition:
The five-number summary of a distribution consists of the
smallest observation, the first quartile, the median, the third
quartile, and the largest observation, written in order from
smallest to largest.
Minimum Q1 M Q3 Maximum
+
Boxplots (Box-and-Whisker Plots)
+
In addition to serving as a measure of spread, the
+
Describing Quantitative Data
Consider our NY travel times data. Construct a boxplot.
10 30 5 25 40 20 10 15 30 20 15 20 85 15 65 15 60 60 40 45
5 10 10 15 15 15 15 20 20 20 25 30 30 40 40 45 60 60 65 85
+
The most common measure of center is the ordinary
Definition:
To find the mean x (pronounced “x-bar”) of a set of observations, add
their values and divide by the number of observations. If the n
observations are x1, x2, x3, …, xn, their mean is:
x
x i
n
Measuring Center
+
Use the data below to calculate the mean and median of the
10 30 5 25 40 20 10 15 30 20 15 20 85 15 65 15 60 60 40 45
10 30 5 25 ... 40 45
x 31.25 minutes
20
0 5
1 005555
2 0005
3 00 Key: 4|5
represents a 20 25
4
5
005
New York M 22.5 minutes
6 005
worker who 2
reported a 45-
7 minute travel
8 5 time to work.
+
Comparing the Mean and the Median
+
The most common measure of spread looks at how far each
deviation: 1 - 5 = -4
deviation: 8 - 5 = 3
x =5
Measuring Spread: The Standard Deviation
+
Describing Quantitative Data
xi (xi-mean) (xi-mean)2
1 1 - 5 = -4 (-4)2 = 16
3 3 - 5 = -2 (-2)2 = 4
3) Square each deviation. 4 4 - 5 = -1 (-1)2 = 1
4 4 - 5 = -1 (-1)2 = 1
4) Find the “average” squared
deviation. Calculate the sum of 4 4 - 5 = -1 (-1)2 = 1
the squared deviations divided 5 5-5=0 (0)2 = 0
by (n-1)…this is called the
7 7-5=2 (2)2 = 4
variance.
8 8-5=3 (3)2 = 9
5) Calculate the square root of the 9 9-5=4 (4)2 = 16
variance…this is the standard
deviation. Sum=? Sum=?
+
Describing Quantitative Data
Definition:
The standard deviation sx measures the average distance of the
observations from their mean. It is calculated by finding an average of
the squared distances and then taking the square root. This average
squared distance is called the variance.
(x1 x ) 2 (x 2 x ) 2 ... (x n x ) 2 1
variance = s 2
x
n 1
n 1
(x i x ) 2
1
standard deviation = sx
n 1
(x i x ) 2
+
Choosing Measures of Center and Spread
•The median and IQR are usually better than the mean and
standard deviation for describing a skewed distribution or a
distribution with outliers.
Summary
In this section, we learned that…
Summary
In this section, we learned that…
Summary
In this section, we learned that…
Summary, continued
In this section, we learned that…
You can organize many problems using the four steps state, plan,
do, and conclude.
+ Displaying Quantitative Data with Graphs
Summary
In this section, we learned that…
Summary
In this section, we learned that…
The interquartile range (IQR) is the range of the middle 50% of the
observations: IQR = Q3 – Q1.
+ Describing Quantitative Data with Numbers
Summary
In this section, we learned that…
The variance and its square root, the standard deviation are
common measures of spread about the mean as center.