An Accountability & Assessment Brief

Spring 2011 EOCT

Spring 2011 Scale Scores and Cut Scores for the End-of-Course Tests

Scale Scores
Scores on all reports are expressed as scale scores. The scale score reported for each subject EOCT is derived by converting the number of correct responses on the test (the raw score) to the EOCT scale. Scale scores are comparable across all test forms and administrations for the same EOCT test. For example, a scale score of 420 on the GPS-based American Literature EOCT from one form of the test or from one administration indicates the same examinee ability as a score of 420 from any other form or administration of the GPS-based American Literature EOCT.

Performance Levels
A process known as standard setting helps to define points along the scale score range and gives additional meaning to
student performance. New EOCT performance standards are being set as each content area and course transitions to GPS. In December 2009, standards were set for the Mathematics I and Mathematics II EOCT. Georgia educators and stakeholders from around the state participated in the standard setting process. For the EOCT, three performance levels have been defined: Does Not Meet the Standard, Meets the Standard, and Exceeds the Standard. Scores that are at or above 450 on GPSbased EOCT indicate a level of performance that Exceeds the Standard set for the test. Scores from 400 to 449 for GPSbased EOCT indicate a level of performance that Meets the Standard set for the test. Scores below 400 on GPSbased EOCT indicate a level of performance that Does Not Meet the Standard set for the test (i.e., the states minimum level of proficiency). Test developers build multiple parallel forms for each EOCT for each semester. Even after applying the best psychometric principles in test construction, forms may differ slightly in difficulty. For this reason, tests are equated and results are reported in scale scores instead of raw scores. Scale scores are used to allow comparison of a specific course test within and across administrations. Since the EOCT is used as the final exam for the courses requiring an EOCT, a score on the typical 0 to 100 grade scale must be provided. The grade conversion scores (GCS) is used as this score and is averaged in as 15% of the final course grade for a student. The chart below depicts the scale scores associated with each performance level as well as the corresponding grade conversion score. Spring 2011 EOCT Scale Scores Copyright 2011 by the Georgia Department of Education Page 1

An Accountability & Assessment Brief

Spring 2011 EOCT

Does Not Meet Expectations Scale Grade Score Conversion Grade 9 Literature. (GPS) American Literature (GPS) Biology (GPS) Physical Science (GPS) US History (GPS) Economics (GPS) Mathematics I (GPS) Mathematics II (GPS) Below 400 Below 400 Below 400 Below 400 Below 400 Below 400 Below 400 Below 400 Below 70 Below 70 Below 70 Below 70 Below 70 Below 70 Below 70 Below 70

Meets Expectations Scale Score 400 to 449 400 to 449 400 to 449 400 to 449 400 to 449 400 to 449 400 to 449 400 to 449 Grade Conversion 70 to 89 70 to 89 70 to 89 70 to 89 70 to 89 70 to 89 70 to 89 70 to 89

Exceeds Expectations Scale Score 450 or Above 450 or Above 450 or Above 450 or Above 450 or Above 450 or Above 450 or Above 450 or Above Grade Conversion 90 or Above 90 or Above 90 or Above 90 or Above 90 or Above 90 or Above 90 or Above 90 or Above

How Cut Points Define Performance Levels

During the standard setting process, the participants identify how many items a student must answer correctly to be classified as just meeting standard or just exceeding standard. The raw scores that define one performance level from another are called cut points. The cut points in raw scores are based on the initial administration for that test. When the performance standards are set for a test, the student ability (known as theta among psychometricians) at these cut points is established. These theta estimates are utilized to identify the raw cut score points for each future administration. After each administration, the raw scores are converted to the scale score metric. This is the behind the scenes process that allows student performance from one year to another to be comparable. The thetas for the meets and exceeds performance levels remain constant across years and correspond to the established scaled cut scores. However, the corresponding raw scores for meets and exceeds may vary slightly because tests may differ slightly in difficulty from form to form within and across administrations. The chart below shows the meets and exceeds raw cut scores for the 2010 Spring EOCT.

Spring 2011 EOCT Scale Scores Copyright 2011 by the Georgia Department of Education

Page 2

An Accountability & Assessment Brief

# of Items Possible 68 68 67 68 68 68 68 68 68 68 68 68 54 54

Spring 2011 EOCT

Performance Level MEETS EXCEEDS Raw cut score Raw cut score 37 56 38 56 34 55 34 55 29 41 29 41 32 50 33 50 37 51 37 51 34 50 34 48 27 42 23 39

Subject Grade 9 Literature (GPS) American Literature (GPS) Physical Science (GPS) Biology (GPS) U. S. History (GPS) Economics (GPS) Mathematics I (GPS) Mathematics II (GPS)

Form 1 2 1 2 1 2 1 2 1 2 1 2 1 1

For more information on interpreting scores, find the 2010-2011 EOCT Score Interpretation Guide on the Georgia Department of Education website: http://www.gadoe.org/ci_testing.aspx?PageReq=CI_TESTING_EOCT

This brief is produced by the Assessment Research and Development Division in the Assessment and Accountability Office of the Georgia Department of Education. Questions should be directed to Assessment and Accountability at 404-656-2668.

Spring 2011 EOCT Scale Scores Copyright 2011 by the Georgia Department of Education

Page 3