Practice:

Evaluate outcomes to show your program is

making a difference
Key Action: Identify outcome measures and instruments

SAMPLE MATERIAL: School Climate Survey

Purpose: Teachers’ and school-based professionals’ perceptions

of school climate are an important noncognitive measure
of program impact. This survey asks these professionals
to assess the climate in their schools, including areas
such as academic achievement, school connectedness,
equity, learning supports, and health-related learning
barriers. In general, the survey has good internal
and test/retest reliabilities. Review the survey and
accompanying footnotes to see how the questions were
refined to get the most reliable results, and to gather
ideas for your own evaluation.

Source: Excerpted from WestEd (2007). The California healthy

kids survey (CHKS) “Staff school climate module” San
Francisco, CA: Author.

Questions for Reflection

Note: When this survey was pilot tested and its reliability analyzed, it became clear that
the wording and placement of questions were important factors influencing how people
responded to the survey. Before you reflect on the following questions, be sure you’ve
read the footnotes at the bottom of the survey pages to get a sense of how the evaluator
and district staff “fine tuned” questions to make them most effective.

1. In what way might the word “inviting” (question 6; footnote 1) influence how people
answer the question? Is there an alternative that would convey the content more
clearly?

2. Does your change in wording clarify the intent of the question? Are there other alter-
natives to the words and “supportive” or “inviting” in question 6 that might better fit
your magnet school program?

3. In footnote 7, which refers to the professional development section of the survey, how
do you understand the difference between teacher “perceptions” and “program re-
porting” about professional development? How might teachers’ perceptions influence
program improvements? How might such program improvements differ from improve-
ments made based on program reporting? Which is more important in your setting?

1
 Practice: Evaluate outcomes to show your program is
making a difference
Key Action: Identify outcome measures and instruments

2008-09

This survey is designed to provide schools with data useful for fostering a
positive learning and working environment that promotes academic success
among all students. Several questions have been added this year related to
closing the racial/ethnic achievement gap, staff working conditions, and special
education. Your survey participation is very important to insure accurate and
useful data

x Answer the questions based on your experiences only at the

school that asked you to complete it, not your experiences with
the district overall or another school where you might also work.

x Questions about staff or adults at the school refer to ALL staff —

administrators, teachers, teaching assistants, counselors, and all
other certificated and classified staff.

All responses are anonymous and confidential. A few questions ask for personal
information, such as the work you do at the school, how long you have done it, and your
race/ethnicity. But the survey reports provided your district contain only percentages for
all respondents combined. If there are less than 6 respondents in any group, that data
are not made available.

2
 Practice: Evaluate outcomes to show your program is
making a difference
Key Action: Identify outcome measures and instruments

1. What is your role(s) at this school? (Mark all that apply.)

A) Teacher in grade 5 or above
B) Teacher in grade 4 or below
Administrator
C) Prevention staff
nurse, or health aide
D) Counselor, psychologist
E) Police, resource officer, or safety personnel
F) Paraprofessional, teacher assistant, or instructional aide
G) Other certificated staff (e.g., librarian)
H) Other classified staff (e.g., janitor, secretarial or clerical, food service)

2. Do you provide services to the following types of students? (Mark all that apply.)
A) Migrant education students
B) Special education
C) English language learners

3. How many years have you worked, in any position, at this school?
A) Less than one year
B) 1 to 2 years
C) 3 to 5 years
D) 6 to 10 years
E) Over 10 years

4. How many years have you worked at any school in your current position (e.g.,
teacher, counselor, administrator, food service)?
A) Less than one year
B) 1 to 2 years
C) 3 to 5 years
D) 6 to 10 years
E) Over 10 years

5. What is your race or ethnicity?

A) African American (Not Hispanic)
B) American Indian or Alaska Native
C) Asian or Pacific Islander
D) White, not Hispanic
E) Hispanic or Latino/a
F) Other or Multi-ethnic

3
 Practice: Evaluate outcomes to show your program is
making a difference
Key Action: Identify outcome measures and instruments

Please indicate how much you agree or disagree with the following statements
about this school. If the question is not applicable to your job, and you could not
know enough to answer it, mark “Not Applicable.”

This school…
Strongly Strongly Not
Agree Agree Disagree Disagree Applicable

6. is a supportive and inviting place for students to A B C D E

learn.
7. sets high standards for academic performance A B C D E
for all students.
8. promotes academic success for all students. A B C D E
9. emphasizes helping students academically A B C D E
when they need it.
10. provides adequate counseling and support A B C D E
services for students.
11. emphasizes teaching lessons in ways relevant A B C D E
to students
12. is a supportive and inviting place for staff to A B C D E
work.1
13. promotes trust and collegiality among staff. A B C D E
14. provides the materials, resources, and training A B C D E
(professional development) needed to do your
job effectively.2
15. +provides the materials, resources, and training A B C D E
(professional development) needed to work
with special education (IEP) students.
16. encourages opportunities for students to decide A B C D E
things like class activities or rules.
17. gives all students equal opportunity to A B C D E
participate in classroom discussions or
activities.
18. gives all students equal opportunity to A B C D E
participate in numerous extracurricular and
enrichment activities.
19. gives students opportunities to “make a A B C D E
difference” by helping other people, the school,
or the community (e.g., service learning).3

1Suggested deleting “inviting” but that would affect comparison with previous data.
2Suggested deleting “supports” as this much more general than “materials and resources”
and we also asked if school “supportive” place to work.
4
 Practice: Evaluate outcomes to show your program is
making a difference
Key Action: Identify outcome measures and instruments

20. Encourages students to enroll in rigorous A B C D E

courses (such as honors and AP), regardless of
their race, ethnicity, or nationality.4
21. emphasizes using instructional materials that A B C D E
reflect the culture or ethnicity of its students.
22. has staff examine their own cultural biases A B C D E
through professional development or other
processes.
23. considers closing the racial/ethnic achievement A B C D E
gap a high priority.
24. fosters an appreciation of student diversity and A B C D E
respect for each other.
25. emphasizes showing respect for all students’ A B C D E
cultural beliefs and practices.5
26. clearly communicates to students the A B C D E
consequences of breaking school rules.
27. handles discipline problems fairly. A B C D E
28. effectively handles student discipline and A B C D E
behavioral problems.
29. is a safe place for students. A B C D E
30. is a safe place for staff. A B C D E
31. is welcoming to and facilitates parent A B C D E
involvement.
32. has clean and well-maintained facilities and A B C D E
property.

How many adults at this school …

Nearly
All Most Some Few Almost
Adults Adults Adults Adults None
33. really care about every student? A B C D E
34. acknowledge and pay attention to students? A B C D E
35. want every student to do their best? A B C D E
36. listen to what students have to say? A B C D E
37. believe that every student can be a success? A B C D E

3 Purpose to align with the “make a difference” question asked of students.

4 California Department of Education is interested in whether we can ask a more direct
question about providing all students equally rigorous courses. This is difficult. Task
force settled on issue of “opportunity.” The WREN survey asks about the school
“encouraging” students to take these courses. Is that a better alternative?
5 CHANGED FROM “Adults at this school respect”
5
 Practice: Evaluate outcomes to show your program is
making a difference
Key Action: Identify outcome measures and instruments

38. treat all students fairly? A B C D E

39. treat every student with respect? A B C D E
40. have close professional relationships with one another? A B C D E
41. support and treat each other with respect? A B C D E
42. feel a responsibility to improve this school?6 A B C D E

Do you feel that you need more professional development, training, mentorship or other
support to do your job in any of the following areas?

Note: If the indicated training is not needed for your job, mark “Not Applicable” 7
Not
Area of Professional Development Yes No Applicable

43. Meeting academic standards A B C

44. Evidence-based methods of instruction A B C
45. Positive behavioral support and classroom A B C
management
46. Working with diverse racial, ethnic, or cultural A B C
groups
47. Culturally relevant pedagogy for the school’s A B C
student population
48. Serving English language learners A B C
49. Closing the achievement gap A B C
50. Serving special education (IEP) students A B C
51. Meeting the social, emotional, and A B C
developmental needs of youth (e.g., resilience
promotion)
52. Creating a positive school climate A B C

Based on your experience, how many students at this school…

Nearly Almost
All Most Some Few None
53. are healthy and physically fit? A B C D E
54. arrive at school alert and rested? A B C D E
55. are motivated to learn? A B C D E
56. are well-behaved? A B C D E

6 Considerable discussion about whether to change these questions to “level of

agreement.” Many felt they liked these because they were more concrete.
7 Originally was also going to ask if they had it in the past 3 years, but deleted this

because districts should have this data, and the purpose of the survey is to assess
perceptions, not program reporting.
6
 Practice: Evaluate outcomes to show your program is
making a difference
Key Action: Identify outcome measures and instruments

The next questions ask for your opinions about behaviors or problems of
students you may have experienced in doing your job at this school. How much of
a problem AT THIS SCHOOL is…
Insignificant Mild Moderate Severe
Problem Problem Problem Problem

57. student alcohol and drug use?8 A B C D

58. student tobacco use? A B C D
59. harassment or bullying among students? A B C D
60. physical fighting between students? A B C D
61. disruptive student behavior? A B C D
62. racial/ethnic conflict among students? A B C D
63. student depression or other mental health problems? A B C D
64. lack of respect of staff by students? 9 A B C D
65. cutting classes or being truant? A B C D
66. gang-related activity? A B C D
67. weapons possession? A B C D
68. vandalism (including graffiti)? A B C D
69. theft? A B C D

8 Combined two separate questions (#30 and 31) because results similar for alcohol and
drugs
9 Changed because physical abuse question often results in low percentages of B,C, D

responses, and new question fits better into theme of respect being assessed as part of
CTAG.