Evaluation Tools
Evaluation is a critical component of any education
program. Lions Clubs International Foundation is committed
to assisting schools with program evaluation tools so
that teachers and administrators can provide the most
effective Lions Quest implementation possible. The Skills
for Growing, Skills for Adolescence and Skills
for Action curriculum kits contain tests for each
unit so that knowledge from individual lesson plans
can be tested. If a more comprehensive pre- and post-test
is needed, there are a number of evaluation tools below
which have been used with minor modifications in a variety
of settings. If you are interested in obtaining results
from specific Evaluation Studies please visit
the Results section of
this site.
Character
Education Partnership
CEP provides links to a variety of tools for individual,
teacher and school assessment. Two publications are
also available outlining key components of effective
character education and program evaluation.
Search
Institute: Starting Out Right - Developmental Assets
for Children
The Search Institute has identified 40 Assets as building
blocks of healthy development that help young people
grow up healthy, caring and responsible. These assets
can be used to evaluate programs that promote healthy
communities and youth.
Following is a list of the Evaluation Tool sections
below. Click on an item to go to that section.
Lions Quest Tools
Additional Tools - Related Agencies and Organizations
Lions Quest Tools
Social & Emotional Learning
and Character Education
Lions Quest Evaluation Kit Instruments: Grades K
- 5
The evaluation instruments from the Lions Quest Evaluation
Kit, Appendix III, will work well with the Skills
for Growing program, provided all core lessons
(24 for Grades K - 2 and 27 for Grades 3 - 5) are implemented
from baseline pre-test to post-test. Without this fidelity,
it would not be possible to attribute all of the outcomes
measured on the evaluation instruments to the Skills
for Growing program.
A. Observational
checklists for prosocial behaviors, completed by
teachers for students in grades K-5 (30 questions) as
pre-test baseline and post-test measures of observed
student behaviors.
- Spontaneous Prosocial Behavior (10 questions)
- Negative Social Behaviors (10 questions)
- Prosocial Behaviors; collapsed version (5 questions)
- Negative Social Behaviors; collapsed version (5
questions)
B. The Student Assessment Surveys are self-report instruments
completed by students as pre-test-baseline and post-test
measures of social and emotional competence and character
behaviors. (105 questions)
Skills for Adolescence Unit Tests: Grades 6 - 8:
The Unit Tests at the end of Units 1 - 7 in the Skills
for Adolescence curriculum will work well as pre-
and post-test measures of student self-reported social
and emotional competence and character attitudes and
behaviors.
Drug
Prevention Surveys
Skills for Adolescence Survey: Grades 6 - 8
The survey used by Dr. Marv Eisen and the Urban Institute
for the NIDA Evaluation Study of Skills for Adolescence
(SFA) is an excellent pre-and post-test instrument
for evaluating SFA as a drug prevention program, when
the minimum 45 essential SFA lessons identified in the
One-Year Model in the SFA Program Guide are implemented
from baseline pre-test to post-test, including complete
coverage of Unit 6, Year 1. The test contains 99 questions.
Service Learning Surveys
Life Review Post-Survey A: Grades 6 - 12
The Checklist of Personal Gains Post-Test will
work well with Grades 6 - 12 when:
- A minimum of the Service-Learning Unit is being
implemented in Skills for Adolescence from
baseline pre-test to post-test
- A minimum of Parts 1 and 2 are being implemented
in Skills for Action from pre-test to
post-test. This test could also be used for Teens
- Alcohol and Other Drugs if it is taught
in its entirety from baseline pre-test to post-test.
Ideally, the entire Skills for Action curriculum
would be taught for the strongest outcomes.
Life
Review Post Survey "A" (45 questions with
background)
- Use of Time (10 questions)
- Motivation about School (9 questions)
- Risk Behaviors (11 questions)
- Goals (8 questions)
School Climate Surveys
Lions Quest School Climate Surveys: Grades K - 8:
Skills for Growing and Skills for Adolescence
both include School Climate Surveys in their Program
Guides. Both are excellent tools for pre- and post-test
use with the K-8 programs.
Student Attitude Pre-Survey: Grades 6 - 12
The Student Attitude Pre-Survey could be used as a pre-test
and post-test with Skills for Adolescence and
Skills for Action when:
- A minimum of the Service-Learning Unit is being
implemented in Skills for Adolescence from
baseline pre-test to post-test.
- A minimum of Parts 1 and 2 are being implemented
in Skills for Action from pre-test to post-test.
This test could also be used for Teens Alcohol and
Other Drugs if it is taught in its entirety from baseline
pre-test to post-test. Ideally, the entire Skills
for Action curriculum would be taught for the
strongest outcomes.
The
Student Attitude Pre-Survey (53 questions)
- Use of Time/Background Information (16 questions)
- Helping and Volunteering Behaviors (10 questions)
- Motivation about School (5 questions)
- Life Expectations (1 question)
- Personal and Social Responsibility (10 questions)
- Goals (5 questions)
- Background (4 questions)
Additional Tools - Related Agencies and Organizations
Social & Emotional Learning
and Character Education
Surveys of the Behavioral Characteristics of
Students: Grades 3 - 12
Professional Development and Assessment Center
Dr. Clete Bulach, Director
Bulach's instruments will work well as pre-and post-tests
for measuring students' self-reported levels of character
behaviors with the K-8 Lions Quest programs, provided:
- All Skills for Growing core lessons (24 for
Grades K - 2 and 27 for Grades 3 - 5) are implemented
from baseline pre-test to post-test.
- The minimum 45 essential Skills for Adolescence
(SFA) lessons identified in the One-Year Model in
the SFA Program Guide are implemented from baseline
pre-test to post-test. Without this fidelity, it would
not be possible to attribute all of the outcomes measured
on the instruments to Lions Quest.
Overview of instruments:
a) A Survey of the Behavioral Characteristics of Students,
Grades 3 - 6 (99 questions)
- Part I: Background (4 questions)
- Part II: Survey (95 questions)
b) A Survey of the Behavioral Characteristics of Students,
Grades 6 - 12 (100 Questions)
- Part I: Background (4 questions)
- Part II: Survey (96 questions)
How to obtain: www.westga.edu/~cbulach
or cbulach@comcast.net
BERS 2, Behavioral and Emotional Rating Scale:
ages 5-18
Michael H. Epstein
Designed for use in schools, mental health clinics,
juvenile justice settings, and child welfare agencies,
the Behavioral and Emotional Rating Scale, Second Edition
(BERS-2) helps to measure the personal strengths and
competencies of children ages 5-0 through 18-11. The
BERS-2 is a multi-modal assessment system that measures
the child's behavior from three perspectives: the child
(Youth Rating Scale), parent (Parent Rating Scale),
and teacher or other professional (Teacher Rating Scale).
The scale can be completed in approximately ten minutes.
The BERS-2 measures a child's:
- Interpersonal strength
- Involvement with family
- Intrapersonal strength
- School functioning
- Affective strength
- Career strength
Information is useful in evaluating children for:
- Prereferral services
- Specialized services
- Outcomes of services
How to obtain: Visit PRO-ED
Inc. for details and ordering information.
The Social-Emotional Resilience and Assets Scales
(SEARS): Grades 3-12
Oregon Resiliency Project, University of Oregon
The Social-Emotional Assets and Resiliency Scales
(SEARS) are being designed as cross-informant measures
of students' assets and resilience, taking into account
problem-solving skills, interpersonal skills, the ability
to make and maintain friendships, the ability to cope
with adversity, and the ability to be optimistic when
faced with adversity. The SEARS represents a new direction
in infusing positive psychology and resiliency into
child and adolescent social-emotional assessment.
The SEARS assessments are being designed for the purpose
of:
- Screening
- Assessment
- Intervention planning
- Intervention monitoring and evaluation
- Program evaluation
The cross informant scales of the SEARS system include:
- SEARS-C: a self-report measure for students in grades
3 through 6
- SEARS-A: a self-report measure for students in grades
7 through 12
- SEARS-T: a teacher report rating scale for assessing
students
- SEARS-P: a parent report rating scale for assessing
children and adolescents
How to obtain: Evaluation of the SEARS assessments
is on-going. To learn more, download sample copies,
or view preliminary research studies, visit Strong
Kids.
School Social Behavior Scales (SSBS): Grades
K-12
Ken Merrell
Designed specifically for use in educational settings,
the SSBS is a teacher rating scale that includes 65
items on two separate conormed scales:
- Scale A: Social Competence (32 items)
- Scale B: Antisocial Behavior (33 items)
All items are rated on a scale ranging from 1 (never)
to 5 (frequently). The empirically derived structure
for each scale includes three subscales and a total
score.
Scale A includes:
- Interpersonal Skills
- Self-Management Skills
- Academic Skills subscales
Scale B includes:
- Hostile-Irritable subscale
- Antisocial-Aggressive subscale
- Demanding-Disruptive subscale
All subscale and total scores are converted to social
functioning levels, which serve as general indicators
of the
normative range of skill deficits or problem excesses.
In addition, the total scores for each scale are converted
to standard scores and percentile ranks. SSBS items
and scales are scored by using a very simple scoring
key that is printed on the rating form. Both scales
of the SSBS were standardized with a sample of 1,855
students in kindergarten through Grade 12 from several
U.S. states.
How to obtain: Contact Ken
Merrel to get the scales.
Assessment
of Children's Social Skills: Recent Developments, Best
Practices, and New Directions
Drug Prevention Surveys
California Healthy Kids Survey: Grades 5 - 12
California Department of Education
The Healthy Kids Survey is a comprehensive and customizable
youth self-report data collection system that can be
used as a pre- and post-test and provides essential
and reliable health risk assessment and resilience information
to schools, districts and communities. Targeted for
grades 5 - 12, the HKS enables schools and communities
to collect and analyze valuable data regarding local
youth health risks, assets and behaviors.
At the heart of the HKS is a research-based Core module
that provides valid indicators of drug use, violence,
crime, and physical and mental health. In addition to
the Core, there are five supplementary modules to choose
from that ask detailed questions on specific topics.
Among these, the Resilience and Youth Development Module
measures 11 external assets and 6 internal assets.
The external assets include caring relationships, high
expectations, and opportunities for meaningful participation
in the school, home, community, and peer group. Internal
assets consist of cooperation and communication, empathy,
problem-solving, self-efficacy, self-awareness, and
goals and aspirations. There is also a custom module
for incorporating additional questions targeting topics
of local interest.
The Elementary School Questionnaire will work very
well with Skills for Growing when the program
is taught in its entirety from baseline pre-test to
post-test. The instrument measures social and emotional
competencies, character traits, resiliency and drug
prevention. The section about "Health and Things
You Might Do" contains questions that pertain to
weight, exercise and fitness, which is beyond the specific
content of Skills for Growing. Lions Quest would
counsel schools to leave out questions 47 - 52.
Overview of instruments:
a) Elementary School Questionnaire, Grades 3 - 6 (64
questions)
- Background ( 8 questions)
- About Your School (12 questions)
- About What Happens at School (9 questions)
- About Cigarettes, Alcohol, and Other Drugs (11 questions)
- About Health and Things You Might Do (13 questions)
- About Home (11 questions )
The Middle School Questionnaire will work very well
with Skills for Adolescence when the program
is taught in its entirety from baseline pre-test to
post-test. The instrument measures social and emotional
competencies, character traits, resiliency and drug
prevention. The section about "Physical Health
and Eating Habits" contains questions that are
beyond the specific content of Skills for Adolescence.
Lions Quest would need to counsel schools to leave out
questions A10 - 20.
b) Middle School Questionnaire, Grades 6 - 12
Module A: Core (90 questions)
- Background (9 questions)
- Physical Health and Eating Habits (11 questions)
- About Alcohol, Tobacco, Marijuana, and Other Drugs
(42 questions)
- About Violence, Safety, Harassment, and Bullying
(28 questions)
Module B: Resilience and Youth Development (23 questions)
- About School (14 questions)
- About the Neighborhood, Community, and Caring Adults
(14 questions)
The High School Questionnaire will work with Skills
for Action when the Skills Bank and Teens:
Alcohol and Other Drugs unit are taught from
baseline pre-test to post-test. The instrument measures
social and emotional competencies, character traits,
resiliency and drug prevention. Questions A10 - 20 in
the section about "Physical Health and Eating Habits"
are beyond the specific content of Skills for Action.
Lions Quest would need to counsel schools to leave out
questions A10 - 20.
c) High School Questionnaire, Grades 6 - 12
Module A (101 questions)
- Background ( 9 questions)
- Physical Health and Eating Habits (11 questions)
- About Alcohol, Tobacco, Marijuana, and Other Drugs
(54 questions)
- About Violence, Safety, Harassment, and Bullying
(27 questions)
Module B (23 questions)
- About School (14 questions)
- About the Neighborhood, Community, and Caring Adults
(9 questions)
How to obtain: All of the surveys
are available in Spanish and English.
The Individual Protective Factors Index (IPFI):
Grades 6 - 12
EMT Associates, Inc. J. Fred Springer, Joel L. Phillips
Developed by EMT Associates, the Individual Protective
Factors Index (IPFI) can be used as a tool for evaluating
prevention programs. One of the few measures on adolescent
resiliency and protective factors available in the public
domain, the items of the IPFI measure constructs related
to adolescent resiliency, including social bonding,
personal competence and social competence.
Sub-constructs for each of these three resiliency domains
are as follows:
- Social Bonding : School; Family; Pro-Social Norms
- Personal Competence: Self-Concept; Self-Control;
Self-Efficacy; Positive Outlook
- Social Competence: Assertiveness; Confidence; Cooperation
The index also measures individual, family, peer and
neighborhood risk factors for substance use.
The IPFI will work well with Skills for Adolescence
and Skills for Action when:
- Skills for Adolescence is taught in its entirety,
with a strong emphasis on parent involvement from
baseline pre-test to post-test.
- Teens: Alcohol and Other Drugs and
the Skills Bank are covered in Skills for Action
from baseline pre-test to post-test.
Overview of instruments:
a) Section I: General SEL and prevention questions (71
questions)
b) Part II: Information and perceptions about family,
friends, and neighborhood (16 questions)
How to obtain: The survey
is available.
PRIDE Surveys: Grades 4 - 12
International Survey Associates, LLC
The PRIDE Surveys will work well as pre-test baseline
to post-test instruments provided that:
- The Skills for Growing implementation includes
complete coverage of Unit 4 from baseline pre-test
to post-test
- The minimum 45 essential Skills for Adolescence
(SFA) lessons identified in the One-Year Model
in the SFA Program Guide are implemented from baseline
pre-test to post-test, including complete coverage
of Unit 6, Year 1.
The PRIDE Surveys are divided into categories of questions.
Each category has its own numbering system. Therefore,
the tests could be given in sections, which add flexibility
for the user.
The Grades 6 - 12 survey is a hard-core drug use questionnaire.
Before administering this test, teachers will need to
get parental permission, informing schools and families
of the information that is being requested, as it could
be incriminating for both.
Overview of instruments:
a) The Pride Questionnaire for Grades 4 - 6 ( 64 questions)
b) The Pride Questionnaire for Grades 6 - 12 (150 questions)
c) Risk and Protective Factor Questionnaire for Grades
6 - 12 (74 questions.)
How to obtain: www.pridesurveys.com
Student Survey of Risk and Protective Factors
and Prevalence of Alcohol, Tobacco, and Other Drug Use:
Grades 6 - 12
Social Development Research Group
Dr. Michael W. Arthur, Dr. J. David Hawkins, Dr. Richard
F. Catalano
This evaluation instrument will work with Skills
for Adolescence, and Teens: Alcohol and Other
Drugs, when:
- The minimum 45 essential Skills for Adolescence
(SFA) lessons identified in the One-Year Model in
the SFA Program Guide are implemented from baseline
pre-test to post-test, including the family component.
- Teens: Alcohol and Other Drugs is taught in its
entirety from pre-test to post-test with strong family
involvement.
Overview of instruments:
Student Survey of Risk and Protective Factors and Prevalence
of Alcohol, Tobacco, and Other Drug Use (126 questions)
- Experience at School (16 questions)
- Feelings and Experiences in Other Parts of Life
(25 questions)
- Tobacco, Alcohol, and Other Drugs (21 questions)
- Neighborhood and Community (24 questions)
- Family (33 questions)
How to Obtain: http://cart.rmcdenver.com/instruments/communities_that.pdf
Youth Risk Behavior Survey: Grades 6 - 12
Centers for Disease Control; National Center for Chronic
Disease Prevention and Health Promotion
The "YRBS" 2009 surveys for middle and high
school students are self-report questionnaires used
to determine rates of various adolescent high-risk behaviors.
Schools that use these items in needs and outcome assessment
can compare and contrast their local data with national
findings collected annually in all 50 states by the
Centers for Disease Control and Prevention (CDC).
The 2009
Middle School Youth Risk Survey will work well with
Skills for Adolescence when the program is taught
in its entirety from baseline pre-test to post-test.
There is emphasis on suicide prevention, weight control,
physical activity, and other health-related topics that
are not overtly covered in Skills for Adolescence
but may be tertiary outcomes because of the program's
emphasis on making healthy choices.
The 2009
High School Youth Risk Survey will work well when
Teens: Alcohol and Other Drugs (TAOD)
is taught in its entirety with support from the Skills
Bank from baseline pre-test to post-test. There
is emphasis on suicide prevention, weight control, physical
activity, and other health-related topics that are not
overtly covered in TAOD or the Skills Bank
but may be tertiary outcomes because of the program's
emphasis on making healthy choices.
Service-Learning Surveys
Checklist of Personal Gains: Grades 6 - 12
Four District Career Education Consortium, Dr. Richard
Bradley
The Checklist of Personal Gains Post-Test will work
well with Grades 6 - 12 when:
- A minimum of the Service-Learning Unit is being
implemented in Skills for Adolescence from
baseline pre-test to post-test.
- A minimum of Skills for Action Parts 1 and
2 are being implemented from pre-test to post-test.
This test could also be used with Teens: Alcohol
and Other Drugs if it is taught in its entirety
from baseline pre-test to post-test. Ideally, the
entire Skills for Action curriculum would be
taught for the strongest outcomes.
Overview of instruments:
Checklist of Personal Gains Post-Test (Grades 6 - 12)
- Personal Development (5 questions)
- Social and Interpersonal Development (5 questions)
- Ethical Development (4 questions)
- Academic Development (7 questions)
- Career Development (4 questions)
- Personal Reflection on Service (1 question)
- Background (8 questions)
How to Obtain: Email Dr. Richard Bradley at
creativityrb@juno.com.
National and Community Service Study: Grades
6 - 12
Brandeis University. ABT Associates, Inc.
The National and Community Service Study will work
well with Skills for Adolescence and Skills
for Action when:
- A minimum of the Service-Learning Unit is being
implemented in Skills for Adolescence from baseline
pre-test to post-test
- A minimum of Skills for Action Parts 1 and 2 are
being implemented from pre-test to post-test. This
test could also be used for Teens: Alcohol and Other
Drugs if it is taught in its entirety from baseline
pre-test to post-test. Ideally, the entire Skills
for Action curriculum would be taught for the strongest
outcomes.
This instrument is long and complicated. While it would
reveal a wide range of outcomes, it may be most appropriate
for use in a research capacity, rather than by the average
teacher.
Overview of instruments:
National Community Service Study (137 questions)
- Section A: Background (4 questions)
- Section B: Service Experience (26 questions)
- Section C1: Educational Competence (18 questions)
- Section C2: Personal and Social Responsibility
(70 questions)
- Section D: Homework (2 questions)
- Section E: Formal Helping Behavior (10 questions)
- Risk Behaviors (7 questions)
How to Obtain: http://CART.rmcdenver.com
The 2006 Metro School Student Survey: Grades
6 - 12
RMC Research Corporation, modified by Richard Bradley,
Ph.D.
The 2006 Metro School Student Survey Pre-Test will
work well with Skills for Adolescence and Skills
for Action students as a pre-test in Grades 6 -
12 classrooms when:
- A minimum of the Service-Learning Unit is being
implemented from Skills for Adolescence.
- A minimum of Parts 1 and 2 are being implemented
from Skills for Action. This test could also
be used for Teen: Alcohol and Other Drugs.
Ideally, the entire Skills for Action curriculum
would be taught for the strongest outcomes.
Overview of instruments:
Metro School Student Survey Pre-Test (Grades 6 - 12)
- Background: (10 questions)
- Your School (7 questions)
- Your Place in the Community (7 questions)
- About You (10 questions)
- How Good Are You At: (14 questions)
How to Obtain: Email Dr. Richard Bradley at
creativityrb@juno.com.
School Climate Surveys
California Healthy Kids Survey: Grades 5 - 12
California Department of Education
The California Healthy Kids School Climate Survey for
staff members will work well as a baseline pre-and post-test
with Skills for Growing (SFG) and Skills for
Adolescence (SFA) because they target school climate
as a program outcome. It would not be valid for Skills
for Action.
Overview of instruments:
a) School Climate Survey (for all staff - 43 questions)
- Background (2 questions)
- About the School (14 questions)
- About the Adults in the School (8 questions)
- About the students (19 questions)
b) School Climate Survey for Support Services Staff
- About the School (13 questions)
- About Health and Prevention Services (9)
How to Obtain: www.wested.org/cs/chks/print/docs/chks_home.html
CASEL Evaluation Instruments: Grades K - 8
Collaborative for Academic, Social and Emotional Learning
(CASEL)
Dr. Mary Utne O'Brien, Executive Director
The CASEL Staff Survey for staff members is appropriate
for use as a pre-test and post-test instrument with
the Lions Quest K-8 programs, because Skills for
Growing and Skills for Adolescence target
school climate as a program outcome. It would not be
valid for Skills for Action.
Overview of instruments:
Staff Survey (43 questions)
- Background Information (5 questions )
- About the School (38 questions)
How to Obtain: Permission is required to use
this tool. Visit www.casel.org.
Go to Sustainable Schoolwide Social and Emotional
Learning Implementation Guide and Tool Kit, and
then to SEL Assessment Instruments.
CSAP Measures: Grades 6 - 12
U.S. Department of Health and Human Services; Center
for Substance Abuse Prevention
The CSAP measures for the School Domain for students
will work well as pre-test and post-test instruments
with Skills for Adolescence, since it has a strong
school climate component. It would not be valid for
Skills for Action.
Overview of instruments:
- School Domain (9 questions)
- School Bonding/Commitment (5 questions)
- School Safety/Dangerousness (4 questions)
How to Obtain: http://CART.rmcdenver.com
PRIDE Survey for Faculty and Staff
International Survey Associates, LLC
This instrument will be useful if staff implementing
Lions Quest programs would like to evaluate how knowledgeable
and prepared they are as a prevention environment. Prevention
includes a wide range of health-compromising behaviors.
Overview of instruments:
The Pride Questionnaire for Faculty and Staff (70 questions)
How to obtain: www.pridesurveys.com
Parent Surveys
CASEL Evaluation Instruments: Grades K - 8
Collaborative for Academic, Social and Emotional Learning
(CASEL)
Dr. Mary Utne O'Brien, Executive Director
The CASEL Home Survey would be appropriate for use
as a pre-test and post-test instrument with the Lions
Quest K - 8 programs because Skills for Growing
and Skills for Adolescence target school climate
as a program outcome. It would not be appropriate for
Skills for Action.
Overview of instrument:
Home Survey (33 questions)
- Background Information (2 questions)
- About the School (27 questions)
- About You (4 questions)
How to Obtain: Permission is required to use
this tool. Visit www.casel.org.
Go to
Sustainable Schoolwide Social and Emotional Learning
Implementation Guide and Tool Kit, and then to SEL
Assessment Instruments.
PRIDE Survey for Parents
International Survey Associates, LLC
This instrument will be useful if staff implementing
Lions Quest programs would like to evaluate how knowledgeable
and prepared parents are to help their children avoid
illegal and illicit drug use and a wide array of other
health-compromising behaviors.
Overview of instruments:
The Pride Questionnaire for Parents (100 questions)
How to obtain: www.pridesurveys.com
|
