CAEP Annual Reporting Measures

Impact Measure #1: Completer effectiveness

Several data sources allow Relay to gauge completer effectiveness including surveys sent to supervisors of graduates, administrative data from Texas, and educator preparation program report cards from Tennessee and Colorado.

‍

Relay administered the Alumni Employer Survey each spring. This survey is sent to the current supervisor (i.e., School Principal) of all Relay graduates. In the 20024 survey, 94% of surveyed principals indicated a belief that completers contributed to an expected level of student learning growth in their classrooms.

‍

In 2024, Relay contracted with researchers from Texas Tech University to answer the research question - What is the impact of Relay teachers on PK-12 student achievement, attendance, and suspensions over their first five years of teaching compared to non-Relay teachers? The researchers used a large, statewide dataset consisting of teacher and student data. They found that Relay-trained teachers’ students outperformed students of teachers from similar educator preparation programs after their first year of teaching. But year 2 gains in reading were equivalent to five additional months of learning (see Figure 1). In math, Relay teachers’ students also outperformed students of teachers from similar programs after year one. In Year 2, the gains were equivalent to almost 3 additional months of learning (see Figure 1).

‍

Figure 1. Texas Reading and Mathematics Months of Learning

The states of Tennessee and Colorado produce public report cards for educator preparation programs. Those report cards include data regarding the effectiveness of Relay graduates. When deploying formal observations and evaluations, Relay teachers exceeded state standards or expected teacher performance levels in Colorado and Tennessee (see Figure 2). In Colorado, Relay is the only EPP in the state where all first-year, rated teachers received accomplished or exemplary ratings across all four quality standards included on the EPP report card (see Figure 3). For 2022-2024 cohorts in Tennessee, Relay surpassed state averages in formal teacher evaluation scores and observation scores (Figure 4).

‍

Figure 2. Percent of Relay Graduates Exceeding Standards in Tennessee and Colorado‍

Figure 3. Percent of Relay Graduates in Colorado Receiving Accomplished of  Exemplary Rating (2019-2020 First-Year Alumni)

Figure 3. Tennessee Teacher Performance (2020-2022 Cohorts)

Impact Measure #2: Satisfaction of employers and stakeholder involvement

Initial Level Programs

Findings from Relay’s 2024 Employer Survey demonstrate that the majority of principals are satisfied with the initial-level preparation their teachers received at Relay.

‍

1) 98% of surveyed principals responded that completers were moderately, mostly, or fully ready to meet the needs of students after completing their studies with Relay, with 80% stating that completers were fully or mostly ready.

‍

2) 94% of surveyed principals believe that completers contributed to an expected level of student learning growth in their classrooms.

‍

3) Principals provided the following feedback on specific aspects of completers’ performance in the classroom:

• 87% of principals responded that completers were “Very Well” or “Well” prepared to implement well-structured lessons.
• 84% of principals responded that completers were “Very Well” or “Well” prepared to maintain an academic learning environment where students are unafraid to academic risks.
• 82% of principals responded that completers were “Very Well” or “Well” prepared to make adjustments to practice based on assessment data.
• 78% of principals responded that completers were “Very Well” or “Well” prepared to meet the diverse needs of learners within the classroom including English Language Learners and students with special needs.
• 84% of principals responded that completers were “Very Well” or “Well” prepared to use self-reflection to improve practice.

‍

Advanced Level Programs

Findings from Relay’s 2020 Employer Survey demonstrate that the majority of principals are satisfied with the advanced-level preparation their teachers received at Relay. There are very few Relay students in Advanced level programs and the response rate from employers of advanced-level completers on the 2024 Employer Survey is too small to report any findings. Relay operates only one advanced level program with a small enrollment that leads to recommendation for special education certification. We are strategizing on how we can do more targeted outreach to improve the advanced-level response rate on future Employer Surveys.

‍

Advanced Level Programs Findings from Relay’s 2020 Employer Survey

1) 82% of surveyed principals responded that completers were mostly or fully ready to meet the needs of students after completing their studies with Relay.

‍

2) 73% of surveyed principals believe that completers contributed to an expected level of student learning growth in their classrooms.

‍

3) Principals provided the following feedback on specific aspects of completers’ performance in the classroom:

• 73% of principals responded that completers were “Very Well” or “Well” prepared to consistently enforce high expectations for all students.
• 100% of principals responded that completers were “Very Well” or “Well” prepared to implement well-structured lessons.
• 73% of principals responded that completers were “Very Well” or “Well” prepared to maintain an academic learning environment where students are unafraid to academic risks.
• 82% of principals responded that completers were “Very Well” or “Well” prepared to make adjustments to practice based on assessment data.
• 80% of principals responded that completers were “Very Well” or “Well” prepared to meet the diverse needs of learners within the classroom including English Language Learners and students with special needs.

Impact Measure #3: Candidate competency at completion

Relay’s 2023-24 certification pass rates, by state, are provided in the tables below. These pass rates are based on candidates’ best attempt of program completers.

‍