1. Completer effectiveness and impact on P-12 student learning
Completer impact in contributing to P-12 student-learning
INITIAL PROGRAMS
Overview of Evidence System
Notre Dame of Maryland University (NDMU) utilizes a comprehensive and triangulated system of evidence to demonstrate that program completers positively impact P–12 student learning and development, in alignment with CAEP Standard 4. Multiple, complementary sources of data are collected and analyzed, including completer surveys, structured observations, artifact analysis, and extended support and coaching.
The Director of Clinical Programs maintains a comprehensive database of program completers, including alternate contact information to support longitudinal data collection. Annually, NDMU administers a completer survey aligned with InTASC. The survey gathers both quantitative and qualitative data regarding instructional practices, professional responsibilities, and career progression. Completers are also asked to submit Student Learning Objectives (SLOs), a required measure of teacher effectiveness in Maryland, along with additional evidence such as principal evaluations and professional milestones. Survey results are compiled into an annual executive summary that integrates both quantitative and qualitative findings.
NDMU also conducts structured case study observations of completers one to five years post-program completion. Observations are conducted by trained evaluators—former teachers and current university supervisors—using an instrument aligned with InTASC standards. Each observation includes both quantitative scoring and qualitative feedback across 29 components. In addition to observation data, supervisors collect supporting artifacts such as lesson plans and samples of student work demonstrating attainment of instructional objectives.
A systematic document analysis, informed by qualitative methodologies (e.g., John W. Creswell), is conducted across all data sources, including surveys, observations, artifacts, and extended support documentation. This analysis identifies patterns and themes that inform program strengths and areas for improvement. NDMU ensures representation across diverse school settings, including urban, suburban, public, private, and parochial contexts.
Finally, NDMU provides extended support and coaching to completers. Graduates may elect to work with former supervisors to develop individualized support plans, which may include consultation on instruction and assessment, additional observations, and targeted classroom management support. Data generated through these activities contribute to a comprehensive understanding of completer effectiveness.
Findings: Impact on P–12 Student Learning and Development
Across all data sources, evidence indicates that NDMU completers demonstrate strong effectiveness in positively impacting P–12 student learning and development.
Survey Results
Survey findings reflect high levels of self-reported instructional competence among completers. Respondents indicated that they impact student learning through a variety of effective instructional practices. Specifically:
- 50% of respondents rated their ability to differentiate instruction at the highest level (5 out of 5), while the remaining 50% rated themselves at 4 out of 5.
- 100% of respondents reported creating respectful and inclusive classroom environments, rating themselves 5 out of 5 in this area.
- 75% of respondents indicated effectiveness in integrating technology, with ratings ranging from 3 to 5 on a 5-point scale.
These results demonstrate strong alignment with program expectations and professional teaching standards.
Observation Results
Observation data further corroborate these findings. A total of seven formal observations were conducted in the 2023-2024 academic year, with each observation scored out of a maximum of 29 points, resulting in a cumulative possible score of 203. NDMU completers achieved a total score of 202 out of 203, indicating consistently high levels of instructional effectiveness.
Analysis of observation data revealed several consistent strengths across completers, including:
- Effective differentiation of instruction
- Strong rapport and relationships with students
- Facilitation of higher-order thinking and cognitively demanding tasks
These competencies are emphasized throughout program coursework and align with professional benchmarks, including edTPA and National Board for Professional Teaching Standards expectations.
In addition to classroom teaching roles, evidence of leadership impact was also observed. One completer who transitioned into a school leadership position demonstrated effectiveness using a role-specific evaluation tool, with responsibilities including facilitating professional development workshops and leading curriculum revision efforts.
Artifact and SLO Analysis
Artifact analysis provides additional evidence of completer impact. Completers are asked to submit SLOs, which require the use of baseline data and the measurement of student growth over time. Among those who submitted SLO data, all demonstrated successful attainment of their instructional objectives.
Additional artifacts, including lesson plans and curricular materials, were analyzed. Consistent with survey and observation findings, document analysis revealed common strengths in:
- Differentiation of instruction
- Student engagement and rapport
- Promotion of higher-order thinking
These findings provide strong evidence of completers’ ability to design and implement effective, standards-aligned instruction that supports student learning.
Extended Support and Continuous Improvement
Data collected through extended support and coaching further highlight both strengths and areas for growth. Supervisors noted measurable improvements in:
- Student engagement
- Use of positive reinforcement
- Consistency of classroom procedures
- Increased time on task
These findings inform continuous improvement efforts. Based on the data, a targeted focus for the upcoming year is the continued strengthening of positive classroom management practices to further enhance student engagement and learning outcomes.
Summary
Across all measures including surveys, observations, artifacts, and extended support—NDMU demonstrates a robust and systematic approach to evaluating completer effectiveness. The 12 completers engaged through this evidence system consistently demonstrate high levels of effectiveness and a clear, positive impact on P–12 student learning and development.
This triangulated system of evidence supports continuous program improvement and ensures alignment with CAEP Standard 4 expectations.
Initial Impact on P-12 Learning Data