Research & Program Evaluation Office

The Research & Program Evaluation Office (RPEO) provides high quality analysis and reporting designed to support continuous improvement at all levels and support strategic planning around district priorities.

Office Staff

Research, Accountability, & Data Use Department (RAD) Executive Director

Andrew Statz, MUP

Executive Director of Accountability

Since 2010, Andrew has been the Executive Director of Research, Accountability, & Data Use. In this role, he oversees MMSD's research and program evaluation, enrollment, assessment administration, and innovation functions. His experience includes a Master’s Degree and several long-tenured positions in state and local government focusing on policy analysis, budgeting, project management, and program evaluation.

To contact RPEO with a general question please email Jamie Anderson at jlanderson@madison.k12.wi.us. or call (608) 442-2915.

For data requests please visit the requests tabs for an explanation of how to place your request.

Research & Program Evaluation Staff

Director of RPEO

Oriana Eversole, Ph.D.

Director of RPEO

Oriana has a Ph.D. in Educational Measurement and Evaluation. She draws on her experience as a teacher, instructional coach, evaluator, and researcher to support the research and evaluation needs of the district. She oversees the Research & Program Evaluation Office, which includes data dashboard development, surveys, data analysis, research, and evaluation. In addition to contributing to major research projects and evaluations, she helps identify and develop metrics to support the district’s strategic framework.

Dashboard Team

Travis Grover

Data Warehouse & Dashboard Supervisor

Travis has been working at MMSD since 2001 in various IT roles. His current work includes:

• ■ Data warehouse development and maintenance to support integration of data from multiple data systems.
• ■ Development and maintenance of Data Dashboard.

Surveys and Data Analysis

Jill Brown

Data & Survey Analyst

Jill has worked at MMSD since 2001 in various assessment and research roles:

• ■ Provides consultation and support for surveys and evaluation, including the annual Climate Survey.
• ■ Supports departments in improving the efficiency, accuracy, and useability of the data they collect.

Analytics and Evaluation

Brianne Monahan, MPA

Research Coordinator

Bri holds a Master's of Public Affairs from the University of Wisconsin and has worked in state and local education agencies and as an external evaluator:

• ■ Coordinates internal and external data requests.
• ■ Leads and manages research and evaluation projects in support of the district’s mission and Strategic Framework.

Grady Brown, MPA

Quantitative Analyst

Grady has a Master's in Public Policy and has worked at MMSD since 2016:

• ■ Provides data support, analysis, and data visualization work for the district.
• ■ Develops reports to monitor and evaluate district initiatives and programs.

Eric Lequesne, MA

Quantitative Analyst

Eric has a Master's of Economics from the University of Wisconsin-Milwaukee and has worked with several nonprofits in Wisconsin as an education data analyst and external evaluator:

• ■ Provides data support, analysis, and data visualization work for the district.
• ■ Provides support for reports to monitor and evaluate district initiatives and programs.

RAD Department Research Staff

Beth Vaade, MPA

Co-Director of MEP and Innovation Project Manager

Beth has a Master’s in Public Administration from UW-Madison. As the Innovation Project manager, she helps build the skills, experience, and capacity of MMSD staff to engage in innovation, design thinking, and creative problem solving. She also directs the Madison Education Partnership, a research practice partnership between MMSD and UW-Madison.

Chris Harrison, Ph.D.

Researcher

Chris holds a Ph.D. in Education Policy, Leadership, and School Improvement. He works closely with the Chiefs of Elementary, Middle, and High Schools, along with other central office and school partners, to support evidence- and data-based improvement in schools. He also works closely with the rest of RPEO to support the district’s research and evaluation needs, and coordinates MMSD’s External Research Committee.

Other Webpages

Madison Education Partnership

Central Office Measures
of Performance

Building Excellence

Annual Report

MMSD Visual Analytics

MMSD Visual Analytics is powered by Tableau.

MMSD Visual Analytics is used to provide MMSD senior central leadership and school based leadership with operational dashboards and trend analytics. These resources are meant to facilitate strategic planning and provide summary statisitcs for reporting.

To sign in to the MMSD Visual Analytics server, please provide your MMSD b-number and your MMSD password when prompted by the sign in page.

After signing in you will arrive at the Select a Site page. MMSD's internal dashboarding content is on the MMSD Visual Analytics site. MMSD's public dashboarding content is on the Public Visual Analytics site.

Data Dashboard

Data Dashboard is powered by Hoonuit.

Data Dashboard is used to provide MMSD staff in general with operational dashboards and student rosters. These resources are meant to facilitate day-to-day operations and provide student level data to staff.

To sign in to the Data Dashboard server, please provide your MMSD b-number and your MMSD password when prompted by the sign in page.

Data Dashboard 2.0

Data Dashboard 2.0 is the long-term replacement for Dashboard. New content is posted in consultation with content area experts.

Data Dashboard 2.0 is powered by Hoonuit.

Data Dashboard 2.0 is used to provide MMSD staff in general with operational dashboards and student rosters. These resources are meant to facilitate day-to-day operations and provide student level data to staff.

To sign in to the Data Dashboard server, please provide your MMSD b-number and your MMSD password when prompted by the sign in page.

The dashboards on this page are available to the general public. More dashboards are available on the reports page.

Home Language Tree Map

Parent Climate Survey

Staff Climate Survey

Student Climate Survey

Strategic Framework Metrics

MMSD Fall Enrollment 2019

DPI Accountability Scorecards

The Research & Program Evaluation Office produces reports and program evaluations on a regular basis as part of the district's Evaluation and Review Cycles. The reports and evaluations posted below have been shared with the Board of Education and/or external audiences. These documents are organized by topic, with the newest appearing first under each topic heading. Reports published before September 2017 may lack accessibility features. To obtain a copy of an RPEO Report older than 2017 please email our Office and we will provide a copy of the resource. A listing of historical reports still available digitally can be obtained here.

Virtual Learning and COVID-19 Response

Virtual Learning and COVID-19 Response

RPEO reports and presentations in support of analyzing the virtual learning session and the re-opening of the district.

(2020) Reopening of School for Families Survey This is a presentation summarizing a survey of MMSD families on their preferences for school during the 2019-2020 school.

(2020) Virtual Learning Survey This is a presentation summarizing a survey of MMSD staff, students, and families concerning their opinions of the virtual learning session during quarters 3 and 4 during the 2019-2020 school year.

(September 2020) 2020 Virtual Learning Feedback Report This report summarizes feedback from surveys of families, students, and staff, as well as other sources, to better understand the implementation of Virtual Learning in MMSD during Spring 2020. The report identifies successes and challenges in implementing Virtual Learning. Key findings from this report were used to plan for fall 2020.

Assessment Reports

Assessments

RPEO annual reports a summary of student results on standardized assessments.

(2019) Measures of Academic Progress (MAP) Annual Update The MAP Annual Update includes student assessment scores for the 2013-2014 through 2018-2019 school years.

(2019) ACT/Aspire Annual Update The ACT/Aspire Annual Update includes student assessment scores for the 2013-2014 through 2018-2019 school years.

(2019) PALS Annual Update The PALS Annual Update includes student assessment scores for the 2013-2014 through 2018-2019 school years.

Behavior Reports

Behavior

RPEO produces an annual summary of MPD Officer enforcement activity in MMSD high schoools.

During the 2016-2017 school RPEO conducted an evaluation of the Behavior Education Plan and reported quantitative and qualtitative analyses from that evaluation.

(2020) MPD School Resource Officer Arrest and Citation report The MPD School Resource Officer Arrest and Citation report focuses on incidents occuring during the 2019-2020 school year. This report represents a major change from past reports and presents data collected internally by MMSD on arrests, citations, and other types of diversionary outcomes stemming from incidents involving MPD officers. An update of the report presenting historical MPD data is available here.

(2019) MPD Enforcement Activities Annual Update The MPD Enforcement Activities Annual Update report includes data for MMSD's high schools for the 2015-2016, 2016-2017, and 2017-2018 school years.

(2017) Behavior Education Plan Evaluation The Behavior Education Plan Evaluation summarizes data from the first three years of implementation (2013-2014 to 2016-2017) and presents lessons learned from this period.

(2017) Student-to-Student Bullying Perceptions This report focuses on student perceptions of student-to-student bullying in MMSD.

Enrollment Reports

Enrollment

RPEO produces a summary of MMSD enrollment each fall.

(2019) Fall Enrollment This report contains four enrollment reports from November 2019: 1) Enrollment History and Projections, 2) Capacity Utilization, 3) Inter-district transfers (includes Internal Transfers), and 4) Intra-district transfers (includes Open Enrollment).

Facilities and Referenda Reports

Facilities and Referenda

RPEO provides technical expertise and support to the Building Excellence team and long-range planning in MMSD.

(2020) Facilities and Operating Revenue Referenda Community Engagement and Input Report This report summarizes community input concerning the planned referenda for the 2020 election: one referendum for facilities, and one recurring referendum to fund operating expenses.

(2019) Long-Range Facilities Plan-High School Input This report summarizes major themes in student and staff input regarding proposed long-range plans for MMSD facilities.

Human Resources Reports

Human Resources

RPEO produces a summary of the diversity of MMSD staffing each year.

(2020) Human Resources Annual Summary This report presents the diversity of MMSD's workforce and staff retention over the past five years (2014-2015 through 2018-2019).

(2018) Human Resources Annual Summary This report presents the diversity of MMSD's workforce and staff retention over the past five years (2013-2014 through 2017-2018).

Secondary and Postsecondary Reports

Secondary and Postsecondary Vision

RPEO reports annual on the high school completion rates of MMSD students according to DPI cohort information.

(2020) High School Completion This dashboard presents a summary of MMSD high school completion rates according to DPI cohort information published January 2020.

Data in past reports may differ due to DPI updating completion and cohort information over time. Listing of past reports: (2019) High School Completion.

(2019) Pathways Year 2 Data Snapshot This data snapshot provides an overview of Pathways students and their academic outcomes during year two of Pathways implementation

(2017) Senior Survey This report summarizes the results of the 2017 MMSD Senior Survey.

Strategic Framework and Graduate Vision Reports

Strategic Framework and Graduate Vision

RPEO conducted and analyzed a series of engagement sessions and surveys in support of developing the MMSD Graduate Vision.

(2018) Strategic Framework Listening and Learning This report summarizes findings from the Strategic Framework Engagement sessions from the Listening & Learning Phase.

Annual Plan Monitoring Reports

Annual Plan Monitoring

RPEO produces annual monitoring reports for MMSD's major programming plans.

(2018) Advanced Learner Plan This report summarizes data related to the Advanced Learner Plan up through the 2016-2017 school year.

(2018) English Language Learner Plan This report summarizes data related to the ELL Plan up through the 2016-2017 school year.

(2018) Ignite Plan This report summarizes data related to the Ignite Plan up through the 2016-2017 school year.

(2018) Special Education Plan This report summarizes data related to the Special Education Plan up through the 2016-2017 school year.

Other Topics for Reports

Other Topics

RPEO has produced a large number of other resources over the years to answer specific research/policy questions for the Board, the Public, and Senior Leadership.

(2020) Summer School Enrollment and Outcomes This report focuses on students participating in summer school at MMSD during the summer of 2019. It presents enrollment information and key outcome metrics.

(2019) Hmong Student Summary This report summarizes a large number of metrics for Hmong students.

(2019) American Indian Student Summary This report summarizes a large number of metrics for American Indian students.

(2019) Class Size Summary This summary reports the average class size and the distribution of class sizes for AGR and non-AGR schools as of October 2019.

(2017) Food and Nutrition Survey This report summarizes input from elementary and middle school parents on MMSD's Food and Nutrition program.

External Research in MMSD

Any potential research project in MMSD must undergo the review process by the External Research Committee (ERC). To determine if you should submit an ERC request and learn more about this process please Visit the ERC Webpage.

MMSD Internal Data Request

If you are a central office staff member or school-based leader, and you have a specific request for data analysis, report, survey, data visualization, or Tableau dashboard, please use this request form and provide as much information as possible.

Once the request form is completed, RPEO will assign a team member to manage your request who will be in contact with you to carry out the request. Note that if you have a general inquiry about the request process, please reach out to the Research Coordinator or Director of RPEO directly:

• General data requests are managed by the Research Coordinator, Brianne Monahan.
• Board reports, large-scale evaluation work, and support for district leadership are managed by the Director of RPEO, Oriana Eversole.
• Data Dashboard development and requests are managed by the Data Warehouse & Dashboard Supervisor, Travis Grover.

RPEO makes every effort to fulfill requests in as timely a manner as possible. Response times vary based on the nature and complexity of the data request as well as staff's availability to fulfill it. With that in mind, please think about the general timeframes below when requesting your completion date. Please note that RPEO is currently prioritizing work that directly supports COVID-19 response and projects that directly support the district’s implementation and monitoring of the Strategic Framework:

• Major projects or surveys - 1 month or longer.
• Standard requests (e.g., data pulls, simple dashboard or data visualization) - typically at least 10 business days.

General Queries and Public Data Requests

If you have a general query for a member of the Research & Program Evaluation Office or if you are a not an MMSD employee and you have a data request, please email Brianne Monahan at bcmonahan@madison.k12.wi.us.