Project Utkarsh
Measuring Learning Outcomes at Scale, Feb–Mar 2024
Overview
The Ratnagiri Learning Outcomes Assessment was a structured, data-driven evaluation conducted in partnership with Zilla Parishad Ratnagiri to measure the effectiveness of Learning Outcome (LO)-based teaching. Ratnagiri DIET pre-defines specific LOs for each month across all subjects; teachers assess students and enter achievement data into the V-School application, which automatically analyses and presents results graphically to administrators. VOPA conducted an independent one-month study with baseline and endline assessments to validate the project's impact, demonstrating measurable learning improvements across all four subjects within a single month.
The Problem
Ratnagiri's assessment system existed but lacked independent validation. There was no clear measurement of monthly Learning Outcome achievement, limited visibility on whether teaching translated into learning, and no structured baseline-versus-endline comparison to confirm whether interventions were working.
The Solution
VOPA designed and supervised a rigorous one-month impact evaluation. Baseline assessments were conducted across 10 selected Zilla Parishad schools (5 urban, 5 rural) covering Grades 4 and 5 in four subjects: Marathi, English, EVS, and Maths. Each subject was mapped to DIET-defined Learning Outcomes, with an LO considered achieved when 50% or more questions under it were answered correctly. Teachers taught the syllabus through the LO-based intervention phase, and an endline assessment was conducted after one month using the same or closely matched question papers. The V-School platform handled data entry and automated graphical analysis for administrative dashboards.
Implementation
Baseline assessment: 2-3 February 2024, covering 672 students across 10 schools. Intervention phase: 4 February to 10 March 2024, with DIET-defined LOs guiding classroom teaching. Endline assessment: 11-12 March 2024, covering 662 students. The VOPA team was present for data collection in all 10 schools. Data quality was enforced through Standard Operating Procedures, Google Sheets macros for data entry, and random 5% daily rechecks. Across 2,612 total data entries and 144 rechecked rows, zero errors were identified.
Zero errors across 2,612 data entries and 144 independent quality rechecks, establishing one of the most rigorous data quality standards in a short-cycle field study.
Scale & Reach
Partnerships
Impact
Peak gain: Creative language and expression (Grade 4)
- Creative language use improved from 32% to 90% (+58pp)
- Contextual vocabulary understanding improved from 65% to 95% (+30pp)
- Personal expression in literature improved from 50% to 88% (+38pp)
- All 6 Marathi Learning Outcomes showed consistent positive growth
Peak gain: Engagement and comprehension
- Engagement in poems, songs, and expressive reading improved by ~25pp
- Reading with understanding improved by ~16pp
- Ability to use greetings, punctuation, and contextual language improved significantly
- Overall improvement across all English Learning Outcomes
Peak gain: Analytical and conceptual understanding
- Analytical thinking and comparison skills improved by ~27pp
- Understanding of real-world concepts improved by ~23pp
- Students showed stronger ability to express opinions based on observations
- Consistent improvement across conceptual Learning Outcomes
Peak gain: Data interpretation and application
- Data interpretation skills improved by up to 67pp
- Significant gains in applied mathematics and problem-solving
- Improvement in division, multiplication, and time calculation skills (8-16pp range)
- Basic operations remain a challenge for a subset of students
Case Story
One Month, Measurable Impact
In just one month, 10 Zilla Parishad schools in Ratnagiri produced learning gains of up to 58 percentage points in Marathi and 67 percentage points in Maths. The study proved that when assessment is aligned with curriculum, monitored with rigour, and supported by digital tools, teachers and students can show rapid, measurable improvements. This project became an important evidence reference for VOPA's subsequent district-scale FLN programmes.
Key Learnings
Measurement aligned with teaching directly improves learning outcomes, even within a single month.
Short-cycle, high-frequency assessments can drive rapid instructional improvements when results are acted on immediately.
Data quality is foundational; rigorous collection and verification protocols are as important as the assessment design itself.
Learning Outcome frameworks provide a powerful structure for both instruction and evidence-based accountability.
Independent third-party evaluation builds confidence in district-level data systems and strengthens the case for scale.
A voiceover walkthrough of the Ratnagiri LO Assessment impact presentation, explaining baseline and endline findings across all four subjects.
Ratnagiri LO Assessment Impact Evaluation Report (Feb–Mar 2024)