Evidence and Challenges

What we publish, what we hold back and why, and every challenge to a score alongside our response.

Three levels, and what each one contains

Every entry on this Ledger publishes its evidence at three levels. The levels exist because the honest constraint on the middle one is legal, not editorial, and saying so plainly is better than quietly posting less than we have.

1On the entry page

Scores, verdict, adjusted gap, REI / LAE / AEC counts, factual-error status, the seven-practice result, and passages quoted verbatim from the curriculum with their location. Free, no request, no account.

2The curated evidence file

A downloadable spreadsheet, in Excel and CSV, of 8 to 12 passages per unit.

The selection rule, stated so you can check whether we followed it. The passages are chosen to illustrate every pattern the pipeline found in that unit, including the patterns that count in the program's favor. Where a pattern recurs, one representative instance is included and the full count is reported on the entry page rather than reproduced in the file. Passages are verbatim and identified by location. This is a sample, not the evidence table, and it is selected by us. If you want to audit the selection rather than trust it, request the full dataset at level 3 and compare.
3The full dataset

The complete classified evidence table for any unit: every extracted passage, its classification, and the scoring decision attached to it. Available to researchers, journalists, and to the publisher of the program being scored. No agreement to sign and no conditions attached.

Why it is not simply posted. A complete passage-level table reproduces a substantial portion of a copyrighted work. Quoting selectively for analysis and criticism is one thing; republishing the extracted body of a program is another, and doing it would expose the Ledger to a takedown that would take the analysis down with it. So the full tables move on request instead of sitting on a public URL. That is a real limitation on transparency and we would rather name it than pretend the curated file is everything we have.

Challenging a score

If you think a result is wrong, tell us which passage or which classification is wrong and why. We will send the underlying data for that unit so the disagreement is about evidence rather than impressions.

Every challenge is published here with our response, including the ones where we were wrong and corrected the score. A challenge that we lose changes the entry and is logged as a correction. Publishers who fix the underlying problem can send the revised material for a rescore; the entry is then updated and both results stay visible, because a program that improved should be able to show that it improved.

Challenge log

No challenges have been submitted yet. When one is, it appears here with the date received, the unit, the specific claim, our response, and whether the score changed. Entries are not removed from this log after they are resolved.

Files currently available

Every curated evidence file on the site, in one place.

UnitPublisher PassagesDownload
ACS Inquiry in Action - Grade 2 Chapter 1 (Lessons 1.1–1.4 as unit)ACS12xlsx · csv
ACS Inquiry in Action - Grade 2, Lesson 2.1: Liquids Have PropertiesACS10xlsx · csv
ACS Inquiry in Action - Grade 2, Lesson 3.1: Dissolving Is a PropertyACS11xlsx · csv
ACS Inquiry in Action - Grade 2, Lesson 4.1: Float and SinkACS11xlsx · csv
ACS Inquiry in Action - Grade 2 Chapter 5 (Lessons 5.1–5.2 as unit)ACS12xlsx · csv
ACS Inquiry in Action - Grade 2 Chapter 6 (Lessons 6.1–6.2 as unit)ACS12xlsx · csv
OpenSciEd Elementary - Grade K, Unit K.1: Why do some surfaces get hot and how can we make them less hot? (Energy: Sunlight)OpenSciEd12xlsx · csv
OpenSciEd Elementary - Grade K, Unit K.2: How can we be prepared for the weather? (Weather)OpenSciEd12xlsx · csv
OpenSciEd Elementary - Grade K, Unit K.3: How can we move things to where we want them to go? (Forces & Motion)OpenSciEd12xlsx · csv
OpenSciEd Elementary - Grade 1, Unit 1.1: How can we read under covers when it is dark?OpenSciEd12xlsx · csv
OpenSciEd Elementary - Grade 2, Unit 2.2: How can we design a new toy?OpenSciEd12xlsx · csv
OpenSciEd Elementary - Grade 3, Unit 3.1: How can we design objects to balance and move in different ways?OpenSciEd12xlsx · csv
OpenSciEd Elementary - Grade 4, Unit 4.1: Why does an object's motion change? (Energy Transfer: Collisions)OpenSciEd12xlsx · csv
OpenSciEd Elementary - Grade 4, Unit 4.2: How do we power clocks and other devices? (Energy Transfer: Electricity)OpenSciEd12xlsx · csv
OpenSciEd Elementary - Grade 5, Unit 5.2: How can we make water healthy for all living things? (Matter Properties)OpenSciEd12xlsx · csv
OpenSciEd Middle School - Grade 6, Unit 6.1: Light & Matter (One-Way Mirror)OpenSciEd12xlsx · csv
OpenSciEd Middle School - Grade 6, Unit 6.2: Thermal Energy (Cup Design)OpenSciEd12xlsx · csv
OpenSciEd Middle School - Grade 6, Unit 6.6: Cells & Systems (Healing)OpenSciEd12xlsx · csv
OpenSciEd Middle School - Grade 7, Unit 7.1: Chemical Reactions & Matter (Bath Bombs)OpenSciEd14xlsx · csv
OpenSciEd Middle School - Grade 7, Unit 7.2: Chemical Reactions & Energy (Homemade Heater)OpenSciEd12xlsx · csv
OpenSciEd Middle School - Grade 7, Unit 7.4: Matter Cycling & Photosynthesis (Maple Syrup)OpenSciEd14xlsx · csv
OpenSciEd Middle School - Grade 8, Unit 8.1: Contact Forces (Collisions / Broken Phone)OpenSciEd12xlsx · csv
OpenSciEd Middle School - Grade 8, Unit 8.2: Sound Waves (Truck Speaker → Window)OpenSciEd13xlsx · csv
OpenSciEd Middle School - Grade 8, Unit 8.3: Magnets / Forces at a Distance (Speaker)OpenSciEd14xlsx · csv
PhD Science - Level K Module 1: Weather (Cliff Dwellings at Mesa Verde)PhD Science15xlsx · csv
PhD Science - Level K Module 2: Pushes and Pulls (Tugboats Moving Cargo Ships)PhD Science14xlsx · csv
PhD Science - Level 1 Module 2: Light (Wayang Shadow Puppetry)PhD Science14xlsx · csv
PhD Science - Level 1 Module 3: Sound (Recycled Orchestra of Cateura)PhD Science14xlsx · csv
PhD Science - Level 2 Module 1: Matter (Birds Building Nests)PhD Science14xlsx · csv
RS4K - Science Book 1 — Chemistry (Chapters 2-5)RS4K12xlsx · csv
RS4K - Science Book 1 — Biology (Chapters 6-9)RS4K14xlsx · csv
RS4K - Science Book 1 — Physics (Chapters 10-13)RS4K14xlsx · csv
RS4K - Science Book 1 — Geology (Chapters 14-17)RS4K9xlsx · csv
RS4K - Science Book 1 — Astronomy (Chapters 18-21)RS4K9xlsx · csv
RS4K - Science Book 2 — Chemistry (Chapters 2-5)RS4K13xlsx · csv
RS4K - Science Book 2 — Biology (Chapters 6-9)RS4K9xlsx · csv
RS4K - Science Book 2 — Physics (Chapters 10-13)RS4K13xlsx · csv
RS4K - Science Book 2 — Geology (Chapters 14-17)RS4K11xlsx · csv
RS4K - Science Book 2 — Astronomy (Chapters 18-21)RS4K11xlsx · csv
RS4K - Science Book 3 — Chemistry (Chapters 2-5)RS4K12xlsx · csv
RS4K - Science Book 3 — Biology (Chapters 6-9)RS4K10xlsx · csv
RS4K - Science Book 3 — Physics (Chapters 10-13)RS4K11xlsx · csv
RS4K - Science Book 3 — Geology (Chapters 14-17)RS4K14xlsx · csv
RS4K - Science Book 3 — Astronomy (Chapters 18-21)RS4K14xlsx · csv
RS4K - Science Book 5 — Chemistry (Chapters 2–5)RS4K10xlsx · csv
RS4K - Science Book 5 — Biology (Chapters 6–9)RS4K10xlsx · csv
RS4K - Science Book 5 — Physics (Chapters 10–13)RS4K10xlsx · csv
RS4K - Science Book 5 — Geology (Chapters 14–17)RS4K10xlsx · csv
RS4K - Science Book 5 — Astronomy (Chapters 18–22)RS4K10xlsx · csv
RS4K - Science Book 6 — Chemistry (Chapters 2–5)RS4K10xlsx · csv
RS4K - Science Book 6 — Biology (Chapters 6–9)RS4K10xlsx · csv
RS4K - Science Book 6 — Physics (Chapters 10–13)RS4K10xlsx · csv
RS4K - Science Book 6 — Geology (Chapters 14–17)RS4K10xlsx · csv
RS4K - Science Book 6 — Astronomy (Chapters 18–22)RS4K10xlsx · csv
BFSU Vol I - Lesson A-2: Distinguishing Solids, Liquids, and GasesBFSU12xlsx · csv
BFSU Vol I - Lesson A-3: Air Is a Substance and the Concept of the AtmosphereBFSU12xlsx · csv
BFSU Vol I - Lesson C-1: Concepts of Energy IBFSU12xlsx · csv
BFSU Vol I - Lesson C-2: Sound, Vibrations, and EnergyBFSU12xlsx · csv
BFSU Vol I - Lesson C-3: Concepts of Energy II - Kinetic and Potential Energy and the Flow of EnergyBFSU12xlsx · csv
BFSU Vol I - Lesson C-3A: Energy and ForceBFSU12xlsx · csv
BFSU Vol I - Lesson C-4: Concepts of Energy III - Distinguishing between Matter and EnergyBFSU12xlsx · csv
BFSU Vol I - Lesson C-5: InertiaBFSU12xlsx · csv
BFSU Vol I - Lesson C-6: FrictionBFSU12xlsx · csv
BFSU Vol I - Lesson C-7: Push Pushes Back (Newton's Third Law)BFSU12xlsx · csv
R.E.A.L. Science Odyssey - Physics Level 1RSO12xlsx · csv
R.E.A.L. Science Odyssey - Biology Level 1RSO12xlsx · csv
R.E.A.L. Science Odyssey - Chemistry Level 1RSO12xlsx · csv
Mystery Science - Grade 4: Energizing EverythingMystery Science15xlsx · csv
Mystery Science - Grade 1: Lights & SoundsMystery Science10xlsx · csv
Mystery Science - Grade 2: Material PropertiesMystery Science11xlsx · csv
Mystery Science - Grade 2: States of MatterMystery Science10xlsx · csv
Mystery Science - Grade 5: Chemical Reactions and Properties of MatterMystery Science10xlsx · csv
Sprocket Learning — Grade K: Pushes and PullsSprocket10xlsx · csv
Sprocket Learning — Grade K: Weather and EnergySprocket10xlsx · csv
Sprocket Learning — Grade 4: EnergySprocket10xlsx · csv
Sprocket Learning — Grade 4: WavesSprocket10xlsx · csv
Sprocket Learning — Grade 5: Chemistry of TasteSprocket10xlsx · csv
TERC — The Inquiry Project: Investigating Things in My WorldTERC10xlsx · csv
TERC — The Inquiry Project: Investigating Earth MaterialsTERC10xlsx · csv
TERC — The Inquiry Project: Investigating Water TransformationsTERC10xlsx · csv

← Back to Science Ed Ledger

Request a Review

Have a curriculum, kit, or program you'd like us to review? Drop us a note, tell us what you want to see, we'll test it and post the results.