Mystery Science - Grade 4: Energizing Everything

Mystery Science · 3-5
✕ Not Recommended Shallow by Design

Mystery Science Grade 4 "Energizing Everything" defines energy as invisible "stuff" stored inside objects that travels and transfers - the substance misconception, asserted as fact - with no atomic grounding (100% gap, 12 reification errors). Foundation 0%: Shallow by design. Practices are scripted and low-agency (36%, amber); the physics is factually accurate.

Foundation Score
0%
Shallow
Gap: 100% · Map errors: 12 (×3 = 36 pts)
What-Why Gap
100%
Full gap - atoms/molecules never introduced before explanations expected
Map Errors
80%
Significant error rate - systematic ontological mismatches in explanatory language
Factual Errors
0
No factual errors detected.
Practices
36%
Mid
Some practices are present, but significant types are missing from the unit entirely. Reported, and does not affect the verdict.
Program Information
ProgramMystery Science
UnitGrade 4: Energizing Everything (5 lessons)
Lessons(1) How is your body similar to a car? (2) What makes roller coasters go so fast? (3) How can marbles save the world? (4) Could you knock down a building using only dominoes? (5) Can you build a chain reaction machine?
PublisherMystery Science (Discovery Education)
Year2024
Grade BandGrade 4 (3-5 calibration)

Verdict and Foundation

Mystery Science Grade 4 "Energizing Everything" scores Foundation 0%. This is a two-axis result, and both axes are weak. The unit teaches energy as an invisible substance that is stored inside objects, contained, released, transferred, and takes "forms," and it never grounds any of it in atoms or molecules. Practices score 36% (amber): the activities are engaging and well-produced, but they are procedurally scripted and low-agency.

What Students Learn

Across five lessons the unit covers: energy in food and fuels (L1), gravitational/"height" energy and potential-to-kinetic conversion on roller coasters (L2), energy transfer in collisions (L3), stored energy and transfer in falling dominoes (L4), and chain-reaction machines (L5). The physics, described observationally, is accurate. The problem is not factual error. It is ontology: every causal claim is framed in the substance metaphor, and none is connected to the particle level.

Key Evidence

"Inside a battery, inside of food, inside of gasoline, there is something stored up, which, when it gets released, makes things start moving. That thing... that\'s what energy is." (L1)
"Putting something up high is a way to store energy in something... all that stored energy gets released." (L2)
"The energy went from the first marble to the second marble. It transfers from one to the other." (L3)
"Being at the top of a hill gives the train a lot of that invisible stuff that\'s called \'energy.\' Energy is strange stuff... energy is the stuff that makes things happen." (L5 reading)

Each of these treats energy as a material that occupies, enters, and leaves objects. Under the OAO (Objects-Actions-Outcomes) test, energy is the outcome/measurement of objects interacting, not an object itself, so each is scored as an REI-substance mismatch.

Two grades of REI

10 of 12 errors are by-convention substance shorthand (ordinary physics language). 2 are asserted-as-definition, which is qualitatively worse: the curriculum raises the correct objection ("it\'s not an object") and then overrides it, telling students energy is nevertheless a real "thing"/"stuff" located inside objects. This is why the depth label is "by design" rather than "by default."

Practices (36%, amber)

On first impression the unit looks practice-rich: there is a hands-on build in every lesson. But scored for student agency rather than "an activity happened," the practices are thin. The builds are scripted assembly of pre-designed paper kits, not student modeling. Explanations are delivered by the narrator, not constructed by students. "Collaboration" is task-division (Klunk/Boom/Crash/Pow; Clipper/Ruler). There is no argument from evidence or peer challenge, and almost no quantification. A genuine seed of engineering design (build-test-improve toward a goal) keeps several practices at PARTIAL rather than ABSENT.

Design Context

The macroscopic-only scope is consistent with NGSS 4-PS3, which defers atomic/molecular models of energy to middle school. But the depth label here is "Shallow by design" because the reification is not required by NGSS. NGSS actually cautions against the "energy is a substance" metaphor. Teaching energy as "invisible stuff stored inside things," and defending that as the truth, is Mystery Science\'s own pedagogical decision.

What Would Change This Verdict

Replace substance language ("stored inside," "contains energy," "travels," "stuff") with change/measurement language ("the spring is arranged so it can push back," "the moving marble makes the next one move," "we measure a bigger energy change"). Even one or two particle-level anchors would move the gap off 100%.

Scoring Detail
Total Passages Scored15
Raw Gap Error100% (13 of 13 mechanism passages unanchored)
FALSE = atoms/molecules not present before students are asked to explain. The student is navigating without a starting point.
Adjusted Gap Error100% (no scaffolding available - zero atomic content in unit)
UNSCAFFOLDED = no atomic grounding at all. LESSON_ATOMS = atoms mentioned elsewhere in lesson but not connected to this concept.
Substance-Model Errors (REI)12
Curriculum treats a process or outcome as a substance - "heat flows," "energy is stored," "electricity flows like water." Student builds a substance ontology.
Label-as-Explanation (LAE)0
Curriculum provides a name and treats it as an explanation - "this happens because of gravity." Student believes knowing the name IS understanding the concept.
Vague-Entity Errors (AEC)0
Curriculum uses vague entities ("tiny particles," "building blocks") without specifying atoms or molecules. Student invents their own model with macroscopic properties.
Factual Science Errors (FSE)0
Statements that are scientifically incorrect - not imprecise framing, but wrong. Any confirmed FSE = Not Recommended.
Practices36% - Mid
Seven practices scored PRESENT, PARTIAL, or ABSENT and averaged: asking questions, developing and using models, planning and carrying out investigations, analyzing and interpreting data, using mathematics, constructing explanations and designing solutions, and argument from evidence. Higher is better, the opposite direction from gap and map errors. Reported but not part of the Foundation Score or the verdict.
Curriculum-Wide Finding

Defines energy as an invisible substance stored inside objects that is released, transferred, and changes "forms" - asserting it as fact ("it is real... that\'s what energy is") and overriding the objection that energy is not an object - with no atomic grounding. Engaging but scripted, low-agency activities. Weak on both axes.

Bright Spots

Factual accuracy of the described physics is fine - no empirical or equation errors. A genuine seed of iterative engineering design (build-test-improve toward a goal). Macroscopic scope is consistent with NGSS 4-PS3 grade-banding.

Depth Classification

shallow by design - The unit affirmatively defines energy as a real substance ("it\'s not an object, but it is real... that\'s what energy is"; "energy is strange stuff... the stuff that makes things happen"). This is not inherited convention; it is an argued stance that raises and overrides the correct objection. The reification is not required by NGSS, which cautions against the substance metaphor. Shallow by design.

Unit note: Scores represent the evaluated unit only. Other units in this program may score differently. The depth label (Shallow) describes this unit's structural relationship to causal mechanism - the detail above explains whether that structure reflects deliberate design, inherited convention, or other factors.

Evidence and data

Evidence for every entry is published at three levels. Each level states what it contains and what it leaves out.

1On this page

Scores, verdict, and the full pattern count for this unit are above: adjusted gap, REI / LAE / AEC counts, FSE status, and the seven-practice score. The analysis quotes 4 passages verbatim from the curriculum.

2Download the evidence

This file covers the unit scored on this page, and it is complete: every passage scored for this unit is in it.

Excel (.xlsx)CSV15 passages · 8 KB
How these passages were selected. They were not selected. This unit was scored in full at a passage count small enough to publish whole, so this file is the complete classified evidence table, not a subset of one. Nothing scored for this unit is held back. Passages are quoted verbatim and identified by location so any claim can be checked against the source. Most entries on this Ledger carry a curated file instead, because their full tables are large enough that publishing them would reproduce a substantial portion of a copyrighted work.
3The full dataset

The file above already is the complete classified evidence table for this unit. Working notes behind the classifications, and the same data for any other unit on this Ledger, are available to researchers, journalists, and to the publisher of the program being scored, on request and with no conditions attached.

If you think a score is wrong, say so. Challenges and our responses to them are published on the evidence and challenges page, including the ones we lose.

← Back to Science Ed Ledger

Request a Review

Have a curriculum, kit, or program you'd like us to review? Drop us a note, tell us what you want to see, we'll test it and post the results.