Not Recommended (10 FSE flags: 1 confirmed, 9 review): oxygen defined as "a type of gas" rather than an element. 100% gap with 14 AEC errors: five lessons introduce a particle model but define particle as "a very tiny thing" with atoms and molecules never named. 10 total FSE flags (1 confirmed, 9 review) including water molecules called "droplets." Practices 42.9% (amber).
| Program | Mystery Science |
| Unit | Grade 5: Chemical Reactions and Properties of Matter (5 lessons) |
| Lessons | (1) Are magic potions real? (2) Could you transform something worthless into gold? (3) What would happen if you drank a glass of acid? (4) What do fireworks, rubber, and Silly Putty have in common? (5) Why do some things explode? |
| Publisher | Mystery Science (Discovery Education) |
| Year | 2024 |
| Grade Band | Grade 5 (3-5 calibration) |
Not Recommended: 1 confirmed factual science error (10 FSE flags total). Oxygen is defined as "a type of gas." Oxygen is an element (atomic number 8), not a gas. Only as the diatomic molecule O₂ does it exist as a gas at standard conditions, and even O₂ can be liquid or solid at low temperatures. This is not a framing problem; the curriculum states science that is incorrect.
Beyond the FSE: Foundation 0%. Gap 100%. Map error 25.8% (17 errors: 14 AEC, 2 LAE, 1 REI-substance). The unit teaches chemical reactions using a "particle" model but defines particle as "a very tiny thing, too small to be seen." Atoms and molecules are never named. 10 FSE flags total (1 confirmed, 9 review).
Five lessons on chemical reactions through the history of alchemy. Students observe oxidation, dissolving, acid reactions, new substance formation, and gas production. A particle model is introduced in Lesson 2 and used through Lesson 5 to explain dissolving and gas pressure. The word "atom" never appears. The word "molecule" never appears. The unit gets halfway to the mechanism (it introduces sub-visible entities and has students build particle models) but stops short of naming the entity.
"We can make sense of this if we think of substances as being made of tiny particles. Particles so small that we can\'t see them, like a single grain of sugar in tea." (Lesson 2)
The unit\'s explanatory peak. Particles introduced as a visualization tool, never named as atoms or molecules.
"particle: a very tiny thing, too small to be seen" (Lesson 2 Vocabulary)
Textbook AEC error. The definition is explicitly vague.
"oxygen: a type of gas that plants release and animals breathe in" (Lesson 1 Vocabulary)
CONFIRMED FSE. Oxygen is an element, not "a type of gas." Defining an element by one state of one molecular form is a category error.
"The water in this bottle is made up of billions of teeny tiny droplets of water." (Lesson 5 Mini Lesson)
FSE_REVIEW: Water is made of molecules (H₂O), not "droplets." A droplet is a macroscopic liquid unit.
Beyond the 1 confirmed FSE (oxygen), the pipeline flagged 9 additional passages for factual-error review:
1. Water molecules called "teeny tiny droplets" (2 instances). Water is made of molecules, not droplets. A droplet is a macroscopic liquid unit that retains all liquid properties. This language invites students to imagine miniature water drops rather than molecules.
2. Density defined only as packing without mass/volume (1 instance). "When the droplets were closer together, the water was more dense." Density = mass/volume. For the same substance, packing does determine density, but the general concept taught is incomplete and will mislead when applied to different substances (e.g., helium vs. air at the same pressure).
3. Gas described as "lighter in weight" (1 instance). "All gases are real things. They\'re substances. They\'re much lighter in weight than liquids and solids." Gases are not inherently lighter in weight. Gases have lower density (less mass per unit volume), but weight depends on amount.
4. Steam conflated with water vapor (2 instances). "Gas: a state of matter, such as water when it is steam." Visible steam is actually condensed water droplets (liquid) suspended in air. The gas form of water (water vapor) is invisible.
5. Mass described as "weight" (1 instance). Weight and mass are different quantities. Weight depends on gravitational field; mass does not.
6. Oxygen defined as "a type of gas" (1 additional instance beyond the confirmed FSE). Repeats the confirmed error in a second vocabulary location.
7. Droplet-based molecular description (1 instance). Additional passage using "droplets" as the sub-visible entity for water, reinforcing the macroscopic-miniature model rather than the molecular one.
AEC (agency/erroneous causation): 14. The dominant error type. Vague "particle" entities used where atoms/molecules should be named. Every passage that says "particles" instead of "atoms" or "molecules" is an AEC error at Grade 5.
LAE (label-as-explanation): 2. Labels substituted for mechanism.
REI (reification): 1. One substance-model passage.
Every investigation is a prescribed recipe. Students follow step-by-step procedures ("dip your penny halfway for 15 seconds," "spoon six spoonfuls of vinegar into the bag"). Data collection exists but analysis is teacher-led. Students draw and revise particle models but do not use them to predict. No genuine student-to-student argumentation. Quantity is present but never student-produced: the decisive weighings happen on video and students reason from supplied values on paper. Zero PRESENT, six PARTIAL, one ABSENT.
The curriculum must first correct the confirmed factual error: oxygen is an element, not a gas. Beyond that: replace "particles" with "atoms" and "molecules" throughout (the existing particle-model language is structurally sound), resolve FSE_REVIEW passages (replace "droplets" with "molecules," add mass/volume to density), and give students more design agency in investigations.
| Total Passages Scored | 66 |
| Raw Gap Error | 100.0% (63 of 63 mechanism passages unanchored) FALSE = atoms/molecules not present before students are asked to explain. The student is navigating without a starting point. |
| Adjusted Gap Error | 100.0% (63 UNSCAFFOLDED, 0 SCAFFOLDED) UNSCAFFOLDED = no atomic grounding at all. LESSON_ATOMS = atoms mentioned elsewhere in lesson but not connected to this concept. |
| Substance-Model Errors (REI) | 1 Curriculum treats a process or outcome as a substance - "heat flows," "energy is stored," "electricity flows like water." Student builds a substance ontology. |
| Label-as-Explanation (LAE) | 2 Curriculum provides a name and treats it as an explanation - "this happens because of gravity." Student believes knowing the name IS understanding the concept. |
| Vague-Entity Errors (AEC) | 14 Curriculum uses vague entities ("tiny particles," "building blocks") without specifying atoms or molecules. Student invents their own model with macroscopic properties. |
| Factual Science Errors (FSE) | 10 total (1 confirmed, 9 review) Statements that are scientifically incorrect - not imprecise framing, but wrong. Any confirmed FSE = Not Recommended. |
| Practices | 42.9% - Mid Seven practices scored PRESENT, PARTIAL, or ABSENT and averaged: asking questions, developing and using models, planning and carrying out investigations, analyzing and interpreting data, using mathematics, constructing explanations and designing solutions, and argument from evidence. Higher is better, the opposite direction from gap and map errors. Reported but not part of the Foundation Score or the verdict. |
Particle model introduced but never anchored to atoms or molecules. 14 AEC errors from vague particle language. 10 FSE flags (1 confirmed, 9 review): oxygen defined as "a type of gas" (it is an element). The curriculum gets halfway to the mechanism but stops short of naming the entity.
Conservation of matter correctly emphasized. The particle model infrastructure is structurally sound: the fix is naming the entity. Model-drawing and revision is the strongest practice area.
Fifth Mystery Science unit. First with a confirmed FSE (oxygen-is-a-gas). The 14 AEC errors are a new pattern for this publisher: the other units had REI (substance-model) or LAE (hollow label) errors, while this one has vague-entity errors because it introduced particles without naming them. Practices 42.9% is the highest of the 3-5 band units (G4 energy was 36%).
shallow by default - No design note defends or acknowledges the omission of atoms/molecules. The particle model is introduced as a "visualization tool" rather than a description of what matter actually is. Follows conventional NGSS-aligned sequencing without stated rationale.
Evidence for every entry is published at three levels. Each level states what it contains and what it leaves out.
Scores, verdict, and the full pattern count for this unit are above: adjusted gap, REI / LAE / AEC counts, FSE status, and the seven-practice score. The analysis quotes 4 passages verbatim from the curriculum.
This file covers the unit scored on this page.
The complete classified evidence table for this unit, every extracted passage with its classification, is available to researchers, journalists, and to the publisher of the program being scored. This is a standing offer with no conditions attached and no agreement to sign.
If you think a score is wrong, say so. Challenges and our responses to them are published on the evidence and challenges page, including the ones we lose.
Have a curriculum, kit, or program you'd like us to review? Drop us a note, tell us what you want to see, we'll test it and post the results.