Project 2061 LogoAAAS Project 2061
AAAS  :: Project 2061  :: Textbook Evaluations


Middle Grades Science Textbooks: A Benchmarks-Based Evaluation

Science Insights. Addison-Wesley Publishing Company, 1996 and 1997
Earth Science Life Science Physical Science

1.
About this Evaluation Report
2.
Content Analysis
3.
Instructional Analysis
[Explanation] This section examines whether the curriculum material's content aligns with the specific key ideas that have been selected for use in the analysis.
[Explanation] This section examines whether the curriculum material develops an evidence-based argument in support of the key ideas, including whether the case presented is valid, comprehensible, and convincing.
[Explanation] This section examines whether the curriculum material makes connections (1) among the key ideas, (2) between the key ideas and their prerequisites, and (3) between the key ideas and other, related ideas.
[Explanation] This section notes whether the curriculum material presents any information that is more advanced than the set of key ideas, looking particularly at whether the “beyond literacy” information interrupts the presentation of the grade-appropriate information.
[Explanation] This section notes whether the curriculum material presents any information that contains errors, misleading statements, or statements that may reinforce commonly held student misconceptions.

Alignment

Idea a: All matter is made up of particles called atoms and molecules (as opposed to being continuous or just including particles).
There is a content match. The idea that all matter is made up of particles is stated explicitly a few times in the Student Edition. Most of the instances are brief mentions made in the body of the text. The idea that “all forms of matter are made up of tiny particles that are in constant motion” is introduced as the particle model of matter in chapter 6 (p. 135s). Thereafter, the idea of particles is used to explain a few properties of substances (such as hardness and phases of matter). In chapter 7, before being introduced to the structure of the atom, students are reminded that all matter in the universe is made up of tiny particles: “A glass of water, for example, has many water particles, each too small to see” (p. 157s). The text continues by defining atoms as the building blocks of matter:
Water particles can actually be divided into even smaller units. The pieces of matter that result from dividing a water particle are no longer water. They are examples of the most basic units of matter called atoms. Atoms can’t be broken down into smaller pieces by any common methods of separating matter. Atoms are the building blocks of the universe…. [p. 157s]

On the following page, the idea is stated as one of four concepts in Dalton’s theory: “All matter is composed of tiny, indivisible particles called atoms” (p. 158s). In chapter 9, before learning about heat energy and temperature at the molecular level, students are reminded that “all matter is made up of molecules that are in constant motion” (p. 209s).

In chapter 6 and at the beginning of chapter 7, the term “particles” is used to refer to a substance’s molecules. For example, the Student Edition states:

A glass of water, for example, has many water particles, each too small to see…. Water particles can actually be divided into even smaller units. The pieces of matter that result from dividing a water particle are no longer water. They are examples of the most basic units of matter called atoms. [p. 157s]

However, on the following page, the term “particles” is used to refer to atoms: “All matter is composed of tiny, indivisible particles called atoms” (p. 158s). After a molecule is defined as a single particle of a substance (such as water) made up of two or more atoms (chapter 7, p. 170s), the term “molecule” is used to describe ideas related to the kinetic molecular theory. In Science Insights: Exploring Matter and Energy, the atomic theory is not contrasted to naive theories (such as matter being continuous or just including particles), as the statement of the key idea does.

Idea b: These particles are extremely small—far too small to see directly through a microscope.

There is a partial content match. The following presentation of Idea b shows which parts of the idea are treated (in bold) and what alternative vocabulary, if any, is used (in brackets): These particles are extremely small—far too small to see directly through a microscope. A few times, the Student Edition refers to the particles that matter is made of as tiny (for example, “All forms of matter are made up of tiny particles that are in constant motion” [p. 135s]). In two instances, it is stated that even the tiniest piece of matter contains a huge number of particles (pp. 135s, 138t). Also, in two instances, the text mentions that the particles that make up matter are too small to see, but does not clarify the statement further (pp. 135s, 157s). The component called Themes in Science asserts that under a microscope individual cells can be seen, and that with an electron microscope, scientists can see that living and nonliving matter is composed of very tiny particles (p. 135t). However, the text does not make clear that atoms and molecules cannot be seen with a light microscope (the kind with which students are familiar). The same component suggests that students should “describe a blueberry muffin from across the classroom, from two meters away, and using a hand lens” but does not suggest that (or how) teachers can link this activity to the composition of matter or the size of particles (p. 135t).

Idea c: Atoms and molecules are perpetually in motion.

There is a content match. The idea that particles are moving constantly is mentioned briefly in a few instances in the Student Edition. The idea that “all forms of matter are made up of tiny particles that are in constant motion” is introduced as the particle model of matter in chapter 6 (p. 135s). The idea of moving particles appears in a section describing the different motions of particles in solids, liquids, and gases, but it is not stated explicitly that particles of all substances are in constant motion in all phases. Before the concept of temperature is linked to molecular motion, the text refers to specific substances whose molecules are constantly in motion:
Recall that all matter is made up of molecules that are in constant motion. The gas molecules that make up air move freely all around you. Molecules of water move about in a container. The molecules in your chair constantly move back and forth, or vibrate. [p. 209s]

Idea d: Increased temperature means greater molecular motion, so most substances expand when heated.

There is a content match. The idea that increasing the temperature of a substance (or adding heat energy to a substance) increases the motion (or speed) of its particles appears in the Student Edition in a variety of contexts. It is introduced briefly in chapter 6 in the explanation of properties of matter: “The speed of particle movement changes with temperature. As the temperature increases, the speed of the particles in matter increases. Particle movement determines whether a substance will be a solid, liquid, or gas” (p. 138s). Then, it is used to define the relationship between the temperature of a gas and its volume. Chapter 9 uses the idea that increased temperature means greater molecular motion to explain heat transfer by conduction and convection, melting, and boiling. It also links the idea to thermal expansion and accounts for the thermal expansion of liquids in thermometers. Chapter 15: Sound uses the idea to elucidate the increase in the speed of sound when the temperature of the air increases, and Chapter 21: Solution Chemistry explains why temperature affects solution rate.

In chapter 9, “temperature” is defined as “[t]he measurement of the average kinetic energy of the molecules in a substance” (p. 209s). However, kinetic energy is not related to thermal expansion. In the explanations given of heat transfer, thermal expansion, and changes of state, the simpler idea that increased temperature means greater motion is used.

Idea e: There are differences in the arrangement and motion of atoms and molecules in solids, liquids, and gases. In solids, particles (1) are packed closely, (2) are (often) arranged regularly, (3) vibrate in all directions, (4) attract and “stick to” one another. In liquids, particles (1) are packed closely, (2) are not arranged regularly, (3) can slide past one another, (4) attract and are connected loosely to one another. In gases, particles (1) are far apart, (2) are arranged randomly, (3) spread evenly through the spaces they occupy, (4) move in all directions, (5) are free of one another, except during collisions.

There is a partial content match. The following presentation of Idea e shows which parts of the idea are treated (in bold) and what alternative vocabulary, if any, is used (in brackets): There are differences in the arrangement and motion of atoms and molecules in solids, liquids, and gases. In solids, particles (1) are packed closely, (2) are (often) arranged regularly, (3) vibrate in all directions, (4) attract and “stick to” one another. In liquids, particles (1) are packed closely, (2) are not arranged regularly, (3) can slide past one another, (4) attract and are connected loosely to one another. In gases, particles (1) are far apart, (2) are arranged randomly, (3) spread evenly through the spaces they occupy, (4) move in all directions, (5) are free of one another, except during collisions. Almost all of the parts of Idea e are addressed once in Chapter 6: Properties of Matter, in the description of the phases of matter. However, some parts are not covered; they are item 4 of solids, item 4 of liquids, item 2 of gases, the concept of particles being “spread evenly” in item 3 of gases, and the concept of their moving freely “except during collisions” in item 5 of gases. The different motion of the particles of solids, liquids, and gases is illustrated with an analogy to the movement of children in and after class. The different arrangement and motion of particles of solids and liquids are linked briefly to the definite shape and volume of solids and to the lack of definite shape of liquids. The text states that particles of gases do not stick to one another and that, “[u]nlike the particles in a solid or liquid, each gas particle is mostly unaffected by its neighbors” (p. 142s). In addition, the different strength of attraction between particles of diamond, graphite, and soot is connected to the fact that these materials have different properties (without stating what the properties are). However, the ideas that particles in all solids and liquids attract one another, or that particles in solids “stick to” one another, while particles in liquids are connected loosely to one another are not addressed specifically.

Idea f: Changes of state—melting, freezing, evaporating, condensing—can be explained in terms of changes in the arrangement, interaction, and motion of atoms and molecules.

There is a partial content match. The following presentation of Idea b shows which parts of the idea are treated (in bold) and what alternative vocabulary, if any, is used (in brackets): Changes of state—melting, freezing, evaporating, condensing—can be explained in terms of changes in the arrangement, interaction, and motion of atoms and molecules. There are brief and incomplete explanations of melting, boiling, and evaporation, but only in terms of the increased motion of a substance’s molecules. For example: “When heat is applied to ice, the water molecules in the ice vibrate faster. The ice melts as it changes from a solid to a liquid” (p. 222s). Explanations of freezing and evaporation at the molecular level are not included.

Building a Case

The text asserts the key ideas without developing an evidence-based argument to support them.


Coherence

The key ideas are treated mostly as isolated pieces of information in chapters that are organized around topics, rather than around a coherent set of physical science concepts. Although the text occasionally mentions that students have had experience with an idea—for example, before defining temperature as the measurement of the average kinetic energy of the molecules in a substance, students are asked to “Recall that all matter is made up of molecules that are in constant motion” (p. 209s)—this is not done systematically, nor are the experiences described specifically. For instance, the idea that increased temperature means greater molecular motion appears in several places. In chapter 6, this idea comes up in the context of Charles’ Law; in chapter 9, it is used to explain the thermal expansion of liquids in thermometers in the discussion of measuring temperature; later in the same chapter, it is used to define and explain thermal expansion in general and to give examples of thermal expansion. However, no connections are made between these instances.

Like every chapter in Science Insights: Exploring Matter and Energy, the chapters that are related closely to the kinetic molecular theory include numerous features (e.g., Themes in Science, Integrating the Sciences, STS Connection) that are intended to integrate the sciences, connect science to other disciplines, and integrate science, technology, and society (p. T–35). However, the connections to be made do not contribute to students’ understanding of the key physical science ideas. For example, some features simply emphasize labeling various phenomena as physical changes (e.g., pp. 147t, 148t).

In other cases, the connection that the material tries to make is contrived and relates only tangentially to the content of the section. For example, in a section on the properties of gases and their explanation at the molecular level, the text states in Integrating the Sciences that during photosynthesis, plants release oxygen [a gas] into the air and suggests that students see bubbles of oxygen forming on plant leaves in an aquarium (p. 142s).



Beyond Literacy

Science Insights: Exploring Matter and Energy goes far beyond the key idea that all matter is made up of atoms and includes content that is more appropriate for high school students, well beyond the scope of the science literacy ideas in Benchmarks for Science Literacy (American Association for the Advancement of Science, 1993) and National Science Education Standards (National Research Council, 1996). For example, the text examines Thomson’s, Rutherford’s, and Bohr’s models of the atom, the electron cloud model, the structure of the nucleus, atomic numbers and isotopes, and mass number and atomic mass. However, when treating the kinetic molecular theory, the material does not go too much beyond the level of sophistication of the key ideas.

Accuracy

The evaluation teams developed a summary assessment of the most common kinds of errors found in each of the three subject areas—physical science, Earth science, and life science. In this context, “errors” is taken to mean not only outright inaccuracies, but also those instances in which the material is very likely to lead to or support student misconceptions. Overall, inducement to misconstrue is the most serious problem of accuracy in the evaluated materials.

The evaluation teams’ collective findings, presented below, should be taken as having general applicability to all of the evaluated materials, not complete and specific applicability in toto to any one of them.

Identified errors occur most frequently in drawings and other diagrams. They take the form of representations that are likely to either give rise to or reinforce misconceptions commonly held by students. Following are physical science examples of the kinds of misleading illustrative materials of most concern to the evaluation teams:

  • Diagrams and drawings that show atoms or molecules of solids, liquids, and gases in colored backgrounds (for example, water molecules inside blue drop shapes) and that thereby can initiate or reinforce the misconception that particles are contained in solids, liquids, and gases, in contrast to the correct idea that substances consist of particles (with empty space between particles). This misconception may be further reinforced by the wording of diagram labels, such as “solid particles in solid water and water particles in liquid water” (emphasis added). Similarly, statements such as “explanations for what is inside things” may imply that matter contains particles (as well as other things), rather than that matter is made of particles.

  • Diagrams of solids (and occasionally liquids) that do not depict the motion of atoms or molecules can give rise to, or reinforce, the misconception that atoms or molecules of solids (or liquids) are still.

  • Diagrams that show molecules of liquids much farther apart than the molecules of solids are misleading; in most liquids, molecules are only a little farther apart.

  • Diagrams that show particles of a substance in the solid, liquid, and gaseous state in different colors can reinforce the erroneous idea that the particles themselves are different, not their arrangement and motion. Similarly, diagrams that show particles of a substance changing size as the substance changes state can give rise to the misconception that the molecules themselves change size, becoming larger when heated.

The use of imprecise of inaccurate language is problematic in text materials, not solely in illustrations. Specifically, language that does not maintain a clear distinction between substances and atoms or molecules can mislead students to attribute macroscopic properties or behavior (such as hardness, color or physical state) to individual atoms or molecules. For example, statements such as “the particles of perfume are moving farther apart as they change into a gas and diffuse throughout the air,” “write a story from the point of view of a particle in the solid phase as it melts and then evaporates,” and “draw what happens when the particles change state” (emphasis added) imply inaccurately that the particles themselves change state (melt, evaporate, etc.).