Earth Science | Life Science | Physical Science |
1.About this Evaluation Report 2.Content Analysis 3.Instructional Analysis
Categories | |
I. | [Explanation] This category consists of criteria for determining whether the curriculum material attempts to make its purposes explicit and meaningful to students, either in the student text itself or through suggestions to the teacher. The sequence of lessons or activities is also important in accomplishing the stated purpose, since ideas often build on each other. |
II. | [Explanation] Fostering understanding in students requires taking time to attend to the ideas they already have, both ideas that are incorrect and ideas that can serve as a foundation for subsequent learning. This category consists of criteria for determining whether the curriculum material contains specific suggestions for identifying and addressing students’ ideas. |
III. | [Explanation] Much of the point of science is to explain phenomena in terms of a small number of principles or ideas. For students to appreciate this explanatory power, they need to have a sense of the range of phenomena that science can explain. The criteria in this category examine whether the curriculum material relates important scientific ideas to a range of relevant phenomena and provides either firsthand experiences with the phenomena or a vicarious sense of phenomena that are not presented firsthand. |
IV. | [Explanation] Science literacy requires that students understand the link between scientific ideas and the phenomena that they can explain. Furthermore, students should see the ideas as useful and become skillful at applying them. This category consists of criteria for determining whether the curriculum material expresses and develops the key ideas in ways that are accessible and intelligible to students, and that demonstrate the usefulness of the key ideas and provide practice in varied contexts. |
V. | [Explanation] Engaging students in experiences with phenomena (category III) and presenting them with scientific ideas (category IV) will not lead to effective learning unless students are given time, opportunities, and guidance to make sense of the experiences and ideas. This category consists of criteria for determining whether the curriculum material provides students with opportunities to express, think about, and reshape their ideas, as well as guidance on developing an understanding of what they experience. |
VI. | [Explanation] This category consists of criteria for evaluating whether the curriculum material includes a variety of aligned assessments that apply the key ideas taught in the material. |
VII. | [Explanation] The criteria in this category provide analysts with the opportunity to comment on features that enhance the use and implementation of the curriculum material by all students. |
References |
I. Providing a Sense of Purpose
Conveying
unit purpose (Rating = Poor)
Conveying lesson/activity
purpose (Rating = Poor) Lesson purposes are typically not provided for students.
For example, in lessons 2 and 3 of the Food chapter,
an outline of the chapter activities is provided for
the teacher, but with no suggestion that it should be
conveyed to students (level C, pp. 221t, 234t). No purpose
is provided for the readings except as implied by section
headings—for example, “Photosynthesis,”
“Wheat,” “The role of chlorophyll,”
“Plant pigments,” “Burning food in
the body,” “Respiration,” “Energy,”
and “Food facts” (level C, pp. 3s, 4s, 110s,
111s, 102s). However, these section headings are not
likely to be comprehensible to students. They are not
encouraged to think about the purpose of lessons and
activities, and, typically, the lessons and activities
are not related to the chapter purpose. Furthermore,
the material never engages students in thinking about
what they have learned so far and what they need to
do next.
Justifying lesson/activity
sequence (Rating = Poor) While it might be possible to tell a story based on
the above sequence of points, the material does not
appear to do so, either in notes to the teacher or in
what the students actually encounter. Furthermore, lessons
and activities within a chapter, while all are related
to food and photosynthesis, appear to be a collection
of ideas with no evident basis for their sequence. For
example, the outlines of lessons 1–3 in the Green
Machine chapter present brief descriptions of included
activities, as follows:
[level C, p. 35t]
Lesson
2: Green Stuff
Lesson
3: Breathing Plants?
[level C, pp. 37t, 43t, 49–50t]
II. Taking Account of Student Ideas
Attending to prerequisite
knowledge and skills (Rating = Poor) The Background section found in the Teacher’s
Guide for each chapter points to earlier chapters that
relate to the ideas developed in the chapter and hence
provides some indication of where prerequisite experiences
and topics may have been addressed. However, this section
does not identify any specific prerequisite ideas or
skills or where exactly in the earlier chapters related
ideas were developed. In the Food chapter, students
compare photosynthesis and respiration (level C, pp.
221t, 227–228t, 111s). While the Teacher’s
Guide refers to the “terms introduced” in
an earlier chapter, it does not refer to specific previous
experiences with these terms (level C, p. 227t). PRIME Science treats several important prerequisites,
but it does not treat all of them before they are needed.
Preliminary ideas about chemical changes and energy
transfer are introduced early in levels A and B. For
example, level A, Chapter 1: Primrose Park develops
the prerequisite ideas that a chemical reaction or chemical
change occurs when chemicals are mixed to produce new
substances, and that many changes also involve energy
changes. Likewise, level B, Chapter 3: Fire: Friend
or Foe? introduces burning as a chemical reaction and
explicitly addresses the idea that chemical reactions
can be written in the form of word equations. Level
B, Chapter 4: Child’s Play addresses the prerequisite
ideas that energy never disappears, can only be transferred
from place to place, and can be transferred as light.
The chapter also provides students with experiences
tracing energy in physical systems and representing
energy transfer processes using energy flow diagrams.
However, the term “food” is not defined
until several chapters after its initial use. In level
C, Chapter 1: Green Machine, the text states that “we
all depend on plants for our food” (p. 1s), that
“[p]lants make their own food” (p. 3s),
and that “[p]lants are the first organisms in
all food chains” (p. 11s). But not until level
C, Chapter 5: Food, does the text explain that food
is the source of both fuel and building materials (pp.
99s, 104s). Unfortunately, even when prerequisites are treated
before they are needed, the program does not point to
later chapters where prerequisites will be needed, nor
does it refer back to its treatment of prerequisites
when presenting more advanced material. Most significantly,
it does not make connections between the ideas about
the flow of matter and energy and the prerequisite ideas
on matter and energy transformations in physical systems.
Alerting teachers to commonly
held student ideas (Rating = Poor) Furthermore, in some cases, these very troublesome
ideas are reinforced in the material. For example, the
material explains that light energy is used in photosynthesis
and then, in a different chapter, that food can be broken
down to release energy. However, it does not point out
that the energy in food comes from some of the light
energy that was captured by the plant. Since many students
have difficulties appreciating that energy cannot be
created or destroyed, they might think that the light
energy “disappeared” and that food energy
is a “new” energy. Additionally, not only is the connection not made to
the idea that the total amount of matter remains constant,
but there are statements in the material that imply
that matter is converted into energy, as, for example,
that “[r]espiration is a series of chemical reactions
that change food and oxygen into energy, carbon dioxide,
and water” (level C, p. 111s). With respect to
decomposers, the material simply states that they “obtain
their energy by breaking down the remains of dead animals
and plants,” and it includes a chart showing recycling
of matter. Minerals are included in the chart, but carbon
dioxide and water are ignored in this recycling (level
1, p. 344s). Note that this is a naive conception of
matter cycling (Smith
& Anderson, 1986).
Assisting teachers in identifying
their students’ ideas (Rating = Poor)
Addressing commonly held
ideas (Rating = Poor)
III.
Engaging Students with Relevant Phenomena
Providing variety of phenomena
(Rating = Poor) For the idea that food serves as a fuel and building
material for all organisms (Idea a), students burn peanuts,
identify the products (carbon dioxide and water), and
observe temperature changes of water (level C, pp. 108–109s,
226–227t). They also test foods for fats, carbohydrates,
and proteins (level C, pp. 100–101s, 211–212t).
However, the material does not provide phenomena that
show that all organisms (as opposed to only
humans) get their energy and building matter from their
food. To support the ideas that plants make sugars from carbon
dioxide and water (Idea c1)
and that, in the process, light energy is transformed
and stored in sugars (Idea d1),
students plan their own experiments to test the effects
of light, carbon dioxide, and temperature on the rate
of photosynthesis (level C, pp. 5s, 51–52t). They
observe the preferential absorption of light colors
by chlorophyll (level C, p. 44t, and student sheet,
p. 48t) and test for starch leaves that were grown in
the dark and in the light (level C, p. 40t, and student
sheet, p. 42t). However, the latter activity is not
explained in terms of the key idea that light energy
is being transformed, but rather in terms of
the less sophisticated idea that “[l]ight is necessary
for photosynthesis” (level C, p. 37t). No other phenomena are provided that are linked directly
to the key life science ideas.
Providing vivid experiences
(Rating = Poor)
IV. Developing and Using Scientific Ideas
Introducing terms meaningfully
(Rating = Fair) Although sometimes the use of technical terms is limited
to those needed for effective communication about key
life science ideas, more than a dozen unnecessary technical
terms are used. For example, when showing pigments found
in spinach, the figure in the text uses terms for each
color—chlorophyll a, chlorophyll b, carotene,
xanthophyll (level C, p. 4s)—that are not needed
to communicate about key ideas or related phenomena.
Also, when showing how carbon dioxide gets into a leaf,
the text uses a diagram of a leaf section labeled with
terms like “upper epidermis,” “lower
epidermis,” “palisade layer,” and
“spongy layer”; a jigsaw puzzle for students
to assemble pieces of a leaf section; and terms such
as “cuticle,” “vacuole,” “phloem,”
and “guard cell” (level C, pp. 5s, 53t).
To distinguish among types of consumers, the text uses
terms—“primary,” “secondary,”
“herbivore,” “carnivore,” “omnivore”—that
do not seem needed to communicate about key ideas. However,
none of the extra terms are required for students to
respond to questions within and at the end of the chapter,
and they are not included in the chapter summary.
Representing ideas effectively
(Rating = Poor) A few better representations are included in level
C. Students complete a work sheet that includes a flow
diagram and the word equation of photosynthesis, while
the teacher is advised to discuss the conventions of
writing such chemical equations (level C, pp. 54–55t,
and student sheet, p. 60t). This is better than other
materials that typically just give students the equation.
The analogy of respiration to burning gasoline might
be helpful for those students that are already familiar
with burning of gasoline (level C, pp. 108–110s).
Demonstrating use of knowledge
(Rating = Poor)
Providing practice (Rating
= Poor) While both the Green Machine and Food chapters provide
questions in a Things To Do section at the end of the
chapter (e.g., “Check in the library to find out
if any food crops are grown in your state,” “Make
a collection of foods that you think contain starch,”
“[M]ake a model of the inside of a plant leaf.
Explain the model to one of your friends or family members”
[level C, chapter 1, p. 17]), none of the things to
do are directly related to these key ideas.
V. Promoting Students' Thinking about Phenomena, Experiences, and Knowledge
Encouraging students to
explain their ideas (Rating = Poor)
Guiding student interpretation
and reasoning (Rating = Poor) The material then draws the analogy to how energy is
released from food in the body. But questions ask: “Which
gas, used as food, is ‘burned’ in the body?”
and “What new products are exhaled into the air?”
(level C, p. 110s). In another instance, the experience
and surrounding text are aimed at the key ideas but
the questions move students toward a much less sophisticated
concept. After examining a food chain of cabbageàslugsàskunks,
students read the text explanation: “Inside a
slug’s body, the cabbage takes part in chemical
reactions to make new materials. Some of these materials
become part of the slug’s body” (level C,
p. 13s). However, the subsequent questions ask students
to draw the food web showing the feeding relationship
instead of focusing on the matter transformations. When questions do relate to the key life science ideas,
such as the questions about the burning peanut, they
sometimes help students relate phenomena to scientific
ideas but they are not scaffolded to develop these key
ideas.
Did the burning peanut release energy?
Consider the fact that the peanut’s
oil that burns contains far less oxygen than is given
in the form of CO2 and H2O. Where do you think the missing
oxygen came from?
Copy and complete this word equation:
Food + ____ → ____ + _____ + Energy
[level C, p. 109s]
Encouraging students to
think about what they have learned (Rating = Poor)
Aligning assessment to
goals (Rating = Poor)
For the idea that food provides the energy and building
blocks for all organisms (Idea a), students are shown
a food label and are asked which one of the substances
supplies most of the energy and which one is used for
growth and repair. For the idea that plants make sugars
from carbon dioxide and water (Idea c1),
students are shown a cartoon of a pondweed giving off
gas bubbles and are asked to name the process that is
making the gas and to write its word equation. Also, they
explain where the carbon dioxide and water that are needed
to make starch come from (and how they get into the plant—which
is not part of the key idea). For the idea that plants
use light energy to make energy-rich sugars (Idea d1),
the material includes three questions that get at the
less sophisticated idea that light is needed
for photosynthesis to take place (level C, pp. 16–17s,
questions 1c, 6; p. 73t, question 2b). For the idea that
organisms break down the stored sugars into simpler substances
(Idea d3), students write
the word equation for respiration. No other tasks are
provided to assess students on the key life science ideas.
Testing for understanding
(Rating = Poor)
Using assessment to inform
instruction (Rating = Poor)
Providing teacher content
support (Minimal
support is provided.) The material rarely provides sufficiently detailed
answers to questions in the student text for teachers
to understand and interpret various student responses.
Most answers are brief and require further explanation
(e.g., “Oxygen. The Elodea have been photosynthesizing,”
[level C, p. 51t, Answers to Student Sheet 3a, item
1]). Some questions go unanswered (e.g., level C, p.
72t, Answers To Things to Do, items 3–12). The material provides minimal support in recommending
resources for improving the teacher’s understanding
of key ideas. The introductory notes of the Teacher’s
Guide includes a list of “Optional Resources”
(printed matter, video, computers, and resource centers
[e.g., level 1, pp. 28–33t]), and additional “Optional
Resources” are listed at the beginning of each
chapter (e.g., “Plants Are Alive. Flinn
Scientific, Inc.” [level C, Printed Materials,
p. 36t]). Limited descriptions for some of the references
identify topics addressed, but few of the references
are explicitly linked to specific text sections or key
ideas.
Encouraging curiosity
and questioning (Some
support is provided.) The material provides many suggestions for how to respect
and value students’ ideas. Introductory notes
in the student text generally elicit and value students’
ideas by stating, “Write your thoughts down to
see how they sound, and take a moment from time to time
to see if you have changed your ideas or have more evidence
that your thoughts were right in the first place”
(level 1, p. xvis). Also, teacher notes state that multiple
student answers should be acceptable for some questions
(e.g., level C, p. 227t, Answers to Student Sheet 2d,
items 3, 4) and ask students to record their own ideas
in many tasks (e.g., level C, p. 99s, Why do we need
food?, items 1–4). In addition, students and their
ideas are highlighted throughout the text. For example,
drawings of students with dialogue balloons illustrate
students discussing scientific ideas to be studied (e.g.,
level C, p. 16s, Things To Do, item 1), and students
are specifically referenced in some tasks (e.g., level
C, p. 73t, Sample Assessment Items with answers, item
2). The material provides a few suggestions for how to
raise questions such as, “How do we know? What
is the evidence?” and “Are there alternative
explanations or other ways of solving the problem that
could be better?” It also encourages students
to pose such questions themselves. Introductory notes
in the student text ask students to review their ideas
periodically and determine if they have more evidence
that their “thoughts were right in the first place”
(level C, p. xiiis). In addition, the material includes
a few tasks that ask students to provide evidence or
reasons in their responses (e.g., level C, p. 13s, Chomping
through the cabbage, item 2; level 1, p. 347s, item
2). The material provides some suggestions for how to avoid
dogmatism. Introductory teacher’s notes emphasize
the human focus of the material stating that ideas are
“introduced through personal and social contexts”
(e.g., level C, p. 1t), and introductory student notes
emphasize the use of multiple resources to increase
student understanding (e.g., level 1, p. xvis). The
student text portrays the nature of science as a human
enterprise in which students may participate (e.g.,
level C , pp. 100–101s, What’s in food?).
Student dialogues throughout the material often present
multiple perspectives on a scientific issue (e.g., level
C, p. 99s). However, the material also contributes to
dogmatism by providing little attention to the work
of particular practicing scientists and changes over
time in scientific thinking. In addition, single specific
responses are expected for most student tasks. The material does not provide examples of classroom
interactions (e.g., dialogue boxes, vignettes, or video
clips) that illustrate appropriate ways to respond to
student questions or ideas. However, a limited sense
of desirable student-student interactions may be gained
from procedural directions for laboratories and cooperative
group activities (e.g., level C, pp. 39-40t, Lab work
1; level C, p. 51t, Lab work 1).
Supporting all students
(Some
support is provided.) The material does not provide illustrations of the contributions of women and
minorities to science and as role models. Few contributions of any scientists
are included, in that the material instead emphasizes the role of science in
students’ everyday lives. The material suggests multiple formats for students
to express their ideas during instruction, including
individual investigations (e.g., level C, p. 122s, Things
To Do, item 1), cooperative group activities (e.g.,
level 1, p. 828t, Text application), laboratory investigations
(e.g., level C, p. 40t, Lab work 2), whole class discussions
(e.g., level 1, p. 828t, Discussion 3), essay questions
(e.g., level C, p. 111s, Respiration and plants, item
6), creative writing (e.g., level C, p. 17s, Things
To Do, item 9), and visual projects (e.g., level 1,
p. 826t, Modeling). In addition, multiple formats are
suggested for assessment, including oral discussion
(e.g., level C, p. 71t, Discussion), essay (e.g., level
C, p. 73t, Sample Assessment Items with answers, item
2b), and performance (e.g., level C, p. 17s, Things
to Do, item 8). However, the material does not usually
provide a variety of alternatives for the same
task. The material does not routinely include specific suggestions about how teachers
can modify activities for students with special needs. The material provides many strategies to validate students’ relevant
personal and social experiences with scientific ideas. Introductory teacher’s
notes emphasize the material’s focus on “personal and social contexts”
and the “applications of science” (level 1, p. 1t). Many text sections
relate specific, personal experiences students may have had to the presented
scientific concepts (e.g., level C, p. 97s). In addition, some tasks ask students
about particular personal experiences they may have had or suggest specific
experiences to have. For example, a question at the end of a chapter on plant
processes asks students to put a potted plant in a closet for a couple of days
and then to explain any differences they observe in the plant’s appearance
(level C, p. 17s, Things To Do, item 6). However, the material rarely encourages
students to contribute relevant experiences of their own choice to the science
classroom and sometimes does not adequately link the specified personal experiences
to the scientific ideas being studied (e.g., level C, p. 17s, Things To Do,
item 7).