Earth Science | Life Science | Physical Science |
1.About this Evaluation Report 2.Content Analysis 3.Instructional Analysis
Categories | |
I. | [Explanation] This category consists of criteria for determining whether the curriculum material attempts to make its purposes explicit and meaningful to students, either in the student text itself or through suggestions to the teacher. The sequence of lessons or activities is also important in accomplishing the stated purpose, since ideas often build on each other. |
II. | [Explanation] Fostering understanding in students requires taking time to attend to the ideas they already have, both ideas that are incorrect and ideas that can serve as a foundation for subsequent learning. This category consists of criteria for determining whether the curriculum material contains specific suggestions for identifying and addressing students’ ideas. |
III. | [Explanation] Much of the point of science is to explain phenomena in terms of a small number of principles or ideas. For students to appreciate this explanatory power, they need to have a sense of the range of phenomena that science can explain. The criteria in this category examine whether the curriculum material relates important scientific ideas to a range of relevant phenomena and provides either firsthand experiences with the phenomena or a vicarious sense of phenomena that are not presented firsthand. |
IV. | [Explanation] Science literacy requires that students understand the link between scientific ideas and the phenomena that they can explain. Furthermore, students should see the ideas as useful and become skillful at applying them. This category consists of criteria for determining whether the curriculum material expresses and develops the key ideas in ways that are accessible and intelligible to students, and that demonstrate the usefulness of the key ideas and provide practice in varied contexts. |
V. | [Explanation] Engaging students in experiences with phenomena (category III) and presenting them with scientific ideas (category IV) will not lead to effective learning unless students are given time, opportunities, and guidance to make sense of the experiences and ideas. This category consists of criteria for determining whether the curriculum material provides students with opportunities to express, think about, and reshape their ideas, as well as guidance on developing an understanding of what they experience. |
VI. | [Explanation] This category consists of criteria for evaluating whether the curriculum material includes a variety of aligned assessments that apply the key ideas taught in the material. |
VII. | [Explanation] The criteria in this category provide analysts with the opportunity to comment on features that enhance the use and implementation of the curriculum material by all students. |
References |
I. Providing a Sense of Purpose
Conveying
unit purpose (Rating = Fair)
Conveying lesson/activity
purpose (Rating = Fair)
Justifying lesson/activity
sequence (Rating = Poor) 2. Activity: comparing carbon dioxide use by plants
in the light and in the dark 3. Text: photosynthesis is described 4. Activity: identifying leaf pigment 5. Text: fall color changes are linked to pigments,
a word equation for photosynthesis is given, and how
substances enter leaves is considered 6. Activity: observing the opening and closing of
stomata 7. Text: how water gets into plants is described 8. Text: the support role of stems is examined (but
it is not connected to keeping plants near light) 9. Activity: listing examples of plants with herbaceous
and woody stems 10. Text: respiration is explained 11. Text: in a literature link, students write about
a weed that takes over England 12. Text: the distinction is made between vascular
and nonvascular plants, and vascular tissue is related
to plant height 13. Text: evergreen and deciduous trees are compared
in terms of dormancy and leaf fall 14. Text: the career of a landscape architect is
outlined 15. Text: the differences between annual, biannual,
and perennial plants are defined 16. Activity: relating tree rings to the age of trees.
1.
Activity: designing a greenhouse
II. Taking Account of Student Ideas
Attending to prerequisite
knowledge and skills (Rating = Poor) This lack of explicit connection may be related to
the design of the Macmillan/McGraw-Hill series. Each
unit is designed to stand alone (a school district may
choose to purchase any combination of units).
Alerting teachers to commonly
held student ideas (Rating = Fair) Several other important misconceptions, such as that
food is a requirement for growth (rather than a source
of matter for growth), that dead organisms “rot
away”(rather than that the matter from dead organisms
is converted into yet other materials), and that a plant’s
mass increases mainly due to the incorporation of matter
from carbon dioxide (a gas), are not mentioned. The
existence of these misconceptions has been reported
in several studies (Roth
& Anderson, 1987; Eisen
& Stavy, 1988; Smith
& Anderson, 1986; Stavey
et al., 1987).
Some students may still be unaware of
the fact that plants produce their own food. Students
may believe that plants take in food from the soil in
which they live. These students probably consider “plant
food” to be food for a plant. While it is true
that plants obtain a variety of mineral nutrients from
the soil (e.g., calcium, potassium, magnesium, sulfur,
phosphorus, nitrogen, and iron) by absorption through
their roots, these nutrients are not used as food. [The Plant Kingdom, p. 40t]
Assisting teachers in identifying
their students’ ideas (Rating = Fair)
Addressing commonly held
ideas (Rating = Poor) No questions designed to engage students in contrasting
their ideas with others are included, nor are there
tasks designed specifically to challenge common student
misconceptions. It is not suggested that teachers might
use knowledge of their students’ ideas to adapt
the flow of activities to their needs.
You know that plant roots and rhizoids
absorb water and dissolved nutrients from the soil.
Plants also need sunlight. In this lesson, you’ll
discover how plants use water, dissolved nutrients,
and sunlight, as well as carbon dioxide and oxygen,
to make food…. [The Plant Kingdom, p. 33s]
III.
Engaging Students with Relevant Phenomena
Providing variety of phenomena
(Rating = Poor) While other phenomena related to the topic are included,
they either do not focus on the key life science ideas,
or are not linked to them explicitly. For example, The Plant Kingdom unit, which introduces the concept of
photosynthesis, includes the following activities that
do not center on the key ideas: students design and
draw a greenhouse (this concentrates on the less sophisticated
idea of plants’ needs) (p. 33s); students observe
what happens to stomata in the presence of distilled
and salt water (the focus is on the opening and closing
of stomata and osmosis) (p. 39s); and students extract
pigments from a leaf and separate them on chromatography
paper (the focus here is that leaves contain green pigment
among others) (p. 37s). One activity is provided that could be helpful in supporting
the key idea that plants make sugars from carbon dioxide
and water (Idea c1).
However, the activity is not used to explain this key
idea. Students observe that in the presence of light,
Elodea plants “remove” carbon dioxide
from a solution, but the material does not mention that
the carbon dioxide “removed” has been incorporated
into sugar (pp. 34-35s). Likewise, for the idea that
decomposers transform dead organisms into reusable substances
(Idea c4), an activity
that could be helpful (students set up compost piles
and observe them for several weeks [Earth's Riches,
p. 9s]), is not explained in terms of this key idea.
It does not mention that decomposers transform compost
into reusable substances like carbon dioxide and water.
Providing vivid experiences
(Rating = Poor)
IV. Developing and Using Scientific Ideas
Introducing terms meaningfully
(Rating = Poor)
Representing ideas effectively
(Rating = Poor)
Demonstrating use of knowledge
(Rating = Poor)
Providing practice (Rating
= Poor)
V. Promoting Students' Thinking about Phenomena, Experiences, and Knowledge
Encouraging students to
explain their ideas (Rating = Poor)
Guiding student interpretation
and reasoning (Rating = Fair)
List the ingredients from a bottle or box
of “plant food” you get from your teacher.
However, other questions emphasize simply repeating information
from the reading or very limited application of readings.
While some of the individual questions are useful, only
the set cited above increases in complexity to try to
develop understanding.
How are these ingredients used by plants?
Is the label “plant food” really correct?
Why or why not?
[The Plant Kingdom, p. 44t]
Encouraging students to
think about what they have learned (Rating = Poor)
Aligning assessment to
goals (Rating = Poor) Unfortunately, the last two items are based on a diagram
that is unnecessarily complex (Earth’s Ecosystems,
Teacher's Resource Book, p. 18a). Students are
also shown a diagram of a food chain and are asked to
decide whether a shape of a triangle or a shape of a
square represents better the energy that flows among
organisms and to explain their preferences (Earth’s Ecosystems, Teacher's Resource Book, p. 19a, item
18). No other task is provided to assess students’
grasp of the key ideas. While some additional items were found that relate
to the topic, they focus on students’ knowledge
of terms, rather than of the key ideas. For example,
students are asked to match columns of terms to their
definitions (Earth's Ecosystems, Teacher's
Resource Book, p. 8, items 2, 8; p. 13, item 8).
Students could respond successfully to these items without
understanding the key life science ideas.
Most of the key life science ideas are not assessed.
Only one oral assessment (which asks students to compare
photosynthesis and respiration) is related somewhat
to the key ideas (The Plant Kingdom, p. 32d). However,
the suggested answer focuses on photosynthesis and respiration
being opposite processes, where the processes occur,
and whether light is required. The only similarity noted
is that the processes involve the same substances, not
that they both involve transformations of matter and
energy. In the tests in the Teacher's Resource Book, a few items are aligned with the key ideas. Students
are to choose the phrases that best complete the following
statements or questions:
Plants use carbon dioxide _______.
a. during photosynthesis
b. during respiration
c. at night
d. none of the above.
[The Plant Kingdom, Teacher's Resource Book, p.
4a, item 8; the answer is a]Plant leaves exposed to sunlight take
in and use _______ .
a. carbon dioxide
b. sugar
c. oxygen
d. all of the above.
[The Plant Kingdom, Teacher's Resource Book, p.
4a, item 10; the answer is a]________ are organisms that
break down dead materials and recycle nutrients in the
environment. [Earth’s Ecosystems,
Teacher Assessment Guide, p. 2a, item 8; the
answer is “decomposers”]
Which processes return gaseous carbon
dioxide to the cycle?
a. decomposition, respiration, and photosynthesis
b. decomposition and respiration
c. respiration and photosynthesis
d. photosynthesis and decomposition.
[Earth’s Ecosystems, Teacher's Resource Book, p. 18a, item 14; the answer is b]By what process does carbon become bound
into compounds that are food for consumers?
a. decay
b. decomposition
c. respiration
d. photosynthesis.
[Earth’s Ecosystems, Teacher's Resource Book, p. 18a, item 15; the answer is d]
Testing for understanding
(Rating = Poor)
Using assessment to inform
instruction (Rating = Poor) The material includes a few questions that can be used
to diagnose students’ remaining difficulties with
respect to the key life science ideas. Working in groups,
students illustrate photosynthesis and transpiration
using drawings of leaves and molecular diagrams (p.
41t, Checkpoint); list ingredients of “plant food,”
are asked how the ingredients are used, and whether
the label “plant food” is really correct
(p. 44s); compare photosynthesis and respiration with
respect to energy (p. 49s, item 1); and explain why
animals cannot use light energy to make food (p. 49s,
item 5). However, the material does not include suggestions
for teachers of how to probe beyond their students’
initial responses, nor does it include specific suggestions
of how to use students’ responses to make decisions
about instruction.
Providing teacher content
support (Minimal
support is provided.) The material does not usually provide sufficiently
detailed answers to questions in the student text for
teachers to understand and interpret various student
responses. Most answers are brief and require further
explanation (for example, “Student designs will
vary depending on their research and their knowledge
of plant requirements. They should take into consideration
light, temperature, moisture, air, and the amount of
space needed by specific plants” [The Plant
Kingdom, p. 33t, Activity Log, Assessing Student
Results]); emphasize a “right answer” approach
(for example, “What is an ecosystem? [A complex
system of organisms that interact with one another and
their physical and chemical environment]” [Oceans
in Motion, p. 72t, Discussion Strategies]), or
are incomplete (for example, “Corn consumed by
humans” [Earth’s Ecosystems,
p. 83t, Critical Thinking, item 4]). The material provides minimal support in recommending
resources for improving the teacher’s understanding
of key ideas. The Teacher's Planning Guide includes
a list of “Outside Resources” (books, computer
software, films, filmstrips, videos, laserdiscs, field
trips, speakers and visitors, and resource addresses)
at the beginning of each unit (e.g., The Plant Kingdom,
p. 4t). Limited descriptions for some of the references
identify topics addressed in them, but none of the references
are explicitly linked to specific text sections or key
ideas.
Encouraging curiosity
and questioning (Some
support is provided.) The material provides many suggestions for how to respect
and value students’ ideas. Teacher’s notes
state that multiple student answers should be acceptable
for some questions (e.g., Simple Organisms and Viruses,
p. 13t, Minds On!, Assessing Student Results) and ask
students to record their own ideas in many tasks, including
some Discussion Strategies and Activity Log tasks. For
example, teacher’s notes for an activity in which
students describe surviving in a sealed plastic bag
ask students to “record their ideas in the Activity
Log” (Simple Organisms and Viruses, p.
13t, Developing Critical Thinking Processes: Problem
Solving). Each Activity Log also includes a blank page
following each activity page entitled “My Notes”
in which students may record additional ideas they may
have (see separate Activity Log booklet for each unit).
The material provides a few suggestions for how to
raise questions such as “How do we know? What
is the evidence?” and “Are there alternative
explanations or other ways of solving the problem that
could be better?” But it does not encourage students
to pose such questions themselves. Specifically, the
material includes a few tasks that ask students to provide
evidence or reasons in their responses (e.g., Changes in Ecosystems, p. 13t, Activity Log; Oceans in Motion,
p. 71t, Activity Log, What Now? items 1, 2, 5). In some
instances, however, the material first asks students
about their observations (e.g., The Plant Kingdom, pp.
34–35t, Activity Log, What Happened?) and then
asks them to make inferences (e.g., The Plant Kingdom,
p. 35t, Activity Log, What Now?) without explicitly
linking the two kinds of tasks. The material provides many suggestions for how to avoid
dogmatism. For example, the material includes the work
of many cultural groups (e.g., The Plant Kingdom,
pp. 29–30s) as well as particular practicing scientists
(e.g., Simple Organisms and Viruses, p. 38s)
and describes changes over time in scientific thinking
(e.g., Changes in Ecosystems, p. 21s). In addition,
the student text portrays the nature of science as a
human enterprise in which students may participate (e.g.,
Simple Organisms and Viruses, pp. 8–9s).
However, the material also contributes to dogmatism
with some text sections being written in a static, authoritative
manner (e.g., Earth’s Ecosystems,
pp. 74–75s) and single specific responses expected
for many student tasks (e.g., The Plant Kingdom,
p. 40t, Discussion Strategies). The material does not provide examples of classroom
interactions (e.g., dialogue boxes, vignettes, or video
clips) that illustrate appropriate ways to respond to
student questions or ideas, etc. However, a limited
sense of desirable student-student interactions may
be gained from procedural directions for laboratory
and cooperative group activities (e.g., Changes in Ecosystems,
p. 34t, Discussion Strategies; The Plant Kingdom, pp.
34–35s, Explore Activity!; Oceans in Motion, pp.
70–71s, Explore Activity!).
Supporting all students
(Considerable
support is provided.) The material provides many illustrations of the contributions
of women and minorities to science and as role models.
At the beginning of each unit, a feature in the teacher’s
notes entitled “Science for Everyone: Culture
in the Classroom” briefly describes the contributions
of different cultural groups to the topics studied (e.g.,
Simple Organisms and Viruses, p. 5t). In addition,
some discussion of the contributions of particular cultural
groups as well as individual women and minority scientists
is integrated into the main student text. For example,
in the text’s discussion of protists, the material
integrates scientist Lynn Margulis’ theory about
the evolution of protists from monerans (Simple
Organisms and Viruses, p. 38s). Some contributions,
however, appear in separate features, particularly Multicultural
Perspective and Careers. The Multicultural Perspective
feature discusses contributions of particular cultural
groups, sometimes with suggestions for further student
research (e.g., Earth's Riches, p. 36t). The
Careers feature highlights various science professions
related to the lesson topics, and some of the scientists
identified are women (e.g., Oceans in Motion,
pp. 80–81s). The material also references related
trade books (e.g., Changes in Ecosystems, p.
11s) and includes readings in the Teacher's Anthology
with Classroom Library Lessons (e.g., The Plant
Kingdom, Teacher's Anthology with Classroom
Library Lessons, pp. 8–10), some of which
are authored by or describe the experiences of women
and minorities. However, the features highlighting cultural
contributions that are separated from the main text
may not be seen by students as central to the material. The material suggests multiple formats for students
to express their ideas during instruction, including
individual log writing (e.g., Simple Organisms and
Viruses, p. 13s, Minds On!; p. 13t, Activity Log),
cooperative group activities (e.g., The Plant Kingdom,
p. 41t, Checkpoint), laboratory investigations (e.g.,
The Animal Kingdom, pp. 52–53st, Explore
Activity!), whole class discussions (e.g., Simple
Organisms and Viruses, p. 16t, Discussion Strategies),
narrative writing (e.g., The Plant Kingdom,
p. 44s, Literature Link), oral and written reports (e.g.,
Earth’s Ecosystems, p. 82st,
Literature Link), and visual projects (e.g., , Earth’s
Ecosystems, Teacher's Anthology with Classroom
Library Lessons p. 21). In addition, multiple formats
are suggested for assessment, including oral (e.g.,
The Plant Kingdom, p. 32d, Oral Assessment,
item 1), concept mapping (e.g., Oceans in Motion,
Assessment Guide and Masters, p. 7), performance
(e.g., The Animal Kingdom, p. 53t, Performance
Assessment), group projects (e.g., Earth's Riches,
p. 70c, Project Ideas), and portfolio (e.g., Earth’s
Ecosystems, p. 66c, Portfolio Assessment).
However, the material does not usually provide a variety
of alternatives for the same task in either instruction
or assessment. The material does not routinely include specific suggestions
about how teachers can modify activities for students
with special needs. However, the Teacher's Planning Guide and supplemental resources (including Teacher's
Resource Book, Teacher's Anthology with Classroom
Library Lessons, Audio Tapes for Student Books,
Activity Cards, Science On-Line Masters, and Problem
Solving Software) provide additional activities
and resources for students of specific ability levels.
Each lesson in the Teacher's Planning Guide includes
a Meeting Individual Needs feature that provides activities
for students related to the lesson topics. These activities
are specifically designated for students learning English,
various learning modalities, challenge, reinforcement,
or reading comprehension (e.g., Earth’s
Ecosystems, p. 24t, Meeting Individual Needs;
The Plant Kingdom, p. 32t, Meeting Individual
Needs). However, the placement of supplemental resources
in materials separate from the main text may discourage
their use, and the special needs codes within chapters
may discourage teachers from using the activities with
all students. The material provides many strategies to validate students’ relevant
personal and social experiences with scientific ideas. Some text sections relate
specific, personal (sometimes hypothetical) experiences students may have had
to the presented scientific concepts (e.g., Oceans in Motion, p. 67s). In addition,
some tasks—including Minds On! (e.g., Changes in Ecosystems, p. 13s),
Multicultural Perspective (e.g., Earth's Riches, p. 26t), and Meeting
Individual Needs (e.g., Earth’s Ecosystems, p. 5t, item 2)—ask students
about personal experiences they may have had or suggest specific experiences
they could have. For example, an introductory Minds On! task asks students to
list their favorite foods, clothes, and sports equipment and then to trace each
item back to a plant (The Plant Kingdom, p. 8s). Teacher’s notes then
suggest that students work in groups to determine the relationships between
the items and plants (The Plant Kingdom, p. 8t, Developing Critical Thinking
Processes: Concept Formation). Additionally, teacher’s notes for assessment
suggest looking “for logical tracings back to plants or back to water
or minerals” in group reports to the class (The Plant Kingdom, p. 8t,
Assessing Student Results). For a few tasks, however, the material does not
adequately link the specified personal experiences to the scientific ideas being
studied (e.g., Oceans in Motion, p. 5t, Meeting Individual Needs, item 3).