Earth Science | Life Science | Physical Science |
1.About this Evaluation Report 2.Content Analysis 3.Instructional Analysis
Categories | |
I. | [Explanation] This category consists of criteria for determining whether the curriculum material attempts to make its purposes explicit and meaningful to students, either in the student text itself or through suggestions to the teacher. The sequence of lessons or activities is also important in accomplishing the stated purpose, since ideas often build on each other. |
II. | [Explanation] Fostering understanding in students requires taking time to attend to the ideas they already have, both ideas that are incorrect and ideas that can serve as a foundation for subsequent learning. This category consists of criteria for determining whether the curriculum material contains specific suggestions for identifying and addressing students’ ideas. |
III. | [Explanation] Much of the point of science is to explain phenomena in terms of a small number of principles or ideas. For students to appreciate this explanatory power, they need to have a sense of the range of phenomena that science can explain. The criteria in this category examine whether the curriculum material relates important scientific ideas to a range of relevant phenomena and provides either firsthand experiences with the phenomena or a vicarious sense of phenomena that are not presented firsthand. |
IV. | [Explanation] Science literacy requires that students understand the link between scientific ideas and the phenomena that they can explain. Furthermore, students should see the ideas as useful and become skillful at applying them. This category consists of criteria for determining whether the curriculum material expresses and develops the key ideas in ways that are accessible and intelligible to students, and that demonstrate the usefulness of the key ideas and provide practice in varied contexts. |
V. | [Explanation] Engaging students in experiences with phenomena (category III) and presenting them with scientific ideas (category IV) will not lead to effective learning unless students are given time, opportunities, and guidance to make sense of the experiences and ideas. This category consists of criteria for determining whether the curriculum material provides students with opportunities to express, think about, and reshape their ideas, as well as guidance on developing an understanding of what they experience. |
VI. | [Explanation] This category consists of criteria for evaluating whether the curriculum material includes a variety of aligned assessments that apply the key ideas taught in the material. |
VII. | [Explanation] The criteria in this category provide analysts with the opportunity to comment on features that enhance the use and implementation of the curriculum material by all students. |
References |
I. Providing a Sense of Purpose
Conveying
unit purpose (Rating = Fair)
Conveying lesson/activity
purpose (Rating = Poor)
Justifying lesson/activity
sequence (Rating = Poor)
II. Taking Account of Student Ideas
Attending to prerequisite
knowledge and skills (Rating = Poor)
Alerting teachers to commonly
held student ideas (Rating = Poor)
Assisting teachers in identifying
their students’ ideas (Rating = Poor) Most of the questions and tasks are not relevant to
the key life science ideas. For example, at the beginning
of the chapter on ecology (course 1, chapter 11), teacher’s
notes comment: Very few questions focus on the key life science ideas.
For the idea that plants make their own food, whereas
animal obtain food by eating other organisms (Idea b),
the question accompanying a cartoon in which a plant
is about to eat a dog asks: “Bushes get food somehow.
Is this the usual way?” (course 1, p. 312t; also
see course 1, pp. 312t, 313t, 344t; course 2, pp. 594t,
596t). Although these questions are likely to be comprehensible
to students who have not learned the scientific vocabulary
yet, teachers are given no guidance about what to do
with the students’ ideas if they are not the correct
answers. Usually questions do not ask students to make
predictions or give explanations of phenomena.
Students may believe that any changes
to the environment are destructive to all living things.
Some human-made and natural disasters may be beneficial
to some organisms. Ask students if they can think of
any organisms that might benefit from the clearing of
a forest. [course 1, chapter 11, p. 345t]
Addressing commonly held
ideas (Rating = Poor)
III.
Engaging Students with Relevant Phenomena
Providing variety of phenomena
(Rating = Poor) Worth mentioning is the fact that other phenomena that
are related to the flow of matter and energy in ecosystems
are included, but they are not explained in terms of
the key ideas. For example, students record the temperature
changes of soaked beans and dry beans, but this activity
is linked only to the term “respiration,”
assuming students understand what it means, and not
to the idea that the beans get their energy by breaking
down their stored sugars, releasing some of the energy
into the environment as heat (Idea d2)
(course 2, chapter 19, p. 596s). Science Interactions also contains a few phenomena
that ask students to draw conclusions based on insufficient
evidence. For example, students blow into bromothymol
blue solution and observe the change of color. Then,
they add Elodea plants to the beaker,
incubate them under bright light, and record the color
change (course 1, chapter 10, p. 336t, Extension Activity).
The Teacher Wraparound Edition states, “Students
should infer that photosynthesis in the plants removed
carbon dioxide from the solutions...” (course
1, chapter 10, p. 336t, Extension Activity); however,
the experiment is not controlled properly, and, as far
as students are concerned, the bright light could have
caused the color change.
Providing vivid experiences
(Rating = Poor)
IV. Developing and Using Scientific Ideas
Introducing terms meaningfully
(Rating = Poor) Similarly, when the term “photosynthesis”
is introduced, it is not linked adequately to a relevant
experience: The only endeavor to link the term to a relevant student
experience is found in the phrase: “Almost all
plants, on the other hand, do not depend on other organisms
for food. They produce their own” (p. 336s). However,
this is not likely to give students a sense of a process
that requires a special name. Some attempt is made to use photographs to link terms
to relevant experiences with ideas, though it could
be done better. For example, in introducing the term
“decomposer,” the text shows photographs
of mushrooms and a compost pile. However, these photographs
do not illustrate the process of decomposition, which
would give the term more meaning (course 1, chapter
11, p. 353s). The text does not limit the number of terms to those
needed for effective communication about these key life
science ideas. For example, course 1 introduces the
terms “chlorophyll” (chapter 10, p. 336s),
and “stomata,” “guard cells,”
“xylem,” “phloem,” “palisade,”
and “spongy layers” (chapter 10, pp. 314–315s),
and course 2 uses terms for digestive enzymes—“amylase,”
“pepsin,” “trypsin,” and “lipase”
(Chapter 18: Chemical Reactions, p. 572s). All together,
when presenting the key ideas, the text uses 22 terms
that go beyond those used in either benchmarks 6 through
8 (American
Association for the Advancement of Science, 1993)
or science standards 5 through 8 (National
Research Council, 1996).
Cellular respiration is one of the chemical
changes that goes on in an organism. The total of all
of the chemical changes that take place in an organism
is its metabolism. During the metabolism of food, heat
is released. The faster food is broken down, the greater
the amount of heat energy released. Why do you suppose
you get warm when you exercise? Could this be related
to increased metabolism from increased muscle action?
[course 1, chapter 9, pp. 298–299s]
Plants produce food in a series of chemical
reactions. The energy for these reactions comes from
sunlight. Photosynthesis is the process in which plants
use light to produce food. During photosynthesis, plants
use sunlight to change water and carbon dioxide into
sugar and oxygen. [course 1, chapter 10, p. 336s]
Representing ideas effectively
(Rating = Poor) Science Interactions provides two potentially helpful
representations. In the context of plant anatomy, there
is a diagram showing how sugar is transported from the
leaves to other parts of the plant by phloem, and how
water and minerals are absorbed by roots from the soil
(course 1, chapter 10, p. 314s, Figure 10–2).
This might help students understand the idea that plants
incorporate the sugars made in their leaves into their
other structures (Idea c2). In course 2, chapter 19,
the equation for cellular respiration is given and students
are asked to count up the atoms on both sides of the
arrow and to decide whether any atoms were created or
destroyed during respiration (p. 601s). While this is
a potentially good activity to connect respiration to
the concept of the conservation of matter, it is the
only representation at the molecular level and is probably
insufficient to make the ideas intelligible to students.
Demonstrating use of knowledge
(Rating = Poor)
Providing practice (Rating
= Poor) For the idea that plants make their own food, whereas
animals consume energy-rich food (Idea b), students
are asked to classify organisms around their homes as
producers or consumers (course 1, chapter 11, p. 352t).
To demonstrate the idea that plants make sugars from
carbon dioxide and water (Idea c1),
students are questioned about the inputs and outputs
of photosynthesis (course 1, chapter 10, p. 336st).
For the idea that plants get energy by breaking down
sugars, releasing some of the energy as heat (Idea d2),
students are to predict what will happen to the temperature
if they add water to a jar of dried beans (course 2,
chapter 19, p. 611st, Developing Skills, item 3). This
is clearly insufficient to give students a chance to
practice the key ideas and appreciate their usefulness.
Very few questions allow students to practice using
their knowledge in novel tasks or questions (i.e., tasks
that have not been presented previously). Furthermore,
question sets do not increase in complexity and there
are no suggestions for teachers to provide feedback
to students.
V. Promoting Students' Thinking about Phenomena, Experiences, and Knowledge
Encouraging students to
explain their ideas (Rating = Poor)
Guiding student interpretation
and reasoning (Rating = Poor)
Encouraging students to
think about what they have learned (Rating = Poor) Another feature, Flex Your Brain, has students write
what they know about a topic, research the topic further,
write about what they found, and compare their new knowledge
to their original statement. It is possible that students
could monitor their learning by using this feature.
However, the topics given are vague (e.g., flowers [course
1, chapter 10, p. 323t], ecosystems [course 1, chapter
11, p. 357t], and respiration [course 2, chapter 16,
p. 492t]). It is uncertain what students will investigate,
and there is no guidance or indication that the key
life science ideas will be explored.
Aligning assessment to
goals (Rating = Poor) Science Interactions does not provide a sufficient
number of assessment items across the set of key ideas
that both require the key ideas and can be answered
without additional knowledge. For some key ideas, no
assessment items are provided. Although several questions
appear to relate to the topic of matter and energy transformations,
on close inspection most of them do not focus on the
key life science ideas about matter and energy transformations.
On the one hand, some questions can be answered without
knowledge of any key ideas. For example, the question,
“Cells are ‘on-duty’ constantly, taking
in ______ and giving off ______ (course 2, Review
and Assessment, Chapter 19 Test, p. 115, item 11;
the answers are “nutrients” and “waste
products”), does not require knowledge of the
key idea that organisms break down stored sugars into
simpler substances and reassemble them into their own
body structures (Idea c3). To
respond to this question, students merely need to know
that nutrients are taken in and waste products are given
off, a simpler idea that does not specify what is transformed
into what else or even that a transformation of matter
is involved. On the other hand, some questions require
knowledge outside the scope of the key ideas. For example,
the question, “What can you infer about a cell’s
function from its number of mitochondria?” (course
2, Review and Assessment, Chapter 19 Test, p.
118, item 28), requires that students know the meaning
of the specialized term “mitochondria.”
Only a few questions focus on the key life science
ideas. For example, to assess the idea that plants use
the energy from light to make energy-rich sugars (Idea
c1), only one item is provided.
Students are to respond to the true/false question:
“Energy from the sun is stored in the form of
sugar” (course 1, Review and Assessment,
Chapter 11 Review, p. 65, item 9). For the idea that
other organisms break down the stored sugars or the
body structures of the plants they eat (or in the animals
they eat) into simpler substances and reassemble them
into their own body structures (including some energy
stores) (idea c3), only two items
are provided: “Why does exercise cause you to
exhale more carbon dioxide?” (course 2, Review
and Assessment, Chapter 16 Review, p. 96, item 18),
and ”What causes the amount of carbon dioxide
exhaled to eventually decrease?” (course 2, Review
and Assessment, Chapter 16 Review, p. 96, item 19).
Furthermore, several of the key ideas are not assessed,
such as the idea that food serves as fuel and building
material for all organisms (Idea a), or that decomposers
break down dead organisms into simpler reusable substances
(Idea c4).
Testing for understanding
(Rating = Poor)
Using assessment to inform
instruction (Rating = Poor) Furthermore, the material does not assist teachers
in interpreting student responses or provide specific
suggestions about how to use the information to modify
instruction accordingly.
Providing teacher content
support (Minimal
support is provided.) The material rarely provides sufficiently detailed
answers to questions in the student text for teachers
to understand and interpret various student responses.
Most answers are brief and require further explanation
(e.g., “Oxygen is needed to combine with food
to produce carbon dioxide, water, and energy”
[course 2, p. 580t, Understanding Ideas, item 2]). The material provides minimal support in recommending
resources for improving the teacher’s understanding
of key ideas. While the material lists references in
the introductory notes of the Teacher Wraparound
Edition (e.g., “Hancock, Judith M. Variety
of Life: A Biology Teacher’s Sourcebook.
Portland, OR: J. Weston Walch, 1987” [course 1,
p. 47T]), National Geographic resources at the beginning
of each chapter (e.g., course 2, p. 582Bt, National
Geographic Teacher’s Corner), and websites throughout
the book (e.g., course 1, p. 338t, interNET CONNECTION)
that could help teachers improve their understanding
of key ideas, the lists lack annotations about what
kinds of information the references provide or how they
may be helpful.
Encouraging curiosity
and questioning (Minimal
support is provided.) The material provides a few suggestions for how to
respect and value students’ ideas. Introductory
teacher’s notes about cooperative learning state
that students will “recognize…the strengths
of others’ [perspectives],” be presented
with “the idea that there is no one, ‘ready-made’
answer” (courses 1–3, p. 22T), and “respect
other people and their ideas” (courses 1–3,
p. 33T). Introductory teacher’s notes also state
that student responses may vary in concept mapping tasks.
Teachers are thus instructed to “[l]ook for the
conceptual strength of student responses, not absolute
accuracy” (courses 1–3, p. 26T). A special
feature, Teens in Science, describes specific students
conducting experiments and activities related to the
chapter content (e.g., course 1, p. 371st). In addition,
Design Your Own Investigation and some Investigate!
activities (e.g., course 1, pp. 514–515st, Investigate!)
are structured to be open-ended, allowing students to
pursue a laboratory task in various ways. However, teacher’s
notes often give specific expected outcomes for these
activities that may limit their intended open-ended
nature (e.g., course 1, pp. 266–267t, Design Your
Own Investigation). The material provides a few suggestions for how to
raise questions such as, “How do we know? What
is the evidence?” and “Are there alternative
explanations or other ways of solving the problem that
could be better?” But it does not encourage students
to pose such questions themselves. Specifically, the
material includes a few tasks that ask students to provide
evidence or reasons in their responses (e.g., course
1, p. 355st, Investigate! item 3; course 2, p. 599st,
Investigate! item 3). The material provides a few suggestions for how to
avoid dogmatism. Introductory teacher’s notes
state, “Science is not just a collection of facts
for students to memorize” but instead “a
process of applying those observations and intuitions
to situations and problems, formulating hypotheses,
and drawing conclusions” (courses 1–3, p.
23T). The first chapter portrays the nature of science
as a human enterprise that proceeds by trial and error
and uses many skills familiar to students (pp. 2–17st).
However, most of the text is generally presented in
a static, authoritative manner with little reference
to the work of particular practicing scientists, and
single specific responses are expected for most student
tasks. The material does not provide examples of classroom
interactions (e.g., dialogue boxes, vignettes, or video
clips) that illustrate appropriate ways to respond to
student questions or ideas. However, a limited sense
of desirable student-student interactions may be gained
from procedural directions for laboratories and cooperative
group activities (e.g., course 1, pp. 354–355st,
Investigate!; course 3, pp. 354–355st, Investigate!;
Cooperative Learning in the Science Classroom
resource book).
Supporting all students
(Some
support is provided.) The material provides some illustrations of the contributions
of women and minorities to science and as role models.
While the introductory teacher’s notes state the
goal of multicultural education as promoting “the
understanding of how people from different cultures
approach and solve the basic problems all humans have
in living and learning” (courses 1–3, p.
25T), most of the contributions of women and minorities
appear in special features. Science Connections emphasize
associations among the various science disciplines and
society. Some of these essays describe scientific contributions
of women and minorities (e.g., course 1, p. 340st, History
Connection). In addition, Multicultural Perspectives
teacher’s notes highlight specific cultural contributions
related to chapter topics (e.g., course 3, p. 355t).
A separate Multicultural Connections resource
book contains short readings and questions about individual
scientists or groups addressing text-related issues
in many parts of the world. For example, the book includes
a reading activity about Native Americans’ use
of plants in their medicinal treatments (e.g., Multicultural
Connections, p. 23). All of these sections highlighting
cultural contributions are interesting and informative
but may not be seen by students as central to the material
because they are presented in sidebars, supplemental
materials, and teacher’s notes. The material suggests multiple formats for students
to express their ideas during instruction, including
individual investigations (e.g., course 2, p. 596st,
Find Out!), journal writing (e.g., course 1, p. 344s,
Science Journal), cooperative group activities (e.g.,
course 2, p. 601t, Going Further), laboratory investigations
(e.g., course 3, pp. 354–355st, Investigate!),
whole class discussions (e.g., course 2, p. 594t, Discussion),
essay questions (e.g., course 1, p. 342st, Understanding
Ideas, item 5), concept mapping (e.g., course 2, p.
611st, Developing Skills, item 1), and visual projects
(e.g., course 1, p. 327t, Visual Learning). In addition,
multiple formats are suggested for assessment, including
oral discussion (e.g., course 1, p. 336t, Discussion),
essay (e.g., Computer Test Bank Manual, course
2, pp. 19–20, item 24), performance (e.g., course
2, p. 613t, Assessment), and portfolio (e.g., course
1, p. 356t, Across the Curriculum). However, the material
does not usually provide a variety of alternatives for
the same task (except in rare instances for
special needs students). The material does not routinely include specific suggestions
about how teachers can modify activities for students
with special needs. However, the Teacher Wraparound
Edition and supplemental Program Resources provide
additional activities and resources for students
of specific ability levels. At the beginning of each
chapter, teacher’s notes link the various chapter
activities to different learning styles (e.g., course
1, p. 344t, Learning Styles), and each activity is coded
according to ability level (courses 1–3, p. 33T).
Each chapter also includes a Meeting Individual Needs
feature, which provides activities specifically designated
for students with special needs (e.g., course 2, p.
595t, Meeting Individual Needs). For Spanish speakers,
there are English/Spanish audiocassettes, which summarize
the student text in both languages, and a Spanish
Resources book, which translates chapter vocabulary
terms and definitions. However, the placement of supplemental
resources in individual booklets separate from the main
text may discourage their use, and the special needs
codes within chapters may discourage teachers from using
those activities with all students when appropriate.
The material provides some strategies to validate students’
relevant personal and social experiences with scientific
ideas. Many text sections begin with a brief reference
to a specific, personal experience students may have
had that relates to the presented scientific concepts
(e.g., course 1, p. 374t), Across the Curriculum, Daily
Life and How It Works resource book work sheets—ask
students about particular, personal experiences they
may have had or suggest specific experiences to have.
For example, teacher’s notes ask students to make
a list of the changes in their bodies before, during,
and after exercise and to describe how these changes
provide evidence of respiration (course 2, p. 595t,
Across the Curriculum, Daily Life). However, the material
rarely encourages students to contribute relevant experiences
of their own choice to the science classroom and sometimes
does not adequately link the specified personal experiences
to the scientific ideas being studied (e.g., course
1, p. 273t, Science at Home). Overall, support is brief
and localized.