Earth Science | Life Science | Physical Science |
1.About this Evaluation Report 2.Content Analysis 3.Instructional Analysis
Categories | |
I. | [Explanation] This category consists of criteria for determining whether the curriculum material attempts to make its purposes explicit and meaningful to students, either in the student text itself or through suggestions to the teacher. The sequence of lessons or activities is also important in accomplishing the stated purpose, since ideas often build on each other. |
II. | [Explanation] Fostering understanding in students requires taking time to attend to the ideas they already have, both ideas that are incorrect and ideas that can serve as a foundation for subsequent learning. This category consists of criteria for determining whether the curriculum material contains specific suggestions for identifying and addressing students’ ideas. |
III. | [Explanation] Much of the point of science is to explain phenomena in terms of a small number of principles or ideas. For students to appreciate this explanatory power, they need to have a sense of the range of phenomena that science can explain. The criteria in this category examine whether the curriculum material relates important scientific ideas to a range of relevant phenomena and provides either firsthand experiences with the phenomena or a vicarious sense of phenomena that are not presented firsthand. |
IV. | [Explanation] Science literacy requires that students understand the link between scientific ideas and the phenomena that they can explain. Furthermore, students should see the ideas as useful and become skillful at applying them. This category consists of criteria for determining whether the curriculum material expresses and develops the key ideas in ways that are accessible and intelligible to students, and that demonstrate the usefulness of the key ideas and provide practice in varied contexts. |
V. | [Explanation] Engaging students in experiences with phenomena (category III) and presenting them with scientific ideas (category IV) will not lead to effective learning unless students are given time, opportunities, and guidance to make sense of the experiences and ideas. This category consists of criteria for determining whether the curriculum material provides students with opportunities to express, think about, and reshape their ideas, as well as guidance on developing an understanding of what they experience. |
VI. | [Explanation] This category consists of criteria for evaluating whether the curriculum material includes a variety of aligned assessments that apply the key ideas taught in the material. |
VII. | [Explanation] The criteria in this category provide analysts with the opportunity to comment on features that enhance the use and implementation of the curriculum material by all students. |
References |
I. Providing a Sense of Purpose
Conveying
unit purpose (Rating = Fair)
Conveying lesson/activity
purpose (Rating = Fair)
Justifying lesson/activity
sequence (Rating = Poor)
II. Taking Account of Student Ideas
Attending to prerequisite
knowledge and skills (Rating = Poor)
Alerting teachers to commonly
held student ideas (Rating = Poor)
Assisting teachers in identifying
their students’ ideas (Rating = Poor)
Addressing commonly held
ideas (Rating = Poor)
III.
Engaging Students with Relevant Phenomena
Providing variety of phenomena
(Rating = Poor)
Providing vivid experiences
(Rating = Poor)
IV. Developing and Using Scientific Ideas
Introducing terms meaningfully
(Rating = Fair)
Representing ideas effectively
(Rating = Poor) There is an analogy of people dancing that could be
helpful in illustrating thermal expansion and the transition
from solid to liquid to gas at the molecular level (Using
Energy, p. 37s).
Demonstrating use of knowledge
(Rating = Poor)
Providing practice (Rating
= Poor)
V. Promoting Students' Thinking about Phenomena, Experiences, and Knowledge
Encouraging students to
explain their ideas (Rating = Poor)
Guiding student interpretation
and reasoning (Rating = Poor)
Encouraging students to
think about what they have learned (Rating = Poor)
Aligning assessment to
goals (Rating = Poor) Only two tasks in the Teacher's Planning Guide
relate to the key physical science ideas. Students work
in groups to make a tape recording to compare the motion
and spacing of molecules in solids, liquids, and gases
(Changes in Matter, Additional Portfolio Assessment
Options, p. 12c), and to explain what happens to the
kinetic energy as a piece of ice is changed from solid
to liquid to gas (Using Energy, Oral Assessment, p.
12d, question 3). In the tests, only two multiple-choice items are aligned
with the ideas: No other task is provided to assess students on the
physical science ideas used for this evaluation. Although some items in the material may seem related
to ideas about the particulate nature of matter, students
can respond to them successfully at the macroscopic
level without knowing anything about molecules. For
example, students are asked to choose the appropriate
phrase to complete the following statements: “An
object with a definite shape and volume is most likely
to be a ____” (Teacher's Resource Book for
Changes in Matter, p. 2, question 3; the answer is “solid”),
and “Thermal expansion occurs in ____” (Using Energy, Teacher's Resource Book, p. 18, item 20’
the answer is “ solids, liquids, and gases”).
They are also asked to explain why rivets used to hold
steel beams together in a building are heated red-hot
before they are used. In all three examples, the suggested
answers do not deal with matter at the microscopic level.
When you heat a pan of water, the water
boils because the _____.
a. mass of the water increases
b. mass of the water decreases
c. particles move faster
d. particles move more slowly
[Using Energy, Teacher's Resource Book, p. 2, question 9; the answer is c]When a solid turns liquid, its particles
_____.
a. gain kinetic energy
b. move slower
c. evaporate
d. lose energy
[Using Energy, Teacher's Resource Book, p. 17, item 12; the answer is a]
Testing for understanding
(Rating = Poor)
Using assessment to inform
instruction (Rating = Poor) A few questions that can be used to diagnose students’
remaining difficulties with respect to the key physical
science ideas are included in the material. Students
make a tape recording to compare the motion and spacing
of molecules in solids, liquids, and gases (Changes in Matter, p. 12c, Additional Portfolio Assessment Options,
item 2), explain why liquids and gases take the shape
of their containers (Changes in Matter, p. 25s, Critical
Thinking, item 5), what happens to the kinetic energy
as a piece of ice is changed from solid to liquid and
to gas (Using Energy, p. 12d, Oral Assessment, item
3), and choose the best phrase to complete the statement,
“When you heat a pan of water, the water boils
because the _____ (Using Energy, Teacher's Resource Book, p. 2, item 9; the answer is “particles move
faster”). However, the material fails to include
suggestions for probing beyond students’ initial
responses or diagnosing these responses, it also lacks
specific suggestions for using students’ responses
to make decisions about instruction. In some cases, the assessment that follows the introduction
of key physical science ideas targets far less sophisticated
ideas or skills. For example, in the Changes in Matter
unit, after students are introduced to the arrangement
and motion of particles in the three states (p. 20s),
they are handed an ice cube in a plastic bag, challenged
to change it into liquid as quickly as possible, and
asked to calculate the melting time (Checkpoint, p.
21t).
Providing teacher content
support (Minimal
support is provided.) The material does not usually provide sufficiently
detailed answers to questions in the student text for
teachers to understand and interpret various student
responses. Most answers are brief and require further
explanation (e.g., the answer to a question asking if
students noticed a change in thermal energy after connecting
copper wire to a battery states simply “Yes”
[Using Energy, p. 18t, Activity Log, item 3]),
emphasize a “right answer” approach (for
example, “A solid is a form of matter that has
a definite shape and volume. A liquid is a form of matter
that has a definite volume but no definite shape”
[Changes in Matter, p. 19t, Discussion Strategies,
item 1]), or are incomplete (for example, “The
tiny particles are in constant motion” [Using
Energy, p. 17t, Addressing Misconceptions]). The material provides minimal support in recommending
resources for improving the teacher’s understanding
of key ideas. The Teacher's Planning Guide includes
a list of “Outside Resources” (books, computer
software, films, filmstrips, videos, laserdiscs, field
trips, speakers and visitors, and resource addresses)
at the beginning of each unit (e.g., Changes in Matter,
p. 4t). Limited descriptions for some of the references
identify topics addressed in them, but none of the references
are explicitly linked to specific text sections or key
ideas.
Encouraging curiosity
and questioning (Some
support is provided.) The material provides many suggestions for how to respect
and value students’ ideas. Teacher’s notes
state that multiple student answers should be acceptable
for some questions (e.g., Using Energy, p. 24t, Theme
Connection: Energy) and ask students to record their
own ideas in many tasks, including some Discussion Strategies
and Activity Log tasks. For example, a Literature Link
task associates the book Frozen Fire with a discussion
of the states of matter. The Activity Log for the task
asks students for their own ideas about surviving in
the Arctic based on what they know about the physical
properties of matter (Changes in Matter, p. 19t, Activity
Log). Each Activity Log also includes a blank page following
each activity page entitled “My Notes” in
which students may record additional ideas they may
have (see separate Activity Log booklet for each unit).
The material provides a few suggestions for how to
raise questions such as, “How do we know? What
is the evidence?” and “Are there alternative
explanations or other ways of solving the problem that
could be better?” However, it does not encourage
students to pose such questions themselves. Specifically,
the material includes a few tasks that ask students
to provide evidence or reasons in their responses (e.g.,
Using Energy, p. 25t, Activity Log, item 4; Using Energy,
p. 27t, Activity Log, What Happened?, item 4). The material provides many suggestions for how to avoid
dogmatism. For example, the material includes the work
of many cultural groups (e.g., Using Energy, p. 13s)
as well as of particular practicing scientists (e.g.,
Using Energy, p. 21s) and describes changes over time
in scientific thinking (e.g., Changes in Matter, pp.
6–7s). In addition, the student text portrays
the nature of science as a human enterprise in which
students may participate (e.g., Using Energy, pp. 14–15s,
Explore Activity!). However, the material also contributes
to dogmatism with some text sections written in a static,
authoritative manner (e.g., Using Energy, pp. 16–20s)
and single, specific responses expected for many student
tasks (e.g., Changes in Matter, p. 19t, Discussion Strategies).
The material does not provide examples of classroom
interactions (e.g., dialogue boxes, vignettes, or video
clips) that illustrate appropriate ways to respond to
student questions or ideas, etc. However, a limited
sense of desirable student-student interactions may
be gained from procedural directions for laboratory
and cooperative group activities (e.g., Changes in Matter,
pp. 14–15st, Explore Activity!; Using Energy,
pp. 26–27st, Explore Activity!).
Supporting all students
(Considerable
support is provided.) The material provides many illustrations of the contributions of women and
minorities to science and as role models. At the beginning of each unit, a feature
in the teacher’s notes entitled “Science for Everyone: Culture in
the Classroom” briefly describes the contributions of different cultural
groups to the topics studied (e.g., Changes in Matter, p. 5t). In addition,
some discussion of the contributions of particular cultural groups as well as
individual women and minority scientists is integrated into the main student
text. For example, a text section about the relationship between heat and the
law of conservation of energy describes the special design features of Inuit
and Japanese homes that provide efficient heating (Using Energy, pp. 57–58s).
Some contributions, however, appear in separate features, particularly Multicultural
Perspective and Careers. The Multicultural Perspective feature discusses contributions
of particular cultural groups, sometimes with suggestions for further student
research (e.g., Changes in Matter, p. 53t). The Careers feature highlights various
science professions related to the lesson topics and some of the scientists
identified are women (e.g., Using Energy, p. 80s). The material also references
related trade books (e.g., Using Energy, p. 10s) and includes readings in the
Teacher’s Anthology with Classroom
Library Lessons (e.g., Using Energy,
Teacher’s Anthology with Classroom
Library Lessons, pp. 7–8), some
of which are authored by or describe the experiences of women and minorities.
However, the features highlighting cultural contributions that are separated
from the main text may not be seen by students as central to the material. The material suggests multiple formats for students
to express their ideas during instruction, including
individual log writing (e.g., Changes in Matter,
p. 12s, Minds On! and p. 12t, Activity Log), cooperative
group activities (e.g., Changes in Matter,
p. 21t, Checkpoint), laboratory investigations (e.g.,
Changes in Matter, p. 9st, Try This Activity!),
whole class discussions (e.g., Changes in Matter,
p. 7t, Discussion Strategies), narrative writing (e.g.,
Using Energy, p. 22st, Language Arts Link),
oral and written reports (e.g., Changes in Matter,
p. 43st, Literature Link), and visual projects (e.g.,
Changes in Matter, p. 6t, Meeting Individual
Needs). In addition, multiple formats are suggested
for assessment, including oral (e.g., Using Energy,
p. 24dt, Oral Assessment), concept mapping (e.g., Changes
in Matter, Assessment Guide and Masters,
p. 1a), performance (e.g., Using Energy, p.
31t, Performance Assessment), group projects (e.g.,
Using Energy, p. 104ct, Project Ideas), and
portfolio (e.g., Changes in Matter, p. 12c,
Portfolio Assessment). However, the material does not
usually provide a variety of alternatives for the same
task in either instruction or assessment. The material does not routinely include specific suggestions
about how teachers can modify activities for students
with special needs. However, the Teacher's Planning
Guide and supplemental resources (including Teacher's
Resource Book, Teacher’s Anthology with
Classroom Library Lessons, Audio Tapes for
Student Books, Activity Cards, Science On-Line Masters,
and Problem Solving Software) provide additional
activities and resources for students of specific ability
levels. Each lesson in the Teacher's Planning Guide
includes a Meeting Individual Needs feature which provides
activities for students related to the lesson topics.
These activities are specifically designated for students
learning English, various learning modalities, challenge,
reinforcement, or reading comprehension (e.g., Changes
in Matter, p. 22t, Meeting Individual Needs; Using
Energy, p. 45t, Meeting Individual Needs). However,
the placement of supplemental resources in materials
separate from the main text may discourage their use,
and the special needs codes within chapters may discourage
teachers from using those activities with all students. The material provides many strategies to validate students’ relevant
personal and social experiences with scientific ideas. Some text sections relate
specific personal (sometimes hypothetical) experiences students may have had
to the presented scientific concepts (e.g., Changes in Matter, p. 25s). In addition,
some tasks—including Minds On! (e.g., Using Energy, pp. 6–7s) and
Meeting Individual Needs (e.g., Using Energy, p. 12t, Meeting Individual Needs:
Students Acquiring English)—ask students about personal experiences they
may have had or suggest specific experiences they could have. For example, a
Minds On! task at the beginning of a lesson on heat and temperature first asks
students to list examples of ways they know objects can be heated and cooled.
The students are then asked to hypothesize how cooling occurs and to state the
direction of warmth flow between objects. Finally, students are asked to explain
how they know the direction of warmth flow (Using Energy, p. 25s). This task
is followed by a laboratory activity in which students actually determine how
thermal energy flows between different objects (Using Energy, pp. 26–27s,
Explore Activity!). For a few tasks, however, the material does not adequately
link the specified personal experiences to the scientific ideas being studied
(e.g., Changes in Matter, p. 23t, Seashells to Ceramics).