Earth Science | Life Science | Physical Science |
1.About this Evaluation Report 2.Content Analysis 3.Instructional Analysis
Categories | |
I. | [Explanation] This category consists of criteria for determining whether the curriculum material attempts to make its purposes explicit and meaningful to students, either in the student text itself or through suggestions to the teacher. The sequence of lessons or activities is also important in accomplishing the stated purpose, since ideas often build on each other. |
II. | [Explanation] Fostering understanding in students requires taking time to attend to the ideas they already have, both ideas that are incorrect and ideas that can serve as a foundation for subsequent learning. This category consists of criteria for determining whether the curriculum material contains specific suggestions for identifying and addressing students’ ideas. |
III. | [Explanation] Much of the point of science is to explain phenomena in terms of a small number of principles or ideas. For students to appreciate this explanatory power, they need to have a sense of the range of phenomena that science can explain. The criteria in this category examine whether the curriculum material relates important scientific ideas to a range of relevant phenomena and provides either firsthand experiences with the phenomena or a vicarious sense of phenomena that are not presented firsthand. |
IV. | [Explanation] Science literacy requires that students understand the link between scientific ideas and the phenomena that they can explain. Furthermore, students should see the ideas as useful and become skillful at applying them. This category consists of criteria for determining whether the curriculum material expresses and develops the key ideas in ways that are accessible and intelligible to students, and that demonstrate the usefulness of the key ideas and provide practice in varied contexts. |
V. | [Explanation] Engaging students in experiences with phenomena (category III) and presenting them with scientific ideas (category IV) will not lead to effective learning unless students are given time, opportunities, and guidance to make sense of the experiences and ideas. This category consists of criteria for determining whether the curriculum material provides students with opportunities to express, think about, and reshape their ideas, as well as guidance on developing an understanding of what they experience. |
VI. | [Explanation] This category consists of criteria for evaluating whether the curriculum material includes a variety of aligned assessments that apply the key ideas taught in the material. |
VII. | [Explanation] The criteria in this category provide analysts with the opportunity to comment on features that enhance the use and implementation of the curriculum material by all students. |
References |
I. Providing a Sense of Purpose
Conveying
unit purpose (Rating = Satisfactory) Grade 7, unit 3 (on the physics of motion) is framed
both through the narrative and the questions included
in the background and story-line sections of the unit’s
overview. In the background section, students are told
that they will explore what causes motion. This issue
is made both comprehensible and interesting to students
by being related to experiences in their everyday lives.
For example, students are told to suppose a friend was
leaning up against a wall: The unit’s story line makes the unit purpose
further interesting to students. They are told that,
in the context of encouraging bicycling in their city,
the city’s newly established Bicycle Advisory
Board is sponsoring a citywide All-Terrain Bicycle Design
Contest: The material does not provide explicit opportunities
for students to think about and discuss the presented
unit purpose. The clusters within the unit are generally consistent
with the purpose of designing bicycles that can travel
over a variety of terrain. They focus on investigative
questions, such as: “How fast does a bicycle move?”
“How can a small bicycle tire support my weight?”
“How does a bicycle start and stop?” and
“How does the weight of a bicycle affect its motion?”
(grade 7, Teacher’s Guide, pp. 5.11–12).
Students, however, may not always see the link between
the lessons and the unit purpose since it is not consistently
made explicit for them. The last cluster in the unit
(cluster 25, and in particular, lesson 3, which is described
as being “the culminating evaluation for the entire
unit”) returns to the unit purpose, namely, the
design of an all-terrain bicycle. The individual student
reports and small group presentations that result from
this final lesson are to incorporate explanations of
how the motions and features of the students’
bicycles work “in terms of the physics of motion”
(7.3.25.3, LP25, p. 10). The clusters within the unit are framed through the
investigative questions listed above. The questions
are likely to be comprehensible but may not prove highly
interesting for the majority of seventh-grade students
(for example, “How does the weight of a bicycle
affect its motion?”). On the other hand, the challenge
or goal of designing an all-terrain bicycle—which
extends across the entire unit—may provide ongoing
motivation for the clusters’ activities. In most
clusters, students are not given an opportunity to think
about and discuss the investigative question of the
cluster as they begin with the cluster activities (an
exception is cluster 20). In some clusters, the lessons
and the activities within lessons are consistent with
the cluster purpose (i.e., the investigative question),
but in others they are not. The material does not return
to the stated cluster purpose at the end of the cluster.
“Hey,” she shouted, “look
at the wall pushing on me!” Until you have completed
Unit 3 of Science 2000, you might think she
was not quite herself that day. While investigating
balanced and unbalanced forces, you will learn that
walls can push us every bit as much as we push on them!
[grade 7, Teacher’s Guide, p. 5.11]
Preparation for this design contest
remains the focus of much of this unit. Your class will
be challenged to design bicycles that can travel over
a variety of terrain, including ice, snow, water, sand,
and even a lava field!
What are the factors involved in designing
a bicycle that can move across different types of terrain?
How does a bicycle move? How does it start and stop?
How does a bicycle turn and why doesn’t it fall
over? All of these questions investigate the physics
of motion. [grade 7, Teacher’s Guide, p. 5.11]
Conveying lesson/activity
purpose (Rating = Fair)
Justifying lesson/activity
sequence (Rating = Satisfactory)
II. Taking Account of Student Ideas
Attending to prerequisite
knowledge and skills (Rating = Poor)
Alerting teachers to commonly
held student ideas (Rating = Poor) Not only does Science 2000 not alert teachers to the
numerous commonly held student misconceptions documented
in research studies, but it occasionally presents material
in ways that are likely to reinforce (at least some)
student misconceptions. For example, molecules or atoms
are referred to as being “in” a substance
rather than that they constitute the substance—that
is, the substance is composed (solely) of molecules
and/or atoms.
Assisting teachers in identifying
their students’ ideas (Rating = Fair)
Addressing commonly held
ideas (Rating = Poor)
III.
Engaging Students with Relevant Phenomena
Providing variety of phenomena
(Rating = Poor)
Providing vivid experiences
(Rating = Fair)
IV. Developing and Using Scientific Ideas
Introducing terms meaningfully
(Rating = Fair) Regarding the terms for which it is clear how they
are to be introduced, some are explored within the context
of a first-hand experience. In these cases, the term
is usually introduced prior to the experience rather
than having the need for the term grow out of the experience.
For example, in grade 5, when the term “state
of water” is introduced (5.1.1.2, LP1, procedures
1, 2), students first brainstorm what is meant by “state
of water,” and then point to different pictures
and ask what state the water is in. Other terms are
not linked well to a relevant experience. For example,
in grade 6, cluster 21, lesson 1, the terms “matter,”
“atoms,” and “molecules” are
not introduced in the context of relevant experiences.
With respect to the number of terms introduced, in
teaching the kinetic molecular theory, the material
typically reduces the number of terms to those necessary
for communication. In the context of introducing the
atomic theory in grade 6, though, the material introduces
(and links to the glossary) 12 mostly new terms on one
page (“matter,” “atoms,” “microscopes,”
“elements,” “protons,” “neutrons,”
“nucleus,” “electrons,” “compounds,”
“molecules,” “forces,” and “bonds”),
some of which relate to content inappropriate for middle
school students (6.3.21.1, SI21–1–B, p.
3). This may distract student understanding of the main
idea the material is trying to communicate, that “all
matter is composed of small building blocks called atoms”
(6.3.21.1, LP1, p. 4).
Representing ideas effectively
(Rating = Poor)
Demonstrating use of knowledge
(Rating = Poor)
Providing practice (Rating
= Poor)
V. Promoting Students' Thinking about Phenomena, Experiences, and Knowledge
Encouraging students to
explain their ideas (Rating = Satisfactory)
Guiding student interpretation
and reasoning (Rating = Fair)
Encouraging students to
think about what they have learned (Rating = Poor)
Aligning assessment to
goals (Rating = Poor) In grade 7, there are few items relevant to the idea
that increased temperature means greater molecular motion,
so most materials expand when heated (Idea d). In the
cluster 20 assessments, students are to explain why
a raft full of air that was left in the sun pops, and
why a heated empty can that was capped and cooled then
caved in. (While additional ideas are needed to provide
the desired explanations, they are all taught in the
cluster.) In the cluster 26 assessments, in the context
of weather, students are to explain why the liquid in
a thermometer rises when the temperature warms and falls
when the temperature cools, (question 2), and whether
a cubic meter of warm air is heavier than a cubic meter
of cold air (question 6). The weight question and the
question “What is air pressure?” also assess
the idea that, in gases, particles spread evenly through
the spaces they occupy and move in all directions (part
of Idea e). Other than these questions, the material does not include
questions that require the specific key physical science
ideas.
Testing for understanding
(Rating = Poor)
Using assessment to inform
instruction (Rating = Poor) In the Teacher’s Guide, however, there is no
explicit mention of this instructional strategy and
no specific reference to questions or tasks. Assessment
is discussed in the Science 2000 Instructional Approach
(pp. 8.1, 8.2), which states that the questions in step
1 are for preassessment and should be used to “guide
the teacher in building bridges to new content”
(p. 8.2), and that those in step 5 (Evaluation) are
for the “final step in a constructivist learning
sequence.” The paragraph notes that Science 2000
“outlines a variety of strategies for assessing
the conceptual understanding achieved by students”
and that “[t]here are structured assessment questions
or assignments after many lessons and after each cluster.”
It further notes that “many of these engage students
in the applications of concepts and knowledge”
(p. 8.2). However, the role of these assessments in
instruction is not made explicit. Likewise, Chapter
13: The Science 2000 Software, includes a paragraph
on assessments that notes that However, no mention is made of the function of the
assessments in instruction. Although not explicit, Science 2000 does include some
opportunities for students to express and apply relevant
ideas (see the above criteria entitled “Encouraging
students to examine their ideas” and “Providing
practice”) that can be used, in principle, by
a well-informed teacher to diagnose students’
remaining difficulties. However, while some relevant
questions are included, Science 2000 does not include
suggestions for teachers about how to probe beyond students’
initial responses to better understand where they are,
nor does it include specific suggestions about how to
use students’ responses to make decisions about
instruction.
[F]ormative assessment offers
guidance for improvement and is an ongoing process.
It can be formal…or informal…. Because many
students work independently or in groups during Science
2000 lessons, the teacher is able to circulate
in the classroom, observe students, and get informal
feedback…. During lessons, teachers are encouraged
to informally assess students’ comprehension by
observing their progress at the activities. [grade 6,
p. 19.3]
Science 2000
includes short written tests of student understanding
of each cluster.… Some of the assessments ask
for quite specific information to check problem-solving
and mathematical skills while others ask for more formative
responses such as ideas the students had while conducting
an investigation. [p. 13.8]
Providing teacher content
support (Minimal
to some support is provided.) The material provides some sufficiently detailed answers
to questions in the student text for teachers to understand
and interpret various student responses (e.g., 5.1.1.2,
SI1–2–B, Teacher Answer Key, p. 9, item
4). However, there are some limitations to the responses
provided in the teacher’s notes, which are sometimes
brief and require further explanation (for example,
“Water changes from a liquid to solid [ice] at
this temperature,” 5.1.1.2, SI1–2–A,
Teacher Answer Key, p. 6, Station 2, item 2) or are
incomplete (for example, the answer to the first task
but not the second one is provided [5.1.1.2, SI1–2–A,
Teacher Answer Key, p. 6, Station 1, item 1]). The material provides minimal support in recommending
resources for improving the teacher’s understanding
of key ideas. The material includes lists of mediagraphy
(film, video, and software), teacher articles, teacher
books, and organizations in the Resources component
of each cluster. However, the lists lack annotations
about what kinds of information the references provide
or how they may be helpful.
Encouraging curiosity
and questioning (Some
support is provided.) The material provides some suggestions for how to respect
and value students’ ideas. Teacher’s notes
state that multiple student answers should be acceptable
for selected questions (e.g., 5.1.1.2, SI1–2–B,
Teacher Answer Key, p. 9, item 1), and the student text
explicitly elicits and values students’ own ideas
in some hypothesis and design tasks (e.g., 7.3.20.2,
LP2, p. 11, Procedure, item 9). The material provides a few suggestions for how to
raise questions such as, “How do we know? What
is the evidence?” and “Are there alternative
explanations or other ways of solving the problem that
could be better?” But it does not encourage students
to pose such questions themselves. Specifically, the
material includes a few tasks that ask students to provide
evidence or reasons in their responses (e.g., 6.4.28.1,
SI28–1–A, p. 1, items 1, 2; 26.4.28.2, SI28–2–B,
p. 21, item [a]). The material provides some suggestions for how to avoid
dogmatism. Introductory teacher’s notes emphasize
the role of the teacher as “a facilitator and
a question-asker, encouraging students to articulate
what they already know and to draw on their knowledge
as they pursue an investigation” (8.PD, p. 6.2).
The student text portrays the nature of science as a
human enterprise in which students may participate (e.g.,
6.4.28.1, SI28–1–A, pp. 1–3) and highlights
the work of some current scientists in the Scientists
in Action component (e.g., 5.1.1.Scientists in Action
component, Clark, Eugenie). The material provides a few examples of classroom interactions
through brief vignettes in the Science 2000 Professional
Development Teacher’s Guide that illustrate appropriate
ways to respond to student questions or ideas (e.g.,
8.PD, pp. 1.1–1.2). In addition, a limited sense
of desirable student-student interactions may be gained
from procedural directions for laboratories and cooperative
group activities (e.g., 8.PD, pp. 19.6–19.10;
6.4.28.1, SI28–1–C, pp. 11–13; 7.3.20.3,
SI20-3a, p. 520).
Supporting all students
(Considerable
support is provided.) The material provides some illustrations of the contributions
of women and minorities to science and as role models.
Most of the contributions of women and minorities appear
in the Scientists in Action component that lists the
names of scientists who have worked in the subject area,
with links to biographies (e.g., 8.3.22.Scientists in
Action component, Curie, Marie [1867–1934]) sometimes
including video, still photographs, and links to other
databases. In addition, some Careers, Extension (e.g.,
6.4.28.2, LP2, p. 16, Extensions, item 3) and Option
(e.g., 7.3.20.1, LP1, p. 5, Procedure, item 8, Option)
features highlight cultural contributions related to
chapter topics. For example, an entry about masons describes
how masonry was a profession throughout the world from
early times, and provides video examples of fine masonry
from various countries, including China, Egypt and Greece
(6.3.21.Careers component, mason). The cultural contributions
within these components are interesting and informative,
but may not be seen by students as central to the material
because they are often presented separate from the main
lesson plans and student investigations. The material suggests multiple formats for students
to express their ideas during instruction, including
individual investigations (e.g., 7.3.20.3, SI20–3c,
p. 521), journal or log writing (e.g., 6.4.28.1, LP1,
p. 8, Procedure, item 1), cooperative group activities
(e.g., 7.3.20.3, LP3, p. 14, Procedure, item 3), laboratory
investigations (e.g., 5.1.1.2, SI1–2–B,
pp. 7–8), whole class discussions (e.g., 6.3.21.1,
LP1, p. 7, Procedure, item 7), essay questions (e.g.,
6.4.28.1, SI28–1–C, p. 13, Questions, item
2), creative writing (e.g., 5.1.1.2, LP1, p. 22, Extensions,
item 3), visual projects (e.g., 6.3.21.1, LP1, p. 8,
Extensions, item 2), and role play (e.g., 5.1.1.2, LP2,
p. 21, Procedure, item 7, Option). In addition, multiple
formats are suggested for assessment, including oral
discussion (e.g., 7.3.20.3, LP3, p. 14, Procedure, item
[3]), essay (e.g., 7.3.20.Assessments component, Assessment
[20–1]: Cluster 20 Assessment, item 2), and performance
(e.g., 6.4.28.Assessments component, Assessment [28–1]:
Cluster 28 Assessment). However, the material does not
usually provide a variety of alternatives for the same
task, but often includes additional optional activities
(e.g., 5.1.1.2, LP2, p. 20, Procedure, item 6, Option). The material does not routinely include specific suggestions about how teachers
can modify activities for students with special needs. However, the material
suggests that Extension activities may be used in place of parts of the lesson
if deemed by the teacher to be “more appropriate for the class’
ability, background or interests” (8.PD, p. 7.1) and are later designated
as suitable for gifted and advanced students (8.PD, p. 7.3). In addition, the
material suggests that teachers provide opportunities for students to explore
the database individually (8.PD, p. 18.4). For Spanish speakers, background
descriptions of lessons, story lines, key concepts, many database entries, many
student investigations, and other materials are written in Spanish and English
(8.PD, p. 7.3). For hearing impaired students, the audiotrack of the video clips
has close-captioning. For visually impaired students, some text is written in
large type. Teacher tips provide additional suggestions for supporting limited
English proficiency and bilingual students (8.PD, pp. 19.5–19.6, Computer
Instruction with Language Minority Students). The material provides many strategies to validate students’
relevant personal and social experiences with scientific
ideas. Many tasks ask students about particular personal
experiences they may have had or suggest specific experiences
they could have. For example, in a class discussion
introducing a lesson on gases and air pressure, the
teacher’s notes suggest asking students how their
bicycle tires support their weight, then discuss air
as a type of gas, and consider how tires would ride
if filled with different substances (7.3.20.1, LP1,
pp. 2, 3, Procedure, items 1, 2). However, the material
rarely encourages students to contribute relevant experiences
of their own choice to the science classroom, and sometimes
does not adequately link the specified personal experiences
to the scientific ideas being studied (e.g., 5.1.1.2,
LP2, p. 21, Extensions, item 2).