Earth Science | Life Science | Physical Science |
1.About this Evaluation Report 2.Content Analysis 3.Instructional Analysis
Categories | |
I. | [Explanation] This category consists of criteria for determining whether the curriculum material attempts to make its purposes explicit and meaningful to students, either in the student text itself or through suggestions to the teacher. The sequence of lessons or activities is also important in accomplishing the stated purpose, since ideas often build on each other. |
II. | [Explanation] Fostering understanding in students requires taking time to attend to the ideas they already have, both ideas that are incorrect and ideas that can serve as a foundation for subsequent learning. This category consists of criteria for determining whether the curriculum material contains specific suggestions for identifying and addressing students’ ideas. |
III. | [Explanation] Much of the point of science is to explain phenomena in terms of a small number of principles or ideas. For students to appreciate this explanatory power, they need to have a sense of the range of phenomena that science can explain. The criteria in this category examine whether the curriculum material relates important scientific ideas to a range of relevant phenomena and provides either firsthand experiences with the phenomena or a vicarious sense of phenomena that are not presented firsthand. |
IV. | [Explanation] Science literacy requires that students understand the link between scientific ideas and the phenomena that they can explain. Furthermore, students should see the ideas as useful and become skillful at applying them. This category consists of criteria for determining whether the curriculum material expresses and develops the key ideas in ways that are accessible and intelligible to students, and that demonstrate the usefulness of the key ideas and provide practice in varied contexts. |
V. | [Explanation] Engaging students in experiences with phenomena (category III) and presenting them with scientific ideas (category IV) will not lead to effective learning unless students are given time, opportunities, and guidance to make sense of the experiences and ideas. This category consists of criteria for determining whether the curriculum material provides students with opportunities to express, think about, and reshape their ideas, as well as guidance on developing an understanding of what they experience. |
VI. | [Explanation] This category consists of criteria for evaluating whether the curriculum material includes a variety of aligned assessments that apply the key ideas taught in the material. |
VII. | [Explanation] The criteria in this category provide analysts with the opportunity to comment on features that enhance the use and implementation of the curriculum material by all students. |
References |
I. Providing a Sense of Purpose
Conveying
unit purpose (Rating = Fair) Similarly
Chapter 9: Volcanoes, Earthquakes, and Explantions opens
with a photograph of an erupting volcano while its introductory
paragraph explains that "[a]s you proceed through this
chapter, see whether you can discover people's different
ideas about why volcanoes erupt and earthquakes happen"
(p. 157s). This statement of purpose is both
comprehensible and likely to interest students in the
chapter. Lessons in the chapter are consistent
with this purpose, and it is returned to at the end
of the chapter. In contrast, the introduction
to Chapter 10: Connecting the Evidence is not understandable
and therefore not likely to interest students. The
introductory paragraph explains that "[w]hen scientists
cooperate and share their ideas, they often develop
explanations that answer many questions at once.
As you explore Chapter 10, you will see how certain
questions and answers fit together" (p. 195s). This
purpose is vague and likely to be unappealing to students.
Furthermore, this stated purpose does not convey
one of the purposes of the chapter, which seems to be
to learn about plate tectonics. The accompanying
photograph is actually two photographs (one superimposed
on the other), but neither of them clearly helps students
better understand the chapter purpose. The chapter
purpose is revisited at the end of the chapter.
Conveying lesson/activity
purpose (Rating = Fair)
Justifying lesson/activity
sequence (Rating = Satisfactory)
II. Taking Account of Student Ideas
Attending to prerequisite
knowledge and skills (Rating = Poor)
Alerting teachers to commonly
held student ideas (Rating = Poor)
Assisting teachers in identifying
their students’ ideas (Rating = Poor)
Addressing commonly held
ideas (Rating = Poor) However, nowhere in the play, not
even in the audience participation questions (embedded within the play), are
these ideas challenged or confronted, making this activity unlikely to address
the commonly held ideas of students.
[These] explanations may seem inaccurate at first glance. These
same theories, however, may match your students' misconceptions
about earthquakes and volcanoes.. Respectful treatment
of these old ideas may make the students more willing
to share their thoughts (and misconceptions) with you.
[p. 157at]
III.
Engaging Students with Relevant Phenomena
Providing variety of phenomena
(Rating = Poor) A few phenomena are provided for
the idea that several processes contribute to the changing surface of the
Earth (Idea b). Unfortunately, very few of these phenomena explain
clearly how the processes have changed the Earth. For example, the
Teacher's Edition presents several instances of earthquakes and volcanoes,
but none of the descriptions explains how the surface of the Earth was changed
as a result of such an event (pp. 157a-157ct). Instead, the descriptions
of these events tend to focus on the number of deaths and the amount of destruction
that occurred as a result. Only the account of the formation of Mount
Parícutin includes a brief description of the change to the surface of the
Earth: "In 10 months a volcanic cone had grown to more than 300 meters high
and 900 meters wide" (p. 157bt). Some phenomena are provided only
in the Teacher's Edition. On occasion, notes in the Teacher's Edition
suggest that teachers photocopy the relevant pages as supplemental reading
for students (e.g., p. 157at). Most of the phenomena for the idea that
some Earth-shaping processes are fast and some are slow (Idea d) is found
in the Teacher's Edition. The reading mentions that a San Francisco
earthquake lasted 67 seconds, that Mount Parícutin was created in 10 months,
and that five large volcanic cones on the island of Hawaii were built up over
thousands of years of intermittent lava flows (pp. 157a-157ct). Very few phenomena target the key
ideas about plate tectonics (Ideas g, h). For the idea that plate interactions
create landforms and cause geologic events (Idea h), several maps showing
features such as the age of rocks, the locations of volcanoes and earthquakes,
and features of the ocean floor are presented as evidence for patterns on
the Earth (pp. 186−191s.) Later in the next chapter (chapter 10), students
read that plate interactions cause earthquakes and volcanoes (pp. 201−204s).
Providing vivid experiences
(Rating = Poor)
IV. Developing and Using Scientific Ideas
Introducing terms meaningfully
(Rating = Satisfactory) Overall the number of new
technical terms is fewer than typically found in middle
grades Earth science textbooks. Notably absent
are terms that label land features (such as "loess,"
"syncline," "dome," "alluvial fan," "arete," "drumlin,"
"cirques," and "moraine") and terms associated with
volcanic eruptions (such as "bombs," "caldera," and
"cinders"). However, in some cases, terms that
would have facilitated communication about the key Earth
science ideas are not presented and some technical terms
are used incorrectly. For example, terms such as "diverging"
and "converging" were not used to describe how tectonic
plates move. Instead, the terms "ridges" and
"trenches" (which are landforms, not plate boundaries)
are substituted (p. 208t). Using the terms "divergent"
and "convergent" for plate boundaries clearly depicts
how the plates are moving with respect to one another.
Furthermore, not all diverging boundaries have ridges
and not all convergent boundaries have trenches.
Also, some extraneous terms are included in chapter
10. For example, the chapter includes a large number
of technical terms for rock types, such as "andesite,"
"granite," "shale," "sandstone," and "quartzite' (pp.
215−216s), that are not linked to relevant experiences,
and are not particularly useful for communicating the
key Earth science ideas.
Representing ideas effectively
(Rating = Poor)
Demonstrating use of knowledge
(Rating = Poor)
Providing practice (Rating
= Poor)
V. Promoting Students' Thinking about Phenomena, Experiences, and Knowledge
Encouraging students to
explain their ideas (Rating = Fair)
Guiding student interpretation
and reasoning (Rating = Poor) 2. How does the theory of plate tectonics explain earthquakes. 3. According to the theory of plate tectonics,
why are the youngest rocks in the Atlantic Ocean in
the middle of the ocean? [p. 202, Stop & Think] 4. How does the theory of plate tectonics explain why the continents
are moving? 5. How does plate tectonic movement explain the formation of volcanoes? 6. Use the theory of plate tectonics to
explain the correlations you saw between the locations
of volcanoes and earthquakes. [p.
204, Stop & Think] While these questions ask students to explain various isolated events
in light of the theory of plate tectonics, they are not sequenced in order
of increasing complexity to guide students' understanding of the key ideas.
1. List some of the patterns that scientists noticed
but did not know how to explain.
Encouraging students to
think about what they have learned (Rating = Poor)
Aligning assessment to
goals (Rating = Poor)
Testing for understanding
(Rating = Poor)
Using assessment to inform
instruction (Rating = Poor) In
addition, students study a topic they choose from a
list, describe its connection to plate tectonics, and
present it to the class (pp. 212-218s). Of the 14 topics
listed, 7 are relevant to the key Earth science ideas:
6. Why are some rocks
on land billions of years old but in the ocean the
oldest rocks are only 200 million years old? 7. If most mountains
are found on the edges of continents, how can you
explain the location of the Ural Mountains? 10. Choose one of
the following mountain ranges: the Andes, Himalayas,
Cascades, or Appalachians. Explain how that mountain
range may have been formed according to the plate
tectonic theory. 11. Use the theory
of plate tectonics to explain why Mt. St. Helens erupted. 12. According to
recent research, the continent of Africa is splitting
apart. Describe and show where this is occurring and
what the evidence is. 13. Describe what
a hot spot is and how scientists can use a hot spot
on the ocean floor to indicate the direction of a
plate's movement. [pp. 213-214s] Furthermore,
for questions found in Evaluate sections, the introductory
material in unit 2 encourages teachers to ask questions
such as: "Why do you think.? What evidence do you have?
What do you know about x? How would you explain x?"
(level A, p. xviii). Unfortunately, teachers are not
reminded of these probing questions in the Evaluate
sections throughout the chapters, so this advice may
go unheeded. Overall, the material does not include
suggestions for teachers about how to interpret students'
responses, nor does it include specific suggestions
about how to use students' responses to make decisions
about instruction.
1. How does the landscape change
after a severe earthquake?
Providing teacher content
support (Some support is provided.) The material generally provides sufficiently
detailed answers to questions in the student text for teachers to understand
and interpret various student responses (e.g., p. 162t, item 19). However,
there are some limitations to the answers in the teacher's notes, which occasionally
contain or may create misconceptions (e.g., p. 207t, Wrap Up, items 2-4) or
are absent (e.g., p. 209t, Wrap Up). The material provides minimal support
in recommending resources for improving the teacher's understanding of key
ideas. The Teacher's Edition gives a list of "Websites of Interest"
with brief, bulleted descriptions and recommendations at the beginning of
each chapter (e.g., p. 195dt) and a list of "Educational Technology Resources"
(software, CD-ROMs, videos, and laser discs) with recommendations but not
descriptions at the beginning of each unit (e.g., p. 139bt). A reference
list subdivided by unit without annotations is provided at the end of the
Teacher's Edition (pp. 447-450t). Limited descriptions of references
in the Teacher's Edition identify topics addressed, but none of the
references are explicitly linked to specific text sections or key ideas.
In addition, the Teacher's Resource Book has a Background Resources
section that includes commentary on science standards documents and general
references on learning and assessment strategies.
Encouraging curiosity
and questioning (Some
support is provided.) The material provides some
suggestions for how to respect and value students' ideas. Teacher's
notes sometimes stress that multiple student answers should be acceptable
for selected questions (e.g., p. 158at, Class Discussion Questions). The
skills "Show respect for others and their ideas" (e.g., p. 159s, Working Cooperatively)
and "Treat others politely" (e.g., p. 208s, Working Cooperatively) are stated
in multiple places in the student text and teacher's notes as new cooperative
group skills. However, other than stating the skills, the material
does not usually provide students with any further support in how to enact
the skills within their cooperative groups. For example, the rationale
for the skill "Show respect for others and their ideas" is stated only once
in the teacher's notes (p. 138t, Cooperative Learning Overview), and single
examples of what this skill would look like in cooperative group work are
given only in the student text (pp. 138-139s, Cooperative Learning Overview)
and teacher's notes (p. 158bt, Getting Started). The material provides many
suggestions for how to raise such questions as, "How do we know? What is
the evidence?" and "Are there alternative explanations or other ways of solving
the problem that could be better?" for explanations of earthquakes and volcanoes
(e.g., p. 184s, Reading: Evaluating Explanations). However,
the material does not routinely encourage students to pose such questions
themselves. The material provides
some suggestions for how to avoid dogmatism. For example, the student
text portrays the nature of science as a human enterprise in which students
may participate (e.g., pp. 186-191s, Investigation: Patterns on the
Earth). In addition, the material includes the work of particular,
practicing scientists (e.g., pp. 162-183s, Volcanoes and Earthquakes: Explanations
from the Past) and describes changes over time in scientific thinking about
earthquakes and volcanoes (pp. 184-186s, Reading: Evaluating Explanations). The material does not provide
examples of classroom interactions (e.g., dialogue boxes, vignettes, or video
clips) that illustrate appropriate ways to respond to student questions or
ideas. However, some sense of desirable student-student interactions
may be gained from procedural directions and descriptions of student roles
and social skills in cooperative group activities (e.g., pp. 197-199s, Working
Cooperatively, Investigation: Continents on the Move).
Supporting all students
(Some support is provided.) The material provides some
illustrations of the contributions of women and minorities to science and
as role models. The illustrations sometimes occur in the main text
(e.g., pp. 170-176s, Act II: A New Invention). They are also presented
in sidebars that are interesting and informative, but may not be seen by students
as central to the material (e.g., p. 192s, Sidelight on History). Children
doing science in the video materials as well as cartoon characters of European
scientists in the text are intended as role models for students. It
is unclear, however, if students will relate to the cartoon animal figures,
and the figures' dialogues may appear superfluous to the main content of the
text (e.g., p. 204s). The material suggests multiple
formats for students to express their ideas during instruction, including
individual investigations and notebook writing (e.g., pp. 212-213s, Investigation:
Plate Tectonics Research), cooperative group activities and lab investigations
(e.g., pp. 197-199s, Investigation: Continents on the Move), play acting (e.g.,
pp. 158-183s, Investigation: And Along the Way They Met.), and whole
class discussions (e.g., p. 158s, Connections: Can You Imagine?). Introductory
teacher's notes suggest using a wide variety of classroom activities for assessment,
including in-class discussion, notebook entries, portfolios, and Evaluate
activities (Teacher's Resource Book, p. 35). However, the material
does not usually provide a variety of alternatives for the same task
in either instruction or assessment. The material does not routinely
include specific suggestions about how teachers can modify activities for
students with special needs. There is only one instance of modifying
an activity for more advanced students (p. 187t, Process and Procedure).
However, the Teacher's Edition and Teacher's Resource Book
provide some additional activities and resources for students. Within
each chapter, the Teacher's Edition provides Further Opportunities
for Learning in which students may further study a related interest (e.g.,
p. 220t), sometimes using chapter and unit resources that include websites
(e.g., pp. 157c-157dt) and educational technology resources (software, CD-ROMs,
videos, and laser discs [e.g., p. 139bt]). The Teacher's Resource
Book includes a few extension activities similar in complexity to those
in the student text (e.g., pp. 188-190). The material provides a
few strategies to validate students' relevant personal
and social experiences with scientific ideas. A
few text sections include brief references to specific
personal experiences that students may have had that
relate to the presented scientific concepts (e.g., p.
142s, Investigation: How Do You Know?). In
addition, a few tasks ask students about particular
personal experiences they may have had, or suggest specific
experiences they could have. For example, in
the beginning of chapter 9 (about explanations of volcanoes
and earthquakes), teacher's notes suggest asking "students
to share their ideas about, and perhaps experiences
with, earthquakes and volcanoes" (p. 157t, Strategies).
However, the material rarely encourages students
to contribute relevant experiences of their own choice
to the science classroom, and sometimes does not adequately
link the specified personal experiences to the scientific
ideas being studied (e.g., p. 158s, Connections:
Can You Imagine?, item 2). Overall, support
is brief and localized. Endnote Diversity and Limits describes its use of the five E's instructional model
as follows: "Each chapter goes through a cycle of activities, and each activity
exemplifies one of the "E" words. First the students are engaged by an event
or question related to the concept that the teacher plans to introduce. Then
the students participate in one or more activities to explore the concept.
This exploration provides students with a common set of experiences from which
they can initiate the development of their understanding of the concept. In
the explain phase, the teacher clarifies the concept and defines relevant
vocabulary terms. Next, the students elaborate and build on their understanding
of the concept by applying it to new situations. Finally, the students complete
an activity that will help them and the teacher evaluate their understanding
of the concept" (level B, p. xvii).