Digital Age Assessment: Learning in Web 2.0 (NECC 09)

How do we assess  students’ learning in these in Web  2.0 environments? We want to go beyond assessing the mere mechanics of using these tools; unfortunately, most current rubrics for Web 2.0 learning devote only a minuscule amount (usually 16% or less) to actual student academic learning. We want to refocus our assessments to reflect the students in-depth and comprehensive standards-based learning and the 21st Century Skills.

Change Web 2.0 assessments to assess standards-based learning and 21st Century learning!

With minor changes, the following assessments can be modified for any Web 2.0 tool.

Pre-assess your students’ Web 2.0 projects to raise the academic learning and 21st century skills.

The following are  “rubrics” that assess  standards-based learning and 21st century skills.

Wiki/Blog

Images/Photo/Flickr

Video/YouTube

Podcast

Social Bookmarking

Twitter

Videoconferencing

General Assessment: Prensky’s 21st century skills

General Assessment: enGauge’s 21st century skills

General Assessment: Partnership for 21st century skills

I welcome your reaction to these assessments as we try to help students improve in their academic content and develop 21st century skills.

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning with Web 2.0: Twitter in the Classroom

As teachers think about using twitter in the classroom, they can consider how they will evaluate  the various academic skills that students learn.  This digital age learning twitter rubric hopefully can assist them.

Harry G. Tuttle's Web 2.0 Twitter Rubric

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning With Web 2.0: Videoconferencing

As students use Web 2.0  tools such as videoconferencing/Skype, etc. to interact with peers and experts, we need a tool to assess their learning. This digital age learning rubric focuses on expert videoconferencing.

Harry Tuttle's Web 2.0 Videoconferencing Rubric

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning with Web 2.0: Blog/Wiki Rubric

As more and more teachers have students use blogs or wikis,  the teachers benefit from having a rubric that assesses student learning rather than the mechanics of a blog or wiki. This rubric focuses on the communication skills that students demonstrate in using a blog or wiki.

Harry G Tuttle's Web 2.0 Blog Wiki Rubric

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning with Web 2.0: Podcast

Many teachers want to involve their students in podcasting yet they are unsure of how to evaluate such Web 2.0 digital age learning.  I offer this podcast rubric as a useful tool to focus on learning, not the technology.

Harry Tuttle Web 2.0 Podcast Rubric

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning with Web 2.0: Movie Producing/YouTube

As teachers begin to have their students produce videos and share them about learning topics, teachers can benefit from having a digital age rubric that assesses the learning and not the mechanics of producing a video. Here is a Web 2.0 rubric on producing a video that focuses on 21st century skills.

Harry G. Tuttle Web 2.0 Movie/YouTube Rubric

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning with Web 2.0: Images/Visuals/Flickr

When we apply critical thinking to how we use images/photos/flickr in Web 2.0, we can assess how well our students communicate.

The following rubric applies the “Universal  Intellectual Standards” by  Linda Elder and and Richard Paul which was modified by Gerald Noisch in his Learning to Think Things Through.

Tuttle’s Web 2.0 Assessment for Images

Assessing Learning With Web 2.0: Social Bookmarking

Teachers often have students do social bookmarking so students can share information with the teacher and other students.  Here is a rubric to assess this digital age learning.

Harry G Tuttle's Web 2.0 Social Bookmarking Rubric

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning with Web 2.0: Partnership for 21st Century Assessment

As teachers look at possible projects involving Web 2.0 tools, they can pre-assess using general 21st century skills assessments.  Furthermore, they can use these general assessments during and after a learning experience.

Assessing 21st Century Skills in the Classroom Using Partnership for 21st Century concepts

Hotchalk, Jan 10 2009

http://www.hotchalk.com/mydesk/index.php/hotchalk-blog-by-dr-harry-grover-tuttle-on-teaching/538-assessing-21st-century-skills-in-the-classroom-

According to the Partnership for the 21st Century website, the 21st century skills has four major categories: Core Subjects and 21st Century Themes; Learning and Innovation skills; Information, Media and Technology Skills; and Life and Career Skills

Learning and Innovation Skills Assessment (Use 4 (weekly) -3 (every 5 weeks) -2 (every 10 weeks)-1 (once a year) -0 (does not happen) scale

Creativity and innovation skill

____ Demonstrating originality and inventiveness in work. Example: _________________________

____ Developing, implementing and communicating new ideas to others. Example: _________________________

____ Being open and responsive to new and diverse perspectives. Example: _________________________

____ Acting on creative ideas to make a tangible and useful contribution to the domain in which the innovation occurs. Example: _________________________

Critical thinking and problem solving skills

____ Exercising sound reasoning in understanding. Example: _________________________

____ Making complex choices and decisions. Example: _________________________

____ Understanding the interconnections among systems. Example: _________________________

____ Identifying and asking significant questions that clarify various points of view and lead to better solutions. Example: _________________________

____ Framing, analyzing and synthesizing information in order to solve problems and answer questions. Example: _________________________

Communication and Collaborative Work

____ Articulating thoughts and ideas clearly and effectively through speaking and writing. Example: _________________________

____ Demonstrating ability to work effectively with diverse teams. Example: _________________________

____ Exercising flexibility and willingness to be helpful in making necessary compromises to accomplish a common goal. Example: _________________________

____ Assuming shared responsibility for collaborative work. Example: _________________________

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning With Web 2.0: enGauge 21st Century Skills

Several years ago, enGauge published its 21st Century Skills list. This collection provides the basis for assessing any Web 2.0 tool-based project.

Harry G. Tuttle's Web 2.0 Assessing using enGauge's 21st Century Skills

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning with Web 2.0: Marc Prensky’s 21st Century Skills2.0

Marc Prensky offers his ideas on 21st Century skills which I’ve converted into an assessment tool.

Harry G Tuttle Web 2.0 Marc Prensky's 21st Century Skills

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Woeful Book Wiki Turned to Wow Book Wiki

As I prepare for my NECC presentation on assessing Web 2.0 tools, I have visited many schools’ wikis, websites, etc.

I’m feeling more and more discouraged.  I’ve noticed that most wikis are simply an online collection of student work. For example, all students in a class may do a book report and these book reports are posted to the class wiki.  The students post their book report and the project is done when the last book report is posted. There has been no interaction among students or other adults.  They have only worked in one learning style, linguistics.  Likewise, the students have paraphrased  (summarized) their book; they have not analyzed it.

Let’s look at another version of a book wiki.  The teacher asks all students to select a book that has friendship as a theme. They read their book and post an explanation of  how the book demonstrates friendship (analysis level of thinking). They create a drawing or a concept map that shows the specific  friendship in their book and post that to the wiki.  Then the students select at least three other book reviews to read. After they read each review, they comment on how their own book’s theme of friendship  is similar or different to this student’s review. They come up with an example of that book’s friendship from their lives and post it. Then the class has a discussion on various types of friendship.

Let’s change wikis from just a collection place to an interactive high-level thinking learning place.

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Spoiling our Students Through Formative Assessment

My wife and I spent the week taking care of our 15 month old grandson, Rowan. We now understand what it means to spoil a grandchild.  Like other grandparents, we did not buy special toys or clothing; we did not keep him up past his bedtime; and we did not take him to special places.  We did spoil him by devoting our complete attention to him. We did not focus on working, taking care of the house, etc; we only focused on him.

Every teacher should spoil the students in their classroom.  The teachers should be so prepared for class that when class starts the teachers can focus their complete attention on the students. How are the students responding to the instruction? Which students are “getting it” and which are not?  What learning problems are emerging?  What instant strategy can be implemented right now to help the students overcome their learning gap? We need to change our perspective from what we teach to what the students are learning. We need to  become  attentive parents/guardians who constantly look for clues of learning strengths and learning gaps.  We need to be nurturing parents/guardians who can treat  any “illness” as soon as we see it.  We do not want any student to bleed out while they wait overnight for us to figure out a solution to their illness.

Let’s spoil our students so that they achieve more in-depth learning!

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Standardized Terms for Common Understanding

I am constantly amazed that we, in education, have not standardized learning terms.  Is a benchmark a 3-4 a year comprehensive test of the skills in the course? Or is a benchmark the level at which the students are to arrive? What’s a standard? The list of generic skills from the state?  The quality we expect of students?  What is formative assessment? Student observations that lead to improved lessons for next year?  A student observation that leads to instant feedback for that student?  Each new educational movement brings in its interpretation of a term.

We cannot even have an educational discussion because we use the same word to mean different things.

The Federal Gov’t wants to clarify the end product of learning instead of having states have their own standards. I agree. Even more the federal government should publish a dictionary of what educational terms mean so that everyone can use the words with the same meaning. A common vocabulary means that teachers within the same building, within the same district, within the same state, and within the same country can have a common meaning.

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Formative Assessment and RTI

According to Response Through Intervention (RTI), the most critical part of the interventions is Tier One where 80-90 percent of the students are in the regular classroom. The teacher uses baseline data, instruction, monitoring, diagnosing, and feedback with more assessments to see if students are showing growth in critical skills. Tier One is an excellent time for formative assessment.  Teachers can observe if the new strategy or modification of a strategy is making a difference in the students’ learning. The constant cycle of instruction, monitor, diagnosis, feedback and assessment in RTI is also the cycle for Formative Assessment. Tier One teachers who use formative assessment have more interventions on a regular basis in the classroom.

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Formative Assessment Avoids One-Size-Fits-All Solutions

Grant Wiggins’ Big Ideas website published my latest article,  Formative Assessment: Not One-Size-Fits-All- Feedback.

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Formative Assessment Rubric: Different than the Usual Rubric

You probably use a rubric to assess students.  Your rubric is most likely a summative rubric.  It tells the students what they did right or wrong (a score of 4/6).

It probably does not show the students what a proficient answer looks like so that they can improve (a formative assessment rubric). Since a formative assessment rubric includes what a proficient example looks like the students move from the theory of the rubric (what I got wrong or the abstract terms in the rubric) to the classroom practice (what does a “good” answer look like in practice) so that the students can change.

In addition, a formative assessment rubric contains suggestions for improvement for any less than proficient area. Students not only see a proficient response but they learn a strategy that will enable them to do  that proficient response.

The rubric moves from “a grade” to “an improvement”.

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Frequent Formative Assessment: Road Trip Metaphor

Recently I’ve been thinking of learning as a road trip.  Our students start out on the trip but soon they may take a road that does not lead to the  destination. In many classes, the instructors do not find out that the students have been on the wrong road until the weekly quiz or even the unit exam. Formative assessment helps to monitor students as they drive. Students do not have to take the same road (differentiation) but they do need to end up at the same destination. Formative assessments helps  identify students who have wandered off on dead-ends, have  being caught going around traffic circles, or have taken roads that lead in the opposite directions from the destination. Formative Assessment shows them how to get back on a road that leads to the destination and then monitors that they are continuing on that road. Formative Assessment can monitor when students have stopped for an extended break. Formative Assessment celebrates their success as they arrive at the destination.

How do you use Formative Assessment to help your students reach their destination?

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Creating Imaginary Worlds in the Class

Some educators feel strongly that schools should use virtual worlds to engage today’s youth. I remember a distant time when teachers had the power to create imaginary worlds in the class. A Social Studies would tell about the Civil War from the viewpoint of a teenager as his middle school students enter in that teenager’s struggles.  An English teacher used A Midsummer’s Nights Dream to explore young love for high school students. They understand the world of crazy love, mistaken love, and true love. The play becomes a vehicle for them to explore an important issue in their lives.  A science teacher had the students adopt a local stream; they tell the stream’s story throughout the school year. They write as if they were the living stream.  Teachers have the power to create wonderful worlds in the classroom.  Students can be transported to other places, times, and events and see through the eyes of others. They learn more in-depth and more comprehensively.

Can you create imaginary worlds in your class so that students enter into a different world? Do you transport them to a different realm of seeing and thinking?  Get your Merlin’s wand out!

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Quality Learning in Education

Long ago when I began a new job, my superintendent suggested I go to TQM training which was being done via videoconferencing. I learned much and changed my department into one that applied TQM to increase our effectiveness while providing high quality service. Then the TQM movement was criticized for being too business like and it quietly disappeared from education.  Ironically, many of the TQM ideas and tools have been renamed into more “acceptable” terms such as “continuous quality improvement” (CQI) or “data driven”. The premise in TQM is that you identify the quality that you want and you constantly measure to see if you are obtaining that quality. If not, you change your actions to achieve that quality.  TQM builds in success structures (many graphic organizers came out of TQM).  Movements such as formative assessment can be seen as TQM applied to student success.

How have  you identify the quality of learning you want in your students? How do you build in success measures so that students reach that level of quality in their learning?

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Web 2.0 Learning Only Works With Critical Learning

Web 2.o  allows students to have more access to information through the social interactions. Collecting information is not creating knowledge.  Some  of my writing students have a ton of information about a topic through Web 2.0 tools but they cannot put the information together in a coherent fashion. The problem is not access to information; the problem is thinking.  As we get more into Web 2.0, we need to get more into Critical Thinking.  Students need to be able to analyze, synthesis, and evaluate information (Bloom) . They need to be able to see information from various perspectives (Chaffee) and to think through various aspects of the issue  such as purpose and  consequences  (Noisch). If we want to “teach” how to use Web 2.o tools, then we need to teach Critical Thinking.  Instead of  Web 2.o courses/”new literacies” courses, we need “Critical Thinking with Web 2.0″ courses. The thinking skills will be transferable as new tech tools quickly evolve.

Let’s focus on critical 21st century thinking skills so we can use Web 2.0 tools wisely!

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Baby Walking and Improving Student Learning

My grandson is beginning to walk. He takes about ten steps and then falls down. He crawls over to the nearest table/chair and gets up again. He does not get discouraged about failing to walk many steps. He walks some more and falls down again.

How do we help our students to not get discouraged about their failures?  Do we use the “fail forward” mentality that a failure is simply an indication that we tried something that did not work and now we can try something that can work?  A mistake is an opportunity to learn. When students see their answers and work  as work in progress, they are more willing to take chances and move forward. When we do not criticize them but help them to see how to improve, we encourage them to see failures as stepping stones as opposed to stop signs.

How do you show your students  that learning from  mistakes is a sign of growth?

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Revisions and Formative Assessment

I find that if I ask students to revise their work based on my formative feedback, some of them do make the changes  and others do not.  However, if the students have to create a Change sheet, they do make the changes.  In the Change sheet, they list the original learning problem, tell what they did to improve, and include an example from their most recent work.  As I look at their revisions, I first look at the original rubric, then their Change sheet, then put their previous work and their revised work side by side. I look for the changes in their revision. I look to see if they have changed all of the items for each formative feedback. For example, if I asked a student to improve his/her topic sentences, I look to see if all the original poorly done topic sentences have changed. If students have made the revisions for the three major areas of feedback and, therefore, reached the level of proficiency or above proficiency, they receive a new higher grade.

How do you help your students to improve?

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Contractors – Summative and Formative Assessment

I had several contractors in to give me estimates for some changes to my house.  The first one measured the room and left.  The second one measured the room and then spent double that time in asking me questions about the room and the house. I went with the second one because he understood what I wanted and how that fit in with the rest of the house.

I see the first contractor as a summative assessment- get a number and leave.  The second contractor was formative. He had numbers but he needed to know what those numbers meant in terms of what I expected in terms of the room (the end goal) and in terms of the whole house (all the other data from the house). He gave me several suggestions for improvements (getting me from where I am to where I want to be) and let me select the one I felt was the most helpful.

Which type teaching contractor are you- summative or formative?

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Having Students Go from Proficient to Above Proficient Through Improvements

In my Oral presentations (speech) class, I’m grading their final speeches on how much they have improved from when they originally gave the speech. They have to show me their original speech, the rubric in which I indicated their strengths and gaps, and a sheet which explains how they are overcoming their gaps. Their final (two speeches that they select from those they have done) are graded on improvement.  If they show the three  improvements, they get an A. For each learning gap that is not changed into a strength, they loose ten points.  So far students have shown drastic improvements, their speeches have gone from being below proficient or being proficient to being above proficient. They have learned to support their speeches with image-based PowerPoints that drive home their messages. When we raise the bar and prove ways for students to improve, they go over the bar!

How do you have your students improve and become above proficient?

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Fixed or Flexible Learning

I recently talked to someone who teaches an online course.  She says that the college has supplied the lectures for each class.  I questioned how a college could think that the fixed lectures would fit the needs of the class. Then the person reminded me that high school textbooks,  textbook websites, textbook DVDs,  textbook PowerPointsand content websites present the material  in a fixed manner.  I think it is good for a teacher to see an exemplary lesson and then to modify the lesson for the class or  for the teacher to use the fixed  lesson as a jumping off point  but I do feel that teachers should not follow a book lesson blindly. Based on our students’  intellectual, physical and emotional needs, we, as instructional leaders, need to decide how to teach the selected goal.  We need to modify the lesson to meet various learning styles and learning levels in our class. We need to know when to abandon a lesson to teach a missing skill or a complimentary skill. We are the ones to show the students the connections between what they are learning and the big picture, to bring in our life experiences in that learning.

How do you teach your course?  Do you strictly follow the textbook (fixed) or do you modify the learning in a flexible manner based on your students’ needs?

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Student or Teacher Duty: Improving Time for Feedback

On Sunday, the church congregation was surprised to see a young ten year boy be the liturgist. He said the prayers, introduced the hymns, and read the scripture.  The boy had listened to the adults who usually do this and thought he could do it.  He did a good job!

It made me think of what duties are only teacher duties in the classroom and what are student only duties. Students can pass out materials, collect material, take attendance, do class review, prepare classroom materials such as handouts or PowerPoints, make quizzes, and assess other students’ work. Students often present information in a way that their classmates can easily understand the information.

If we have students do more in the classroom, we can spend more time on giving small group or one-on-one with students. We have more time for formative feedback.  We spend out time not in many managerial things but in helping students to learn.

Let’s give our students more duties so that we can help them more!

Color Coded Rubrics For Formative Assessment

If your rubric has a limited number of concepts, you might consider using  color coding. As you assess student work, you use a certain color highlighter for each major concept in the rubric (for example, for writing, red for  thesis and topic sentences, yellow for evidence, green for details,  etc.)  When you see a strength, you use that color marker to put in a Plus(+) sign next to where you  highlight the actual strength  Likewise, you can put a minus (-) sign next to a learning gap such a sentence that is missing a  transition and indicate where the transition should be.  Since each color corresponds to your rubric, you do not have to write out the type of learning strength or gap.  You indicate the category by its color and then you can write a formative feedback comment more quickly.

A variation is to use a certain colored highlighter for above proficient (green), proficient (blue), developing yellow), and beginning (red)  levels in the student work. For example, if students write an introduction at the proficient level, you highlight it in blue. If their conclusion lacks a restatement of the thesis, does not include the categories of proof, , and does not have an extender, you highlight it in red.  Students can do a color scan of their papers to see their levels of proficiency.

Help your students to improve by adding  color to their work

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Teacher Portfolios- Real Student Success or Faked Success?

Individually, I talked  to two teachers who had to present teacher portfolios and had received back  comments on their portfolio.  One teacher had glowing feedback.  He told me how he had only put student material in the portfolio that demonstrated above proficient work. He explained that usually only one or two students in all of his classes had reached that level for each standard and so he included that  work.

The other teacher had put in student work at all levels of proficiency.  Her feedback focused on how she had to help students to be successful. She had included the percent of  students  at each level of proficiency; she had even included a graph for the proficiency rates on  the four major standards. She indicated some strategies she had tried and whether each strategy succeed or did not succeed with these students.

The administrators were looking for measures of the teachers’ success in helping students to learn. They did not discern the difference between  a staged or fake representation of success for a teacher and a teacher’s  full disclosure about classroom learning.

How can your teacher portfolio show your growing success in reaching more and more students?

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Providing Classroom Variation

My wife and I like to go to productions of  the musical Godspell to see how the director will vary the setting, costumes, and dialogue and yet keep the central message of the play. Godspell is a musical that encourages variation.

I wonder how much most classroom teacher encourage variations on the central learning. One English teacher has all of his students write on the same topic for a contrast essay. Another English teacher lets her students select their own topic from a very long list or come up with their own topic for a contrast essay. One   social studies teacher has his students answer the questions from the text book chapter. Another teacher has her students find news articles about the topic and react to the news articles. One science teacher hands out a description of “the” project.  Another teacher provides a tic-tac-toe board with various projects  arranged by learning style.

When we allow students choice, they are more invested in their learning. They have more opportunity to engage themselves through their own interests in their  central learning. They think more and they learn more.

How do you encourage variation?

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.