Assess students’ academic learning, not Web 2.0 technology

I thought that we have moved beyond focusing on the technology to focusing on student academic learning.  I thought that back in the 90s.  However, I find evidence even today that technology still has become the true focus rather than student academic learning.  Whenever I look at the rubrics for an Web 2.0 tool, I see that the vast majority of rubric items focus on the “mechanics” of the technology. They do not focus  on the students’  academic learning.

My writing teachers never graded me on the mechanics of a pencil. They wanted to see if I could write something worthwhile. As I went to college, no one graded me on the mechanics of word processing; they did grade me on how I could demonstrate my content learning. Yes, I do agree that we need basic word processing skills  but those technology skills must not be confused with academic learning.

What new academic skills are students learning through Web 2.0 tools?  What new ways of thinking are they developing and how do they demonstrate those ways of thinking?  Does each Web 2.0 tool add a different dimension of learning?

Let’s demystify Web 2.0 learning by focusing on student academic learning, not on the technology!

My new book,  Successful Student Writing Through Formative Assessment, is available through Eye on Education.

My book, Formative Assessment: Responding to Your Students, is available through Eye on Education.

Wiki- Collaborative Notes Instead of Individual Ones

My classes use a wiki.  If the classes are sections of the same course, they share the same wiki. For example, my 8, 9 and 12:30 classes are all Writing and Research so I group them together on the wiki.  I  have been having students from each class take class notes and post them to the wiki.  As I read the notes on the same classroom  topic material, I notice  that although each student included the critical information, each student picked different things to emphasize more.

Now that students have gotten use to note taking, we are moving onto collaborate notes. The first person posts  his/her notes and writes his/her name.  Then when a person from another section of the same course logs in to post his/her notes, the second person reads what the first has written and adds to the notes or clarifies information; he or she adds her name where she added info.  Likewise, the third person from another section does the same and adds examples if there exist.  The quality of information has increased drastically. The initial notes get transformed into a complete set of notes that will help anyone who is absent.  The notes serve as a great reminder of what we covered with specific examples. The wiki notes demonstrate that students collaborate to advance everyone’s learning.

How do your students collaborate?

My new book,  Successful Student Writing Through Formative Assessment, is available through Eye on Education.

My book, Formative Assessment: Responding to Your Students, is available through Eye on Education.

Assessing Learning with Web 2.0: Social Bookmarking

I was talking to  teacher who was so proud of the social bookmarking his students had done. They had collected over 60 links about the topic they were studying. I asked him if they had agreed on what tags they were going to use; he said that they used whatever tag they wanted.  Next,  I asked him what categories they had divided the links into; he said that the 60+ links were neatly organized in one long list.  Then, I asked how much they had annotated (explained about the importance of each link); he proudly said that they listed the title of  each website. Finally, I inquired how they students used these bookmarks;  he mentioned that the activity was to collect them.  He was so excited about using the Web 2.0 tool of Social Bookmarking.

In my opinion, he wasted his students’ time. The students did not  learn about the academic topic; they learned how to collect information.  They did not know the topic in a deeper or more comprehensive nature  anymore than when  they started their social bookmarking.

Even if each student found two links about the learning topic  and compared and contrasted the information  on those two links, they would have learned so much more in a very little time.

How do you use social bookmarking?

My new book,  Successful Student Writing Through Formative Assessment, is available through Eye on Education.

My book, Formative Assessment: Responding to Your Students, is available through Eye on Education.

Assessing Web 2.0 Projects Through Bloom And Time

I offer the following mini-assessment of any Web 2.0 project as a way to refocus our attention on student learning rather than the Web 2.0 tool.

Take the highest level of Bloom achieved during the project

1- Knowledge                                  2. Comprehension

3 – Application                               4. Analysis

5.5 Synthesis                                   5.5 Evaluation

and multiple it by the number of days in the project.

So, if Susan produces a Social Studies podcast that simply restates (Comprehension) information about George Washington after five days, her score is 2 (Comprehension) x 5 (days) or 10.

If Pablo produces a Social Studies podcast in which he goes through the problem solving steps that George Washington went through and evaluates his final solution (5.5) in two days, his score would be Evaluation (5.5) x 2 = 11

Based on this analysis, a two day project of higher level thinking rates a higher score than a longer project. Let’s focus on student learning!

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Formative Assessment and Successful Student Writing Through Formative Assessment by Harry Grover Tuttle

My book. Successful Student Writing Through Formative Assessment will be available from Eye-on-Education in the Fall.

21st Century Skills Learning and Web 2.0

I’ve noticed that many “Web 2.0″-based learning experiences are not 21st century skills-based.  For example, students can twitter about a novel but if their comments are simply plot summaries then they are not showing critical thinking. Likewise, many 21st century skills are not Web 2.0 based.  Students can create a video reacting to a novel  but if no one reacts to it or builds on it than it really is not Web 2.0 read-write based.

I think that we have to move from isolated thinking to more global thinking. We want to see 21st century skills developed through Web 2.0.

I share this preliminary draft of a grid in which we can look at both 21st century skills and Web 2.0 characteristics at the same time to see if we really have an intersection of the two.

Tuttle's 21st Century Skills and Web 2.0 Grid

Digital Age Assessment: Learning in Web 2.0 (NECC 09)

How do we assess  students’ learning in these in Web  2.0 environments? We want to go beyond assessing the mere mechanics of using these tools; unfortunately, most current rubrics for Web 2.0 learning devote only a minuscule amount (usually 16% or less) to actual student academic learning. We want to refocus our assessments to reflect the students in-depth and comprehensive standards-based learning and the 21st Century Skills.

Change Web 2.0 assessments to assess standards-based learning and 21st Century learning!

With minor changes, the following assessments can be modified for any Web 2.0 tool.

Pre-assess your students’ Web 2.0 projects to raise the academic learning and 21st century skills.

The following are  “rubrics” that assess  standards-based learning and 21st century skills.

Wiki/Blog

Images/Photo/Flickr

Video/YouTube

Podcast

Social Bookmarking

Twitter

Videoconferencing

General Assessment: Prensky’s 21st century skills

General Assessment: enGauge’s 21st century skills

General Assessment: Partnership for 21st century skills

I welcome your reaction to these assessments as we try to help students improve in their academic content and develop 21st century skills.

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning with Web 2.0: Twitter in the Classroom

As teachers think about using twitter in the classroom, they can consider how they will evaluate  the various academic skills that students learn.  This digital age learning twitter rubric hopefully can assist them.

Harry G. Tuttle's Web 2.0 Twitter Rubric

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning With Web 2.0: Videoconferencing

As students use Web 2.0  tools such as videoconferencing/Skype, etc. to interact with peers and experts, we need a tool to assess their learning. This digital age learning rubric focuses on expert videoconferencing.

Harry Tuttle's Web 2.0 Videoconferencing Rubric

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning with Web 2.0: Blog/Wiki Rubric

As more and more teachers have students use blogs or wikis,  the teachers benefit from having a rubric that assesses student learning rather than the mechanics of a blog or wiki. This rubric focuses on the communication skills that students demonstrate in using a blog or wiki.

Harry G Tuttle's Web 2.0 Blog Wiki Rubric

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning with Web 2.0: Podcast

Many teachers want to involve their students in podcasting yet they are unsure of how to evaluate such Web 2.0 digital age learning.  I offer this podcast rubric as a useful tool to focus on learning, not the technology.

Harry Tuttle Web 2.0 Podcast Rubric

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning with Web 2.0: Movie Producing/YouTube

As teachers begin to have their students produce videos and share them about learning topics, teachers can benefit from having a digital age rubric that assesses the learning and not the mechanics of producing a video. Here is a Web 2.0 rubric on producing a video that focuses on 21st century skills.

Harry G. Tuttle Web 2.0 Movie/YouTube Rubric

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning with Web 2.0: Images/Visuals/Flickr

When we apply critical thinking to how we use images/photos/flickr in Web 2.0, we can assess how well our students communicate.

The following rubric applies the “Universal  Intellectual Standards” by  Linda Elder and and Richard Paul which was modified by Gerald Noisch in his Learning to Think Things Through.

Tuttle’s Web 2.0 Assessment for Images

Assessing Learning With Web 2.0: Social Bookmarking

Teachers often have students do social bookmarking so students can share information with the teacher and other students.  Here is a rubric to assess this digital age learning.

Harry G Tuttle's Web 2.0 Social Bookmarking Rubric

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning with Web 2.0: Partnership for 21st Century Assessment

As teachers look at possible projects involving Web 2.0 tools, they can pre-assess using general 21st century skills assessments.  Furthermore, they can use these general assessments during and after a learning experience.

Assessing 21st Century Skills in the Classroom Using Partnership for 21st Century concepts

Hotchalk, Jan 10 2009

http://www.hotchalk.com/mydesk/index.php/hotchalk-blog-by-dr-harry-grover-tuttle-on-teaching/538-assessing-21st-century-skills-in-the-classroom-

According to the Partnership for the 21st Century website, the 21st century skills has four major categories: Core Subjects and 21st Century Themes; Learning and Innovation skills; Information, Media and Technology Skills; and Life and Career Skills

Learning and Innovation Skills Assessment (Use 4 (weekly) -3 (every 5 weeks) -2 (every 10 weeks)-1 (once a year) -0 (does not happen) scale

Creativity and innovation skill

____ Demonstrating originality and inventiveness in work. Example: _________________________

____ Developing, implementing and communicating new ideas to others. Example: _________________________

____ Being open and responsive to new and diverse perspectives. Example: _________________________

____ Acting on creative ideas to make a tangible and useful contribution to the domain in which the innovation occurs. Example: _________________________

Critical thinking and problem solving skills

____ Exercising sound reasoning in understanding. Example: _________________________

____ Making complex choices and decisions. Example: _________________________

____ Understanding the interconnections among systems. Example: _________________________

____ Identifying and asking significant questions that clarify various points of view and lead to better solutions. Example: _________________________

____ Framing, analyzing and synthesizing information in order to solve problems and answer questions. Example: _________________________

Communication and Collaborative Work

____ Articulating thoughts and ideas clearly and effectively through speaking and writing. Example: _________________________

____ Demonstrating ability to work effectively with diverse teams. Example: _________________________

____ Exercising flexibility and willingness to be helpful in making necessary compromises to accomplish a common goal. Example: _________________________

____ Assuming shared responsibility for collaborative work. Example: _________________________

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning With Web 2.0: enGauge 21st Century Skills

Several years ago, enGauge published its 21st Century Skills list. This collection provides the basis for assessing any Web 2.0 tool-based project.

Harry G. Tuttle's Web 2.0 Assessing using enGauge's 21st Century Skills

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Assessing Learning with Web 2.0: Marc Prensky’s 21st Century Skills2.0

Marc Prensky offers his ideas on 21st Century skills which I’ve converted into an assessment tool.

Harry G Tuttle Web 2.0 Marc Prensky's 21st Century Skills

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Woeful Book Wiki Turned to Wow Book Wiki

As I prepare for my NECC presentation on assessing Web 2.0 tools, I have visited many schools’ wikis, websites, etc.

I’m feeling more and more discouraged.  I’ve noticed that most wikis are simply an online collection of student work. For example, all students in a class may do a book report and these book reports are posted to the class wiki.  The students post their book report and the project is done when the last book report is posted. There has been no interaction among students or other adults.  They have only worked in one learning style, linguistics.  Likewise, the students have paraphrased  (summarized) their book; they have not analyzed it.

Let’s look at another version of a book wiki.  The teacher asks all students to select a book that has friendship as a theme. They read their book and post an explanation of  how the book demonstrates friendship (analysis level of thinking). They create a drawing or a concept map that shows the specific  friendship in their book and post that to the wiki.  Then the students select at least three other book reviews to read. After they read each review, they comment on how their own book’s theme of friendship  is similar or different to this student’s review. They come up with an example of that book’s friendship from their lives and post it. Then the class has a discussion on various types of friendship.

Let’s change wikis from just a collection place to an interactive high-level thinking learning place.

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Creating Imaginary Worlds in the Class

Some educators feel strongly that schools should use virtual worlds to engage today’s youth. I remember a distant time when teachers had the power to create imaginary worlds in the class. A Social Studies would tell about the Civil War from the viewpoint of a teenager as his middle school students enter in that teenager’s struggles.  An English teacher used A Midsummer’s Nights Dream to explore young love for high school students. They understand the world of crazy love, mistaken love, and true love. The play becomes a vehicle for them to explore an important issue in their lives.  A science teacher had the students adopt a local stream; they tell the stream’s story throughout the school year. They write as if they were the living stream.  Teachers have the power to create wonderful worlds in the classroom.  Students can be transported to other places, times, and events and see through the eyes of others. They learn more in-depth and more comprehensively.

Can you create imaginary worlds in your class so that students enter into a different world? Do you transport them to a different realm of seeing and thinking?  Get your Merlin’s wand out!

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Web 2.0 Learning Only Works With Critical Learning

Web 2.o  allows students to have more access to information through the social interactions. Collecting information is not creating knowledge.  Some  of my writing students have a ton of information about a topic through Web 2.0 tools but they cannot put the information together in a coherent fashion. The problem is not access to information; the problem is thinking.  As we get more into Web 2.0, we need to get more into Critical Thinking.  Students need to be able to analyze, synthesis, and evaluate information (Bloom) . They need to be able to see information from various perspectives (Chaffee) and to think through various aspects of the issue  such as purpose and  consequences  (Noisch). If we want to “teach” how to use Web 2.o tools, then we need to teach Critical Thinking.  Instead of  Web 2.o courses/”new literacies” courses, we need “Critical Thinking with Web 2.0″ courses. The thinking skills will be transferable as new tech tools quickly evolve.

Let’s focus on critical 21st century thinking skills so we can use Web 2.0 tools wisely!

My book, Formative Assessment: Responding to Students, is available through Eye-on-Education.

Improving How We Use Wikis for Better Student Learning

Here are some handout notes for the session:

Harry Grover Tuttle, Ed. D.
Instructor, writer, consultant
harry.g.tuttle   at   gmail.com
Blog: http://eduwithtechn.wordpress.com

Purpose: To improve students’ learning through changing how we use wikis in our classroom.

Formative Assessment Focus

Improvements:

• 1. Teach the mechanics

  2. Identify the learning goal/purpose

  3. Explain the quality of responses

  4. Use students’ notes

  5. Organize the class

  6. Provide in-class and out-of-class resources by learning style

  7. Avoid common web topics

  8. Make learning “collective wisdom” instead of  “collective stupidity”
     

  9. Have exemplary work and reactions to the exemplars
     

  10. Build in real and varied interaction

  11. Build on the past

  12. Make group work transparent

  13. Have a student-help-student section

  14. Carefully use outside experts and other classes

  15. Co-create with students

A wiki has been created for you to add to  http://wikiforbetterlearning.pbwiki.com/

A mini version of the presentation is available at slideshare

Dr. Tuttle’s book, Formative Assessment: Responding to Students which is available from Eye-on-Education includes numerous ways that technology can be used in formative assessment.

A Wickedly Good Wiki Idea – Class Learning Notes

In one class I teach, students are required to stop periodically and write in their learning logs a summary of what they have just learned. I supply the topic or learning term and they supply the summary. Sometimes I provide a summary, sometimes the class provides a summary but, usually the students write their own summary of the learning.  Such learning log entries can make great wiki entries so you can assign one or two two student to post  the learning from the class.  Students who are absent can quickly find out the important learning from the lesson (what was really important in that chapter?) and students can review the class learning before doing homework based on the class learning. Such posting help in the class review of what we learned last class which starts each new class. Such posting serve as a history of the learnings in the class over the semester or year.

Posting learning logs creates a powerful learning wiki.  So how do you use a wiki to improve student learning?

Flickr and learning: No new changes

I spent a few hours browsing Flickr to see if it had gained more educational groups than the last time I looked at learning and Flickr. I was sadden to see that there has not been a major increase in educational groups in flickr. I had hoped that composition teachers would have put together images for students’ writing. Maybe people do what I do and make their own list of images from Flickr. Maybe I am guilty as others in not giving back to Flickr what I have taken.

Also, if we all tag our images with educational terms, then others can search for them. At present, a search for educational terms ends with no images.

We have to be not only takers but also givers back. We can help build Flickr into an educational resource. Flickr can be a Web 2.0 tool.

Outside Reviewers Assess Learning in Web 2.0

My sister-in-law lives in Australia and is working on her dissertation. She says that only “experts in the field”, not university professors, will be the final reviewers of her dissertation.

I wonder how often with all of Web 2.0 tools that we have  that outside experts evaluate the work of our students? Do our students only produce work for us or do they produce real world work? Do they apply their math to real life projects so that others can react to their work? Do they investigate science environmental issues and have  local scientists review their work? Do they write up proposals for changes in traffic patterns in their English classes and then have local traffic officials look over the plans? Do our art students create designs for local buildings and then have people judge which design best fits their building?

Do we use Web 2.0 for real world learning or for academic within-the-classroom learning? Do we challenge our students to do real world work?

Social or Learning Network

Web 2.0 apps are called social networking. They build on people to people exchanges.  However, I wonder what we evaluate in the Web 2.0 apps.  Do we measure how much students learn academically? Do we measure how much they share that truly helps another student to grow academically?  Social learning is a critical part of the learning process if we structure it as students coming together to learn from each other or learning together.  The social is more the medium than the purpose. How do you evaluate your  students Web 2.0 learning?

Wii, Web 2.0 Learning, and Improving Student Learning?

I got to spend about 2 hours with Wii sports -bowling,baseball, tennis and golf. I am not very coordinated; you could say I’m ambispastic. I bowl with either hand, both equally poorly. When I play virtual bowling, I do even worse. Being virtual does not make me better.

So how do we prepare our students to be better at learning in Web 2.0 environments? Just popping them into Twitter, Wiki, Blog,  Social bookmarking, etc. does not make them any better learners.  How do we as teachers prepare them for and create environments that are more than just social environments  but that are truly learning  environments?  How do we structure an environment that creates in-depth thinking? That promotes comprehensive thinking about a learning goal? That causes the students to make the connections among big ideas?

I do not need to hear more student chatter, I want to hear more ahas.

How do you structure your Web 2 environments to be be powerful learning environments?

Twitter – Meaningful or Trivial -Up to the Writer

I recently read an article saying that twitter is another example of technology dumming down education. It stressed that nothing important/worthwhile can be said in 140 characters. I disagree; much can be said in those few characters. More important than the word limit is the intent of the writer. Some writers tell about their daily existence while others try to share with others. Here are some of my tweets:

Do we evaluate students’ technology based experiences on their excitement, instead of their in-depth learning?

Do teachers give online pretest/survey before a new concept? If not, then they teach with blinders on,not aware of students.

What do students remember about writing paragraphs? Spelling, grammar & punctuation! Not the writing process, not expressing ideas. Oouch!

I’ve noticed concept maps often limit students’ thinking. They fill in the boxes & then stop thinking. Maps are starting points

Weight lost program says man lost 100 lbs (“results not typical”). Are our students’ technology-based learning typical of higher learning?

If teaching is to impart (or stuff in) knowledge & educate is to nourish (or pull out), which do we use technology for?

My twitter is http://twitter.com/HarryGTuttle.

What do you use Twitter for?

Technology Widespread and Frequent or One Example

I like watching weight lost ads. They say a person has lost 100 pounds and then in small print they say “Results not typical”.

What results are typical? Do we do the same technique with technology use in our schools? Are technology-uses widespread (more than the majority use it)? Are technology uses frequent (i.e. they use it often)? If not, then we are using the weight ad trick.

Should we be boasting about the one teacher who has used a specific technology such as a Web 2.0 to promote learning? Or should we wait and then boast about all of our the teachers who use that technology to promote learning? Do we create the illusion about the benefits of technology through telling about one teacher or do we show the overwhelming reality of it when many teachers have their students improve their higher-level learning through technology?

Are your results typical?

Teaching or Educating with Web 2.0 Tools

If teaching is to impart (or stuff in) knowledge & educating is to nourish (or pull out), which do we use technology for?

Any technology can be used for either. A wiki can be used to push stuff in such as a chapter summary or it can be used to have students think through the pros and cons of a real life situation.   Just because a technology is a Web 2.0 does not make it an educating technology.   Videoconferencing can deliver lectures (teaching) or have students share similarities and differences in local folktales (educating).  Social bookmarking does not necessarily educate, it can just provide lists of websites (teaching).

How do you use Web 2.0 Tools?

Blog Content Skills Checklist

I’m trying to think through the skills that our students should display in the class blog that represent academic learning.

Do our students
Provide in-depth information?
Ask others to clarify information?
Ask probing questions to understand the topic more in-depth?
Summarize the many blog entries  into a few meaningful statements?
Identify patterns in blog entries?
Provide vivid examples?
Provide real life examples?
Show alternative views?
Support others as they try to understand the concepts?

What other academic skills should our students show in the class blog?

How to make Wikis and Blogs Collective Intelligence

THE magazine has an article on 6 technologies that will impact education in very near future. The writer used the term collective intelligence to refer to Wikis and Blogs. I agree that wikis and blogs are collective. Are they intelligent? Ithink that depends on how the teachers have their students use these tools. As a comparision, are all classroom discussions intelligent ones in which students grow academically from the discussion or is it a an exchange of opinions?

Here’s two things we can do to improve the intelligence of the wikis or blogs.

When students do add to a wiki to build a collective body of information, how do they use the information once they have created it? For example, if students find articles on different article on the same topic (immigration), summarize the articles, and post to a wiki, we simply have a collection of articles. What do we have the students do that uses that collection? Do they compare/contrast the articles? Do they search for the bias in each article? Do they create their own article that incorporates an in-depth view of the pros and cons of the issue?

When students post their ideas to a blog or even twitter about the ideas, how do students grow from each other’s comments? Are the students’ comments ones that challenge ideas, ask probing questions about it, give another view(perspective) of it, show connections, provide alternative explanations, or explain how to do it? How do their comments move them along the learning path?