Archive for the 'data driven decision making' Category

Mobile Learning and Assessment

Can use a wide variety of mobile devices and of mobile apps for capturing student learning, analyzing it, providing feedback, and recognizing learning success.

Identify the specific learning goal

Have QR codes for exemplars that students can refer to anytime during the learning process

Pre-assess with mobile device: Need data to go to one location for analysis

Monitor and collect student data: Transform non-data activities such as texting into data ones. Constant monitoring of students. Daily/weekly review of data. Mobile device  spreadsheet of students’ scores

Use formative assessment: In-class performance tasks and short quizzes

Provide feedback: QR code to New strategy to overcome learning gap; Differentiate in strategies

Peer assess: While doing task on app or after learning task

Self assess: See progress and evaluate how to become better

Use Eportfolio: Wiki Edmodo ….

Celebrate successful learning

Other resources:

Search my education and technology blog bit.ly/hgtblog (Am on EdTech’s “The Honor Roll: 50 Must-Read K–12 Education IT Blogs”).

My modern language blogs are  now at  http://bit.ly/imprml

I have developed many  Spanish activities that allow students to begin to express themselves and to begin to move toward spontaneous speaking as in a natural conversation at Teacherspayteachers:  http://bit.ly/tpthtuttle

My three formative assessment books, Formative Assessment: Responding to Your Students,  Successful Student Writing Through Formative Assessment, and Improving Foreign Language Speaking Through Formative Assessment, are available at   http://is.gd/tbook

Problems with Institutional Assessment

Assessment dominates education from K-12 through college.   There are different types of assessment, formative (helps students improve) and summative (grading of students).  However, institutional assessment  involves the bigger picture of how an institution or a department is doing academically.

In institutional assessment, teachers enter data into a  mega-database. For example, teachers may enter their students’ grades  on each section of the final. Then someone, often a department head,  analyzes the overall results using the online data, to assess the student learning across specific courses and across the department.

Institutional assessment has some basic flows
1) Most institutions have not identified a specific  enough curriculum that can be assessed.  Many contain very general statements of learning.  For example, English might state that  students will write a well-written essay. Has the English department specified what constitutes a well-written essay?  Likewise, a Modern language department may have the curriculum statement  “The student should speak in sentences that have relatively simple structures and concrete vocabulary”.  What does “speak” mean?  Does it mean to be able to talk about one’s life, to hold a conversation. to repeat from memory?  When there are only general  learning statements, there cannot be any  meaningful assessment.

2) If departments have identified specific learning goals, what is the priority of those learning goals? For example, in English the purpose of writing is to communicate ideas or feelings.  Shouldn’t the organization of ideas be more important than the spelling?  Or does spelling/grammar have the same assessment weight as organization?  Likewise,  in  Modern Languages, are all skills (listening, speaking, reading and writing) treated equally in assessment weighting even though both in class and in the real world, people listen and speak almost double the amount that they read and write?  Have the specific learning goals and their priority been communicated to the teachers/students through a department website/wiki?

3) The departments do not have exemplars that show the quality that they expect of students.  Does the English department share  electronically with all English teachers essays that show what constitutes a high level paper,  an acceptable paper, and a non-acceptable paper?  Again, are these exemplars on the department website for each course?  Does the Modern Language department share audio files of  a good ten sentence conversation through their website or an their department app?

4) They have vague assessment tools.  The English department has a generic rubric (has good organization,  conveys ideas, etc.) that can be interpreted differently by different people.   What type of essay will be the written? An autobiographical essay requires a very different approach than a contrast essay.  In Modern Languages, how will writing be assessed – holistically or analytically?  If different educators can come up with different scores for the same student, then the assessment tool does not accurately measure learning.  Teachers can receive a digital image of the rubric and work assessed using that rubric.   How well does the assessment tool match up with how the information was taught in class?  Is the assessment tool such as the final developed  at the  competency level or at the highly competent level?  Students may be competent but not highly competent

5) The departments do not do a thorough analysis to get at the root problem once they have discovered a gap.   If the students do not achieve well, was it due to the  students’ lack of effort, a misunderstanding of  how to answer the  assessment question, a specific word in the  assessment question,   the thinking level of the test question,    the structure of the assessment item,  the textbook, the textbook’s powerpoints,  the teacher’s explanation, the homework, or  the online work?  Usually much additional exploration is needed to determine the real reason for the gap. Once the  department identifies the gap, what  specific strategy will help the students over come this gap?  Will the department suggest  technology-based strategies that appeal to students such as Youtube videos, interactive websites,  interactive apps  and that help the students directly overcome the gap?

6) Most important of all, how does the institutional assessment help  students improve in the course right now?  Most institutions assess once a semester.  After the analysis, the department  focuses on  what changes will happen in the future year.  Unless regular assessment is done in small intervals  throughout the year and changes made almost instantly, then the assessment does not benefit  the present students.  Next year’s students may be very different than the students who took this assessment.  Classroom teachers need access to the online data and analysis so they can take class time to provide  the students new learning strategies.  Then, students can be successful learners!

How does your institution assess  student learning?

My Spanish spontaneous speaking activities (20+) includes Modified Speed Dating (Students ask  a question from a card-whole class), Structured Speaking (Students substitute in or select words to communicate in pairs),  Role Playing (Students talk as people in pictures or drawing from 2-4 people) and Speaking Mats (Can talk using a wide variety of nouns, verbs and adjectives to express their ideas- pairs or small group),  Spontaneous Speaking (based on visuals or topics in pairs),  and Grammar speaking games (pairs or small group). Available for a nominal fee at Teacherspayteachers:  http://bit.ly/tpthtuttle

My three formative assessment books:   http://is.gd/tbook

English Essays – Grade or Assess? Done or Keep on Improving?

Today I returned my English students first essay. In my formative assessment manner,  I carefully explained that I want them to improvement in their writing during the course and to do so, I had to identify what they have done well and what they need to improve. Í  reminded them that the rubric  checklist has a plus (+) for doing well, a question mark (?) for inconsistent  work, and negative (-) for needs improvement.  I marked 20+ items on their checklist.  I did not give them a grade like a B since the grade tells them nothing about what they did well or have to improve in.  I also explained that, for each student,  I have identified the three areas that will lead to the greatest improvement. I stressed that I expect to see improvement in those three areas on the next essay.  They copied these three improvement areas on an Essay Improvement sheet that they will hand in with their next essay.  I explained that I will provide new strategies for those  learning gaps demonstrated by the greatest number of students at the beginning of each class.   More ideas are in my Successful Student Writing Through Formative Assessment

How do you help your students  to continually  improve?

My book, Formative Assessment: Responding to Your Students, is available through Eye on Education.

Also, my  book,  Successful Student Writing Through Formative Assessment, is available through Eye on Education.

Class increase of 12 points over last semester

I give a pre-test and a post test in my Spanish course.  From the pre-test I can measure the students incoming knowledge.  From the post-test I measure their departing knowledge.   More importantly, I analyze the results of each unit test by the various categories on the test. If many students do poorly on a certain section, I reteach it.  The next semester I start out that particular point with  the reteaching material.  I also do many formative assessments so that I can give students new strategies to do better.  This semester my students did an average of 12 points better than last semester’s students.  I have analyzed the final to see the area in which they lost the most points – writing mini-compositions and have begun to figure out ways to help them. We will do more writing in class and on our class wiki. I will focus on the verb forms to tell a story such  as what I did last weekend. I will have them write out their weekend in a chronological order and make sure that they use a different verb in each sentence. We will do mini-writings over several class periods. For the final they do not need complicated sentences; they just need simple sentences that communicate different ideas.  My goal is to increase this coming semester’s average by 10 points over last semester.

By how much will you increase your class average  this coming year?

My book, Formative Assessment: Responding to Your Students, is available through Eye on Education.

Also, my  book,  Successful Student Writing Through Formative Assessment, is available through Eye on Education.

Check Lower Level Learning Immediately (Formative Assessment)

We all want our students to be learning at the higher levels of thinking.  However, they first have to learn  lower level information.  For example, Spanish students want to converse in the language but until they learn basic vocabulary and grammar such as the present tense; they cannot converse.  We can change the format of class so that after we have introduced the lower level learning and have them practice it enough to know whether they understand the concept, then we can have them practice the lower level learning at home.

If we have them use an online program that “drills” them, shows them the right answer, and shows them  how to get the right answer,  they can immediately know how well they are doing and be given the opportunity to improve.  They do not have to wait until the next day (or in terms of a college course five days or week) to find out if they can do this lower level thinking.  Since the teacher has put in the program   a full explanation of how to get the right answer, the students can overcome their learning gap (formative feedback aspect of formative assessment).  They can redo the program to verify that they can do this lower level activity well.  They feel successful.  They have practiced this learning in the safety of their homes.

Then, in class, the teacher  can move the students to higher levels from the lower level.  For example, the Spanish students can tell what activities they do that day, can describe the various activities of their family members, and ask others what they things they do during a day.

So how do you practice lower level learning so that students know immediately if they are right or wrong and if they wrong,  do they learn how to change their thinking to get right answers? How do you  use formative assessment to move your students forward in their learning?

My book, Formative Assessment: Responding to Your Students, is available through Eye on Education.

Also, my  book,  Successful Student Writing Through Formative Assessment, is available through Eye on Education.

“Fake” Formative Asssessment by Companies

When I do formative assessment workshops, I always include a section on what formative assessment is not.

Many school districts are buying into systems that supposedly do formative assessment.  Usually these systems test students every 4-6 weeks and often  provide a list of what skills the students have and do not have.  The programs may provide “remedial” work to help the students.    How many schools district would tell their athletic coach to wait until 4-6 weeks  to assess  the strengths and areas for growth for each player?  Coaches want their players to improve each practice.  How many school districts would tell their teachers not to assess students until every 4-6 weeks?   Classroom teachers need to be the ones to assess and help their students on a daily or weekly basis.

How many schools would want their coach to say generic statements like “work harder at passing  the ball” without giving the players better strategies for  passing the ball?  Unfortunately many systems provide just vague feedback such as “Organize  ideas”.   These systems do not offer students a choice of strategies; they simply provide one way of learning the material or do not even provide a strategy. Many systems just drill  the students.

Unfortunately, much of what “sells” for formative assessment is in fact just summative testing.

I define formative assessment as ” based on the students’ present learning condition, providing strategies so  the students can immediately begin to  achieve the desired goal”.  The classroom teacher is the heart and soul of formative assessment. Formative assessment takes place as part of the normal  classroom. It happens constantly in the classroom.  The teacher always  focuses on what the students are learning and how to help them better learn.

Here’s an article that gives some additional information.   http://www.edweek.org/ew/articles/2010/11/10/12assess.h30.html

My book, Formative Assessment: Responding to Your Students, is available through Eye on Education.

Also, my  book,  Successful Student Writing Through Formative Assessment, is available through Eye on Education.

Formative Assessment Time = Success Time

This semester I am teaching  College Composition.  I find that my students’ quality of work has improved drastically since I use formative assessment. In the last essay unit,  the classification essay, the students spent over half of the time in formative assessment, mostly peer review.  We peer review each part of the pre-writing phase, starting with a narrowed topic.  Students constantly get feedback on their work according to the assessment checklists.  Their feedback is not a free-for-all, write whatever you want about the students’ writing; their feedback focuses directly on the assessment checklist.  They can give feedback  since they know whether the person has included a certain aspect such as a classifying verb or the evidence name.  I feel that they are about 90% accurate using the checklists.  In fact, I look over the previous peer-assessments before I actually assess the essay.  Since students have to have different students peer assess their work, they have different “eyes” to see their work.  Since each student gets feedback at least eight times during the writing process,  I find that  when I assess their papers, I do not have to  focus on the big issues (thesis, topic sentences, sufficient evidence, and detailed examples)  since the reviewers already helped the person with these. Each time we spend in formative assessment is time spent in helping students be more successful.   In a survey using Google forms, my students said that they made many changes (4.2 out of a five point where 5 =many many changes).  Also, they said that only 2.8 times in the past had their essay been reviewed twice or more.

How do you use build in formative assessment time for student success?

My book, Formative Assessment: Responding to Your Students, is available through Eye on Education.

Also, my  book,  Successful Student Writing Through Formative Assessment, is available through Eye on Education.

Grading for Success or Failure

A critical question is whether we, as teachers, focus on grading for success or failure.

I think most of us grade for failure.

Jaime has done four science labs. In the one in Oct., he got a 20, in Dec, a 40, in Feb., a 60 and in May, an 80. His last lab score was an 80. He improved from a low 20 to an 80. So what grade do we give him? Do we total his scores (20 +40 +60 +80 = 200) and divide by the number of labs (4) to get the average of 50? Or do we give him a grade of 80?

Also, Luisa was in the same science class. Her grades were 80, 80, 80 and 80.  Her last lab was an 80.   Her average is an 80.  She showed no improvement throughout the year.

Both Luisa and Jaime ended up with the same last lab grade.  Do we reward one  student more than the other?

What does your grading reveal about your focus on success or failure?

My book, Formative Assessment: Responding to Your Students, is available through Eye on Education.

Reponding to Your Students

Also, my  book,  Successful Student Writing Through Formative Assessment, is available through Eye on Education.

Successful Student Writing Through Formative Assessment

Successful Student Writing Through Formative Assessment, my book

My book, Successful Student Writing Through Formative Assessment, is available at

http://tinyurl.com/writingtuttle.

The book provides a systematic approach of observing students’ written work, diagnosing ( strengths and gaps and identify strategies to overcome the gaps),  giving feedback, allowing time for growth and reporting the growth within your classroom.  This formative assessment book breaks down the writing process into specific steps so that you can help the students be successful at each step.  The students build on their successes, not their failures. This book contains numerous strategies to help the students overcome each learning gap in the steps of the writing process. Successful Student Writing Through Formative Assessment applies theory to the classroom in a practical easy-to-do approach.  Formative assessment creates a truly student-centered class where the goal is for each student to be success in a very interactive manner of self, peer and teacher reviews.

I developed the book by using the techniques in my writing classes.  My this year’s writing students are at the same level of writing after their first essay as past students were at the end of the course!

My new book,  Successful Student Writing Through Formative Assessment, is available through Eye on Education.

Successful Student Writing Through Formative Assessment

My book, Formative Assessment: Responding to Your Students, is available through Eye on Education.

Reponding to Your Students

Activating Prior Knowledge and Formative Assessment

As I work with my students to develop their writing skills, I want to know what they already know about writing. I want to activate their prior knowledge and experiences. However, there is a down side to activating prior knowledge. A science teacher friend says that his students have many more misconceptions about science, then conceptions. He is careful to find out their misconceptions about a topic at the very beginning of the unit so that he can spend time in helping them to understand that their misconception is not valid science thinking. If they continue with this misconception, they will never grasp the real conception. I find that the same thing happens in writing. Students have misconceptions about writing such as “if I write it, it has to be good”,  “A very long story at the beginning of a very short essay is a great introduction.” or “One small piece of evidence is enough to convince my reader”.

I think we have to be aware that activating prior knowledge means activating whatever the student s may  think they “know” about the topic. Such activation does not assume that all prior “knowledge” is really positive knowledge. Activating prior knowledge provides a great formative assessment tool since we can “see” the students’ previous learning.  Therefore, we can guide the student forward instead letting student being stuck in his/her misconceptions.

Do you activate and diagnose students’ prior knowledge and  figure out strategies to  help the students improve in their learning?

Scientifically-Based Methods vs Action Research

Action Research Not Academic Research

I love to read science articles when they show that a theory that we have held for centuries and has been “scientifically-proven” is now considered incorrect. Pluto is a famous example. Dinosaur “facts” change constantly. Science is a dynamically changing body of knowledge.

So what have scientifically-based methods done for the P12 or even the college environment? How many “fads” have been proven to be successful only to be displaced by the next “fad”? How many millions of academic research projects are done each year? Has education fundamentally changed due to any of this research? Greg Toppo in “Education Science in Search of Answers” USA Today 6D Wed Apr. 11 2007 mentions research “studies that do little to help schools solve practical problems such as how to train teachers, how to raise skills, (and) how to lower dropout rates” Education researchers do not do “rigorous …and important research”. He tells that the What Works ClearingHouse evaluates research studies and finds over 75% unacceptable.

Let’s move from academic research to Action Research. How does what you do in your class make a learning difference in your students in the next month in terms of the standards? Try out an instructional method, give several assessments, evaluate the success of the method, and try another method if students are not reaching the success level you want. A simple spreadsheet can be a powerful tool to aid you in your action research. When the class reaches your level, congratulate them. Make your classroom a place where action research makes a real difference in the academic lives of students.

(My 200th blog entry!)

© Harry Grover Tuttle, 2007

————–

Classroom Formative Assessments (Class and Individual) with Technology

Formative Vocabulary Strategy

Here are two examples of formative assessment using technology in an English classroom.

Formative -Class

I asked students to do their usual journal writing for their normal eight minutes. At the end of eight minutes, they counted the number of words in their writing and wrote it in their journal log. While they did another activity, I went around, recorded their scores, and then inputted the scores into a class spreadsheet on the computer. Within a few minutes, I showed the students a projected graph of that day’s writing fluency class average and compared it to the last time we did the activity. We talked about our increases and shared successful techniques that some students used. We did this at least once a week and their scores increased from 80 words to about 180 words in less than ten weeks.

Formative – Individuals

The students write down the vocabulary learning strategy that they used on each weekly vocabulary quiz. Each week when they got back their quiz, they entered their most recent score in a personal spreadsheet so that they could see a graph of their vocabulary scores. If they got below an 80, then they had to try out another vocabulary learning strategy from the class list that we had generated. They were to try the new technique for two weeks. They could monitor their own vocabulary learning strategy success and make changes to be more successful.

What regular classroom or individual formative assessments do you build into your class?

————————————

Know Students’ ELA, Math, Science, and SS scores before the benchmarks with technology

Standards, Benchmarks,and Technology Analysis

I think that our students should only take the ELA, Math, SS and Science state benchmarks only if we already know how well they will do and only if we have helped them become better in those standards throughout the year.

As educators, we want to know how our students are progressing on the state standards through out the year. We will measure their progress on a regular basis using the state-rubrics. We will record that data in a spreadsheet or grading program that allows us to see the students’ growth. At any given moment, we can identify what each student does well in and what areas students need to improve in.

Then the state benchmarks simply verify what we already know about our students. We know that we have helped the students grow in the standards through out the year through the many classroom standards -based assessments that we have given them.

Let’s get rid of last minute test prep and build standards-based learning into our curriculum. If we do benchmark type classroom activities through out the year, record, and analyze the data with technology, then we know how well the students are doing at any moment.

——————————-

Essential Data Driven Purposeful Technology Use for Student Learning

Aseltine et al’s Supervision for Learning (ASCD, 2006, pgs 23-24 ) has four tests to guide teachers in selecting what their slice of improvement for the year will be. These questions are consistent with the Understanding by Design model of Wiggins and McTighe

1. Essential Teaching and Learning. Does the target represent an area of essential teaching and learning for the teacher’s grade level and content area?

2. Schoolwide and District Data. Does an analysis of schoolwide or district performance data suggest that the target is an area needing improvement

3. Classroom Assessment. Does an analysis of classroom assessment data confirm the target as an area needing improvement?

4. The School and District Improvement Plan. Does the target correspond to an area of emphasis in the district or school’s improvement plan?

I would add that these same questions should be asked when teachers plan to infuse technology into learning. When they use these four questions, then they are using technology to support essential learning rather than using technology to support non-essential learning. Then technology use supports building goals and are not just a great add-on.

Try asking these questions before your next project.

State Benchmarks, Weekly Data Collection, Life long learning

The other night I was on a conference call with people around the state. I heard the comment about how much testing is being done in school and how much data collection is being done. Several people felt that collecting the data (taking state benchmarks) was interfering with instruction.

 

I have several reactions to the statement.

1) If we give benchmarks once a year, then we are only collecting a snapshot that probably is not a big enough picture to inform instruction. For example, for students to write two essays in three hours in an English Regents means that each essay is really a draft, not a finished product.

 

2) The benchmark results are transformed into data that is supposed to help improve instruction. However, with most benchmarks, the students in that year’s class have gone to the next grade level; the data should go to their next year’s teachers, not the present year’s teachers.

 

3) Teachers need to build formative standard-based assessments into their weekly instruction so that as they assess part of the state standard, they can build in adjustments (Remember M. Hunter’s Modify and Adjust?) I believe that unless we do this on a weekly or very regularly basis, then we will not truly improve student learning. Cramming at the end is not educationally sound. Gradually improvement (building on success) is sound.

 

4) Teachers need to have students collect their own data on how well they are doing. For example, how many students monitor their vocabulary strategy to see if it is effective for them? How many students monitor the words they write in a daily journal to see if they improve on the quantity of the writing (getting in the zone)? I have done both of these and find that students like to be able to monitor their own learning and make improvements. Sounds like life long learning to me ( I remember when that was a purpose of schools.)

 


RSS Education with Technology

  • Tech Integration Teacher, What time is it? August 23, 2016
    When someone asks what time it is, that person wants to know the time, not the history of the clock, not how a clock works, and not what other types of clocks there are. Classroom teachers want to help their students improve their academic learning through technology. Sometimes they need help with technology so they go […]
    hgtuttle
  • Curriculum Focus, Not Technology Focus July 28, 2016
    In my public school career I have been a classroom teacher, a technology integration specialist and a technology administrator. In my technology role, I served under the Assistant Superintendent for Instruction. She had a simple mission: Improve students’ academic learning. My mission was equally simple: Improve students’ academic learning through technology […]
    hgtuttle
  • Students React to Digital Badges: Pros, Cons and Interesting June 22, 2016
      ISTE 2016 By Harry Grover Tuttle, Ed. D. College World Language Students’ Preferences Digital Badges – 52%        Paper Certificates – 48% World Language: Can-Do Digital Badges Digital Badges Pro- – Breaks down proficiency more – Shows all badges at once – Is more attractive – Is more appropriate since we use […]
    hgtuttle
  • Digital Badges: Naming the Badge October 29, 2015
    Once teachers have selected what learning and what digital badges (individual or category badges; see previous blog), the teachers encounter another decision. What will they name each badge? Will they use the full name of the Common Core Standard or the national proficiency? For English, under “Speaking and Listening,”will they write out SL.2 “Integrate and […]
    hgtuttle
  • Digital Badges: Better Than Grades? October 19, 2015
    Teachers understand that the grade in a course consists of many different factors such as homework, participation , projects, tests, etc. Blodget observes that sometimes grades reflect attitude, effort, ability and behavior (http://www.academia.edu/9074119/Grading_and_Whether_or_not_Grades_Accurately_Reflect_Student_Achievement). Equally important, a letter […]
    hgtuttle
  • World Language Students Use of Mobile Devices in the Classroom October 5, 2015
    Do world language students use technology n the classroom? Do their  teachers go beyond having their students use technology simply for the drill and practice in vocabulary and grammar? Students can use laptops and mobile devices to hear authentic language, read authentic texts, read tweets about famous performers, see up-to-the-moment culture,  watch video […]
    hgtuttle
  • Digital Badges: Individual or Categorized Learning Badges? September 12, 2015
    The idea of digital badges sounds appealing for the digital children in classes. As teachers start thinking about digital badges, they have to figure out what badges will be awarded. The teachers can award social or academic badges. If teachers decide to use academic badges, then the teachers may base their badges on the Common […]
    hgtuttle
  • English +Common Core +Mobile = Success (ISTE2014 Poster -details) June 30, 2014
    Here are the ten examples I showed at my English + Common Core  + Mobile ISTE 2014 Poster Session: Based on CCSS Anchor Statements: L.2 Take a Conventions Mobile Online Quiz  to pick the  incorrect sentence from four choices (capitalization) SL.2  Evaluate audio recording of a  book chapter on mobile and predict for next chapter. […]
    hgtuttle
  • Global Cultural Learning Using Mobile Devices (ISTE Mobile MegaShare Presentation) June 28, 2014
    Based on my presentation at ISTE 2014 Mobile Megashare Why teach about other countries? Location: Large view to small on maps. Culture or culture. Find six similarities in a  mobile picture from another culture (“Wars are caused by differences, not similarities.”-Tuttle.) Tell one piece of information from each different Internet visual from a place in that […]
    hgtuttle
  • English + Common Core + Mobile = Success in Learning Poster Session at ISTE 2014 June 25, 2014
    In my ISTE Sunday 8-10 am poster session, I demonstrate many diverse mobile activities to help students achieve the English Language Arts Common Core Anchor Statements through mobile devices. The mobile activities focus on free common tool apps that are available on both the Android and the iPad. The students use the apps as a seamless […]
    hgtuttle

Blog Stats

  • 786,929 hits