Archive for the 'Success' Category

Problems with Institutional Assessment

Assessment dominates education from K-12 through college.   There are different types of assessment, formative (helps students improve) and summative (grading of students).  However, institutional assessment  involves the bigger picture of how an institution or a department is doing academically.

In institutional assessment, teachers enter data into a  mega-database. For example, teachers may enter their students’ grades  on each section of the final. Then someone, often a department head,  analyzes the overall results using the online data, to assess the student learning across specific courses and across the department.

Institutional assessment has some basic flows
1) Most institutions have not identified a specific  enough curriculum that can be assessed.  Many contain very general statements of learning.  For example, English might state that  students will write a well-written essay. Has the English department specified what constitutes a well-written essay?  Likewise, a Modern language department may have the curriculum statement  “The student should speak in sentences that have relatively simple structures and concrete vocabulary”.  What does “speak” mean?  Does it mean to be able to talk about one’s life, to hold a conversation. to repeat from memory?  When there are only general  learning statements, there cannot be any  meaningful assessment.

2) If departments have identified specific learning goals, what is the priority of those learning goals? For example, in English the purpose of writing is to communicate ideas or feelings.  Shouldn’t the organization of ideas be more important than the spelling?  Or does spelling/grammar have the same assessment weight as organization?  Likewise,  in  Modern Languages, are all skills (listening, speaking, reading and writing) treated equally in assessment weighting even though both in class and in the real world, people listen and speak almost double the amount that they read and write?  Have the specific learning goals and their priority been communicated to the teachers/students through a department website/wiki?

3) The departments do not have exemplars that show the quality that they expect of students.  Does the English department share  electronically with all English teachers essays that show what constitutes a high level paper,  an acceptable paper, and a non-acceptable paper?  Again, are these exemplars on the department website for each course?  Does the Modern Language department share audio files of  a good ten sentence conversation through their website or an their department app?

4) They have vague assessment tools.  The English department has a generic rubric (has good organization,  conveys ideas, etc.) that can be interpreted differently by different people.   What type of essay will be the written? An autobiographical essay requires a very different approach than a contrast essay.  In Modern Languages, how will writing be assessed – holistically or analytically?  If different educators can come up with different scores for the same student, then the assessment tool does not accurately measure learning.  Teachers can receive a digital image of the rubric and work assessed using that rubric.   How well does the assessment tool match up with how the information was taught in class?  Is the assessment tool such as the final developed  at the  competency level or at the highly competent level?  Students may be competent but not highly competent

5) The departments do not do a thorough analysis to get at the root problem once they have discovered a gap.   If the students do not achieve well, was it due to the  students’ lack of effort, a misunderstanding of  how to answer the  assessment question, a specific word in the  assessment question,   the thinking level of the test question,    the structure of the assessment item,  the textbook, the textbook’s powerpoints,  the teacher’s explanation, the homework, or  the online work?  Usually much additional exploration is needed to determine the real reason for the gap. Once the  department identifies the gap, what  specific strategy will help the students over come this gap?  Will the department suggest  technology-based strategies that appeal to students such as Youtube videos, interactive websites,  interactive apps  and that help the students directly overcome the gap?

6) Most important of all, how does the institutional assessment help  students improve in the course right now?  Most institutions assess once a semester.  After the analysis, the department  focuses on  what changes will happen in the future year.  Unless regular assessment is done in small intervals  throughout the year and changes made almost instantly, then the assessment does not benefit  the present students.  Next year’s students may be very different than the students who took this assessment.  Classroom teachers need access to the online data and analysis so they can take class time to provide  the students new learning strategies.  Then, students can be successful learners!

How does your institution assess  student learning?

My Spanish spontaneous speaking activities (20+) includes Modified Speed Dating (Students ask  a question from a card-whole class), Structured Speaking (Students substitute in or select words to communicate in pairs),  Role Playing (Students talk as people in pictures or drawing from 2-4 people) and Speaking Mats (Can talk using a wide variety of nouns, verbs and adjectives to express their ideas- pairs or small group),  Spontaneous Speaking (based on visuals or topics in pairs),  and Grammar speaking games (pairs or small group). Available for a nominal fee at Teacherspayteachers:  http://bit.ly/tpthtuttle

My three formative assessment books:   http://is.gd/tbook

Advertisements

Administrators Learn From Others Through Google Forms

Superintendents and other central office people often need to find out information, collect real time data, opinions or interests of others.  Likewise, a building principal might want to survey the views of his/her staff. He/She may be looking for alternative ways of solving a possible school problem.  When  administrators receive suggestions, opinions, etc from others and have up-to-the-minute data, they can make wiser decisions. An easy way to quickly get information from others is through Google Forms.

One just needs a Google email and then they can create a Google Form.

Go to Documents on the Google menu bar.

Click on New

Click on Form.

Type in  the title  of the form such as Hall Problem.

Add in any directions.

Select from several type of questions. Can use as many different types, each in a different question.  Those questions that allow for a specific answer (multiple choice  Checkboxes, Choose from a lists, scale, and grid) can  automatically analyze the number of responses for each choice. If you include numerical or very short answers, people can answer these from their Smartphone.
Text – short phrases or a short sentence
Paragraph – longer answers such as multiple sentences
Multiple Choice (select one of the answers)
Checkboxes (select one or more of the answers)
Choose from a list
Scale Rate something on a scale of 1-5 or 1-1o
Grid Rate a series of items on a scale of 1-5

Remember to click on “Makes  this a required question” if the survey takers have to answer the question.

Move any question up and down by clicking on it, holding down on it, and moving it up or down.

Click on Save.

Go to Forms, Edit and copy the url (http://..). at the bottom of the page.  Email that url to the people you want to take the survey or  take that long URL and shorten it using bit.ly so that people can type  it directly in their Smartphone or tablet.  Be specific about when the closing date is for taking the survey.

To see the results, go to Forms – Show Summary of responses.  The numerical answers will be a graph form. The text answers for any question will be grouped together.

For those  administrators that want real time  data at a meeting,  get the URL of the form, shorten it using bit.ly, and display that shortened URL at a meeting so the people can take the form right then on their Smartphones or tablets.  Show them the results instantly.

Are you ready to learn from others? Are you ready to make better decisions based on real-time information from others.

I have Spanish spontaneous speaking activities at Teacherspayteachers:  http://bit.ly/tpthtuttle

My formative assessment books:   http://is.gd/tbook

Healing Learning injuries: The Immediacy of Formative Feedback

If a student has hurt herself and is bleeding, we do not say, “Wait a few days and we will take care of your bleeding.” We help stop the bleeding immediately.  However, when a student bleeds academically by showing a serious learning gap, we often delay the necessary treatment.

When a student displays a learning gap such as  not being able to write a topic sentence in a composition, we  immediately apply the treatment of providing the student with different new strategies.  We do not simply re-give the student the  original strategy that was unsuccessful for the student.  We have a list of different strategies on the class website, blog, wiki, a handout, or a QR code.  We write these strategies in student-talk and provide examples.  For example, a topic sentence has a topic, like “the school baseball team”, and a strong position or viewpoint  about the team such as “will win this Friday”.  The complete topic sentence becomes “The school baseball team will win this Friday.”
We provide a  variety of differentiated ways for the students to learn the missing concept of a topic sentence such as  a written explanation.   We can ask students to put a box around the topic and put an arrow ( → ) over the position. Also, we can offer the student  a variety of other ways of learning this concept such as    Youtubemovie, a podcast, and  a visual.  The student selects which formative feedback she feels will help her the most. Then, she practices that new strategy so that she improves.

Through the  immediacy of formative assessment, we heal the student  in their learning.  The student does not become injured for the rest of her learning.

Tuttle’s formative assessment books:   http://is.gd/tbook

Formative Assessment and Technology Tech Forum NY 2011 Presentation

Dr. Harry Grover Tuttle
htuttlebs@gmail.com

Formative Assessment:The process of helping students move immediately forward from their presented diagnosed learning to the desired learning goal.

Formative Assessment Process:
Student responds → Monitor → Diagnose → Feedback → Improvement Time → Success

Clearly state the learning goal and desired level of success

Use Exemplars to raise the bar of learning

Pre-test (“I can” forms for self assessment; content quizzes). Use digital forms such as Google Formsand Quia.

Formative Assessment and Technology
Student Responds Monitor Diagnose Feedback Time Success
-Digital form is best
– Write on wiki or blog- Sound or video recording
– Take pictures of
– Record data using spreadsheet, Google Form, digital checklist, online program such as Quia. – Compare against digital exemplar with specifics- Compare against digital checklist or formative rubric-Identify new strategy from digital library -Orally give through avatar (Voki), audacity or screen cast; face to face
– Refer to website that shows new strategy (QR code)
– Suggest explanatory PowerPoint made by student or teacher
– Read word processed info, text, or tweet
– Go through digital exemplar
In-class time  or screen cast – Eportfolio
– Wall of Fame
– See changes in spreadsheet graph
-Celebrate!

His Books on Formative Assessment (Eye on Education)
Formative Assessment: Responding to Students
Successful Student Writing Through Formative Assessment
Improving Foreign Language Speaking Through Formative Assessment

Class increase of 12 points over last semester

I give a pre-test and a post test in my Spanish course.  From the pre-test I can measure the students incoming knowledge.  From the post-test I measure their departing knowledge.   More importantly, I analyze the results of each unit test by the various categories on the test. If many students do poorly on a certain section, I reteach it.  The next semester I start out that particular point with  the reteaching material.  I also do many formative assessments so that I can give students new strategies to do better.  This semester my students did an average of 12 points better than last semester’s students.  I have analyzed the final to see the area in which they lost the most points – writing mini-compositions and have begun to figure out ways to help them. We will do more writing in class and on our class wiki. I will focus on the verb forms to tell a story such  as what I did last weekend. I will have them write out their weekend in a chronological order and make sure that they use a different verb in each sentence. We will do mini-writings over several class periods. For the final they do not need complicated sentences; they just need simple sentences that communicate different ideas.  My goal is to increase this coming semester’s average by 10 points over last semester.

By how much will you increase your class average  this coming year?

My book, Formative Assessment: Responding to Your Students, is available through Eye on Education.

Also, my  book,  Successful Student Writing Through Formative Assessment, is available through Eye on Education.

“Fake” Formative Asssessment by Companies

When I do formative assessment workshops, I always include a section on what formative assessment is not.

Many school districts are buying into systems that supposedly do formative assessment.  Usually these systems test students every 4-6 weeks and often  provide a list of what skills the students have and do not have.  The programs may provide “remedial” work to help the students.    How many schools district would tell their athletic coach to wait until 4-6 weeks  to assess  the strengths and areas for growth for each player?  Coaches want their players to improve each practice.  How many school districts would tell their teachers not to assess students until every 4-6 weeks?   Classroom teachers need to be the ones to assess and help their students on a daily or weekly basis.

How many schools would want their coach to say generic statements like “work harder at passing  the ball” without giving the players better strategies for  passing the ball?  Unfortunately many systems provide just vague feedback such as “Organize  ideas”.   These systems do not offer students a choice of strategies; they simply provide one way of learning the material or do not even provide a strategy. Many systems just drill  the students.

Unfortunately, much of what “sells” for formative assessment is in fact just summative testing.

I define formative assessment as ” based on the students’ present learning condition, providing strategies so  the students can immediately begin to  achieve the desired goal”.  The classroom teacher is the heart and soul of formative assessment. Formative assessment takes place as part of the normal  classroom. It happens constantly in the classroom.  The teacher always  focuses on what the students are learning and how to help them better learn.

Here’s an article that gives some additional information.   http://www.edweek.org/ew/articles/2010/11/10/12assess.h30.html

My book, Formative Assessment: Responding to Your Students, is available through Eye on Education.

Also, my  book,  Successful Student Writing Through Formative Assessment, is available through Eye on Education.

Improve FL Speaking Fluency With Formative Assessment

NYSAFLT  Conference Oct. 16, 2010

If we want students to be speakers of the language, then we have to let them speak more in the classroom.  Engage them in real language use.

Formative Assessment my definition: The process of helping students to immediately move forward from their present diagnosed learning to the expected learning.

Formative Assessment components:

Student does something in the language →

Is monitored →

Is diagnosed (determine present status and assess the gap between the present and expected learning; identify a strategy to improve) →

Is given formative feedback →

Has time for improvement →

Is re-assessed to show improvement →

Celebrates success

Formative assessment  create a culture of success, of constant improvement

Two Formative Assessment videos from the UK:

Secondary Assessment for Learning

Modern Foreign Languages Peer Assessment


Formative assessment advantages and concerns. You do not grade formative assessment or it becomes summative. It is critical that students be given a new strategy or a new way to think about the learning.

Success or Failure Grading?

Importance of Peer assessment. When peers assess peers, students can talk more in class and get more feedback.

Speaking Assessment: Identify the specific language function and level.

Student 1 speaks for a minute while Student 2 records number said. Student 2 reports back to Student 1 and gives additional suggestions. Student 1 practices the improvements.

Student 2 speaks on another topic  for a minute while Student 1 records number said. Student 1 reports back to Student 2 and gives additional suggestions. Student 2 practices the improvements.

Record the information on this baseline.

Students may need teacher given strategies if they do not show sufficient improvement from peer-to-peer help.  The  teacher has to have a large variety of strategies, each of which leads directly to the students’  being successful.

I have worked on 16 different speaking assessments and each one has about ten different strategies for the students.

Tuttle, H. G. (2009). Formative Assessment: Responding to Students. Larchmont, NY: Eye on Education.

Hopefully, my book, Improving Students Speaking Through Formative Assessment, will be out in late April. To be put on the mailing list, email me at htuttlebs@gmail.com

My book, Formative Assessment: Responding to Your Students, is available through Eye on Education.

Also, my  book,  Successful Student Writing Through Formative Assessment, is available through Eye on Education.


RSS Education with Technology

  • Tech Integration Teacher, What time is it? August 23, 2016
    When someone asks what time it is, that person wants to know the time, not the history of the clock, not how a clock works, and not what other types of clocks there are. Classroom teachers want to help their students improve their academic learning through technology. Sometimes they need help with technology so they go […]
    hgtuttle
  • Curriculum Focus, Not Technology Focus July 28, 2016
    In my public school career I have been a classroom teacher, a technology integration specialist and a technology administrator. In my technology role, I served under the Assistant Superintendent for Instruction. She had a simple mission: Improve students’ academic learning. My mission was equally simple: Improve students’ academic learning through technology […]
    hgtuttle
  • Students React to Digital Badges: Pros, Cons and Interesting June 22, 2016
      ISTE 2016 By Harry Grover Tuttle, Ed. D. College World Language Students’ Preferences Digital Badges – 52%        Paper Certificates – 48% World Language: Can-Do Digital Badges Digital Badges Pro- – Breaks down proficiency more – Shows all badges at once – Is more attractive – Is more appropriate since we use […]
    hgtuttle
  • Digital Badges: Naming the Badge October 29, 2015
    Once teachers have selected what learning and what digital badges (individual or category badges; see previous blog), the teachers encounter another decision. What will they name each badge? Will they use the full name of the Common Core Standard or the national proficiency? For English, under “Speaking and Listening,”will they write out SL.2 “Integrate and […]
    hgtuttle
  • Digital Badges: Better Than Grades? October 19, 2015
    Teachers understand that the grade in a course consists of many different factors such as homework, participation , projects, tests, etc. Blodget observes that sometimes grades reflect attitude, effort, ability and behavior (http://www.academia.edu/9074119/Grading_and_Whether_or_not_Grades_Accurately_Reflect_Student_Achievement). Equally important, a letter […]
    hgtuttle
  • World Language Students Use of Mobile Devices in the Classroom October 5, 2015
    Do world language students use technology n the classroom? Do their  teachers go beyond having their students use technology simply for the drill and practice in vocabulary and grammar? Students can use laptops and mobile devices to hear authentic language, read authentic texts, read tweets about famous performers, see up-to-the-moment culture,  watch video […]
    hgtuttle
  • Digital Badges: Individual or Categorized Learning Badges? September 12, 2015
    The idea of digital badges sounds appealing for the digital children in classes. As teachers start thinking about digital badges, they have to figure out what badges will be awarded. The teachers can award social or academic badges. If teachers decide to use academic badges, then the teachers may base their badges on the Common […]
    hgtuttle
  • English +Common Core +Mobile = Success (ISTE2014 Poster -details) June 30, 2014
    Here are the ten examples I showed at my English + Common Core  + Mobile ISTE 2014 Poster Session: Based on CCSS Anchor Statements: L.2 Take a Conventions Mobile Online Quiz  to pick the  incorrect sentence from four choices (capitalization) SL.2  Evaluate audio recording of a  book chapter on mobile and predict for next chapter. […]
    hgtuttle
  • Global Cultural Learning Using Mobile Devices (ISTE Mobile MegaShare Presentation) June 28, 2014
    Based on my presentation at ISTE 2014 Mobile Megashare Why teach about other countries? Location: Large view to small on maps. Culture or culture. Find six similarities in a  mobile picture from another culture (“Wars are caused by differences, not similarities.”-Tuttle.) Tell one piece of information from each different Internet visual from a place in that […]
    hgtuttle
  • English + Common Core + Mobile = Success in Learning Poster Session at ISTE 2014 June 25, 2014
    In my ISTE Sunday 8-10 am poster session, I demonstrate many diverse mobile activities to help students achieve the English Language Arts Common Core Anchor Statements through mobile devices. The mobile activities focus on free common tool apps that are available on both the Android and the iPad. The students use the apps as a seamless […]
    hgtuttle

Blog Stats

  • 777,762 hits
Advertisements