Problems with Institutional Assessment

Assessment dominates education from K-12 through college.   There are different types of assessment, formative (helps students improve) and summative (grading of students).  However, institutional assessment  involves the bigger picture of how an institution or a department is doing academically.

In institutional assessment, teachers enter data into a  mega-database. For example, teachers may enter their students’ grades  on each section of the final. Then someone, often a department head,  analyzes the overall results using the online data, to assess the student learning across specific courses and across the department.

Institutional assessment has some basic flows
1) Most institutions have not identified a specific  enough curriculum that can be assessed.  Many contain very general statements of learning.  For example, English might state that  students will write a well-written essay. Has the English department specified what constitutes a well-written essay?  Likewise, a Modern language department may have the curriculum statement  “The student should speak in sentences that have relatively simple structures and concrete vocabulary”.  What does “speak” mean?  Does it mean to be able to talk about one’s life, to hold a conversation. to repeat from memory?  When there are only general  learning statements, there cannot be any  meaningful assessment.

2) If departments have identified specific learning goals, what is the priority of those learning goals? For example, in English the purpose of writing is to communicate ideas or feelings.  Shouldn’t the organization of ideas be more important than the spelling?  Or does spelling/grammar have the same assessment weight as organization?  Likewise,  in  Modern Languages, are all skills (listening, speaking, reading and writing) treated equally in assessment weighting even though both in class and in the real world, people listen and speak almost double the amount that they read and write?  Have the specific learning goals and their priority been communicated to the teachers/students through a department website/wiki?

3) The departments do not have exemplars that show the quality that they expect of students.  Does the English department share  electronically with all English teachers essays that show what constitutes a high level paper,  an acceptable paper, and a non-acceptable paper?  Again, are these exemplars on the department website for each course?  Does the Modern Language department share audio files of  a good ten sentence conversation through their website or an their department app?

4) They have vague assessment tools.  The English department has a generic rubric (has good organization,  conveys ideas, etc.) that can be interpreted differently by different people.   What type of essay will be the written? An autobiographical essay requires a very different approach than a contrast essay.  In Modern Languages, how will writing be assessed – holistically or analytically?  If different educators can come up with different scores for the same student, then the assessment tool does not accurately measure learning.  Teachers can receive a digital image of the rubric and work assessed using that rubric.   How well does the assessment tool match up with how the information was taught in class?  Is the assessment tool such as the final developed  at the  competency level or at the highly competent level?  Students may be competent but not highly competent

5) The departments do not do a thorough analysis to get at the root problem once they have discovered a gap.   If the students do not achieve well, was it due to the  students’ lack of effort, a misunderstanding of  how to answer the  assessment question, a specific word in the  assessment question,   the thinking level of the test question,    the structure of the assessment item,  the textbook, the textbook’s powerpoints,  the teacher’s explanation, the homework, or  the online work?  Usually much additional exploration is needed to determine the real reason for the gap. Once the  department identifies the gap, what  specific strategy will help the students over come this gap?  Will the department suggest  technology-based strategies that appeal to students such as Youtube videos, interactive websites,  interactive apps  and that help the students directly overcome the gap?

6) Most important of all, how does the institutional assessment help  students improve in the course right now?  Most institutions assess once a semester.  After the analysis, the department  focuses on  what changes will happen in the future year.  Unless regular assessment is done in small intervals  throughout the year and changes made almost instantly, then the assessment does not benefit  the present students.  Next year’s students may be very different than the students who took this assessment.  Classroom teachers need access to the online data and analysis so they can take class time to provide  the students new learning strategies.  Then, students can be successful learners!

How does your institution assess  student learning?

My Spanish spontaneous speaking activities (20+) includes Modified Speed Dating (Students ask  a question from a card-whole class), Structured Speaking (Students substitute in or select words to communicate in pairs),  Role Playing (Students talk as people in pictures or drawing from 2-4 people) and Speaking Mats (Can talk using a wide variety of nouns, verbs and adjectives to express their ideas- pairs or small group),  Spontaneous Speaking (based on visuals or topics in pairs),  and Grammar speaking games (pairs or small group). Available for a nominal fee at Teacherspayteachers:  http://bit.ly/tpthtuttle

My three formative assessment books:   http://is.gd/tbook

About these ads

0 Responses to “Problems with Institutional Assessment”



  1. Leave a Comment

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s




RSS Education with Technology

  • English +Common Core +Mobile = Success (ISTE2014 Poster -details) June 30, 2014
    Here are the ten examples I showed at my English + Common Core  + Mobile ISTE 2014 Poster Session: Based on CCSS Anchor Statements: L.2 Take a Conventions Mobile Online Quiz  to pick the  incorrect sentence from four choices (capitalization) SL.2  Evaluate audio recording of a  book chapter on mobile and predict for next chapter. […]
    hgtuttle
  • Global Cultural Learning Using Mobile Devices (ISTE Mobile MegaShare Presentation) June 28, 2014
    Based on my presentation at ISTE 2014 Mobile Megashare Why teach about other countries? Location: Large view to small on maps. Culture or culture. Find six similarities in a  mobile picture from another culture (“Wars are caused by differences, not similarities.”-Tuttle.) Tell one piece of information from each different Internet visual from a place in that […]
    hgtuttle
  • English + Common Core + Mobile = Success in Learning Poster Session at ISTE 2014 June 25, 2014
    In my ISTE Sunday 8-10 am poster session, I demonstrate many diverse mobile activities to help students achieve the English Language Arts Common Core Anchor Statements through mobile devices. The mobile activities focus on free common tool apps that are available on both the Android and the iPad. The students use the apps as a seamless […]
    hgtuttle
  • English Common Core Mobile Activities ebook June 18, 2014
    I recently published English Common Core Mobile Activities ebook. Use these 150+ different mobile activities to guide your students in learning and demonstrating the English Language Arts Common Core State Standards (CCSS) Anchor Statements in Language, Speaking and Listening, Reading, and Writing. The activities, organized by Anchor Statements, actively eng […]
    hgtuttle
  • Giving Students a Voice in App Selection January 8, 2014
    Traditionally, teachers research apps for their class. They assign apps to students.  The teachers assign a specific app or give students a choice of several pre-selected apps.  As a Modern Language teacher, I suggested apps to my students in the early part of the year. However, in January, I let my students select which apps […]
    hgtuttle
  • Considering Home Learning When Doing Mobile December 14, 2013
    Many schools are going mobile or one-to-one.  Schools sometimes make decisions without thinking about the full consequences such as mobile and home learning. If schools supply mobile devices to the students, do the students take the mobile devices home?   If students do not take the mobile device home, then mobile is only considered an […]
    hgtuttle
  • Good Apps vs Very Good Apps November 5, 2013
    Good mobile learning practice apps  facilitate and transform learning. Mobile learning activities can  increase students’ time on task.  In a classroom, a teacher calls on one student  after another but no student is active all the time; only those who are called on are active. Students remain  off task for much of the time since […]
    hgtuttle
  • Group Texting Programs: The Next Big Wave? October 10, 2013
    Group texting programs fall into two categories.  The first category consists of teacher- to-student text programs such as Reminder 101, . In these programs, the teacher sends out  text reminders, announcements, notes, etc. to the whole class with just a click of button. These programs are teacher -centered since the teacher pushes out information but […] […]
    hgtuttle
  • Assessment and Mobile Learning Questions September 10, 2013
    Technology can play a critical role in the learning process.  Here are some questions about assessment and mobile learning to think about as you plan for your mobile learning. Who/ What  will assess the students’ mobile learning? A) the same mobile app that the student worked on B) a  different mobile app C)  the teacher […]
    hgtuttle
  • How will students’ mobile device be used for learning? September 2, 2013
    How will the  students’ mobile device primarily be used? What other ways can teachers have students use mobile devices to engage in  learning? to introduce the learning goal to the students  before the teacher does in class  such as in a flipped classroom to introduce the learning goal during the class presentation to present alternative […]
    hgtuttle

Blog Stats

  • 649,327 hits

Follow

Get every new post delivered to your Inbox.

Join 74 other followers

%d bloggers like this: