Archive for the 'Assess' Category

Assessment and Mobile Learning Questions

Technology can play a critical role in the learning process.  Here are some questions about assessment and mobile learning to think about as you plan for your mobile learning.

Who/ What  will assess the students’ mobile learning?
A) the same mobile app that the student worked on
B) a  different mobile app
C)  the teacher corrects a paper and pencil quiz
D)  an online  program evaluates learning
E) the teacher assesses the students’ paper, presentation or project that incorporates learning from the mobile device
F) some one in the class, school,  or another school assesses the learning.
G) some one outside the school, from the community, an organization, etc. assesses the learning.
H) the students self-evaluate and reflect on how to improve

Will the assessment be?
A) summative ( a final grade)
B) formative with  specific feedback and an opportunity for improvement

My ebook, 90 Mobile Learning Modern Language Activities, is available at http://bit.ly/90mlact.

My three formative assessment books, Improving Foreign Language Speaking Through Formative Assessment, Formative Assessment: Responding to Your Students and Successful Student Writing Through Formative Assessment, are available at   http://is.gd/tbook

My modern language blogs are  now at  http://bit.ly/imprml.  I have developed 27  Spanish activities and 4 Modern Language Visual activities in which students begin to express themselves in the modern language and to  move toward spontaneous speaking Teacherspayteachers:  http://bit.ly/tpthtuttle

E-Texts: Innvovation or Status Quo

Many textbooks now have an e-text version.  Do these e-texts improve  student learning?

Some advantages:
– No heavy or bulky textbook to carry; portable
– Font size can be adjusted so students can more easily read or see information.
– Text can be searched
– Often has an online assessment; allows online quizzes  to be graded automatically online
– Often has an online homework management; allows  homework  activities to be graded automatically online
– Has organized the content into  chapters; chapters have various sections
– Text can be copied and pasted from the  e-text into a word processor
– Text can  usually be highlighted
– Usually includes multimedia (pictures, video, audio…)

Some disadvantages:
– Often is an exact  reproduction of the textbook. An E-text probably is   not linked,  therefore,  students cannot  click on words or images to get additional information.
-The e-text is still mainly print (word) based.
– Many images  may supplement  the text but they do not add new information;  images help explain the text instead of the image being the main source of information.
– Usually a student cannot write in the e-text such as writing  comments in the margin
– The user needs an e-reader, a computer or a mobile device to read the e-text.
– Additional exercises are  predominantly word based.
– Most e-text homework managers and on-line quizzes only tell the students if they are right or wrong. They do not provide new strategies for learning the material.
– Since homework and quizzes are done online, the teacher may never review what the students do not know. If the teachers do not review student progress, then the teachers cannot provide formative activities for student  improvement.
– Interactivity  may include activities such as  moving some words around or rearranging pictures but  the e-text interactivity  usually lacks high  interactivity such as simulations.
– Additional exercises are still  predominantly at a  low level of thinking.  They do not engage students in real-life use of the learning.
– Often multimedia is an add-on, rather than an integral part of the basic textbook.  Often multimedia comes after the main learning.
– An  e-text cannot be customized; teacher cannot rearrange parts such as  combining a part from chapter 1, a part from chapter 3, and a  a part from chapter 8 to create a new chapter.
– The digital textbook can be outdated very quickly if the  e-text does not contain links to current events.
– May not show the learners  the priority of the learning concepts within the chapter. What part of the chapter is the most critical? Is the most time and space spent on that critical learning or do minor  concepts get equal time and space?
-E-texts are boring since they are still traditional textbooks.

What are your reactions to using e-texts?

My modern language blogs are  now at  http://bit.ly/imprml

I have developed many  Spanish activities that allow students to begin to express themselves and to begin to move toward spontaneous speaking as in a natural conversation at Teacherspayteachers:  http://bit.ly/tpthtuttle

My three formative assessment books:   http://is.gd/tbook

Mobile Learning and Assessment

Can use a wide variety of mobile devices and of mobile apps for capturing student learning, analyzing it, providing feedback, and recognizing learning success.

Identify the specific learning goal

Have QR codes for exemplars that students can refer to anytime during the learning process

Pre-assess with mobile device: Need data to go to one location for analysis

Monitor and collect student data: Transform non-data activities such as texting into data ones. Constant monitoring of students. Daily/weekly review of data. Mobile device  spreadsheet of students’ scores

Use formative assessment: In-class performance tasks and short quizzes

Provide feedback: QR code to New strategy to overcome learning gap; Differentiate in strategies

Peer assess: While doing task on app or after learning task

Self assess: See progress and evaluate how to become better

Use Eportfolio: Wiki Edmodo ….

Celebrate successful learning

Other resources:

Search my education and technology blog bit.ly/hgtblog (Am on EdTech’s “The Honor Roll: 50 Must-Read K–12 Education IT Blogs”).

My modern language blogs are  now at  http://bit.ly/imprml

I have developed many  Spanish activities that allow students to begin to express themselves and to begin to move toward spontaneous speaking as in a natural conversation at Teacherspayteachers:  http://bit.ly/tpthtuttle

My three formative assessment books, Formative Assessment: Responding to Your Students,  Successful Student Writing Through Formative Assessment, and Improving Foreign Language Speaking Through Formative Assessment, are available at   http://is.gd/tbook

Academic Online Poll/Survey Guidelines to Improve Student Learning

Many teachers have begun to use online polling or survey tools in their classroom.  The clicker movement has become transformed into a multitude of  e-polling  tools such as those described in Web 2.0 Survey and Polling Tools.

Some general guidelines for a learning poll in a classroom.

1) Decide on the purpose of the poll.  Is it a pre-assessment, in-progress assessment, or a final assessment?

2) Focus the poll on a single  specific learning concept.  Do not do a poll on all Spanish foods  but on  the subcategory of  breakfast foods.  Avoid sampling polls that cover many different learning concepts.

3) Ask critical essential  material.  Go for the truly important learning , instead of the trivial learning.  It is more important to know what type poetry a poet wrote rather than how many husbands she had.

4) Ask higher level questions  Which of the following  sentences uses an analogy?  or

5) Keep the wording  simple. Avoid negative questions.  Avoid long  questions or statements. Avoid long multi-line possible answers.  Although open-ended questions often allow the students more flexible in how they answer the question, these open-ended answers are hard to analyze for overall class performance.

6) Keep the poll to 10 or fewer questions.  Make it a quick poll to take.

7)  Decide whether to give the poll as homework or in-class.  If done in-class, is it a review of yesterday (or the past few days)?  Is a poll given after  in-class instruction and some practice?  Decide when it  fits in the lesson to give you the best picture of students’ learning?

8) Decide if the poll is anonymous or whether the students identify themselves.  If students identify themselves, then you can keep track of their progress.   If students identify themselves, make sure your poll program can store the data.  Some poll programs have polls that disappear after a certain amount of time. Does the program allow you to manipulate the data such as sorting or ranking?

9) Decide if you will share the class results with the class or whether you will be the only one to look at the data.  If you share the results with the class, does the poll program produce an overall graph with no names or identification of individual students?  For example, the poll may show a graph of how many A,  B, C, and D answers there were for an individual question and  highlight the correct answer.

10)  If you are using the poll for class improvement, do you  provide new strategies for students to overcome the learning gaps shown in the poll? If  you explain the “wrong” answer in the same way that you have previously explained it, then students who are presently confused will still be confused.  Do you have a new different strategy for students to learn the material?  How soon after giving the poll will you give the new strategy? (Research says the sooner, the more effective.)  Do you have students practice the new approach?

11) If at least 20% of the students do poorly (below 80%) on the  poll,  do y0u re-poll students within a few days to see if they have overcome their learning gaps? Can they show that they are proficient?

12) Decide if your next online poll will be this subcategory of the learning goal at a higher learning level, another subcategory of this learning goal, or a new learning goal.  Hopefully, students will see the polls as a logical progression of their learning.

How do you use polls in your class?

My modern language blogs are  now at  http://bit.ly/imprml

I have developed many  Spanish activities that allow students to begin to express themselves and to begin to move toward spontaneous speaking as in a natural conversation at Teacherspayteachers:  http://bit.ly/tpthtuttle

My three formative assessment books:   http://is.gd/tbook

Problems with Institutional Assessment

Assessment dominates education from K-12 through college.   There are different types of assessment, formative (helps students improve) and summative (grading of students).  However, institutional assessment  involves the bigger picture of how an institution or a department is doing academically.

In institutional assessment, teachers enter data into a  mega-database. For example, teachers may enter their students’ grades  on each section of the final. Then someone, often a department head,  analyzes the overall results using the online data, to assess the student learning across specific courses and across the department.

Institutional assessment has some basic flows
1) Most institutions have not identified a specific  enough curriculum that can be assessed.  Many contain very general statements of learning.  For example, English might state that  students will write a well-written essay. Has the English department specified what constitutes a well-written essay?  Likewise, a Modern language department may have the curriculum statement  “The student should speak in sentences that have relatively simple structures and concrete vocabulary”.  What does “speak” mean?  Does it mean to be able to talk about one’s life, to hold a conversation. to repeat from memory?  When there are only general  learning statements, there cannot be any  meaningful assessment.

2) If departments have identified specific learning goals, what is the priority of those learning goals? For example, in English the purpose of writing is to communicate ideas or feelings.  Shouldn’t the organization of ideas be more important than the spelling?  Or does spelling/grammar have the same assessment weight as organization?  Likewise,  in  Modern Languages, are all skills (listening, speaking, reading and writing) treated equally in assessment weighting even though both in class and in the real world, people listen and speak almost double the amount that they read and write?  Have the specific learning goals and their priority been communicated to the teachers/students through a department website/wiki?

3) The departments do not have exemplars that show the quality that they expect of students.  Does the English department share  electronically with all English teachers essays that show what constitutes a high level paper,  an acceptable paper, and a non-acceptable paper?  Again, are these exemplars on the department website for each course?  Does the Modern Language department share audio files of  a good ten sentence conversation through their website or an their department app?

4) They have vague assessment tools.  The English department has a generic rubric (has good organization,  conveys ideas, etc.) that can be interpreted differently by different people.   What type of essay will be the written? An autobiographical essay requires a very different approach than a contrast essay.  In Modern Languages, how will writing be assessed – holistically or analytically?  If different educators can come up with different scores for the same student, then the assessment tool does not accurately measure learning.  Teachers can receive a digital image of the rubric and work assessed using that rubric.   How well does the assessment tool match up with how the information was taught in class?  Is the assessment tool such as the final developed  at the  competency level or at the highly competent level?  Students may be competent but not highly competent

5) The departments do not do a thorough analysis to get at the root problem once they have discovered a gap.   If the students do not achieve well, was it due to the  students’ lack of effort, a misunderstanding of  how to answer the  assessment question, a specific word in the  assessment question,   the thinking level of the test question,    the structure of the assessment item,  the textbook, the textbook’s powerpoints,  the teacher’s explanation, the homework, or  the online work?  Usually much additional exploration is needed to determine the real reason for the gap. Once the  department identifies the gap, what  specific strategy will help the students over come this gap?  Will the department suggest  technology-based strategies that appeal to students such as Youtube videos, interactive websites,  interactive apps  and that help the students directly overcome the gap?

6) Most important of all, how does the institutional assessment help  students improve in the course right now?  Most institutions assess once a semester.  After the analysis, the department  focuses on  what changes will happen in the future year.  Unless regular assessment is done in small intervals  throughout the year and changes made almost instantly, then the assessment does not benefit  the present students.  Next year’s students may be very different than the students who took this assessment.  Classroom teachers need access to the online data and analysis so they can take class time to provide  the students new learning strategies.  Then, students can be successful learners!

How does your institution assess  student learning?

My Spanish spontaneous speaking activities (20+) includes Modified Speed Dating (Students ask  a question from a card-whole class), Structured Speaking (Students substitute in or select words to communicate in pairs),  Role Playing (Students talk as people in pictures or drawing from 2-4 people) and Speaking Mats (Can talk using a wide variety of nouns, verbs and adjectives to express their ideas- pairs or small group),  Spontaneous Speaking (based on visuals or topics in pairs),  and Grammar speaking games (pairs or small group). Available for a nominal fee at Teacherspayteachers:  http://bit.ly/tpthtuttle

My three formative assessment books:   http://is.gd/tbook

Students Paired Oral Testing Better Than With Examiner Modern Language

Based on Brooks, L. (2009). “Interacting in pairs in a test of oral proficiency; co-constructing a better performance”. Language Testing 26(3): 341-366.

Brooks’  research shows that students who are tested in pairs outperform students who are tested one-on-one with the examiner.  In addition, the students’ interactions were more complex and revealed that students co-constructed a more linguistically demanding performance. In addition, when students worked in pairs, they more closely resembled the oral interactions typical of a real conversation.  In paired testing students demonstrated a wider range of interactions (17) to the individual format (10).   The paired students mostly commonly had these interactions: seeking confirmation, asking a question, asking for agreement, clarification requests, and prompting elaboration, finishing sentences, and referring to partner’s ideas.  Over half of all interactions in the one-on-one with the examiner was asking a question.

As Modern Language teachers, we will want to encourage oral communication in the classroom.  We can have our students do more oral work in pairs.  We can structure students speaking  from very basic conversations up to free-flowing spontaneous conversations about common topics. Our scaffolding will allow our Second Language students to have more complex and personally meaningful conversations.

Most of the  Spanish activities I have developed are for pairs. A few of them are

Spanish Tell Me About Yourself Substitution Sentences    (Partners substitute in their own answers to tell about themselves

Spanish Conversation Questions Spontaneous Speaking Partners  (Partners ask basic questions and then variations on those questions)
Spanish Friend /Family Member Detailed Description – Partner Talk   (Each partner talks about a family member using possible words)

My Spanish spontaneous speaking activities (20+) includes Modified Speed Dating (Students ask  a question from a card-whole class), Structured Speaking (Students substitute in or select words to communicate in pairs),  Role Playing (Students talk as people in pictures or drawing from 2-4 people) and Speaking Mats (Can talk using a wide variety of nouns, verbs and adjectives to express their ideas- pairs or small group),  Spontaneous Speaking (based on visuals or topics in pairs),  and Grammar speaking games (pairs or small group). Available for a nominal fee at Teacherspayteachers:  http://bit.ly/tpthtuttle

My three formative assessment books:   http://is.gd/tbook

 

Analysis of Learning with Mobile Learning

Use the following grid to analyze student learning based on  how you will be or are using mobile learning.

If you are planning for mobile learning, how can you modify your present plan to maximize learning with mobile learning?

—————————————————————————————————————————————————————————-

My formative assessment books: Formative Assessment Responding to Your Students,   Student Writing Through Formative Assessment Improving Foreign Language Speaking Through Formative Assessment. http://bit.ly/Tutbks

My 20 Spanish spontaneous speaking activities are available for a nominal fee at Teacherspayteachers:  http://bit.ly/tpthtuttle


RSS Education with Technology

  • Tech Integration Teacher, What time is it? August 23, 2016
    When someone asks what time it is, that person wants to know the time, not the history of the clock, not how a clock works, and not what other types of clocks there are. Classroom teachers want to help their students improve their academic learning through technology. Sometimes they need help with technology so they go […]
    hgtuttle
  • Curriculum Focus, Not Technology Focus July 28, 2016
    In my public school career I have been a classroom teacher, a technology integration specialist and a technology administrator. In my technology role, I served under the Assistant Superintendent for Instruction. She had a simple mission: Improve students’ academic learning. My mission was equally simple: Improve students’ academic learning through technology […]
    hgtuttle
  • Students React to Digital Badges: Pros, Cons and Interesting June 22, 2016
      ISTE 2016 By Harry Grover Tuttle, Ed. D. College World Language Students’ Preferences Digital Badges – 52%        Paper Certificates – 48% World Language: Can-Do Digital Badges Digital Badges Pro- – Breaks down proficiency more – Shows all badges at once – Is more attractive – Is more appropriate since we use […]
    hgtuttle
  • Digital Badges: Naming the Badge October 29, 2015
    Once teachers have selected what learning and what digital badges (individual or category badges; see previous blog), the teachers encounter another decision. What will they name each badge? Will they use the full name of the Common Core Standard or the national proficiency? For English, under “Speaking and Listening,”will they write out SL.2 “Integrate and […]
    hgtuttle
  • Digital Badges: Better Than Grades? October 19, 2015
    Teachers understand that the grade in a course consists of many different factors such as homework, participation , projects, tests, etc. Blodget observes that sometimes grades reflect attitude, effort, ability and behavior (http://www.academia.edu/9074119/Grading_and_Whether_or_not_Grades_Accurately_Reflect_Student_Achievement). Equally important, a letter […]
    hgtuttle
  • World Language Students Use of Mobile Devices in the Classroom October 5, 2015
    Do world language students use technology n the classroom? Do their  teachers go beyond having their students use technology simply for the drill and practice in vocabulary and grammar? Students can use laptops and mobile devices to hear authentic language, read authentic texts, read tweets about famous performers, see up-to-the-moment culture,  watch video […]
    hgtuttle
  • Digital Badges: Individual or Categorized Learning Badges? September 12, 2015
    The idea of digital badges sounds appealing for the digital children in classes. As teachers start thinking about digital badges, they have to figure out what badges will be awarded. The teachers can award social or academic badges. If teachers decide to use academic badges, then the teachers may base their badges on the Common […]
    hgtuttle
  • English +Common Core +Mobile = Success (ISTE2014 Poster -details) June 30, 2014
    Here are the ten examples I showed at my English + Common Core  + Mobile ISTE 2014 Poster Session: Based on CCSS Anchor Statements: L.2 Take a Conventions Mobile Online Quiz  to pick the  incorrect sentence from four choices (capitalization) SL.2  Evaluate audio recording of a  book chapter on mobile and predict for next chapter. […]
    hgtuttle
  • Global Cultural Learning Using Mobile Devices (ISTE Mobile MegaShare Presentation) June 28, 2014
    Based on my presentation at ISTE 2014 Mobile Megashare Why teach about other countries? Location: Large view to small on maps. Culture or culture. Find six similarities in a  mobile picture from another culture (“Wars are caused by differences, not similarities.”-Tuttle.) Tell one piece of information from each different Internet visual from a place in that […]
    hgtuttle
  • English + Common Core + Mobile = Success in Learning Poster Session at ISTE 2014 June 25, 2014
    In my ISTE Sunday 8-10 am poster session, I demonstrate many diverse mobile activities to help students achieve the English Language Arts Common Core Anchor Statements through mobile devices. The mobile activities focus on free common tool apps that are available on both the Android and the iPad. The students use the apps as a seamless […]
    hgtuttle

Blog Stats

  • 780,675 hits