Teaching with AI

Tools like ChatGPT,  DALL•E 2 and Elicit can write essays, answer multiple choice and free response questions, create literature reviews and images, and write/decode programs. The wide range of AI capabilities may soon impact all undergraduate and graduate programs across all disciplines. As these capabilities grow, we will see more sophisticated and widespread use. There are several approaches to instructional design and assessment that may help mitigate undesirable outcomes and create opportunities for deeper learning.  

Changing how you assess student understanding while maintaining expectations for student outcomes can be difficult and time-consuming. The ideas below may not fit your teaching style or feel like the right fit for your discipline. If you would like support creating something that works for you, contact a member of the CAT team, visit our virtual office hours or schedule a consultation 

[Image Source: Human-Like Robot] From MISTI: MIT Global Experiences, Impact: Artificial Intelligence. (https://misti.mit.edu/misti-impact/impact-artificial-intelligence). Copyright [2023].

Instructional and Assessment Design Strategies:

  • Create prompts that refer to in-class/out-of-class experiences.

    Examples include asking students to respond to or expand on an in-class discussion/debate with references to specific comments; asking students to visit local sites such as Shark Valley  or other local sites rich in vegetation and describe and assess the invasive species situation; or have students attend a live performance, describe and reflect on their experiences, and analyze a portion of it using the dramatic/musical/artistic techniques learned in class. 

  • Require students to use and cite textual evidence from specific readings for essays and papers.

    The more required citations, the more challenging it is for ChatGPT. Also, asking students to use textual evidence to build their academic arguments is a skill we want them to develop. Note, longer essays and papers requiring a relatively high number of citations will make it easier to identify questionable submissions as the AI will likely cite things that novice learners would be unlikely to use.  

  • Ask students to compare seminal works or findings to current publications.

    ChatGPT does not pull any citations after 2021. This also allows you to ask students to consider how current knowledge is the result of foundational work. 

  • Ask students to respond to a prompt from a specific point of view.

    For example, ask students to respond to questions from the perspective of someone living in Miami, as an FIU student, or from the culture of their family of origin. Have them reflect on how their lived experience impacts their understanding of the topic. 

  • Break larger, higher-stakes assignments into smaller chunks.

    When the overall grade in a course relies on only a few high-stakes assignments, students are more likely to panic and,in some cases, turn to inappropriate behaviors. This phenomenon is outlined in James Lang’s Cheating Lessons. Doing this also provides the opportunity for the faculty to gauge overall class understanding earlier and redirect if needed. 

     
  • Have students complete at least some work in class.

    Several teaching structures (e.g., flipped classrooms, hybrid, active learning) require students to do work in the classroom. It allows students access to the expert (the faculty) when they are struggling with the content. There are many ways to reduce the grading load for larger classes such as group quizzes, personal response devices, and shorter writing assignments. CAT can help you figure out what might work for you or connect you with other faculty at FIU that are using some of these techniques. 

  • Have students submit a hand-written, extemporaneous short essay at the start of the semester.

    Having an example of their natural writing style may be helpful as a comparison later in the semester. Students with work that appears to be drastically different from what you have on record may indicate a closer examination or conversation is warranted.   

  • Use the AI responses to writing prompts as part of the class.

    Incorporating the AI responses into your assignments can help students recognize the limitations of these products and can help students develop critical skills. You may consider providing students with an AI response to a prompt and ask them to critique it for correctness, style, or substance. For shorter written work, ask students to compare their work to responses from the AI (Hint: plan to have the AI responses prior to class as AI servers can be down or at capacity without warning). 

  • Consider alternative assessments.

    Asking students to perform behaviors that reflect their subject area understanding in class or recorded in small group settings for online/hybrid classes can provide evidence of students meeting desired learning outcomes. Possibilities include presenting problem solutions complete with rationales for their approach,editing each other’s work using rubrics that align with your expectations (for formative stages of an assignment),assessing their own work using your rubrics (as a portion of their grade), or recording interviews or podcasts with experts (or for a different twist, novices) that reflect the knowledge of the student (i.e., the questions and the follow-up to the responses are graded).  

Strategies Beyond Instructional and Assessment Design:

  • Familiarize yourself with AI products.

    Submit sample prompts to ChatGPT to see what types of responses are produced. You may want to submit a variety of the kinds of prompts you give your students to get a feel for the nature of the responses ChatGPT creates. The language used may be very different from what you normally see in student writing. For example, ChatGPT responses can feel “canned” with standard writing structures and word choices. Students often use more expressive language and may not always use standard essay structures. Additionally, AI responses are on the low end of the taxonomical skill set. You are not likely to see language reflecting analysis, critique, interpretation, conjecture, or synthesis. 

  • Share with your students concerns about data security.

    AI products are asking students to submit their phone numbers and/or emails. This may result in their information being shared or sold. There is also the potential for fake AI products and scams. 

  • Decide how you want to treat the potential use of AI responses in your classes and let your students know in the syllabus and on the first day of class.

    Outlining expectations and your reasons for them help students understand why you have designed your course and its assessments in the manner that you have. Don’t assume that their prior experiences will align with your expectations. Students will come to your class with experiences that range from “anything goes” to highly secure, proctored examinations.Use this link for syllabus language suggestions. 

  • Early in the semester, help students understand why representing their own understanding is so important.

    You may be inclined to start by sharing what the consequences of misrepresenting work looks like in your discipline (e.g., loss of funding or credentials, legal actions, or even injuring others), but it may be more impactful if you help students understand the benefits of doing their own work. Here are some ideas: 

    1. Have a discussion at the start of the semester about their fear of not “getting it right”. Share how challenging it can be for you to do some of your research and what you do when you feel stuck. 

    2. Explain how you use what they submit to guide what you do in class or the attention that you give them.  

    3. Create space for failure and confusion in your classroom. Help students understand that “getting it right” requires time, effort, and, often, failed attempts.  

    4. Ask students to talk about what they think of dishonesty in general and then, what they think constitutes academic dishonesty and what does not. A class consensus on what academic dishonesty will look like in your classroom may take a bit of time, but it may be a useful deterrent. 

  • Consider the key skills, knowledge, and/or behaviors that you want to assess and stick to those.

    More frequent, lower-stakes assessments help minimize students’ perceived need to cheat (see Carnegie Mellon’s very useful resources). However, if we overload students with so many low-stakes assessments in all of their classes, they may not have sufficient time to complete all of their work and resort to the practices that we were trying to avoid. Here are some ideas: 

     

    1. Use ungraded peer feedback (using your rubrics) for smaller assignment chunks. 

    2. If you choose to have more frequent assessments, consider making them shorter and more focused. 

    3. Practice is an important part of learning. But, if students are practicing without understanding, they are likely internalizing incorrect/incomplete understandings. Consider using tools that help students identify, learn about, and practice the content that they don’t yet fully understand and skip the content that they do. 

    4. Provide students with assessment options. Some faculty at FIU have found success with allowing students to select which assignments they will complete to show their understanding. 

Additional Resources: