UVA assistant professor of English Piers Gelley in his office
Artificial Intelligence

Inside UVA’s AI Literacy & Action Lab: A&S Students in Pilot Class Pitch AI Lesson Plans to High School

As the University of Virginia navigates the impact of artificial intelligence technologies on higher education, students in the College and Graduate School of Arts & Sciences are playing a key role in developing new ways to integrate AI tools into how we learn, research and create. 

Assistant professor of English Piers Gelly acknowledged that the idea of opening the door to Claude, ChatGPT and other Large Language Models in his first-year writing seminars would have been taboo just a few years ago. This spring, however, Gelly’s students were encouraged to develop — and pitch to a local high school — ways that LLMs and AI could be used as teaching tools in literature and writing classes as part of a pilot supported by a new joint venture between the University’s College and Graduate Schol of Arts & Sciences and UVA Library. 

The new AI Literacy and Action Lab, a program aiming to equip UVA students, faculty and researchers with the technological knowledge, ethical understanding and practical skills needed to effectively assess AI’s potential uses across a wide range of academic and research disciplines, was publicly introduced in April. Gelly’s spring seminar, “You and A.I.,” was one of four faculty pilots already underway before the Lab’s public launch. The other pilots in that first cohort included courses designed by A&S faculty in the departments of chemistry, economics and philosophy. 

“Within the English Department, there are a lot of opinions about whether AI-engaged lessons have a place in writing seminars where we want students to focus on developing their creative, human writing skills,” said Gelly, whose case study on the pilot class was recently published by UVA Library. “Those concerns are valid, but the other argument is, ‘What better place to think about AI literacy than a class where students are already engaging deeply and substantively in questions about literacy?’” 

A framework for AI literacy

The AI Literacy and Action Lab is based on a framework developed by Leo S. Lo, UVA University Librarian and Dean of Libraries. The model has been adopted by peer institutions across the country, and the Lab’s programming is organized around five linked competencies: technical knowledge, ethical awareness, critical thinking, practical skills and understanding AI’s societal impact. 

“This Lab is focused on learning, doing and evaluating,” Arts & Sciences Dean Christa Acampora said. “It is a powerful example of how the liberal arts and sciences cultivate distinctive human capacities — such as reasoning, discerning, choosing and creating — and hone them through concrete opportunities to advance knowledge, discovery, and creativity.” 

Halfway through the “You and A.I.” writing seminar last spring, Meredith Wolnick, UVA Library’s director of teaching and learning, and Sherri Brown, UVA Library’s liaison to the Department of English, introduced Gelly’s students to the AI literacy framework developed by Lo. Tim Klobuchar, an English teacher at nearby Monticello High School also visited the class to share his teaching experience with AI in public high school classrooms, as well as his thoughts — as vice president of the Albemarle Education Association, the labor union representing Albemarle County Public Schools employees — on the role that organized labor might play in setting AI policy. 

Over the course of the semester, Gelly’s students worked in small groups to develop ways to apply Claude or other LLMs in the teaching of creative writing and other upper-level high school English classes. They then pitched their lesson-plan proposals to Klobuchar for consideration for the honors-level and AP English classes he teaches at Monticello. 

“I was excited to have the students collaborate with Tim,” Gelly said, “because he’s someone who can share his real-world experience wrestling with AI and thinking through whether it can be a useful teaching tool. That really makes students in this class sit up in their chairs, knowing that Tim is going to evaluate their work and perhaps be a little more blunt than I would when it comes to whether he actually would use something they pitched.” 

In the end, Klobuchar rated all the students’ proposals either usable or adaptable with modifications and said he was impressed with the level of detail in the proposals pitched to him by Gelly’s students.  

“They’re very well thought out,” he said. “These UVA students are only a year removed from their own high-school experience, so their perspectives on AI and its potential benefits are based on that recent experience.” 

Building on the lessons learned 

One proposal from UVA student Emily Hickey’s group suggested assigning small groups to collaborate to write short stories without using AI, while empowering one group — secretly — to use ChatGPT to submit an AI-generated story. The proposal recommends having students read all the stories at the next class and try to identify which one is AI-generated. As a critical thinking exercise, Hickey explained, the project asks students to evaluate not only writing quality but whether AI can demonstrate the same type of creativity as human writers. 

The goal is to help students develop a clearer way of judging whether designing a prompt for ChatGPT and other large language models has creative value; or if creativity lies in the original idea, your intentional choices as you craft a story, or the final prose. 

“As a pre-med student, this hasn’t been a typical class for me, but it was my favorite class of the semester,” said Hickey, a New Jersey native. “We talked a lot about using AI from an ethical standpoint and about how AI can enhance our education without completely overtaking our learning.  

“This project challenged us to find a strategy where we were helping teach the students to improve their AI literacy and their knowledge of what AI can do to help them. But we’re still trying to supplement their learning so that they’re not completely reliant on it, which has been a really interesting approach to AI. I feel like it’s a good it’s a good representation of what we’ll be doing in the real world.” 

Hickey’s classmate Ryan Heidler said he was not sure what to expect from Gelly’s seminar when the semester started. Developing the teaching plan that they pitched to Monticello High School and debating AI’s value reinforced for him, however, its applicability as a useful tool to support human creativity. 

“It’s very much a two-way street where you’re giving it ideas as you write prompts and bounce ideas off it,” said Heidler, a second year from Tennessee. “I was watching one of the groups in the class use AI to write their story, and it was very much like a back-and-forth conversation, like they were engineering it in a certain way. What it showed me is that if you are applying your own critical thinking and you have the judgment skills to work with it, AI is an extremely helpful tool for writing and coming up with ideas.” 

 Ideally, Gelly said, the lesson plans designed by his students in last spring’s pilot class — and by students in future versions of the seminar — could be reviewed and approved for a collection of potential lessons plans available as part of an open-source educational teaching resource developed by UVA Library. 

“I will certainly use some of these lesson plans in the next iteration of my course,” Gelly said. “And I think every time we do this exercise, as future students look at these lesson plans and take into account how previous students have approached the assignment, the bar is a little higher.” 

Read more research news from College and Graduate School of Arts & Sciences.

This article was originally published here: https://as.virginia.edu/news/inside-uvas-ai-literacy-action-lab-students-pilot-class-pitch-ai-lesson-plans-high-school