The Development of a Digital Platform for Evaluating and Using AI-Generated Content for Academic Purposes
Compose with AI is our digital platform, which will guide students
- to gather and critically evaluate content produced by AI tools such as ChatGPT
- on beneficial and ethical uses of content produced by AI
- to use AI-generated content as a model and resource for composing science-focused texts that make arguments, make claims, and/or provide reasoning
To support diverse learners, Compose with AI will feature embedded videos to provide guidance, incorporate self-regulated learning prompts (Sanders et al., 2019), promote computational thinking, adhere to Universal Design for Learning principles, and assist students in gathering relevant information to create digital compositions.
HOW DOES Compose with AI WORK?
CHOOSING A TOPIC
After signing in to the platform the students will see a dashboard showcasing various writing tasks and AI integration options.
Each option embedded a video explaining how and why you could use it.
The students pick a topic to start their writing experience.
START THE PROJECT
Students can learn about the topic via a video that can be clicked once a topic has been selected.
Students name their project to start.
WRITE A PROMPT
Once students select their purpose related to writing, they are walked through a structured process for engineering a high-quality prompt related to their specific needs.
The R.A.F.T. technique (Role, Audience, Format, Topic) supports them to write a well-founded prompt.
TRY YOUR PROMPT
Students click the “try it” button to try their prompt in Chat GPT or other AI tools chosen through the teachers dashboard.
The students copy the provided answers from the AI tool into the “AI Response” box at the “Compose with AI” website.
RATE YOUR PROMPT
After students review the results generated by AI, they are guided to rate their prompt and decide if it generated the information they needed.
If they indicate that they were unable to write a prompt that helped them, they are redirected to try a new prompt. Otherwise, they move forward.
EVALUATE THE AI RESPONSE
Students critically evaluate the credibility, usefulness and accuracy of the AI response. Students are given a menu of options and each type of evaluation strategy is explained in an embedded video. Students are required to choose two evaluation strategies and answer related questions about their AI content before the platform advances them to the next step.
INFORMATION & TEXT
Students are guided to select which information from the AI-generated response is useful for their purpose.
They are provided with three boxes where they categorize information from the response as something they can use as it is, something they can use but need to modify, and something they will not use.
COMPOSE YOUR RESPONSE
Once this step is complete, the students are directed to compose a response.
This screen varies based on which task-type they chose from the dashboard at the beginning. Regardless of task-type, the information that students have collected and categorized throughout the process follows them throughout the platform and culminates here.
Students have information about content they want to use or exclude available to them on the left side of the screen as they compose their response. Students are required to provide their sources, including AI, before moving to the final screen.
SUMMARY
The summary on the final screen shows the students all the steps they took and the information they collected throughout the entire platform. It also allows them to save their work as a PDF.
