The future of assessment: embracing AI and EdTech

The landscape of tertiary education is undergoing a significant transformation driven by rapid advancements in artificial intelligence (AI) and educational technology (EdTech). As we look towards the future, the role of assessment is set to evolve in ways that promise to enhance learning outcomes while posing new challenges for institutions, educators and students.

Earlier this year, The Edge Foundation and partners hosted the Next Generation Assessment Conference 2024 at the University of Manchester. Among other seasoned experts, the conference saw Dr Miriam Firth (senior lecturer in education management and leadership, University of Manchester), Dr Andy Kemp (principal, The National Mathematics and Science College), and Dr Timo Hannay (managing director, SchoolDash) sharing their insights on the transformative potential of AI in assessment. They also addressed some of the challenges we must navigate as we responsibly implement these technologies.

The potential of AI in assessment

AI offers remarkable opportunities to revolutionise the assessment process. Traditional assessment methods, such as standardised tests and written exams, have long been criticised for their limitations, including potential biases and their inability to fully capture a student's understanding and skills. AI, with its ability to analyse vast amounts of data and adapt in real-time, provides a more nuanced and comprehensive approach to evaluating student performance.

Dr Miriam Firth emphasised the importance of student engagement with AI technologies. Her research indicates that while there are concerns about AI's role in education, particularly regarding fairness and the potential for misuse, there is also a significant opportunity for AI to enhance the assessment process. By allowing students to interact with AI and understand its capabilities, educators can demystify the technology and build trust among learners. This engagement is crucial for developing AI-powered assessments that are fair and effective.

Transforming assessments through conversational AI

One of the most promising applications of AI in education is the development of conversational AI systems that facilitate personalised, adaptive assessments. Dr Andy Kemp envisions a future where AI enables more humane and authentic assessment experiences. He argues that the most effective assessments often resemble dialogues between teachers and students, where misunderstandings can be addressed in real-time, and deeper insights into a student's knowledge can be gained.

Imagine a scenario where a student interacts with a virtual avatar that can dynamically adjust its questions based on the student's responses. This approach not only makes assessments more engaging but also ensures that they are tailored to each student's unique learning journey. Such systems can help identify and bridge gaps in understanding, providing a more accurate reflection of a student's abilities and progress.

Expanding the scope of AI in assessing qualitative skills

While AI's application in quantitative assessments, particularly in STEM fields, is well-established, its potential to assess qualitative skills is now being recognised. Dr Timo Hannay highlighted how advanced machine learning algorithms are being used to evaluate complex tasks such as essay writing and argumentation. This marks a significant shift from traditional methods, enabling more holistic assessments that encompass a broader range of skills and competencies.

However, as AI takes on a more prominent role in assessment, it is essential to maintain human oversight. Educators must ensure that AI systems are used ethically, and that the data collected is used to enhance, not replace, human judgement. Dr Hannay cautions against relying solely on AI, stressing the need for human accountability to safeguard the integrity of the assessment process.

Implications for institutions, staff, and students

The integration of AI and EdTech into assessment practices will have profound implications for all stakeholders at all stages of education. Institutions must invest in the necessary infrastructure and training to support the implementation of these technologies. This includes ensuring that educators are equipped with the skills and knowledge to effectively use AI tools in their teaching and assessment practices.

For educators, the shift towards AI-powered assessments offers an opportunity to move away from rote memorisation and standardised testing. Instead, they can focus on fostering critical thinking, creativity, and problem-solving skills in their students. By leveraging AI, educators can provide more personalised feedback and support, helping students to achieve their full potential.

Students, on the other hand, could benefit from more engaging and meaningful assessment experiences. AI can provide immediate feedback, allowing students to learn from their mistakes and make improvements in real-time. This continuous assessment model aligns more closely with the principles of formative assessment, where the primary goal is to enhance learning rather than merely evaluate it.

Conclusion

As AI and EdTech continue to evolve, the future of assessment in education looks promising. These technologies have the potential to create more equitable, personalised, and effective assessment practices that better reflect a student's abilities and progress.

However, this transformation requires careful consideration and collaboration among all stakeholders to ensure that the benefits of AI are realised while mitigating potential risks. This will need to be a key theme looked at in the exciting review of curriculum and assessment announced by the new government, which will become ever more prominent in the coming months.