Developing an AI literacy test for junior secondary students: The first stage

Artificial Intelligence (AI) education for K-12 is increasingly important as the emerging AI technologies are pervasively infused into human daily lives. Eleven countries have endorsed and implemented the AI curricula at K-12 levels [1]. The "Five Big Ideas" about AI, as proposed by the Association for the Advancement of Artificial Intelligence (AAAI) and the Computer Science Teacher Association (CSTA) have emerged to form the core components of K-12 AI education [2], [3]. However, the assessment of students’ learning in AI education for K-12 is still in its initial stage. Surveys and interviews are the major assessing tools based on students’ self- perceptions. Standardized tests on students’ AI literacy are still rare. This paper focuses on the first stage of an AI literacy test based on the Five Big Ideas for Grade 7 to Grade 9 students. The test aims to measure the changes of students’ AI literacy before and after attending a one-year AI course. The preliminary findings show the students have increased in their AI literacy after attending the course. The test can provide insights for understanding students’ competencies and needs in AI literacy and improving the curriculum guidelines for students’ effective learning.