Exploring AI competency in Chinese undergraduates through the UNESCO framework

Key findings from this study

• The study found that Chinese undergraduates demonstrate stronger competencies in AI mindset and ethics than in technical areas and systems design.
• The researchers demonstrate that first-year students report higher technical skills than senior students, challenging conventional competency progression models.
• The study found a substantial misalignment between students' developed competencies and China's national priorities for practical AI skills in the workforce.

Overview

This study validates the UNESCO AI Competency Framework for Students using survey data from 583 Chinese undergraduates across 13 institutions. The research examines competency levels across four dimensions: Human-centered mindset, Ethics of AI, AI techniques and applications, and AI systems design. Results reveal a significant theory-practice gap between students' stronger performance in mindset and ethics versus technical competencies, misaligned with China's strategic priorities for practical AI skills.

Methods and approach

The researchers administered surveys to 583 undergraduates distributed across 13 institutions in 9 Chinese cities. Principal component analysis confirmed the four-dimensional structure of the UNESCO framework. Multivariate analyses assessed differences by student cohort, gender, and academic discipline.

Results

Students demonstrated stronger competencies in human-centered mindset and ethics dimensions compared to technical areas. First-year undergraduates reported higher technical skills than senior students, contradicting typical progression models where expertise accumulates over time. Principal component analysis validated the framework's four-dimensional structure in the Chinese higher education context.

Multivariate analyses revealed limited effects of gender and academic discipline on competency distributions, with technical aspects showing the most differentiation across these demographic factors. The data consistently indicated a substantial gap between theoretical knowledge and practical application capabilities among surveyed students.

Implications

The identified theory-practice gap suggests current AI curricula in Chinese higher education prioritize conceptual understanding over technical implementation. This misalignment conflicts with national strategic objectives emphasizing practical AI competencies. Institutional reform should incorporate co-creation approaches, spiral design methodologies, and personalized learning pathways to develop responsible AI engagement.

The unexpected finding that first-years exceed seniors in technical competencies warrants investigation into curriculum sequencing and pedagogical approaches. Educators may require targeted professional development to effectively teach advanced technical AI content. The framework's validation in Chinese contexts establishes empirical evidence for applying international competency standards across non-Western educational systems.

Scope and limitations

This summary is based on the study abstract and available metadata. It does not include a full analysis of the complete paper, supplementary materials, or underlying datasets unless explicitly stated. Findings should be interpreted in the context of the original publication.