Hiring in life sciences? Share your open positions with our professional community. Read more Close

Advertisement

Evaluating AI-generated curriculum designs in vocational education: Evidence from a No-AI diagnostic assessment.

Created on 15 Aug 2026

Authors

Zheng Liu

Published in

PloS one. Volume 21. Issue 8. Pages e0352555. Epub Aug 14, 2026.

Abstract

This study examines how vocational students evaluate AI-generated curriculum designs after using generative artificial intelligence to support course-planning tasks. It reports an interpretive single-case study of a Study Tour Curriculum Design course in a Chinese vocational college. Data comprised course task briefs, the instructor's reflective teaching memo, and a closed-book handwritten diagnostic assessment completed by 39 second-year students without AI access. The diagnostic assessment yielded 182 substantive diagnostic claims, which were analysed through thematic and directed content analysis, with students' complete responses also assigned holistic written judgement levels. Students could state broad criteria for judging AI-generated work, including accuracy, feasibility, learner appropriateness, safety, and the need for human revision. Their applied diagnostic performance was uneven. Most identified visible implementation problems such as learner mismatch, time pressure, site overload, and safety insufficiency, while fewer diagnosed deeper issues of curriculum logic, assessment operationalisability, fact verification, and author responsibility. The study identifies this pattern as a stated-applied judgement gap. The findings suggest that no-AI diagnostic assessment can make students' judgement of AI-generated vocational work visible and can help teachers identify where AI-assisted task completion has not yet developed into stable professional judgement. The study offers a transparent classroom case of how AI-generated outputs can be evaluated in vocational education, while recognising the limits of a single-case design.

PMID:
42599986
Bibliographic data and abstract were imported from PubMed on 15 Aug 2026.

Read full publication at:
Please sign in to see all details.

Advertisement

Stats

  • Community rating n/a 0 votes
  • Reviewers' rating n/a 0 votes
  • Your rating

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

  • Recommendations n/a n/a positive of 0 vote(s)
  • Views 10
  • Comments 0

Recommended by

  • No recommendations yet.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.

Advertisement