nav emailalert searchbtn searchbox tablepage yinyongbenwen piczone journalimg journalInfo journalinfonormal searchdiv searchzone qikanlogo popupnotification paper paperNew
2024, 04, v.41 177-184
面向文科学生的AI自然语言生成实验与教学设计
基金项目(Foundation): 教育部-华为第二批“产学合作协同育人—新文科建设项目(A类)”(220900007181709); 浙江大学计算机技术与工程国家级实验教学示范中心项目(浙大发本2012790)
邮箱(Email):
DOI: 10.16791/j.cnki.sjg.2024.04.025
发布时间: 2024-05-21
出版时间: 2024-05-21
网络发布时间: 2024-05-21
移动端阅读
摘要:

在AI技术在各行业的应用呈爆发式增长的背景下,培养文科学生的AI思维和跨学科创新能力很有必要。该文以AI自然语言生成技术为切入点,设计了一套基于语言大模型的藏头诗生成实验教学方案,主要包括语言大模型的基本原理、微调方法、云端部署以及最终实现藏头诗生成的方法。该实验方案成功落地实验教学,形成并开放了一套可操作、可复制的教学资料成果,有助于类似实验教学工作的开展。

Abstract:

[Significance] With the recent technological breakthroughs achieved by a series of large models in cross-media content generation and reasoning, artificial intelligence(AI) applications have emerged as a hot topic across various industries. Notably, natural language generation(NLG) technology, powered by large language models, has the remarkable ability to simulate human language behavior. This allows it to automatically generate texts that are not only grammatically accurate but also semantically clear and highly expressive, thereby facilitating smooth and efficient human–computer interaction. Given its vast potential, this technology is currently employed in a wide range of fields, including education, law, healthcare, finance, literature, and art. In this context, incorporating the teaching and training of AI NLG technology into the “New Liberal Arts” curriculum in universities has become paramount. This integration aims to assist students in cultivating AI thinking and interdisciplinary innovation capabilities, ultimately preparing them for future employment. [Progress] This paper represents a groundbreaking endeavor in “New Liberal Arts” education by introducing an experimental course to create hidden head poets utilizing a language model. The objective of this innovative curriculum is multifaceted—to impart a fundamental understanding of the concepts and principles underlying language models and to foster practical skills in AI applications among students. The experimental coursework is structured to provide a stepwise approach to mastering the subject matter. First, students are introduced to the basics of learning language models, laying the foundation for more advanced concepts.This is followed by an exploration of fine-tuning techniques, which involves adapting pretrained models to specific datasets. Subsequently,students try to deploy code, data, and training and predicting models on the Huawei cloud server. This hands-on experience equips them with the skills necessary to navigate the real-world challenges of AI implementation. The final step of the course is the generation of hidden poetry using the fine-tuned model. This creative application demonstrates the ability of language models and serves to kindle students' interest in the potential of AI in various fields. Overall, this experimental course serves as a bridge between basic concepts and practical applications, enabling students to gain a holistic understanding of language models and their potential in the era of AI.[Conclusions and Prospects] Supported by the second batch of the “Industry–University Cooperation for Collaborative Education—New Liberal Arts Construction Project(Category A)” jointly initiated by the Ministry of Education and Huawei, we have successfully implemented this experimental program in the teaching of the “Python Programming” public course for the entire university during the spring and summer semesters of 2023, which received tremendous positive feedback from a wide range of students. Moreover, we developed and shared a set of operational and replicable experimental teaching materials online(URL: https://gitee.com/yaochw/python_course_zju/). This allows us to establish a long-term teaching mechanism for our university and provides a valuable reference for more educators to conduct similar experimental teaching work.

参考文献

[1] RAMESH A, PAVLOV M, GOH G, et al. Zero-shot text-toimage generation[C]//International Conference on Machine Learning. ICML, 2021:8821-8831.

[2] ANANTRASIRICHAI N, BULL D. Artificial intelligence in the creative industries:A review[J]. Artificial Intelligence Review,2022, 55(1):589–656.

[3] OPENAI. Gpt-4 technical report[R]. OpenAI, 2023.

[4] TAMKIN A, BRUNDAGE M, CLARK J, et al. Understanding the capabilities, limitations, and societal impact of large language models[J]. 2021. DOI:10.48550/arXiv.2102.02503.

[5]胡菲菲,张思思.“新文科”背景下高校文科实验室建设特点与趋向[J].实验技术与管理,2023, 40(1):221–226.HU F F, ZHANG S S. The characteristics and trends of the construction of liberal arts laboratories in universities under the background of “new liberal arts”[J]. Experimental Technology and Management, 2023, 40(1):221–226.(in Chinese)

[6]李波,覃俊,帖军.新工科及人工智能背景下计算机类专业创新创业教育研究[J].实验技术与管理,2021, 38(3):5.LI B, QINUN, TIE J. Research on Innovation and Entrepreneurship Education in Computer Majors under the Background of New Engineering and Artificial Intelligence[J]. Experimental Technology and Management, 2021, 38(3):5.

[7] HOFFMANN J, BORGEAUD S, MENSCH A, et al. Training compute-optimal large language models[J/OL]. 2022. DOI:10.48550/arXiv.2203.15556.

[8]饶高琦.主持人语:大模型时代语言智能应注重科学基础和社会应用[J].语言战略研究,2023, 8(4):5–6.RAO G Q. Host language:Language intelligence should focus on scientific foundations and social applications in the era of big models[J]. Language Strategy Research, 2023, 8(4):5–6.(in Chinese)

[9] BROWN T B, MANN B, RYDER N, et al. Language models are few-shot learners[C]//NeurIPS 2020, December 6–12, 2020.

[10] TOUVRON H, MARTIN L, STONE K, et al. Llama 2:Open foundation and fine-tuned chat models[J]. 2023, arXiv:2307.09288.

[11] SUN Y, WANG S, FENG S, et al. ERNIE 3.0:Large-scale knowledge enhanced pre-training for language understanding and generation[J/OL]. 2021. DOI:10.48550/arXiv.2112.12731.

[12] DU Z, QIAN Y, LIU X, et al. GLM:General language model pretraining with autoregressive blank infilling[C]//Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics(Volume 1:Long Papers). 2022:320–335.

[13] BAICHUANAI. Baichuan 2:Open large-scale language models[J/OL]. 2023. arXiv preprint arXiv:2309.10305.

[14] DEVLIN J, CHANG M W, LEE K, et al. BERT:Pre-training of deep bidirectional transformers for language understanding[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies, 2019.

[15] VASWANIA, SHAZEER N, PARMAR N, et al. Attention is all you need[C]//In Advances in Neural Information Processing Systems 30:Annual Conference on Neural Information Processing Systems 2017:5998–6008.

[16] PETERS M E, NEUMANN M, IYYER M, et al. Deep contextualized word representations[C]//Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies, Volume 1(Long Papers):2227–2237.

[17]陈雷. MindSpore深度学习高阶技术[M].北京:清华大学出版社,2021.CHEN LEI. MindSpore advanced technologies for deep learning[M]. Beijing:Tsinghua University Press, 2021.(in Chinese)

基本信息:

DOI:10.16791/j.cnki.sjg.2024.04.025

中图分类号:TP18-4;G642.4

引用信息:

[1]姚诚伟,陈春晖,陈梅.面向文科学生的AI自然语言生成实验与教学设计[J].实验技术与管理,2024,41(04):177-184.DOI:10.16791/j.cnki.sjg.2024.04.025.

基金信息:

教育部-华为第二批“产学合作协同育人—新文科建设项目(A类)”(220900007181709); 浙江大学计算机技术与工程国家级实验教学示范中心项目(浙大发本2012790)

发布时间:

2024-05-21

出版时间:

2024-05-21

网络发布时间:

2024-05-21

检 索 高级检索

引用

GB/T 7714-2015 格式引文
MLA格式引文
APA格式引文