Are simpler math stories better? Automatic readability assessment of GAI ‐generated multimodal mathematical stories validated by engagement

可读性 计算机科学 数学教育 多媒体 数学 程序设计语言
作者
Hai Li,Wanli Xing,Chenglu Li,Wangda Zhu,Hyunju Oh
出处
期刊:British Journal of Educational Technology [Wiley]
卷期号:56 (3): 1092-1117 被引量:13
标识
DOI:10.1111/bjet.13554
摘要

Abstract Mathematical stories can enhance students' motivation and interest in learning mathematics, thereby positively impacting their academic performance. However, due to resource constraints faced by the creators, generative artificial intelligence (GAI) is employed to create mathematical stories accompanied by images. This study introduces a method for automatically assessing the quality of these multimodal stories by evaluating text‐image coherence and textual readability. Using GAI‐generated stories for grades 3 to 5 from the US math story learning platform Read Solve Create (RSC), we extracted features related to multimodal semantics and text readability. We then analysed the correlation between these features and student engagement levels, measured by average reading time per story (behavioural engagement) and average drawing tool usage per story (cognitive engagement), derived from browsing logs and interaction metrics on the platform. Our findings reveal that textual features such as conjunctive adverbs, sentence connectors, causal connectives and simplified vocabulary positively correlate with behavioural engagement. Additionally, higher semantic similarity between text and images, as well as the number of operators in the stories, is associated with increased cognitive engagement. This study advances the application of GAI in mathematics education and offers novel insights for instructional material design. Practitioner notes What is already known about this topic Mathematical stories can enhance students' motivation and interest in mathematics, leading to improved academic performance. Generative artificial intelligence (GAI) has been increasingly employed to create multimodal educational content, including mathematical stories with accompanying images, to address content creators' resource constraints. Prior readability research has primarily focused on the analysis of text‐based educational content, with less emphasis on the integration and analysis of visual elements. What this paper adds Introduces a novel automated multimodal readability assessment method that evaluates the coherence between text and images and the readability of text in GAI‐generated mathematical stories. Identifies specific story features, such as the more frequent use of three types of conjunctions (adversative conjunctions, common sentence conjunctions and logical conjunctions) and vocabulary simplicity that correlate with student engagement. Implications for practice and/or policy Educators and curriculum developers are encouraged to utilise automated multimodal readability assessment tools to analyse and refine GAI‐generated educational content, aiming to enhance student engagement and learning experience. Suggestions for the design of educational content includes the consideration of identified readability features that correlate with higher engagement. Caution should be exercised in handling the association between images and text considering the cognitive load of the instructional materials.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
语恒完成签到,获得积分10
刚刚
1秒前
人族首领的应助被顺利的曼易采纳,获得20
1秒前
初景发布了新的文献求助10
3秒前
bearcat完成签到,获得积分10
3秒前
JamesPei的应助被酷酷的凡桃采纳,获得10
3秒前
4秒前
瓶子君152完成签到,获得积分10
4秒前
4秒前
王王发布了新的文献求助10
4秒前
4秒前
mu发布了新的文献求助10
4秒前
sunqian完成签到,获得积分10
5秒前
5秒前
7秒前
snow完成签到 ,获得积分10
7秒前
zzz完成签到,获得积分10
7秒前
所所的应助被dongdong采纳,获得10
8秒前
慕青的应助被Anthony采纳,获得10
8秒前
bonnie12完成签到,获得积分10
9秒前
11秒前
zc完成签到,获得积分10
15秒前
爱做梦的火烈鸟完成签到,获得积分10
16秒前
16秒前
小琪发布了新的文献求助10
17秒前
iedq完成签到 ,获得积分0
18秒前
阳光蚂蚁完成签到,获得积分10
18秒前
19秒前
FashionBoy的应助被mu采纳,获得10
20秒前
我是老大的应助被懦弱的冷珍采纳,获得10
20秒前
20秒前
红枣泡枸杞完成签到,获得积分10
21秒前
24秒前
turbohero发布了新的文献求助30
24秒前
27秒前
JJW完成签到,获得积分10
27秒前
白桃战士完成签到,获得积分10
30秒前
30秒前
难过立辉完成签到 ,获得积分10
30秒前
33秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 2000
Sex, Aging, and Death in a Medieval Medical Compendium: Trinity College Cambridge MS R.14.52, Its Texts, Language, and Scribe 500
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
基于结构调控的功能化水诱导发电材料与器件研究 500
基于界面调控的高效湿气发电材料与器件研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8191072
求助须知:如何正确求助?哪些是违规求助? 9578083
关于积分的说明 21856545
捐赠科研通 7790236
什么是DOI,文献DOI怎么找? 3436520
关于科研通互助平台的介绍 2560326
邀请新用户注册赠送积分活动 2483237