An Experimental Study of the Effects of Monetary Incentives on Performance on the 12th-Grade NAEP Reading Assessment

激励 背景(考古学) 阅读(过程) 心理学 心理干预 人口 考试(生物学) 会话(web分析) 数学教育 医学教育 医学 计算机科学 经济 政治学 环境卫生 万维网 精神科 古生物学 微观经济学 法学 生物
作者
Henry Braun,Irwin S. Kirsch,Kentaro Yamamoto
出处
期刊:Teachers College Record [Crossref Test]
卷期号:113 (11): 2309-2344 被引量:82
标识
DOI:10.1177/016146811111301101
摘要

Background/context The National Assessment of Educational Progress (NAEP) is the only comparative assessment of academic competencies regularly administered to nationally representative samples of students enrolled in Grades 4, 8, and 12. Because NAEP is a low-stakes assessment, there are long-standing questions about the level of engagement and effort of the 12th graders who participate in the assessment and, consequently, about the validity of the reported results. Purpose/Focus This study investigated the effects of monetary incentives on the performance of 12th graders on a reading assessment closely modeled on the NAEP reading test in order to evaluate the likelihood that scores obtained at regular administrations underestimate student capabilities. Population The study assessed more than 2,600 students in a convenience sample of 59 schools in seven states. The schools are heterogeneous with respect to demographics and type of location. Intervention There were three conditions: a control and two incentive interventions. For the fixed incentive, students were offered $20 at the start of the session. For the contingent incentive, students were offered $5 in advance and $15 for correct responses to each of two randomly chosen questions, for a maximum payout of $35. All students were administered one of eight booklets comprising two reading blocks (a passage with associated questions) and a background questionnaire. All reading blocks were operational blocks released by NAEP. Research Design This was a randomized controlled field trial. Students agreed to participate without knowing that monetary incentives would be offered. Random allocation to condition was conducted independently in each school. Data Collection/Analysis Regular NAEP contractors administered the assessments and carried out preliminary data processing. Scaling of results and linking to the NAEP reporting scale were conducted using standard NAEP procedures. Findings Monetary incentives have a statistically significant and substantively important impact on both student engagement/effort and performance overall, and for most subgroups defined by gender, race, and background characteristics. For both males and females, the effect of the contingent incentive was more than 5 NAEP score points, corresponding to one quarter of the difference in the average scores between Grades 8 and 12. In general, the effect of the contingent incentive was larger than that of the fixed incentive, particularly for lower scoring subgroups. Conclusions/Recommendations There is now credible evidence that NAEP may both underestimate the reading abilities of students enrolled in 12th grade and yield biased estimates of certain achievement gaps. Responsible officials should take this into account as they plan changes to the NAEP reading framework and expand the scope of the 12th-grade assessment survey.

科研通智能强力驱动
Strongly Powered by AbleSci AI
更新
大幅提高文件上传限制,最高150M (2024-4-1)

科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
1秒前
幸福完成签到,获得积分10
1秒前
2秒前
2秒前
波莉发布了新的文献求助10
2秒前
4秒前
camaelxin发布了新的文献求助10
6秒前
Orange应助benben7采纳,获得10
7秒前
隐形曼青应助LI采纳,获得10
8秒前
8秒前
overThat发布了新的文献求助10
8秒前
lkjh发布了新的文献求助10
9秒前
10秒前
you发布了新的文献求助10
10秒前
xxx7749完成签到,获得积分10
12秒前
12秒前
Ava应助羊青丝采纳,获得10
13秒前
HXie发布了新的文献求助10
14秒前
jenniefer发布了新的文献求助10
15秒前
17秒前
17秒前
18秒前
微笑的依凝完成签到,获得积分10
18秒前
19秒前
溪秋白发布了新的文献求助10
20秒前
liux发布了新的文献求助10
22秒前
benben7发布了新的文献求助10
22秒前
FODCOC发布了新的文献求助200
23秒前
LI发布了新的文献求助10
25秒前
25秒前
勤劳的世平完成签到,获得积分10
26秒前
DDX完成签到 ,获得积分10
26秒前
overThat发布了新的文献求助10
27秒前
28秒前
29秒前
廿廿应助科研通管家采纳,获得10
30秒前
anonymous发布了新的文献求助10
30秒前
30秒前
廿廿应助科研通管家采纳,获得10
30秒前
科研通AI2S应助科研通管家采纳,获得10
30秒前
高分求助中
The ACS Guide to Scholarly Communication 2500
Sustainability in Tides Chemistry 2000
Pharmacogenomics: Applications to Patient Care, Third Edition 1000
Studien zur Ideengeschichte der Gesetzgebung 1000
TM 5-855-1(Fundamentals of protective design for conventional weapons) 1000
Threaded Harmony: A Sustainable Approach to Fashion 810
《粉体与多孔固体材料的吸附原理、方法及应用》(需要中文翻译版,化学工业出版社,陈建,周力,王奋英等译) 500
热门求助领域 (近24小时)
化学 医学 生物 材料科学 工程类 有机化学 生物化学 物理 内科学 纳米技术 计算机科学 化学工程 复合材料 基因 遗传学 催化作用 物理化学 免疫学 量子力学 细胞生物学
热门帖子
关注 科研通微信公众号,转发送积分 3084398
求助须知:如何正确求助?哪些是违规求助? 2737347
关于积分的说明 7544854
捐赠科研通 2386981
什么是DOI,文献DOI怎么找? 1265740
科研通“疑难数据库(出版商)”最低求助积分说明 613167
版权声明 598320