数学
收敛速度
算法
指数函数
随机算法
组合数学
应用数学
数学优化
离散数学
数学分析
计算机科学
钥匙(锁)
计算机安全
作者
Nicholas F. Marshall,Oscar Mickelin
摘要
.We study how the learning rate affects the performance of a relaxed randomized Kaczmarz algorithm for solving \(A x \approx b + \varepsilon\) , where \(A x=b\) is a consistent linear system and \(\varepsilon\) has independent mean zero random entries. We derive a learning rate schedule which optimizes a bound on the expected error that is sharp in certain cases; in contrast to the exponential convergence of the standard randomized Kaczmarz algorithm, our optimized bound involves the reciprocal of the Lambert- \(W\) function of an exponential.Keywordslearning raterandomized Kaczmarzstochastic gradient descentMSC codes65F1060H2565F20
科研通智能强力驱动
Strongly Powered by AbleSci AI