分歧(语言学)
序列(生物学)
计算机科学
任务(项目管理)
编码(内存)
推荐系统
二次方程
序列标记
计算复杂性理论
人工智能
算法
机器学习
理论计算机科学
数学
哲学
语言学
遗传学
生物
几何学
管理
经济
作者
Yanfeng Bai,Haitao Wang,Jianfeng He
出处
期刊:Mathematics
[Multidisciplinary Digital Publishing Institute]
日期:2024-07-31
卷期号:12 (15): 2391-2391
摘要
Sequence recommendation is a prominent research area within recommender systems, focused on predicting items that users may be interested in by modeling their historical interaction sequences. However, due to data sparsity, user interaction sequences in sequence recommendation are typically short. A common approach to address this issue is filling sequences with zero values, significantly reducing the effective utilization of input space. Furthermore, traditional sequence recommendation methods based on self-attention mechanisms exhibit quadratic complexity with respect to sequence length. These issues affect the performance of recommendation algorithms. To tackle these challenges, we propose a multi-task sequence recommendation model, Blin, which integrates bidirectional KL divergence and linear attention. Blin abandons the conventional zero-padding strategy, opting instead for random repeat padding to enhance sequence data. Additionally, bidirectional KL divergence loss is introduced as an auxiliary task to regularize the probability distributions obtained from different sequence representations. To improve the computational efficiency compared to traditional attention mechanisms, a linear attention mechanism is employed during sequence encoding, significantly reducing the computational complexity while preserving the learning capacity of traditional attention. Experimental results on multiple public datasets demonstrate the effectiveness of the proposed model.
科研通智能强力驱动
Strongly Powered by AbleSci AI