模式
模态(人机交互)
计算机科学
对抗制
人工智能
多模式学习
机器学习
互补性(分子生物学)
代表(政治)
冗余(工程)
人工神经网络
不变(物理)
自然语言处理
数学
遗传学
生物
政治
操作系统
政治学
社会学
法学
数学物理
社会科学
作者
Xiang Li,Chao Wang,Jiwei Tan,Xiaoyi Zeng,Dan Ou,Dan Ou,Bo Zheng
标识
DOI:10.1145/3366423.3380163
摘要
For better user experience and business effectiveness, Click-Through Rate (CTR) prediction has been one of the most important tasks in E-commerce. Although extensive CTR prediction models have been proposed, learning good representation of items from multimodal features is still less investigated, considering an item in E-commerce usually contains multiple heterogeneous modalities. Previous works either concatenate the multiple modality features, that is equivalent to giving a fixed importance weight to each modality; or learn dynamic weights of different modalities for different items through technique like attention mechanism. However, a problem is that there usually exists common redundant information across multiple modalities. The dynamic weights of different modalities computed by using the redundant information may not correctly reflect the different importance of each modality. To address this, we explore the complementarity and redundancy of modalities by considering modality-specific and modality-invariant features differently. We propose a novel Multimodal Adversarial Representation Network (MARN) for the CTR prediction task. A multimodal attention network first calculates the weights of multiple modalities for each item according to its modality-specific features. Then a multimodal adversarial network learns modality-invariant representations where a double-discriminators strategy is introduced. Finally, we achieve the multimodal item representations by combining both modality-specific and modality-invariant representations. We conduct extensive experiments on both public and industrial datasets, and the proposed method consistently achieves remarkable improvements to the state-of-the-art methods. Moreover, the approach has been deployed in an operational E-commerce system and online A/B testing further demonstrates the effectiveness.
科研通智能强力驱动
Strongly Powered by AbleSci AI