Quantum Fuzzy Neural Network for multimodal sentiment and sarcasm detection

Sentiment and sarcasm detection in social media contribute to assessing social opinion trends. Over the years, most artificial intelligence (AI) methods have relied on real values to characterize the sentimental and sarcastic features in language. These methods often overlook the complexity and uncertainty of sentimental and sarcastic elements in human language. Therefore, this paper proposes the Quantum Fuzzy Neural Network (QFNN), a multimodal fusion and multitask learning algorithm with a Seq2Seq structure that combines Classical and Quantum Neural Networks (QNN), and fuzzy logic. Complex numbers are used in the Fuzzifier to capture sentiment and sarcasm features, and QNN are used in the Defuzzifier to obtain the prediction. The experiments are conducted on classical computers by constructing quantum circuits in a simulated noisy environment. The results show that QFNN can outperform several recent methods in sarcasm and sentiment detection task on two datasets (Mustard and Memotion). Moreover, by assessing the fidelity of quantum circuits in a noisy environment, QFNN was found to have excellent robustness. The QFNN circuit also possesses expressible and entanglement capabilities, proving effective in various settings. Our code is available at https://github.com/prayagtiwari/QFNN.