RAGE-Fusion: Reliability-Aware Multimodal Emotion Fusion for Real-Time Interactive Interfaces

Clicks: 40
ID: 312651
2026
Free PDF
Article Quality & Performance Metrics
Overall Quality
Not rated
Combines reader engagement with the AI quality analysis. This article has not been analysed, so there is no overall score — reader engagement is measured and shown alongside.
AI Quality Assessment
Not analyzed
Readership in this journal
Emerging

Ranked #15 of 705 articles by views in Journal of Computing & Biomedical Informatics

Most read Least read

Bar heights use a square-root scale. Only the 120 most-read articles are drawn; the journal has 705 in total.

Mint this article as an NFT
Not yet minted

Create a permanent, verifiable on-chain record of this article on the Scimatic Network. The NFT is held in your Journament account, and you can withdraw it to your own wallet at any time.

5 SUSD one-off · no wallet required
Sign in to mint
Abstract
Emotional responsive interactive interfaces can enhance the user experience; they can change the response and presentation depending on the affective condition of the user. But implementing these systems to practical application is still difficult since emotion cues are multimodal, noisy, and frequently absent (e.g. webcam turned off, poor audio, occlusions) and interactive systems also demand low latency and predictive behaviour so as to keep the user trusting them. The paper is about RAGE-Fusion, which is a reliability-conscious multimodal deep learning system used in emotion recognition and interface adaptation, which models text, audio, and visual information together. RAGE-Fusion is a cross-modal attention and pretrained modality encoder architecture that integrates the complementary affective information and a reliability-gated fusion mechanism, elaborating on the weighting of each modality in the case of missing or corrupted input based on an inferred quality improvement in robustness. In order to fit affect recognition to interactive limitations, we also introduce a multi-objective optimization plan, balancing the performance of emotion prediction, the inference latency, and prediction temporal consistency between conversational turns. Simulations of the MELD benchmark show that it steadily outperforms unimodal and baseline fusion baselines especially when there is modality drop and noise. Calibration and stability analysis are reported by us as well to facilitate a safe interface adaptation decision. The findings reveal that reliability-conscious fusion and interaction-based optimization are a viable basis in development of robust and real-time emotion-conscious interfaces.
Reference Key
imported_1777055791_69ebb82fd8acc Use this key to autocite in the manuscript while using SciMatic Manuscript Manager or Thesis Manager
Authors Yim Jinho
Journal Journal of Computing & Biomedical Informatics
Year 2026
DOI
10.56979/1002/2026/1271
URL
https://jcbi.org/index.php/Main/article/view/1271
Keywords Keywords not found

Citations

No citations found. To add a citation, contact the admin at info@scimatic.org

Comments

No comments yet. Be the first to comment on this article.