Logo image
Multimodal-Oriented Interactive Joint Source-Channel Coding for Lightweight Semantic Communication
Journal article   Peer reviewed

Multimodal-Oriented Interactive Joint Source-Channel Coding for Lightweight Semantic Communication

Xupeng Niu, Long Tan, Jun Wu, Weijie Yuan and Tony Q. S. Quek
IEEE transactions on vehicular technology, Vol.74(10), pp.16516-16520
01/10/2025
PMID: 40920525

Abstract

Computational modeling Correlation Encoding hierarchical dynamic resource allocation multimodal cross-attention Receivers Semantic communication Semantics Silicon Smart devices Training Transmitters Visualization
As a pivotal technology for sixth-generation (6G) mobile networks, semantic communication (SC) aims to enable low-energy, high-efficiency intelligent communication through joint source-channel coding (JSCC). However, current multimodal SC systems experience semantic divergence and conflicts due to imbalances in the representation capacity of individual encoders. Furthermore, high computational demands significantly elevate the deployment and operational costs of SC. In this letter, we propose a multimodal-oriented lightweight SC system based on an interactive JSCC scheme, promoting the evolution of 6G towards a multi-source collaboration paradigm. Additionally, a dynamic resource allocation method is introduced, which hierarchically adjusts computational costs to improve efficiency. Simulation results demonstrate that the proposed system reduces computational overhead by 60\% compared to six benchmarks while maintaining high performance and robustness in multiple tasks.

Metrics

1 Record Views

Details

Logo image