1.中国科学院大学,北京 100190
2.中国科学院软件研究所,北京 100190
3.北京航空航天大学,北京 100191
2.中国科学院声学研究所,北京 100190
张扶桑,fusang@iscas.ac.cn
收稿:2025-09-15,
修回:2025-11-03,
录用:2026-02-09,
移动端阅览
范梦瑶, 苏玉琪, 张扶桑, 等. 基于车载分布式声学器件的手势静音控制[J/OL]. 物联网学报, 2026.
FAN Mengyao, SU Yuqi, ZHANG Fusang, et al. Leveraging in-cabin distributed acoustic devices for gesture-based mute control[J/OL]. Chinese Journal on Internet of Things, 2026.
随着智能座舱交互技术的发展,非接触式手势识别已成为车载人机交互的重要补充。针对传统视觉与雷达方案在隐私保护、部署成本及覆盖范围方面的固有局限,提出了一种新型的手势静音控制系统。该方案复用车载分布式的多扬声器与多麦克风阵列,构建低成本的近场手势识别系统。该系统通过发送高频声学信号,并提取手部动作引起的信道冲激响应变化来识别静音手势。具体而言,为消除系统延迟,首先创建一个电回环通道以提取参考信号,该信号可用于动态计算系统延迟,实现准确的信道冲激响应的时间对齐。其次,提出了单通道多维特征判决与多通道协同决策的融合方案,通过两者的协同优化实现预设手势与环境干扰的精准区分。在多场景下开展的实验验证表明,系统静音手势识别准确率超过98%,误报率低于1.5%,响应时间小于0.05秒。
With the rapid evolution of smart cabin interaction technology
contactless gesture recognition has become an essential component of in-cabin human-computer interaction. Traditional methods
such as vision-based and radar-based systems
often face challenges like privacy concerns
high deployment costs
and limited coverage. To overcome these limitations
we introduce a novel gesture-based mute control system that leverages the advantages of contactless interaction to enhance user experience and system efficiency. This solution repurposes existing audio hardware to construct an affordable near-field recognition system. By transmitting high-frequency acoustic signals and analyzing the changes in the channel impulse response (CIR) induced by hand movements
the system effectively recognizes mute gestures. Specifically
to eliminate system delay
we first establish an electrical loopback channel to extract a reference signal. This reference signal is then used to dynamically compute the system delay
ensuring accurate CIR time alignment. Additionally
we propose a fusion scheme that combines single-channel multi-dimensional feature judgment with a multi-channel collaborative decision-making mechanism. This integrated approach is designed to accurately distinguish predefined gestures from environmental interferences. Experimental validations across multiple scenarios show that the system achieves a mute gesture recognition accuracy exceeding 98%
a false alarm rate below 1.5%
and a response time within 0.05 seconds.
TUNG Y-C , BUI D , SHIN K G . Cross-platform support for rapid development of mobile acoustic sensing applications [C ] // Proceedings of the 16th ACM MobiSys (Annual International Conference on Mobile Systems, Applications, and Services) . New York : ACM , 2018 : 455 - 467 .
WANG T B , ZHANG D Q , ZHENG Y Q , GU T , ZHOU X S , DORIZZI B . C-FMCW based contactless respiration detection using acoustic signal [J ] . Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies , 2018 , 1 ( 4 ): 170 .
ZHANG F S , WANG Z , JIN B H , XIONG J , et al . Your smart speaker can "hear" your heartbeat! [J ] . Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies , 2020 , 4 ( 4 ): 161 .
QIAN K , WU C S , XIAO F , et al . Acousticcardiogram: monitoring heartbeats using acoustic signals on smart devices [C ] // IEEE INFOCOM 2018-IEEE Conference on Computer Communications . Piscataway, NJ : IEEE , 2018 : 1574 - 1582 .
WANG A R , SUNSHINE J E , GOLLAKOTA S . Contactless infant monitoring using white noise [C ] // Proceedings of the 25th Annual In-ternational Conference on Mobile Computing and Networking . New York : ACM , 2019 : 1 - 16 .
WAN H R , SHI S Y , CAO W Y , et al . RespTracker: multi-user room-scale respiration tracking with commercial acoustic devices [C ] // IEEE INFOCOM 2021-IEEE Conference on Computer Communications . Piscataway, NJ : IEEE , 2021 : 1 - 10 .
DAI H P , WANG W , LIU A X , et al . Speech based human authentication on smartphones [C ] // Proceedings of the 2019 16th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON) . Piscataway, NJ : IEEE , 2019 : 1 - 9 .
SU Y Q , ZHANG F S , NIU K , et al . Embracing distributed acoustic sensing in car cabin for children presence detection [J ] . Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies , 2024 , 8 ( 1 ): 16 .
PENG C Y , SHEN G B , ZHANG Y G , et al . BeepBeep: a high accuracy acoustic ranging system using COTS mobile devices [C ] // Proceedings of the 5th International Conference on Embedded Networked Sensor Systems (SenSys ’07) . New York : ACM , 2007 : 1 - 14 .
UDDIN M , NADEEM T . RF-Beep: a light ranging scheme for smart devices [C ] // 2013 IEEE International Conference on Pervasive Computing and Communications (PerCom) . Piscataway, NJ : IEEE , 2013 : 114 - 122 .
ZHOU B , ELBADRY M , GAO R , et al . BatMapper: acoustic sensing based indoor floor plan construction using smartphones [C ] // Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services . New York : ACM , 2017 : 42 - 55 .
PRADHAN S , BAIG G , MAO W G , QIU L L , CHEN G H , YANG B . Smartphone-based acoustic indoor space mapping [J ] . Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies , 2018 , 2 ( 2 ): 75 .
LIU K K , LIU X X , LI X L . Guoguo: enabling fine-grained indoor localization via smartphone [C ] // Proceedings of the 11th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys ’13) . New York : ACM , 2013 : 235 - 248 .
WANG Y T , LI J , ZHENG R , et al . ARABIS: an asynchronous acoustic indoor positioning system for mobile devices [C ] // Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN) . Piscataway, NJ : IEEE , 2017 : 1 - 8 .
GUPTA S , MORRIS D , PATEL S , et al . SoundWave: using the doppler effect to sense gestures [C ] // Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’12) . New York : ACM , 2012 : 1911 - 1914 .
RUAN W J , SHENG Q Z , YANG L , et al . AudioGest: enabling fine-grained hand gesture detection by decoding echo sig-nal [C ] // Proceedings of the 2016 ACM International Joint Con-ference on Pervasive and Ubiquitous Computing . New York : ACM , 2016 : 474 - 485 .
CHEN H J , LI F , WANG Y . EchoTrack: Acoustic device-free hand tracking on smart phones [C ] // IEEE INFOCOM 2017-IEEE Conference on Computer Communications . Piscataway : IEEE , 2017 : 1 - 9 .
YUN S , CHEN Y - C , ZHENG H , et al . Strata: fine - grained acoustic - based device - free tracking [C ] // Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services . New York : ACM , 2017 : 15 - 28 .
WANG W , LIU A X , SUN K . Device - free gesture tracking using acoustic signals [C ] // Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking . New York : ACM , 2016 : 82 - 94 .
LING K , DAI H P , LIU Y T , et al . UltraGesture: fine - grained gesture sensing and recognition [C ] // 2018 15th Annual IEEE International Conference on Sensing, Communication, and Networking . Piscataway, NJ : IEEE , 2018 : 1 - 9 .
WANG Y W , SHEN J X , ZHENG Y Q . Push the Limit of Acoustic Gesture Recognition [C ] // IEEE INFOCOM 2020 - IEEE Conference on Computer Communications . Piscataway : IEEE , 2020 : 566 - 575 .
NANDAKUMAR R , IYER V , TAN D , et al . FingerIO: using active so-nar for fine - grained finger tracking [C ] // Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems . New York : ACM , 2016 : 1515 - 1525 .
ABDELNASSER H , YOUSSEF M , HARRAS K A . WiGest: a ubiquitous WiFi - based gesture recognition system [C ] // 2015 IEEE Conference on Computer Communications (INFOCOM) . Piscataway, NJ : IEEE , 2015 : 1472 - 1480 .
PU Q F , GUPTA S , GOLLAKOTA S , et al . Whole-home gesture recognition using wireless signals [C ] // Proceedings of the 19th Annual International Conference on Mobile Computing & Networking (MobiCom ’13) . New York : ACM , 2013 : 27 - 38 .
TAN S , YANG J . WiFinger: leveraging commodity WiFi for fine-grained finger gesture recognition [C ] // Proceedings of the 17th ACM International Symposium on Mobile Ad Hoc Networking and Computing . New York : Association for Computing Machinery , 2016 : 201 - 210 .
KELLOGG B , TALLA V , GOLLAKOTA S . Bringing gesture recognition to all devices [C ] // Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation . Berkeley, CA : USENIX Association , 2014 : 303 - 316 .
WANG J , VASISHT D , KATABI D . RF-IDraw: virtual touch screen in the air using RF signals [C ] // Proceedings of the 2014 ACM Conference on SIGCOMM . New York : ACM , 2014 : 235 - 246 .
DING H , QIAN C , HAN J S , WANG G , XI W , ZHAO K , ZHAO J Z . RFIPad: Enabling Cost-Efficient and Device-Free In-air Handwriting Using Passive Tags [C ] // 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS) . Piscataway : IEEE , 2017 : 447 - 457 .
REHG J M , KANADE T . Visual tracking of high DOF articulated structures: an application to human hand tracking [C ] // Proceedings of the Third European Conference on Computer Vision (ECCV ’94) . Berlin : Springer-Verlag , 1994 : 35 - 46 .
POPOVIC B M . Generalized chirp-like polyphase sequences with optimum correlation properties [J ] . IEEE Transactions on Information Theory , 1992 , 38 ( 4 ): 1406 - 1409 .
0
浏览量
9
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621