生物多样性

• • 上一篇    下一篇

基于双特征融合与解释验证的复杂声景分类研究

谢将剑, 朱梦坤, 郝珠琳, 江欣怡, 毛锐锐, 肖治术   

  1. 北京林业大学工学院多模生态数据智能分析实验室, 100083
    中国科学院动物研究所农业虫害鼠害综合治理研究国家重点实验室, 100101
  • 收稿日期:2026-06-02 修回日期:2026-08-19
  • 通讯作者: 肖治术

Dual-Feature Fusion and Interpretability Validation for Complex Soundscape Classification

Jiangjian Xie, Mengkun Zhu, Zhulin Hao, Xinyi Jiang, Ruirui Mao, Zhishu Xiao   

  1. , 100083,
    , 100101,
  • Received:2026-06-02 Revised:2026-08-19
  • Contact: Zhishu Xiao
  • Supported by:
    Supported by the National Key Research and Development Program of China(2024YFF1307202); the Beijing Natural Science Foundation(5252014); and Beijing Forestry University Science and Technology Innovation Program(2024XY-G002)

摘要: 复杂声景中多种声源常同时存在,不同声学成分在时间、频率及统计特征层面相互叠加,使得单一声学表征难以完整刻画声景中的判别信息。同时,深度学习模型虽能提高声景分类精度,但其决策依据缺乏透明性,限制了其在生态监测中的应用可信度。为此,本文围绕复杂声景分类中的多特征融合与模型可解释性开展研究。首先,分别提取Mel频谱图与声学指数序列两类互补声学表征,构建双分支融合分类模型,并在自然保护区声景、城市公园声景和城市环境声音数据集上验证模型性能。随后,采用LIME解释最佳谱图模型、采用SHAP分析最佳序列模型,并以低维瓶颈层结合符号回归解释融合模型;其中谱图与序列模型进一步采用输入扰动对照评价解释忠实度,融合模型则以符号代理的R²和MSE衡量代理保真度。结果表明,在所评估架构与统一训练条件下,基于Mel频谱图的模型整体具有更强的独立判别能力,而基于3 s片段内短时统计量构成的声学指数序列能够提供补充信息。融合模型在自然保护区声景和城市环境声音数据集上进一步提升分类性能;在CBL-data上,相较最佳谱图模型,Micro-F1和Macro-F1分别提高0.0560和0.0365,达到0.9065和0.7141。在城市公园复合声景中,融合结果低于最佳谱图模型,未获得正增益,说明融合收益具有场景依赖性。解释分析显示,LIME高贡献时频区域具有较清晰的决策相关性;SHAP热图中高贡献时间步与部分目标声源发声区段存在视觉对应,但其等量随机置零对照未显示稳定优势,因此仅作定性解释;融合模型的符号回归在绝大多数类别上表现为瓶颈变量的线性组合,可作为低维瓶颈到类别logit映射的高保真代理。本研究形成了面向不同模型层次的双特征融合与解释验证流程,为复杂声景自动识别的可信性评估提供了方法参考。

关键词: 声景分类, 被动声学监测, 声学指数, Mel频谱图, 可解释人工智能

AbstractIn complex soundscapes, multiple sound sources often coexist, and acoustic components overlap in temporal, spectral, and statistical dimensions, making it difficult for a single representation to capture all discriminative information. This study investigates dual-feature fusion and model interpretability for complex soundscape classification. Mel-spectrograms and acoustic-index sequences are first modeled with separate branches and then fused, and the framework is evaluated on nature-reserve soundscape, urban-park soundscape, and urban environmental sound datasets. LIME is used for the best spectrogram model, SHAP for the best sequence model, and a low-dimensional bottleneck combined with symbolic regression for the fusion model. Input-perturbation controls are applied to the spectrogram and sequence explanations, whereas surrogate R² and MSE are used to assess the fidelity of the symbolic proxy for the fusion model. Under the evaluated architectures and unified training conditions, Mel-spectrogram models show stronger standalone classification performance, while acoustic-index sequences computed as short-time statistics within 3-s clips provide complementary information. On CBL-data, fusion improves Micro-F1 and Macro-F1 over the best spectrogram model by 0.0560 and 0.0365, reaching 0.9065 and 0.7141, respectively. In contrast, fusion performs below the best spectrogram model on the urban-park dataset, indicating scene-dependent benefits. LIME-highlighted time-frequency regions show clear decision relevance. For SHAP, visually high-contribution time steps sometimes coincide with target acoustic events, but the equal-size random zeroing control does not show a stable advantage; this observation is therefore treated qualitatively. For the fusion model, symbolic regression yields high-fidelity proxies, and most class formulas reduce to linear combinations of bottleneck variables rather than explicit interactions. The resulting multi-level interpretation and validation workflow provides a methodological reference for reliability assessment in automatic soundscape recognition.

Key words: soundscape classification, passive acoustic monitoring, acoustic indices, Mel spectrogram, explainable artificial intelligence (XAI)