Bioacoustics data archives management standards and management technology progress

doi:10.17520/biods.2024266

Abstract

Abstract:

Background & Aims: In recent years, bioacoustics monitoring has emerged as a crucial tool for biodiversity conservation, enabling a continuous, real-time, and non-invasive means to gather data on various species and their habitats. This method provides superior efficiency and coverage compared to traditional field surveys and observations. However, the vast amount of diverse bioacoustics data generated presents significant challenges in terms of storage, management, and analysis. This review aims to systematically outline the characteristics and management standards of bioacoustics data archives. It highlights the latest advancements in recording and storage technologies and explores the value and challenges of bioacoustics data archiving in practical applications. Additionally, this review also provides an overview of the current state of bioacoustics databases and data-sharing platforms, both domestically and internationally.

Progress: Bioacoustics data archives are systematic repositories dedicated to the preservation and management of bioacoustics data. These archives include raw audio recordings, metadata detailing recording times, locations, and equipment specifications, and processed data derived from species identification and classification tools. These archives are essential for biodiversity conservation efforts, as they store crucial data on species’ vocalizations, behaviors, and interactions. Standardized management protocols are essential for ensuring data integrity, accessibility, and usability. Recent technological advances have facilitated better data collection, processing, and storage methods, making bioacoustics monitoring more scalable and sophisticated.

Conclusion: The development and implementation of advanced bioacoustics data management and archiving systems are pivotal for effective biodiversity monitoring and conservation. By leveraging the latest technological advancements, bioacoustics data archives can significantly enhance automated data annotation, storage efficiency, intelligent retrieval, and real-time sharing capabilities. These improvements will help meet the increasing demands of bioacoustics monitoring, evaluation, and historical baseline establishment, thereby significantly supporting biodiversity conservation efforts.

Key words: bioacoustics monitoring, data archive management, metadata standards, database construction, data sharing platform

Kaiying He, Xinhui Xu, Chengyun Zhang, Zezhou Hao, Zhishu Xiao, Yingying Guo. Bioacoustics data archives management standards and management technology progress[J]. Biodiv Sci, 2024, 32(10): 24266.

Add to citation manager EndNote|Ris|BibTeX

URL: https://www.biodiversity-science.net/EN/10.17520/biods.2024266

https://www.biodiversity-science.net/EN/Y2024/V32/I10/24266

Figures/Tables 6

References 31

[1]	Abrahams C, Ashington B, Baker E, Bradfer-Lawrence T, Browning E, Carruthers-Jones J, Darby J, Dick J, Eldridge A, Elliott D, Heath B, Howden-Leach P, Johnston A, Lees A, Meyer C, Ruiz Arana U, Smyth S, Metcalf O (2023) Good Practice Guidelines for Long-term Ecoacoustic Monitoring in the UK. The UK Acoustics Network, https://acoustics.ac.uk/. (accessed on 2024-05-15)
[2]	Bach K, Schäfer D, Enke N, Seeger B, Gemeinholzer B, Bendix J (2012) A comparative evaluation of technical solutions for long-term data repositories in integrative biodiversity research. Ecological Informatics, 11, 16-24.
[3]	Baker E, Price BW, Rycroft SD, Hill J, Smith VS (2015) BioAcoustica: A free and open repository and analysis platform for bioacoustics. Database, 2015, bav054.
[4]	Berendsohn WG, Geoffroy M (2007) Networking taxonomic concepts—Uniting without “unitary-ism”. In: Biodiversity Databases:From Cottage Industry to Industrial Networks (eds Curry G, Humphries C). Systematics Association Special Taylor & Francis, Boca Raton.
[5]	Brown A, Garg S, Montgomery J (2020) AcoustiCloud: A cloud-based system for managing large-scale bioacoustics processing. Environmental Modelling & Software, 131, 104778.
[6]	Deng K, Wang XP, Zhu BC, Zhao LH, Yang Y, Cai YL, Sun XQ, Wang TL, Cui JG (2023) A dataset on the call characteristics of 43 anuran species in China. Biodiversity Science, 31, 22344. (in Chinese with English abstract) DOI
	[邓可, 汪小萍, 朱弼成, 赵龙辉, 杨悦, 蔡炎林, 孙晓倩, 王同亮, 崔建国 (2023) 中国43种蛙类鸣声特征数据集. 生物多样性, 31, 22344.] DOI
[7]	Dugan PJ, Klinck H, Roch MA, Helble TA (2016) Raven X high performance data mining toolbox for bioacoustic data analysis. arXiv, 1610.03772.
[8]	Fegraus EH, Andelman S, Jones MB, Schildhauer M (2005) Maximizing the value of ecological data with structured metadata: An introduction to ecological metadata language (EML) and principles for metadata creation. Bulletin of the Ecological Society of America, 86, 158-168.
[9]	Fornwall M, Gisiner R, Simmons S, Moustahfid H, Canonico G, Halpin P, Goldstein P, Fitch R, Weise M, Cyr N (2012) Expanding biological data standards development processes for US IOOS:Visual line transect observing community for mammal, bird, and turtle data. In: U.S. IOOS Report. Interagency Ocean Observation Committee, Washington.
[10]	Frazao F, Padovese B, Kirsebom OS (2020) Workshop report: Detection and classification in marine bioacoustics with deep learning. arXiv, 2002.08249.
[11]	Guan S, Moustahfid H, Milan A, Mize J (2014) A Metadata Convention for Passive Acoustic Recordings (Version 1.0). US Integrated Ocean Observing System, Silver Spring, MD.
[12]	Kolb TL, Blukacz-Richards EA, Muir AM, Claramunt RM, Koops MA, Taylor WW, Sutton TM, Arts MT, Bissel E (2013) How to manage data to enhance their potential for synthesis, preservation, sharing, and reuse—A great lakes case study. Fisheries, 38(2), 52-64.
[13]	Krein T, Hawthorne D, Hu D, Strickman L, Nelson S (2009) Raven Pro Sound Software. Bioacoustics Research Program, Cornell Lab of Ornithology.
[14]	Midway SR, Sievert NA, Lynch AJ, Whittier JB, Pope KL (2022) Asking nicely: Best practices for requesting data. Ecological Informatics, 70, 101729.
[15]	Parsons MJG, Lin TH, Mooney TA, Erbe C, Juanes F, Lammers M, Li SH, Linke S, Looby A, Nedelec SL, Van Opzeeland I, Radford C, Rice AN, Sayigh L, Stanley J, Urban E, Di Iorio L (2022) Sounding the call for a global library of underwater biological sounds. Frontiers in Ecology and Evolution, 10, 810156.
[16]	Reichman OJ, Jones MB, Schildhauer MP (2011) Challenges and opportunities of open data in ecology. Science, 331, 703-705. DOI PMID
[17]	Roch MA, Batchelor H, Baumann-Pickering S, Berchok CL, Cholewiak D, Fujioka E, Garland EC, Herbert S, Hildebrand JA, Oleson EM, Van Parijs S, Risch D, Širović A, Soldevilla MS (2016) Management of acoustic metadata for bioacoustics. Ecological Informatics, 31, 122-136.
[18]	Sedberry GR, Fautin DG, Feldman M, Fornwall MD, Goldstein RP, Guralnick R (2011) OBIS-USA: A data-sharing legacy of the census of marine life. Oceanography, 24, 166-173.
[19]	Shamon H, Paraskevopoulou Z, Kitzes J, Card E, Deichmann JL, Boyce AJ, McShea WJ (2021) Using ecoacoustics metrices to track grassland bird richness across landscape gradients. Ecological Indicators, 120, 106928.
[20]	Soranno PA, Bissell EG, Cheruvelil KS, Christel ST, Collins SM, Fergus CE, Filstrup CT, Lapierre JF, Lottig NR, Oliver SK, Scott CE, Smith NJ, Stopyak S, Yuan S, Bremigan MT, Downing JA, Gries C, Henry EN, Skaff NK, Stanley EH, Stow CA, Tan PN, Wagner T, Webster KE (2015) Building a multi-scaled geospatial temporal ecology database from disparate data sources: Fostering open science and data reuse. GigaScience, 4, 28.
[21]	Toledo FL, Tipp C, Márquez R (2015) The value of audiovisual archives. Science, 347, 484. DOI PMID
[22]	Towsey M, Planitz B, Nantes A, Wimmer J, Roe P (2012) A toolbox for animal call recognition. Bioacoustics, 21, 107-125.
[23]	Towsey M, Wimmer J, Williamson I, Roe P (2014a) The use of acoustic indices to determine avian species richness in audio-recordings of the environment. Ecological Informatics, 21, 110-119.
[24]	Towsey M, Zhang L, Cottman-Fields M, Wimmer J, Zhang JL, Roe P (2014b) Visualization of long-duration acoustic recordings of the environment. Procedia Computer Science, 29, 703-712.
[25]	Wang LS (2010) Introduction to the Darwin Core, a standard for biodiversity informatics. In: Advances in Biodiversity Conservation and Research in China VIII (ed. Chinese National Committee for DIVERSITAS), pp. 105-114. China Meteorological Press, Beijing. (in Chinese)
	[王利松 (2010) 生物多样性信息学标准——Darwin Core介绍. 见: 中国生物多样性保护研究进展(国际生物多样性计划中国委员会主编), 105-114页. 气象出版社, 北京.]
[26]	Wieczorek J, Bloom D, Guralnick R, Blum S, Döring M, Giovanni R, Robertson T, Vieglais D (2012) Darwin Core: An evolving community-developed biodiversity data standard. PLoS ONE, 7, e29715.
[27]	Wilkinson MD, Dumontier M, Aalbersberg IJ, Appleton G, Axton M, Baak A, Blomberg N, Boiten JW, da Silva Santos LB, Bourne PE, Bouwman J, Brookes AJ, Clark T, Crosas M, Dillo I, Dumon O, Edmunds S, Evelo CT, Finkers R, Gonzalez-Beltran A, Gray AJG, Groth P, Goble C, Grethe JS, Heringa J ’t Hoen PAC, Hooft R, Kuhn T, Kok R, Kok J, Lusher SJ, Martone ME, Mons A, Packer AL, Persson B, Rocca-Serra P, Roos M, van Schaik R, Sansone SA, Schultes E, Sengstag T, Slater T, Strawn G, Swertz MA, Thompson M, van der Lei J, van Mulligen E, Velterop J, Waagmeester A, Wittenburg P, Wolstencroft K, Zhao J, Mons B (2016) The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3, 160018.
[28]	Xiao WH, Zhou QS, Zhu CD, Wu DH, Xiao ZS (2020) Advances in techniques and methods of wildlife monitoring. Chinese Journal of Plant Ecology, 44, 409-417. (in Chinese with English abstract)
	[肖文宏, 周青松, 朱朝东, 吴东辉, 肖治术 (2020) 野生动物监测技术和方法应用进展与展望. 植物生态学报, 44, 409-417.] DOI
[29]	Xiao ZS, Cui JG, Wang DP, Wang ZT, Luo JH, Xie J (2023) Interdisciplinary development trends of contemporary bioacoustics and the opportunities for China. Biodiversity Science, 31, 22423. (in Chinese with English abstract) DOI
	[肖治术, 崔建国, 王代平, 王志陶, 罗金红, 谢捷 (2023) 现代生物声学的学科发展趋势及中国机遇. 生物多样性, 31, 22423.] DOI
[30]	Yang ML, Yu XW, Zhang X, Ouyang X, Hou YN, Gao JJ (2021) Design and implementation of the data management system for wild animal acoustics. Forest Resources Management, (6), 124-129. (in Chinese with English abstract)
	[杨铭伦, 于新文, 张旭, 欧阳萱, 侯亚男, 高家军 (2021) 野生动物鸣声数据管理系统设计与实现. 林业资源管理, (6), 124-129.]
[31]	Zhang C, He K, Gao X, Guo Y (2024) Automatic bioacoustics noise reduction method based on a deep feature loss network. Ecological Informatics, 80, 102517.

数据特征 Data characteristics	特征描述 Feature description	管理现状及挑战 Management status and challenges	文献来源 Reference
数据来源 Data source	野外自动录音设备、现有的生物声学图书馆、实验室处理后录音 Field automatic recording equipment, existing bioacoustics libraries, post-processing recording in laboratories	数据来源多样, 格式和质量差异较大 Data sources are diverse and vary widely in format and quality	Brown et al, 2020
数据类型 Data type	原始录音数据、处理后的录音文件、录音元数据、频谱和注释数据 Original recording data, processed recording files, recording metadata, spectrum data, annotation data	类型多样, 存储需求和管理要求不同 Various types, different storage requirements and management requirements	杨铭伦等, 2021
数据量 Data volume	小型项目: 几十GB到数百GB/月 Small projects: Tens of GB to hundreds of GB/month 大型项目: 数百TB/月 Large projects: Hundreds of TB/month	数据量庞大, 传统存储和管理方式难以应对 The amount of data is huge, and traditional storage and management methods are not suitable	杨铭伦等, 2021
元数据标准 Metadata standard	录音时间、地理位置、录音设备、录音参数、物种识别和分类信息 Recording time, geographical location, recording equipment, recording parameters, species identification, and taxonomic information	元数据标准不统一, 数据整合和共享困难 Metadata standards are not uniform, and data integration and sharing are difficult	Roch et al, 2016
数据共享 Data sharing	录音文件格式、元数据标准、数据隐私保护 Recording file format, metadata standards, data privacy protection	共享机制、隐私保护机制和管理标准需进一步完善, 提高数据可访问性和可利用性 Improve sharing mechanisms, privacy protection mechanisms, and management standards to improve data accessibility and availability	Parsons et al, 2022

数据特征 Data characteristics	特征描述 Feature description	管理现状及挑战 Management status and challenges	文献来源 Reference
数据来源 Data source	野外自动录音设备、现有的生物声学图书馆、实验室处理后录音 Field automatic recording equipment, existing bioacoustics libraries, post-processing recording in laboratories	数据来源多样, 格式和质量差异较大 Data sources are diverse and vary widely in format and quality	Brown et al, 2020
数据类型 Data type	原始录音数据、处理后的录音文件、录音元数据、频谱和注释数据 Original recording data, processed recording files, recording metadata, spectrum data, annotation data	类型多样, 存储需求和管理要求不同 Various types, different storage requirements and management requirements	杨铭伦等, 2021
数据量 Data volume	小型项目: 几十GB到数百GB/月 Small projects: Tens of GB to hundreds of GB/month 大型项目: 数百TB/月 Large projects: Hundreds of TB/month	数据量庞大, 传统存储和管理方式难以应对 The amount of data is huge, and traditional storage and management methods are not suitable	杨铭伦等, 2021
元数据标准 Metadata standard	录音时间、地理位置、录音设备、录音参数、物种识别和分类信息 Recording time, geographical location, recording equipment, recording parameters, species identification, and taxonomic information	元数据标准不统一, 数据整合和共享困难 Metadata standards are not uniform, and data integration and sharing are difficult	Roch et al, 2016
数据共享 Data sharing	录音文件格式、元数据标准、数据隐私保护 Recording file format, metadata standards, data privacy protection	共享机制、隐私保护机制和管理标准需进一步完善, 提高数据可访问性和可利用性 Improve sharing mechanisms, privacy protection mechanisms, and management standards to improve data accessibility and availability	Parsons et al, 2022

标准术语 Standard term	定义 Definition	示例 Example	含义 Implication
dwc: eventDate	录音时间, 可以精确到秒 Recording time, down to the second	2009-02-20T08:40Z	2009年2月20日上午8:40 UTC (世界标准时间) February 20, 2009 8:40 am UTC (Coordinated Universal Time)
	录音时间, 可以精确到秒 Recording time, down to the second	1963-03-08T14:07-0600	1963年3月8日下午2:07, 时区比UTC早6小时 March 8, 1963, 2:07 PM, time zone 6 hours ahead of UTC
		2007-03-01T13:00:00Z/ 2008-05-11T15:30:00Z	在2007年3月1日下午1:00 UTC和2008年5月11日下午3:30 UTC之间的某个时间间隔内 Sometime between 1:00 pm UTC on March 1, 2007 and 3:30 pm UTC on May 11, 2008
dwc: decimalLatitude	十进制纬度, 精确到小数点后几位Decimal latitude, accurate to a few decimal places	-41.0983423	南纬41.0983423° 41.0983423 degrees South 正值位于赤道以北, 负值位于赤道以南 Positive values are located north of the equator, negative values are located south of the equator
dwc: decimalLongitude	十进制经度, 精确到小数点后几位 Decimal longitude, accurate to a few decimal places	-121.1761111	西经121.1761111° 121.1761111 degrees West 正值位于格林威治子午线以东, 负值位于格林威治子午线以西 Positive values are located east of the Greenwich Meridian, Negative values are located west of the Greenwich Meridian
dwc: verbatimLocality	录音的具体地点描述 Description of the exact location of the recording	25 km NNE Bariloche por R. Nac. 237	录音地点的原始文字描述 Original text description of the recording location
dwc: scientificName	录音中物种的学名, 使用拉丁名称 Scientific names of species in recordings, using Latin names	Ctenomys sociabilis	属名 + 特定修饰语 Genus name + specific epithet 栉鼠属(Ctenomys)
		Roptrocerus typographi (Györfi, 1952)	属名 + 特定修饰语+科学名称作者身份 Genus name + specific epithet + scientific name authorship
dwc: recordedBy	录音的记录者 The recorder of recording	José E. Crespo	可以是一个人或一个组织 It can be a person or an organization
dwc: samplingProtocol	录音的采样方法或设备描述 Description of the sampling method or device for recording	SM4 acoustic recorder	录音设备或采样方法的名称 The name of the recording device or sampling method
dwc: associatedMedia	录音文件的URL URL of the recording file	https://arctos.database.museum/media/10520962	确保录音文件可以通过网络访问, 将录音文件和元数据关联起来 Make sure audio files are accessible over the network, associate audio files with metadata

标准术语 Standard term	定义 Definition	示例 Example	含义 Implication
dwc: eventDate	录音时间, 可以精确到秒 Recording time, down to the second	2009-02-20T08:40Z	2009年2月20日上午8:40 UTC (世界标准时间) February 20, 2009 8:40 am UTC (Coordinated Universal Time)
	录音时间, 可以精确到秒 Recording time, down to the second	1963-03-08T14:07-0600	1963年3月8日下午2:07, 时区比UTC早6小时 March 8, 1963, 2:07 PM, time zone 6 hours ahead of UTC
		2007-03-01T13:00:00Z/ 2008-05-11T15:30:00Z	在2007年3月1日下午1:00 UTC和2008年5月11日下午3:30 UTC之间的某个时间间隔内 Sometime between 1:00 pm UTC on March 1, 2007 and 3:30 pm UTC on May 11, 2008
dwc: decimalLatitude	十进制纬度, 精确到小数点后几位Decimal latitude, accurate to a few decimal places	-41.0983423	南纬41.0983423° 41.0983423 degrees South 正值位于赤道以北, 负值位于赤道以南 Positive values are located north of the equator, negative values are located south of the equator
dwc: decimalLongitude	十进制经度, 精确到小数点后几位 Decimal longitude, accurate to a few decimal places	-121.1761111	西经121.1761111° 121.1761111 degrees West 正值位于格林威治子午线以东, 负值位于格林威治子午线以西 Positive values are located east of the Greenwich Meridian, Negative values are located west of the Greenwich Meridian
dwc: verbatimLocality	录音的具体地点描述 Description of the exact location of the recording	25 km NNE Bariloche por R. Nac. 237	录音地点的原始文字描述 Original text description of the recording location
dwc: scientificName	录音中物种的学名, 使用拉丁名称 Scientific names of species in recordings, using Latin names	Ctenomys sociabilis	属名 + 特定修饰语 Genus name + specific epithet 栉鼠属(Ctenomys)
		Roptrocerus typographi (Györfi, 1952)	属名 + 特定修饰语+科学名称作者身份 Genus name + specific epithet + scientific name authorship
dwc: recordedBy	录音的记录者 The recorder of recording	José E. Crespo	可以是一个人或一个组织 It can be a person or an organization
dwc: samplingProtocol	录音的采样方法或设备描述 Description of the sampling method or device for recording	SM4 acoustic recorder	录音设备或采样方法的名称 The name of the recording device or sampling method
dwc: associatedMedia	录音文件的URL URL of the recording file	https://arctos.database.museum/media/10520962	确保录音文件可以通过网络访问, 将录音文件和元数据关联起来 Make sure audio files are accessible over the network, associate audio files with metadata

标准术语 Standard term	定义 Definition	示例 Example
ac: accessURI	指向音频文件的URL The URL to the audio file	https://xeno-canto.org/sounds/uploaded/PRVFBYIQYZ/XC932891-sonus-naturalis-7-01-06-2024.mp3
ac: derivedFrom	对原始资源的引用, 当前资源是从中派生的 A reference to the original resource from which the current resource is derived	例如一个经过降噪处理的录音可以标注原始录音的URL或ID For example, the URL or ID of the original recording can be marked after noise reduction
dc: format	音视频文件格式 Audio and video file format	audio/wav, audio/mp3
ac: mediaDuration	音频或视频文件的时长, 使用ISO 8601时间表示法 The duration of an audio or video file, using the ISO 8601 time notation	PT3M45S (3分45秒) Three minutes and 45 seconds
ac: endTimestamp	结束时间戳, 使用ISO 8601时间表示法, UTC时区 End time stamp, using ISO 8601 time notation, UTC time zone	可以应用于感兴趣的区域或整个文件 It can be applied to the area of interest or the entire document
mo: sample_rate	音频的采样率 Sample rate of audio	以Hz为单位的数值 Values expressed in Hz