New article online: Comparison of passive acoustic soniferous fish monitoring with supervised and unsupervised approaches

Comparison of passive acoustic soniferous fish monitoring with supervised and unsupervised approaches

The Journal of the Acoustical Society of America 143, EL278 (2018)
https://doi.org/10.1121/1.5034169

Tzu-Hao Lin
Department of Marine Biodiversity Research, Japan Agency for Marine-Earth Science and Technology, 2-15, Natsushima, Yokosuka City, Kanagawa, 237-0061, Japan

Yu Tsao
Research Center for Information Technology Innovation, Academia Sinica, Number 128, Section 2, Academia Road, Taipei 115, Taiwan, Republic of China

Tomonari Akamatsu
National Research Institute of Fisheries Science, Japan Fisheries Research and Education Agency, 2-12-4 Fukuura, Yokohama, Kanagawa 236-8648, Japan

Passive acoustics has been used to investigate behavior and relative abundances of soniferous fish. However, because of noise interferences, it remains challenging to accurately analyze acoustic activities of soniferous fish. This study proposes a multi-method approach, which combines rule-based detector, periodicity-coded non-negative matrix factorization, and Gaussian mixture models. Although the three methods performed well when used to detect croaker choruses in quiet conditions, inconsistent results are observed in noisy conditions. A consistency matrix can provide insights regarding the bias of acoustic monitoring results. The results suggest that the proposed approach can reasonably improve passive acoustic monitoring of soniferous fish.

Advertisements

Monitoring of coral reef ecosystem: an integrated approach of marine soundscape and machine learning

Presented in International Symposium on Grids & Clouds 2018

Monitoring of coral reef ecosystem: an integrated approach of marine soundscape and machine learning

 Tzu-Hao Lin1, Tomonari Akamatsu2, Frederic Sinniger3, Saki Harii3, Yu Tsao1

1Research Center for Information Technology Innovation, Academia Sinica, Taipei, Taiwan
2National Research Institute of Fisheries Science, Japan Fisheries Research and Education Agency, Yokohama, Japan
3Tropical Biosphere Research Center, University of the Ryukyus, Okinawa, Japan

Coral reefs represent the most biologically diverse marine ecosystem, however, they are vulnerable to environmental changes and impacts. Therefore, information on the variability of environment and biodiversity is essential for the conservation management of coral reefs. In this study, a soundscape monitoring network of shallow and mesophotic coral reefs was established in Okinawa, Japan. Three autonomous sound recorders were deployed in water depths of 1.5 m, 20 m, and 40 m since May 2017. To investigate the soundscape variability, we applied the periodicity-coded nonnegative matrix factorization to separate biological sounds and the other noise sources displayed on long-term spectrograms. The separation results indicate that the coral reef soundscape varied among different locations. At 1.5 m depth, biological sounds were dominated by snapping shrimp sounds and transient fish calls. Although not knowing the specific source, noises were clearly driven by tidal activities. At 20 m and 40 m depths, biological sounds were dominated by nighttime fish choruses and noises were primary related to shipping activities. Furthermore, the clustering result indicates the complexity of biological sounds was higher in mesophotic coral reefs compare to shallow-water coral reefs. Our study demonstrates that the integration of machine learning in the analysis of soundscape is efficient to interpret the variability of biological sounds, environmental and anthropogenic noises. Therefore, the conservation management of coral reefs, especially those rarely studied such as mesophotic coral reefs, can be facilitated by the long-term monitoring of coral reef soundscape.

You can also check the slides of this talk.

Improving the evaluation of soundscape variability via blind source separation

Presented in 174th Meeting of the Acoustical Society of America @ New Orleans, USA

Improving the evaluation of soundscape variability via blind source separation

Tzu-Hao Lin, Yu Tsao
Research Center for Information Technology Innovation, Academia Sinica

Tomonari Akamatsu
National Research Institute of Fisheries Science, Japan Fisheries Research and Education Agency

Mao-Ning Tuanmu, Joe Chun-Chia Huang
Biodiversity Research Center, Academia Sinica

Chiou-Ju Yao
National Museum of Natural Science

Shih-Hua Fang
Department of Electrical Engineering, Yuan Ze University

Abstract

Evaluation of soundscape variability is essential for acoustic-based biodiversity monitoring. To study biodiversity change, many researchers tried to quantify the complexity of biological sound. However, the analysis of biological sound remains difficult because the soundscape is made up of multiple sound sources. To facilitate the acoustic analysis, we have applied non-negative matrix factorization (NMF) to separate different sound sources in an unsupervised manner. NMF is a self-learning algorithm which factorizes a non-negative matrix as a basis matrix and an encoding matrix. Based on the periodicity information learned from the encoding matrix, biological chorus and the other noise sources can be efficiently separated. Besides, vocalizations of different species can also be separated by using the encoding information learned from multiple layers of NMF and convolutive NMF. In this presentation, we will demonstrate the application of NMF-based blind source separation in the analysis of long-duration field recordings. Our preliminary results suggest that NMF-based blind source separation can effectively recognize biological and non-biological sounds without any learning database. It can also accurately differentiate different vocalizing animals and improve acoustic-based biodiversity monitoring in a noisy environment.

Deblending of simultaneous-source seismic data via periodicity-coded nonnegative matrix factorization

Article for IEEE MLSP 2017 DATA CHALLENGE

Deblending of simultaneous-source seismic data via periodicity-coded nonnegative matrix factorization

Tzu-Hao Lin, Yu Tsao
Research Center for Information Technology Innovation, Academia Sinica

Abstract

To increase the efficiency of seismic acquisition, one needs to break down the simultaneous-source seismic data into single source responses by a procedure called deblending. In this study, we employed the periodicity-coded non-negative matrix factorization (PC-NMF) to separate the primary and the secondary sources recorded in Petroleum Geo-Services dataset. Due to the application of random delay times between consecutive shots, the two sources displayed different patterns among various shots. By combining the response matrices of successive receivers, the PC-NMF can learn the basic components and group the basic components into two clusters according to the periodicity among shot index. Therefore, the deblending of simultaneous-source seismic data can be effectively achieved in an unsupervised manner.

The full paper can be accessed in IEEE DATA PORT.

2017年海洋科學年會

2017/5/4-5 @ 國立中山大學

聆聽海洋的訊息:應用深度學習分析海洋聲景之變動

林子皓、曹昱
中央研究院 資訊科技創新研究中心

被動式聲學監測已被廣泛應用在海洋環境與生態研究中,長期錄音中的各種環境音與動物音增加了我們對海洋生態環境的了解,許多研究也深入探討人為噪音對海洋生態的影響。然而,過去針對海洋聲景的分析大多著重噪音的時頻譜特性,並透過設定規則的偵測器尋找海洋動物的聲音。但海洋聲景受到地形、氣候、生物群聚與人為活動的高度影響,時頻譜分析可能無法有效描述同時出現的多種聲源,偵測器效能也隨著噪音變動而改變。為了有效分離海洋聲景中的各種聲源,本研究應用非負矩陣分解法 (non-negative matrix factorization) 及其變形方法分析長期時頻譜圖,將輸入資料拆解為特徵矩陣與編碼矩陣。雖然單層的非負矩陣分解法在多次疊代後,能夠在特徵矩陣與編碼矩陣約略學習到各種聲源的頻譜特徵與時域上的強度,但仍難以分離重疊的多種聲源。本研究將多層學習器分別預訓練後堆疊成深度學習架構,並在各層之間逐漸減少特徵矩陣之基底數量,藉由最末層回傳後之重建資料和輸入資料的誤差,在多次疊代中自行修正各層模型參數以達到最佳的聲源分離成果。本研究針對各地具有不同環境噪音特性的海洋聲景進行分析,結果顯示在不需要辨識樣本與資料標籤的情況下,深度學習能夠有效分離海洋中的各種主要聲源:魚群鳴唱、槍蝦脈衝聲、船隻噪音與環境音。學習到的特徵矩陣也能夠作為辨識樣本,透過半監督式學習分析大量的線上資料。透過深度學習分離聲源,未來將能夠更有效評估海洋聲景的複雜結構,並藉此探討海洋環境與生態的變動,以及人為開發的影響。

[聲物誌] 錄音機漂流記

近期颱風肆虐,連帶著海洋觀測也跟著遭殃。前一陣子就因為蓮花颱風和昌鴻颱風接連靠近台灣,造成研究團隊在苗栗外海所放置的海下錄音機因為不明原因而脫離錨錠裝置、漂流上岸。還好遇到當地的好心人通報之後,得以將錄音機尋回,今天也才有機會讓大家聽聽錄音機迷途的這段過程。 

這段漂流的時間其實不長,大約5至6個小時後錄音機就被浪打上岸。錄音機漂流的路徑根據推測應是從後龍外海約15公尺水深的礁石區一路北漂至附近的中港溪口南岸,再進入潮間帶與碎波帶。然而,在這段濃縮的3分半鐘錄音裡,卻可以聽到海洋聲景有著非常大幅度的改變。

0:00 – 1:00
礁石區內眾多的槍蝦聲音。注意1分鐘後的水花聲,顯示錄音機已經浮上水面 (痛心)。

1:00 – 1:30
脫離礁石區,槍蝦聲音明顯減少。當時已進入傍晚,可以聽見河口附近的石首魚開始發出低頻的鳴聲。

1:30 – 2:57
台灣西部河口附近著名的石首魚群體鳴唱。注意這段時間之中,石首魚聲音的音頻特徵隨錄音機漂流進入潮間帶後的改變趨勢。

2:57 – 3:39
碎波帶的浪花與水流聲。這段聲音是透過水下麥克風所錄製,和空氣中聽到的略有不同。
 

從這段錄音之中,其實我們不難發現在不同型態的海床、地區之間,可能受到當地生態系組成的不同,而造就了多樣化的海洋聲景。許多海洋動物,也可能是透過各地聲景的不同,以此來尋找其偏好的棲地位置。因此,自然的海洋聲景是否受到人為噪音的干擾,將會是海洋保育非常重要的課題,亟需我們更多的關注。