Comparative analysis of wavelet transform and machine learning approaches for noise reduction in water level data

Yukwan Hwang, Kyoung Jae Lim, Jonggun Kim, Minhwan Shin, Youn Shik Park, Yongchul Shin, Bongjun Ji

Research output: Contribution to journalArticlepeer-review

Abstract

In the context of the fourth industrial revolution, data-driven decision-making has increasingly become pivotal. However, the integrity of data analysis is compromised if data quality is not adequately ensured, potentially leading to biased interpretations. This is particularly critical for water level data, essential for water resource management, which often encounters quality issues such as missing values, spikes, and noise. This study addresses the challenge of noise-induced data quality deterioration, which complicates trend analysis and may produce anomalous outliers. To mitigate this issue, we propose a noise removal strategy employing Wavelet Transform, a technique renowned for its efficacy in signal processing and noise elimination. The advantage of Wavelet Transform lies in its operational efficiency-it reduces both time and costs as it obviates the need for acquiring the true values of collected data. This study conducted a comparative performance evaluation between our Wavelet Transform-based approach and the Denoising Autoencoder, a prominent machine learning method for noise reduction.. The findings demonstrate that the Coiflets wavelet function outperforms the Denoising Autoencoder across various metrics, including Mean Absolute Error (MAE), Mean Absolute Percentage Error (MAPE), and Mean Squared Error (MSE). The superiority of the Coiflets function suggests that selecting an appropriate wavelet function tailored to the specific application environment can effectively address data quality issues caused by noise. This study underscores the potential of Wavelet Transform as a robust tool for enhancing the quality of water level data, thereby contributing to the reliability of water resource management decisions.

Original languageEnglish
Pages (from-to)209-223
Number of pages15
JournalJournal of Korea Water Resources Association
Volume57
Issue number3
DOIs
StatePublished - 2024

Keywords

  • Coiflets function
  • Denoising Autoencoder
  • Water level data
  • Wavelet Transform

Fingerprint

Dive into the research topics of 'Comparative analysis of wavelet transform and machine learning approaches for noise reduction in water level data'. Together they form a unique fingerprint.

Cite this