Ziwen Yu¹, Jianjun Zhang^1,*, Wenwu Tan¹, Ziyi Xiong¹, Peilun Li¹, Liangqing Meng², Haijun Lin¹, Guang Sun³, Peng Guo⁴

Journal on Big Data, Vol.4, No.2, pp. 135-143, 2022, DOI:10.32604/jbd.2022.031024

Abstract Many countries are paying more and more attention to the protection of water resources at present, and how to protect water resources has received extensive attention from society. Water quality monitoring is the key work to water resources protection. How to efficiently collect and analyze water quality monitoring data is an important aspect of water resources protection. In this paper, python programming tools and regular expressions were used to design a web crawler for the acquisition of water quality monitoring data from Global Freshwater Quality Database (GEMStat) sites, and the multi-thread parallelism was added to improve the efficiency in the… More >

Jianjun Zhang^1,*, Yifu Sheng¹, Weida Chen², Haijun Lin¹, Guang Sun³, Peng Guo⁴

CMC-Computers, Materials & Continua, Vol.66, No.1, pp. 389-405, 2021, DOI:10.32604/cmc.2020.012384

Abstract Water is one of the basic resources for human survival. Water pollution monitoring and protection have been becoming a major problem for many countries all over the world. Most traditional water quality monitoring systems, however, generally focus only on water quality data collection, ignoring data analysis and data mining. In addition, some dirty data and data loss may occur due to power failures or transmission failures, further affecting data analysis and its application. In order to meet these needs, by using Internet of things, cloud computing, and big data technologies, we designed and implemented a water quality monitoring data intelligent… More >