Data Fusion from Multiple Stations for Estimation of ...

Data Fusion from Multiple Stations for Estimation of PM2.5 in Specific Geographical Location Miguel A. Becerra1,2, Marcela Bedoya Sánchez1, Jacobo García Carvajal1, Jaime A. Guzmán Luna2, Diego H. Peluffo-Ordóñez3,4, Catalina Tobón5 1 GEA Research Group, Institución Universitaria Salazar y Herrera, Medellín, Colombia 2 SINTELWEB Research Group, Universidad Nacional de Colombia, Medellín, Colombia 3 Facultad de Ingeniería en Ciencias Aplicadas-FICA from Universidad Técnica del Norte, Ecuador 4 Department of Electronics- Universidad de Nariño, Colombia 5 Universidad de Medellín, Medellín, Colombia 1 {migb2b, marcelabedoyita, jacobogarcia04}@gmail.com, 2 [email protected], [email protected], [email protected]

Abstract. Nowadays, an important decrease in the quality of the air has been observed, due to the presence of contamination levels that can change the natural composition of the air. This fact represents a problem not only for the environment, but also for the public health. Consequently, this paper presents a comparison among approaches based on Adaptive Neural Fuzzy Inference System (ANFIS) and Support Vector Regression (SVR) for the estimation level of PM2.5 (Particle Material 2.5) in specific geographic locations based on nearby stations. The systems were validated using an environmental database that belongs to air quality network of Valle de Aburrá (AMVA) of Medellin Colombia, which has the registration of 5 meteorological variables and 2 pollutants that are from 3 nearby measurement stations. Therefore, this project analyses the relevance of the characteristics obtained in every single station to estimate the levels of PM2.5 in the target station, using four different selectors based on Rough Set Feature Selection (RSFS) algorithms. Additionally, five systems to estimate the PM2.5 were compared: three based on ANFIS, and two based on SVR to obtain an aim and an efficient mechanism to estimate the levels of PM2.5 in specific geographic locations fusing data obtained from the near monitoring stations. Keywords: ANFIS, PM2.5 estimation, Support Vector Regression.

1

Introduction

The World Health Organization (WHO) has studied the harmful effects of the polluted air on the human health, showing the need of monitoring different types of pollutants, including pollutants like PM2.5 particles in the cities of developed and developing countries [1]. It is because there are evidences that these particles have a high

association with cancer, heart diseases, lung diseases, and low tract respiratory infections, increasing the morbidity and mortality of the population in a considerable way. Therefore, to measure or estimate the PM2.5 in order to determine the values of the air quality, everywhere in an effective way, is very important in order to establish preventive measures and reduce the risk on the health of the population. There are three types of models, which are widely used, for predicting the quality of the air: Probabilistic, autoregressive and hybrids [2]. Probabilistic models use different techniques to assess the relationship between the air quality and the meteorological factors [3]. These are usually cheap computational models, such as Hidden Markov Models (HMM), which allow to do the accuracy statistic prediction with relatively less detailed data in relation to the prognostic in many areas [2–4]. However, these techniques have problems when the sampling data are limited, and the model may not work as expected which limits their ability of predicting future events. The nonlinear relationship between PM2.5 and meteorological data pose a problem of nonlinear regression between predictors, so models of artificial neural networks (ANN) are used, which have the ability to detect underlying nonlinear relationships between the responses and the predictors. These can be trained using some algorithms and require much less informatics resources [4-8]. The Autoregressive models have been widely used to predict the air quality, but with a variable precision due to their capacity of application to nonlinear processes and their dependence of the quality of the input data [9-10]. The support vector machines (SVM) are designed to solve nonlinear classification problems; but because of its ability to generalize, it has shown its application in regression problems and time series forecasting. The SVM makes use of a kernel function, attributing its great capacity for generalization, even when the training set is small, i.e., where both the generalization and the training process of the machine do not necessarily depend on the attributed number; allowing an excellent performance in high dimensional problems [11]. Referring to hybrid models as ANFIS [12], they have better performance, because they have the capacity to predict the maximum PM2.5 concentrations, that are considered a critical factor in the prediction system of air pollution [8]; and they also give adequate solutions to nonlinear problems, ambiguity, and randomness of the data. Other reported studies for the prediction of meteorological variables and contaminants have, in most of them, limitations in predictions respect to time and generality. Also, they do not focus on the estimation of variables in specific geographic locations and cities with a limited number of measurement stations and/or limited variables measurements, as is the case in Medellín city [13–19], which is the principal contribution of this work. In this study, a comparison among three ANFIS approaches, and two SVM approaches to estimate the PM2.5 was applied together with a relevant analysis based on Rough Set Feature Selection. This aimed at reducing the number of features obtained from the fused measures of near monitoring stations, in order to provide an objective, and an accurate mechanism for more reliable estimation of the PM2.5 concentration on a specific geographical location. Thus, this was obtained from meteorological data and

air quality variables in order to give the community an adequate information about the air quality to make decisions on the environmental exposure.

2

Material and Methods

2.1

Database

The air quality network of “Valle de Aburrá” (AMVA) has 22 measuring places of air quality and meteorology that are fixed. These places are distributed in their different municipalities and the jurisdiction of the Metropolitan area. Three stations were selected taken the completeness and their locations as the criteria, as shown in Fig. 1. They are described as follows: i) “Urbana Museo de Antioquia” (MED-MAINT) station, with the following coordinates: an altitude of 1488 [MASL], a latitude of 6º15'08.48" North, and a length of 75º34'07.37" West. ii) “Fondo Urbano Universidad Nacional de Colombia Sede Medellín – Núcleo el Volador” (MEDUNNV) station, with the following coordinates: an altitude of 1506 [MASL], a latitude of 6º15'34.39" North, and a length of 75º34'32.46" West. iii) “Suburbana UNE – Casa Yalta, Loma Los Balsos” (MED-UNEP) station, with the following coordinates: an altitude of 1848 [MASL], a latitude of 6º11'11.07" North, and a length of 75º33'26.55" West. These stations have measures of particles smaller than 2.5 micrometers (PM2.5), automatic monitors of Ozone (O3), and meteorological stations that generate data of temperature, humidity, wind speed, wind direction, and radiation.

Fig. 1. Geographical location of the Medellín stations

2.2

Theoretical Background

Adaptive Neural Fuzzy Inference System (ANFIS). This method needs Fuzzy Logic to change the given inputs into wanted outputs through highly interconnected Neural Network processing elements and information connections, which are weighted to locate and assign inputs into an output. To ease the use of this technique, two fuzzy IF-THEN rules based on a first order Sugeno

model [20] are implemented. 𝑅𝑢𝑙𝑒 1 : 𝐼𝐹 𝑥 𝑖𝑠 𝐴! 𝐴𝑁𝐷 𝑦 𝑖𝑠 𝐵! , 𝑇𝐻𝐸𝑁 𝑓! = 𝑝! 𝑥 + 𝑞! 𝑦 + 𝑟! and 𝑅𝑢𝑙𝑒 2 : 𝐼𝐹 𝑥 𝑖𝑠 𝐴! 𝐴𝑁𝐷 𝑦 𝑖𝑠 𝐵! , 𝑇𝐻𝐸𝑁 𝑓! = 𝑝! 𝑥 + 𝑞! 𝑦 + 𝑟! . Where, 𝑥 and 𝑦 are inputs, 𝐴! and 𝐵! are fuzzy sets, 𝑓! are outputs within the fuzzy region specified by the fuzzy rule, and 𝑝! , 𝑞! , 𝑟! are design parameters which are adjusted during the training process. The layer 1 is a mapping input variable to corresponding fuzzy membership 𝑂! = µ 𝐴! (𝑥). In the layer 2, Π is an AND operator to fuzzify the inputs i.e. 𝑤! = µ 𝐴! 𝑥 ∗ µ 𝐴! 𝑦 𝑖 = 1, 2, 3, … , 𝑁. Layer 3 has N-nodes that indicate normalization to the firing strengths from the previous layer. In the fourth layer, the nodes 𝑖 are adaptive and the output of each node is the product of the normalized firing strength with a first order polynomial (for a first order Sugeno model) 𝑂! = 𝑤! 𝑓! = 𝑤! 𝑝𝑥 + 𝑞𝑦 + 𝑟 𝑖 = 1, 2, 3, … , 𝑁. Finally, the overall output f of the model is given by one single fixed i.e. 𝑓 = ! 𝑤𝑓! .

Fig. 2. ANFIS Architecture

Support vector machines. The support vector machines (SVMs) were proposed by [21], to solve a nonlinear problem, an input variable that corresponds to predictor variable is non-linearly mapped into a high-dimension feature space [22], and the SVR function is formulated as 𝑦 = 𝜔𝜙 𝑥 + 𝑏. Where 𝜙 (x) is called the feature, which is nonlinear mapped from the input space x. The coefficients w and b are estimated by minimizing: 1 𝑅 𝑐 =𝑐 𝑁 𝐿! 𝑑 , 𝑦 =

!

𝐿! 𝑑! , 𝑦! + !!!

𝑑−𝑦 −𝜀 0

1 𝜔 2

!

𝑑−𝑦 ≥𝜀 𝑂𝑡ℎ𝑒𝑟𝑠

Where both 𝑐 and 𝜀 are prescribed parameters. The first term 𝐿! 𝑑 , 𝑦 is called the 𝜀 -intensive loss function. Here, 𝑘 𝑥, 𝑥 is called the kernel function. The value of the kernel is equal to the inner product of two vectors 𝑥 and 𝑥 in the feature space 𝜙 (𝑥) and 𝜙 ( 𝑥 ), such that 𝑘 𝑥, 𝑥 = 𝜙 𝑥 ∗ 𝜙 (𝑥) . Any function satisfying Mercer’s condition can be used as the kernel function. Proposed Procedure.

Fig. 3 shows the proposed procedure to estimate the PM2.5 in specific geographical location. First, we eliminate the samples with outliers, and then the database was normalized between 0 and 1. Then, the data of the selected stations were fused. Next, the relevance analysis was carried out using Rough Set- Neighbor (RS-N), Rough Set - Entropy (RS-E), Fuzzy Rough Set - Neighbor (FRS-N), and Fuzzy Rough Set – Entropy (FRS-E). These techniques are widely explained in [23]. Each of the parameters (inclusion and neighbor) of the algorithms was adjusted heuristic, taking values between 0.05 and 1 with increments of 0.05. Next, the results obtained were computed according to common relevance of the data given by the four selection methods, obtaining a reduct, which was used for training 5 regression approaches. Three system based on ANFIS were trained; each used different algorithms (Grid Partition-GP, Fuzzy C-means-FC [21] and Subtractive Clustering-SC [24, 25]) for establishing the initial FIS. Their parameters were adjusted in order to maximize accuracy. The same way, two SVR systems with two different kernels (polynomial kernel -KP and Gaussian kernel-KG) were trained, and their parameters C and gamma were adjusted for maximizing the accuracy. Finally, all approaches were validated using a 30-fold cross-validation procedure (70/30 split).

Fig. 3. Proposed procedure

3

Results and Discussion

Fig. 4 shows the results obtained of the relevance analysis carried out applying 4 selection algorithms (RS-N, FRS–N, RS-E and FRS–E) obtaining as relevant variables: wind speed, wind direction, and humidity to estimate the PM2.5.

Fig. 4. Global Relevance Analysis.

Table 1 shows the accuracy of the different techniques on the estimation of PM2.5 concentration in each station. The notation ANFIS-SC, ANFIS-GP, ANFIS-FC, SVRKP, SVR-KG means Adaptive neural fuzzy inference system- subtractive clustering, Adaptive neural fuzzy inference system-Grid Partition, Adaptive neural fuzzy inference system-Fuzzy C means, Support vector machines-Kernel Polynomial, Support vector machines-Kernel Gaussian, respectively. The best results were obtained with ANFIS-FC and SVR-KP 93.4% for each. However, the difference among the systems can be considered as minimal 3%. The worst results were obtain by SVR-KG 87.5%. Table 1. PM2.5 Estimation -ANFIS and SVR Accuracy

4

Technique

St-1 (%)

St- 2 (%)

St- 3 (%)

Mean

ANFIS-SC

94.0±0.4

92.3±0.3

93.4±0.3

93.23

ANFIS-GP

92.1±0.8

89.3±1.7

91.5±0.8

90.97

ANFIS-FC

94.4±0.4

92.2±0.4

93.6±0.3

93.4

SVR-KP

94.0±0.2

92.1±0.3

94.1±0.2

93.4

SVR-KG

87.2±0.5

88.3±0.5

87.1±0.6

87.5

Conclusions

In this study, meteorological and pollutant variables obtained from three nearby measurement stations were fused, and a relevance analysis using techniques based on RS for selecting was carried out. This allowed to obtain objectives, and accurate mechanisms to estimate the PM2.5. Besides, five regression systems were compared, where the results were similar. The best results were obtained using the three ANFIS and one SVM systems, which have demonstrated the capability of the variables selected together with data fusion of nearby stations to estimate the PM2.5 in specific geographical location, which demonstrated the effectiveness of our proposed procedure. However, the adjustment of parameters of the regression systems can be

optimized using metaheuristic algortithms in order to obtain major results in terms of accuracy. In addition, this study should be extended using other database from other geographical locations in order to increase its generality.

Acknowledgments This work was supported by the research project identified with code 267 at the “Institución Universitaria Salazar y Herrera” of Medellin, Colombia, CALAIRE Laboratory of “Universidad Nacional of Colombia”, and the Area Metropolitana de Medellín, who supplied the database.

References [1] [2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

«OMS | Calidad del aire (exterior) y salud», WHO. [Online]. Available: http://www.who.int/mediacentre/factsheets/fs313/es/. [Accessed: 24-oct-2015]. M. Dong, D. Yang, Y. Kuang, D. He, S. Erdal, y D. Kenski, «PM2.5 concentration prediction using hidden semi-Markov model-based times series data mining», Expert Syst. Appl., vol. 36, n.o 5, pp. 9046-9055, jul. 2009. W. Sun, H. Zhang, A. Palazoglu, A. Singh, W. Zhang, y S. Liu, «Prediction of 24-hour-average PM2.5 concentrations using a hidden Markov model with different emission distributions in Northern California», Sci. Total Environ., vol. 443, pp. 93-103, ene. 2013. D. Mishra, P. Goyal, y A. Upadhyay, «Artificial intelligence based approach to forecast PM2.5 during haze episodes: A case study of Delhi, India», Atmos. Environ., vol. 102, pp. 239-248, feb. 2015. P. Perez y E. Gramsch, «Forecasting hourly PM2.5 in Santiago de Chile with emphasis on night episodes», Atmos. Environ., vol. 124, Part A, pp. 22-27, ene. 2016. Q. Zhou, H. Jiang, J. Wang, y J. Zhou, «A hybrid model for PM2.5 forecasting based on ensemble empirical mode decomposition and a general regression neural network», Sci. Total Environ., vol. 496, pp. 264-274, oct. 2014. D. Z. Antanasijević, V. V. Pocajt, D. S. Povrenović, M. Đ. Ristić, y A. A. Perić-Grujić, «PM10 emission forecasting using artificial neural networks and genetic algorithm input variable optimization», Sci. Total Environ., vol. 443, pp. 511-519, ene. 2013. X. Feng, Q. Li, Y. Zhu, J. Hou, L. Jin, y J. Wang, «Artificial neural networks forecasting of PM2.5 pollution using air mass trajectory based geographic model and wavelet transformation», Atmos. Environ., vol. 107, pp. 118-128, abr. 2015. A. Kumar y P. Goyal, «Forecasting of daily air quality index in Delhi», Sci. Total Environ., vol. 409, n.o 24, pp. 5517-5523, nov. 2011.

[10] S. Qin, F. Liu, J. Wang, y B. Sun, «Analysis and forecasting of the particulate matter (PM) concentration levels over four major cities of China using hybrid models», Atmos. Environ., vol. 98, pp. 665-675, dic. 2014. [11] Velásquez, J.D.; Olaya, Y.; Franco, C.J.; «Time series prediction using support vector machines». Ingeniare, pp 64-75, apr. 2010. [12] O. Popoola, J. Munda, A. Mpanda, y A. P. I. Popoola, «Comparative analysis and assessment of ANFIS-based domestic lighting profile modelling», Energy Build., vol. 107, pp. 294-306, nov. 2015. [13] Z. B. K. Lovro Hrust, «Neural network forecasting of air pollutants hourly concentrations using optimised temporal averages of meteorological variables and pollutant concentrations», Atmos. Environ., vol. 43, n.o 35, pp. 5588-5596, 2009. [14] M. W. Gardner y S. R. Dorling, «Neural network modelling and prediction of hourly NOx and NO2 concentrations in urban air in London», Atmos. Environ., vol. 33, n.o 5, pp. 709-719, feb. 1999. [15] Y. Yildirim y M. Bayramoglu, «Adaptive neuro-fuzzy based modelling for prediction of air pollution daily levels in city of Zonguldak», Chemosphere, vol. 63, n.o 9, pp. 1575-1582, jun. 2006. [16] G. H. Roohollah Noori, «Uncertainty analysis of developed ANN and ANFIS models in prediction of carbon monoxide daily concentration. Atmos Environ», Atmos. Environ., vol. 44, n.o 4, pp. 476-482, 2010. [17] E. A. M. A. Behrang, «The potential of different artificial neural network (ANN) techniques in daily global solar radiation modeling based on meteorological data», Sol. Energy - Sol. ENERG, vol. 84, n.o 8, pp. 1468-1480, 2010. [18] T.-Y. Pai, K. Hanaki, H.-C. Su, y L.-F. Yu, «A 24-h Forecast of Oxidant Concentration in Tokyo Using Neural Network and Fuzzy Learning Approach», CLEAN – Soil Air Water, vol. 41, n.o 8, pp. 729-736, ago. 2013. [19] K. Polat, «A novel data preprocessing method to estimate the air pollution (SO 2): Neighbor-based feature scaling (NBFS)», Neural Comput. Appl., vol. 21, n.o 8, pp. 1-8, 2001. [20] J. S. R. Jang, «ANFIS: adaptive-network-based fuzzy inference system», IEEE Trans. Syst. Man Cybern., vol. 23, n.o 3, pp. 665-685, may 1993. [21] V. N. Vapnik, The Nature of Statistical Learning Theory. New York, NY: Springer New York, 2000. [22] R. C. Deo, X. Wen, y F. Qi, «A wavelet-coupled support vector machine model for forecasting global incident solar radiation using limited meteorological dataset», Appl. Energy, vol. 168, pp. 568-593, abr. 2016. [23] D. A. Orrego, M. A. Becerra, and E. Delgado-Trejos, «“Dimensionality reduction based on fuzzy rough sets oriented to ischemia detection”», 2012 Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. 2012 Pp 5282–5285. [24] S. L. Chiu, «Fuzzy Model Identification Based on Cluster Estimation», J. Intell. Fuzzy Syst., vol. 2, n.o 3, pp. 267-278, 1994. [25] A. K. Lohani, N. K. Goel, y K. K. S. Bhatia, «Improving real time flood forecasting using fuzzy inference system», J. Hydrol., vol. 509, pp. 25-41, feb. 2014.