F. Salazar1, E. Oñate1,2, M.Á. Toledo3
1 Centre Internacional de Metodes Numerics a l'Enginyeria - CIMNE, Barcelona, Spain
2 Universitat Politècnica de Catalunya (UPC), Barcelona, Spain
3 Universidad Politécnica de Madrid (UPM), Madrid, Spain
Dam behaviour is difficult to predict with high accuracy. Numerical models for structural calculation solve the equations of continuum mechanics, but are subject to considerable uncertainty as to the characterisation of materials, especially with regard to the foundation. As a result, these models are often incapable to calculate dam behaviour with sufficient precision. Thus, it is difficult to determine whether a given deviation between model results and monitoring data represent a relevant anomaly or incipient failure.
By contrast, there is a tendency towards automatising dam monitoring devices, which allows for increasing the reading frequency and results in a greater amount and variety of data available, such as displacements, leakage, or interstitial pressure, among others.
This increasing volume of dam monitoring data makes it interesting to study the ability of advanced tools to extract useful information from observed variables.
In particular, in the field of Machine Learning (ML), powerful algorithms have been developed to face problems where the amount of data is much larger or the underlying phenomena is much less understood.
In this monograph, the possibilities of machine learning techniques are analysed for application to dam structural analysis based on monitoring data. The typical characteristics of the data sets available in dam safety are taking into account, as regards their nature, quality and size.
A critical literature review is performed, from which the key issues to consider for implementation of these algorithms in dam safety are identified.
A comparative study of the accuracy of a set of algorithms for predicting dam behaviour is carried out, considering radial and tangential displacements and leakage flow in a 100-m high dam. The results suggest that the algorithm called “Boosted Regression Trees” (BRT) is the most suitable, being more accurate in general, while flexible and relatively easy to implement.
The possibilities of interpretation of the mentioned algorithm are evaluated, to identify the shape and intensity of the association between external variables and the dam response, as well as the effect of time. The tools are applied to the same test case, and allow more accurate identification of the time effect than the traditional statistical method.
Finally, a methodology for the implementation of predictive models based on BRT for early detection of anomalies is presented, together with its implementation in an interactive tool that provides information on dam behaviour, through a set of selected devices. It allows the user to easily verify whether the actual data for each of these devices are within a pre-defined normal operation interval.
El comportamiento estructural de las presas de embalse es difícil de predecir con precisión. Los modelos numéricos para el cálculo estructural resuelven bien las ecuaciones de la mecánica de medios continuos, pero están sujetos a una gran incertidumbre en cuanto a la caracterización de los materiales, especialmente en lo que respecta a la cimentación. Como consecuencia, frecuentemente estos modelos no son capaces de calcular el comportamiento de las presas con suficiente precisión. Así, es difícil discernir si un estado que se aleja en cierta medida de la normalidad supone o no una situación de riesgo estructural.
Por el contrario, muchas de las presas en operación cuentan con un gran número de aparatos de auscultación, que registran la evolución de diversos indicadores como los movimientos, el caudal de filtración, o la presión intersticial, entre otros. Aunque hoy en día hay muchas presas con pocos datos observados, hay una tendencia clara hacia la instalación de un mayor número de aparatos que registran el comportamiento con mayor frecuencia.
Como consecuencia, se tiende a disponer de un volumen creciente de datos que reflejan el comportamiento de la presa, lo cual hace interesante estudiar la capacidad de herramientas desarrolladas en otros campos para extraer información útil a partir de variables observadas.
En particular, en el ámbito del aprendizaje automático (machine learning), se han desarrollado algoritmos muy potentes para entender fenómenos cuyo mecanismo es poco conocido, acerca de los cuales se dispone de grandes volúmenes de datos.
En esta monografía se hace un análisis de las posibilidades de las técnicas más recientes de aprendizaje automático para su aplicación al análisis estructural de presas basado en los datos de auscultación. Para ello se tienen en cuenta las características habituales de las series de datos disponibles en las presas, en cuanto a su naturaleza, calidad y cantidad.
Se ha realizado una revisión crítica de la bibliografía existente, a partir de la cual se han identificado los aspectos clave a tener en cuenta para implementación de estos algoritmos en la seguridad de presas.
Se ha realizado un estudio comparativo de la precisión de un conjunto de algoritmos para la predicción del comportamiento de presas considerando desplazamientos radiales, tangenciales y filtraciones. Para ello se han utilizado datos reales de una presa bóveda. Los resultados sugieren que el algoritmo denominado “Boosted Regression Trees” (BRTs) es el más adecuado, por ser más preciso en general, además de flexible y relativamente fácil de implementar.
Adicionalmente, se han identificado las posibilidades de interpretación del citado algoritmo para extraer la forma e intensidad de la asociación entre las variables exteriores y la respuesta de la presa, así como el efecto del tiempo. Las herramientas empleadas se han aplicado al mismo caso piloto, y han permitido identificar el efecto del tiempo con más precisión que el método estadístico tradicional.
Finalmente, se ha desarrollado una metodología para la aplicación de modelos de predicción basados en BRTs en la detección de anomalías en tiempo real. Esta metodología se ha implementado en una herramienta informática interactiva que ofrece información sobre el comportamiento de la presa, a través de un conjunto de aparatos seleccionados. Permite comprobar a simple vista si los datos reales de cada uno de estos aparatos se encuentran dentro del rango de funcionamiento normal de la presa.
Mathematical Symbols
Magnitude of the artificial anomaly introduced
Coefficients in the HST formula
Number of days since 1 January
Output of predictive model for
Output of an ensemble model at iteration
Weak learner fitted at iteration
Index of accuracy of anomaly detection models
Reservoir level
Argument of the trigonometrical functions in the HST model.
Version of a BRT model
minimum
Residuals average
Number of records in a period
Regularisation parameter
Number of inputs
Model residuals (prediction-observation)
Variance
Subsample of a training set used to fit
Standard deviation of the residuals
time
Detection time
Input variable
Observed value for input at time
Equally-spaced values of to be used in PDPs
Measured response variable
Predicted response variable
Observed value of the output variable at time
Mean of
Mathematical tools
ANFIS Adaptive Neuro-Fuzzy System
ARX Auto-Regressive Exogenous
BRT Boosted regression Trees
FEM Finite Element Method
GA Genetic Algorithms
HST Hydrostatic Season Time
HSTT Hydrostatic Season Temperature Time
KNN K-Nearest Neighbours
MARS Multivariate Adaptive Regression Splines
ML Machine Learning
MLP Multi Layer Perceptron
MLR Multilinear regression
NN Neural Network
PCA Principal Component Analysis
RF Random Forest
SVM Support Vector Machine
Other Acronyms
ACA Agencia Catalana de l'Aigua
ARV Average Relative Variance
KDE Kernel Density Estimation
MAE Mean Absolute Error
MINECO Ministerio de Economía y Competitividad
MSE Mean Squared Error
OOR Out of range
PDP Partial dependence plot
RI Relative Influence
Dams play a key role in our society, since they provide essential services to our way of living, such as flood defence, water storage and power generation. Moreover, an eventual failure might have catastrophic consequences in terms of casualties, economic and environmental losses, as was unfortunately verified in the past [1].
As a consequence, safe dam operation needs to be ensured, and potentially anomalous performance shall be detected as early as possible, to avoid serious malfunctioning or failure. While the first objective is achieved by means of an appropriate maintenance program both for the structure and the hydro-electromechanical devices, failure prevention by early detection of anomalies is primarily based on surveillance tasks [2], [3].
In turn, surveillance is based on two main pillars [2]: a) visual inspection and b) monitoring of dam and foundation. Its main objective is to reduce the probability of failure [3].
Lombardi [4] formulated the objectives of dam and foundation monitoring in a concise way, by posing four questions to be answered:
The answer to these questions requires the analysis of dam monitoring data two ways:
The result of this analysis is essential in dam safety assessment and decision making, together with the rest of available information about dam construction and operation, including visual inspection. Figure 1 shows schematically the monitoring data analysis process.
Figure 1: Flow diagram of dam monitoring data analysis. |
Dam monitoring data analysis, and the answer to the above mentioned questions, require a behaviour model that provides an estimate on the response of the structure at a given time, taking into account the acting loads.
Existing models can be classified as follows [5]:
Numerical models based on the FEM provide useful estimates of dam displacements and stresses, but are subject to a significant degree of uncertainty in the characterisation of the materials, especially with respect to the structural behaviour of the foundation and the thermal evolution of the dam body in concrete (particularly arch) dams. Other assumptions and simplifications have to be made, regarding geometry and boundary conditions. These tools are essential during the initial stages of the life cycle of the structure, provided that not enough data are available to build data-based predictive models. However, their results are often not accurate enough for a precise assessment of dam safety.
This is more acute when dealing with determined variables such as leakage in concrete dams and their foundations, due to the intrinsic features of the physical process, which is often non-linear [6], and responds to threshold and delayed effects [7], [8]. Numerical analysis cannot deal with such a phenomenon, because comprehensive information about the location, geometry and permeability of each fracture would be needed. Other phenomena are also difficult to reproduce with numerical models, such as the beginning of failure by concrete plasticising or cracking, although tools have been developed for this purpose [9].
These drawbacks are shared by all approaches that make use of a FEM model: deterministic, hybrid and mixed.
Many of the dams in operation have a number of monitoring devices that record the evolution of various indicators such as displacements, leakage flow or pore water pressure, among others. Although there are still many dams with few observed data, there is a clear trend towards the installation of a larger number of devices with higher data acquisition frequency [3]. As a result, there is an increasing amount of information on dam performance.
Statistical tools employed in regular engineering practice for dam monitoring data analysis are relatively simple. They are frequently limited to graphical exploration of the time series of data []myers_fern_ridge_dam_2008, along with simple statistical models [3], [10]. The hydrostatic-season-time (HST) model [11] is the most widely applied, and the only generally accepted by practitioners.
HST is based on multiple linear regression considering the three most influential external variables: hydrostatic load, air temperature and time. It often provides useful estimations of displacements in concrete dams [12], and does not require air temperature time series data (it is assumed to follow a constant yearly cycle). Moreover, the resulting model is easily interpretable, since the contribution of each input is assumed to be cumulative.
Nonetheless, HST also features conceptual limitations that damage the prediction accuracy [12] and may lead to misinterpretation of the results [13]. For example, it is based on the assumption that the hydrostatic load and the temperature are independent, whereas it is well known that they are coupled, since the thermal field is influenced by the the water temperature in the upstream face [14]. On another note, it lacks flexibility, since the functions have to be defined beforehand, and thus may not represent the true behaviour of the structure [7]. Also, they are not well-suited to model non-linear interactions between input variables [6].
In the recent years, non-parametric techniques have emerged as an alternative to HST for building data-based behaviour models [15], e.g. support vector machines (SVN) [16], neural networks (NN) [17], adaptive neuro-fuzzy systems (ANFIS) [18], among others [15]. In general, these tools are more suitable to model non-linear cause-effect relations, as well as interaction among external variables, as that previously mentioned between hydrostatic load and temperature. On the contrary, they are typically more difficult to interpret, what led them to be termed as “black box” models (e.g. [19]). As a consequence, the vast majority of related works are limited to the verification of their prediction accuracy when estimating determined output variables (e.g. [20], [21], [22]).
Therefore, dam engineers face a dilemma: the HST model is widely known and used and easily interpretable. However, it is based on some incorrect assumptions, and its accuracy can be increased. On the other hand, more flexible and accurate models are available, but they are more difficult to implement and analyse.
The research aims at solving this issue by exploring the possibilities of machine learning algorithms to improve dam monitoring data analysis and safety assessment.
The main objective is the development of a methodology for dam behaviour analysis based on machine learning, efficient in early detection of anomalies. To achieve that goal, the following specific objectives need to be fulfilled:
1. Literature review on data-based models for dam monitoring data analysis, with focus on the following topics:
2. Algorithm selection, in terms of accuracy, flexibility, robustness and ease of implementation. 3. Analysis of the effect of the training set size, to have an estimate on the time period required from the first filling before having the possibility of employing some data-based behaviour model. 4. Identification of tools for interpretation of ML models, i.e., analysis of the influence of each input on dam response and retrospective assessment of dam performance to detect potential changes in time. 5. Implementation of the methodology in a software tool for anomaly detection, with the following functionalities:
This monograph is presented as a compendium of articles, previously published in indexed scientific journals. The list and the association with this document follows:
Chapter 2 contains a summary of the articles related to the literature review:
Chapter 3 is a summary of the article dealing with algorithm selection, based on a comparison of candidate techniques:
Chapter 4 focuses on model interpretation, and is associated with the fourth paper in the compendium:
The overall methodology for anomaly detection is described in Chapter 5. It takes into account the conclusions of the precedent works, and is the subject of another article currently under review.
Finally, part of the work was presented in the following conferences:
Salazar, F., Oñate, E., Toledo, M.Á. Posibilidades de la inteligencia artificial en el análisis de auscultación de presas. III Jornadas de Ingeniería del Agua, Valencia (Spain), October 2013 (in Spanish). Salazar, F., Morera, L., Toledo, M.Á., Morán, R., Oñate, E. Avances en el tratamiento y análisis de datos de auscultación de presas. X Jornadas Españolas de Presas, Spancold, Sevilla (Spain), February 2015 1 (in Spanish). Salazar, F., Oñate, E., Toledo, M.Á. Nuevas técnicas para el análisis de datos de auscultación de presas y la definición de indicadores cuantitativos de su comportamiento, IV Jornadas de Ingeniería del Agua, Córdoba (Spain), October 2015. Salazar, F., González, J.M., Toledo, M.Á., Oñate, E. A methodology for dam safety evaluation and anomaly detection based on boosted regression trees. 8 European Workshop on Structural Health Monitoring, Bilbao (Spain), July 2016.
A copy of the post-print version of the articles is included in Appendix 7, while the works presented in conferences form Appendix 8.
Therefore, Chapters 2, 3 and 4 include a summary of the methods and results of the correspondent articles, while Chapter 5 contains the final part of the research, in which the previous results were taken into account.
(1) Section 3 of this paper was carried out by León Morera
A literature review was performed on a selection of articles and conference proceedings featuring examples of application of data-based models in dam behaviour modelling. This chapter includes a summary of this analysis.
In what follows, stands for some response variable (e.g. displacement, leakage flow, crack opening, etc.), which is estimated in terms of a set of inputs : . The observed values are denoted as , where is the number of observations and refer to the dimensions of the input space.
Linear regression is the simplest statistical technique, appropriate to reproduce certain phenomena. It is also the basis of the most popular data-based behaviour model in dam engineering: the Hydrostatic-Season-Time (HST). It was first proposed by Willm and Beaujoint in 1967 [11].
It is based on the assumption that the dam response is a linear combination of three effects:
|
(2.1) |
|
(2.2) |
|
(2.3) |
where and d is the number of days since 1 January.
|
(2.4) |
The model parameters are adjusted by the least squares method: the final model is based on the values which minimise the sum of the squared deviations between the model predictions and the observations.
The main advantages are:
It also features relevant limitations:
Several alternatives have been proposed to overcome these shortcomings. Penot et al. [26] introduced the HSTT method, in which the thermal periodic effect is corrected according to the actual air temperature.
Related approaches also based on linear regression were applied in dam safety, often by means of the addition of further input variables following some heuristics or after a trial-and-error process [17], [6], [7], [10], [27]. In all cases, the need to make a priori assumptions about the model remains, although variable selection procedures have also been proposed, such as Stojanovic et al. [28], who combined greedy MLR with variable selection by means of genetic algorithms (GA).
It is well known that dams respond to certain loads with some delay [8]. The most typical examples are the change in pore pressure in an earth-fill dam due to reservoir level variation [29] and the influence of the air temperature in the thermal field in a concrete dam body [7].
Several alternatives have been proposed to account for these effects. The most popular is based on an enrichment of the linear regression by including moving averages or gradients of some explanatory variables in the set of predictors. Guedes and Coelho [30] predicted the leakage flow on the basis of the mean reservoir level over the course of a five-days period. Sánchez Caro [31] included the 30 and 60 days moving average of the reservoir level in the conventional HST formulation to predict the radial displacements of El Atazar Dam. Further examples are due to Popovici et al. [32] and Crépon and Lino [33].
A more formal alternative to conventional HST to account for delayed effects was proposed by Bonelli [34], [24]. It was intended to account for the delayed response of an arch dam in terms of the temperature field, with the final aim of predicting radial displacements. Lombardi et al. [4] suggested an equivalent formulation, also to compute the thermal response of the dam to changes in air temperature. Although the formulation differs from a multiple linear regression, its numerical integration leads to a predictive model which is a linear combination of:
which is the conventional form of a first order auto-regressive exogenous (ARX) model.
This is the most enriched version of multiple linear regression, where predictors of different types are combined. This gives greater flexibility to the algorithm to adapt to different situations or response variables. By contrast, the number of potential inputs can become very large, which generally leads to the need for some variable selection procedure. For example, Piroddi and Spinelli [35] applied a specific algorithm for selecting 11 out of 40 predictors considered. Principal component analysis (PCA) was also employed for variable selection (e.g. [36], [37], [6]).
A further drawback of linear regression with many input variables is that model interpretation becomes difficult, since the contribution of each predictor is harder to isolate.
Moreover, the use of the previous (lagged) value of the output to calculate a prediction for current record may induce to question a) whether the observed previous value or the precedent prediction should be used, and b) whether the model parameters should be readjusted at every time step.
In addition, current and previous values of response variables different from the target variable (e.g. radial displacements or leakage) can be considered as inputs. They implicitly encompass information from unrecorded or unknown phenomena, so the resulting model will probably be more accurate. However, it can also “learn” the anomalous behaviour and consider it as normal, in which case it would be inappropriate to detect anomalies.
The higher accuracy obtained by increasing the information given to the model invites exploring the utility of this approach, keeping their limitations in mind.
Among the non-conventional data-based algorithms, neural networks (NNs) are by far the most popular in the field of dam monitoring data analysis. NN models are flexible, and allow modelling complex and highly non-linear phenomena. Most of the published works employ the conventional multi-layer perceptron (MLP) and some sigmoid as the activation function.
These models often result in greater accuracy than MLR, due to the higher flexibility. However, the results are highly dependent on some issues to be determined by the user:
The fitting procedures greatly differ among authors. While Simon et al. [7] trained an MLP with three perceptrons in one hidden layer for 200,000 iterations, Tayfur et al. [39] used regularisation with 5 hidden neurons and 10,000 iterations. Neither of them followed any specific criterion to set the number of neurons. For his part, Mata [17] tested NN architectures with one hidden layer having 3 to 30 neurons on an independent test data set. He repeated the training of each NN model 5 times with different initialisation of the weights.
It can be concluded that NNs share some of the target features (flexibility, accuracy), but lack ease for implementation and robustness. Model interpretation is not straightforward, and the results depend on the initialisations, so several models need to be trained and their results averaged to increase robustness. Moreover, only numerical inputs can be considered, which need to be normalised for model fitting (and de-normalised afterwards).
Other ML approaches were also applied in dam safety, such as Adaptive neuro-fuzzy systems (ANFIS) ([20], [41]), Support Vector Machines (SVM) ([42], [16]), or K-nearest neighbours (KNN) ([43]). They mostly share the mentioned properties of NNs: greater flexibility and accuracy, more difficult interpretation and potential over-fitting.
Although each algorithm has its peculiarities, they all need to face intrinsic aspects of the problem to be solved, which can be analysed independently of the selected technique. Some of them have been mentioned before as variable selection. Others are specific to data-based prediction tasks, and in particular to the dam behaviour problem.
The vast majority of statistical and ML algorithms are highly dependent on the inputs considered, which results in a need for input variable selection. The issue has arisen in combination with the use of NN [44], [45], [46], [47], [48], ARX [35], MLR [28] and ANFIS models [20].
The selection of predictors can be useful to reduce the dimensionality of the problem (essential for ARX models), as well as to facilitate the interpretation of the results.
The criterion to be used depends on the type of data available, the main objective of the study (prediction or interpretation), and the characteristics of the phenomenon to be modelled. Engineering judgement is thus essential to make these decisions.
By contrast, some ML algorithms are insensitive to the presence of highly-correlated or uninformative predictors, such as those based on decision trees. Boosted regression trees (BRTs) and random forests (RFs) stand out among those included in this category, though they are relatively new and unknown for most dam engineers.
There is an obvious interest in model interpretation to analyse the effect of each input on dam response, once the parameters have been fitted. This contributes to answer the first question posed by Lombardi [4]: does the dam behave as expected/predicted? For example, an arch dam is expected to move in the downstream direction in front of a combination of high hydrostatic load and low temperature.
The evolution over time is particularly relevant, since it is related to the second and third questions [4]:
The effect of time, hydrostatic load and temperature can be easily obtained from an HST model, since it is based on the assumption that they are additive. However, it was already mentioned that they are actually correlated. Paraphrasing Breiman [23], when a pre-defined model is fit to data, ``the conclusions drawn are about the model's mechanism, not about nature's mechanism 1. Moreover, “if the model is a poor emulation of nature, the conclusions may be wrong”.
Therefore, the interpretation of a more accurate predictive model will offer more reliable conclusions. The price to be paid for the greater flexibility and accuracy is the more difficult interpretation.
The vast majority of published studies are limited to the analysis of model accuracy for the output variable under consideration, as compared to HST. Only a few come to deal with model interpretation, that is, to analyse the strength and nature of the contribution of each action to the dam response. They are often limited to cases where a low number of inputs are considered (e.g. [17], [49], [7], [32]).
(1) Breiman employs “nature” to denote any phenomenon partially understood, which associates the predictor variables to the outcome. In this research, ``nature's mechanism is homologous to “dam behaviour”
Accuracy is the main (and most obvious) measure of model performance, i.e. how well the model predictions fit to the observed data. However, it is well known that an increase in the number of parameters results in models more susceptible to over-fit. The higher complexity of ML algorithms has a similar effect as regards over-fitting. Hence, model accuracy must be computed properly.
It has been proven that the prediction accuracy of a data-based model, measured on the training data, is an overestimation of its overall performance [50]. Therefore, part of the available data needs to be reserved for model accuracy estimation (validation set). In principle, any sub-setting of the available data into training and validation sets is acceptable, provided the data are independent and identically distributed (i.i.d.).
This is not the case in dam monitoring series, which are time-dependant in general. Moreover, the amount of available data is limited, what in turn limits the size of the training and validation sets. Ideally, both should cover all the range of variation of the most influential variables.
On another note, a minimum amount of data is necessary to build a predictive model with appropriate generalisation ability. Some authors estimate the minimum period to be 5 [5] to 10 years [51], though it is case-dependent.
A further problem for the application of data-based models is that transient phenomena take place during the first years of operation [4]. Therefore, data from that period should be analysed in detail, since it might not be representative of subsequent dam performance.
In spite of these issues, many authors use the training set for computing model generalisation capability, or use a small sample for validation. This raises doubts about the actual accuracy of these models, in particular of those more strictly data-based, such as NN or SVM.
The deviation between predictions and observations is essential for dam behaviour assessment [4]. Moreover, the prediction intervals are typically based on some multiple of the standard deviation of the residuals. Hence, the proper estimation of model accuracy, over an adequate validation set, is fundamental from a practical viewpoint.
This topic is covered in depth in Chapter 5.
Despite the increasing amount of literature on the use of advanced data-based tools, very few examples described their practical integration in dam safety analysis. The vast majority were limited to the model accuracy assessment, by quantifying the model error with respect to the actual measured data.
The information provided by reliable automated systems, based on highly accurate models, can be a great support for decision making regarding dam safety [3], [2].
To achieve that goal, the outcome of the predictive model must be transformed into a set of rules that determine whether the system should issue a warning. The actions to be taken need to be defined on a case-by-case basis, taking into consideration the relevance of each device as regards the overall dam safety [4].
Actually, an overall analysis of the most representative instruments is recommended, to identify (and discard) any isolated reading error. Cheng and Zheng [42] proposed a procedure for calculating normal operating thresholds (“control limits”), and a qualitative classification of potential anomalies: a) extreme environmental variable values, b) global structure damage, c) instrument malfunctions and d) local structure damage.
A more accurate analysis could be based on the consideration of the major potential modes of failure to obtain the corresponding behaviour patterns and an estimate of how they would be reflected on the monitoring data. Mata et al. []mata2014construction employed this idea to develop a system that takes the measurements of several devices and classifies them as correspondent to normal or accidental situation. This scheme can be easily implemented in an automatic system, though requires a detailed analysis of the possible failure modes, and their numerical simulation to provide data with which to train the classifier.
There is a growing interest in the application of innovative tools in dam monitoring data analysis. Although only HST is fully implemented in engineering practice, the number of publications on the application of other methods has increased considerably in recent years, specially NN.
It seems clear that the models based on ML algorithms can offer more accurate estimates of the dam behaviour than the HST method in many cases. In general, they are more suitable to reproduce non-linear effects and complex interactions between input variables and dam response.
However, most of the published works refer to specific case studies, certain dam typologies or determined outputs. Many focus on radial displacements in arch dams, although this typology represents roughly 5% of dams in operation worldwide.
A useful data-based algorithm should be versatile to face the variety of situations presented in dam safety: different typologies, outputs, quality and volume of data available, among others. Data-based techniques should be capable of dealing with missing values and robust to reading errors.
These tools must be employed rigorously, given their relatively high number of parameters and flexibility, what makes them susceptible to over-fit the training data. It is thus essential to check their generalisation capability on an adequate validation data set, not used for fitting the model parameters.
The main limitation of these methods is their inability to extrapolate, i.e., to generate accurate predictions outside the range of variation of the training data. Therefore, before applying these models for predicting the dam response in a given situation, it should be checked whether the load combination under consideration lies within the values of the input variables in the training data set.
From a practical viewpoint, data-based models should also be user-friendly and easily understood by civil engineering practitioners, typically unfamiliar with computer science, who have the responsibility for decision making.
Finally, two overall conclusions can be drawn from the review:
In view of the conclusions of the literature review, a set of ML algorithms were selected for a detailed comparative analysis. The main features were already known, but there was a need for testing their appropriateness to build dam behaviour models.
A selection of algorithms were faced to a practical case study, and the results were compared. Specifically, the following techniques were considered: random forests (RF), boosted regression trees (BRT), support vector machines (SVM) and multivariate adaptive regression splines (MARS). Both HST and NN were also used for comparison purposes. Similar analyses had been previously performed in other fields of engineering, such as the prediction of urban water demand [52].
The data used for the study correspond to La Baells dam. It is a double curvature arch dam, with a height of 102 m, which entered into service in 1976. The monitoring system records the main indicators of the dam performance: displacement, temperature, stress, strain and leakage. The data were provided by the Catalan Water Agency (Agencia Catalana de l'Aigua, ACA), the dam owner, for research purposes. Among the available records, the study focused on 14 variables: 10 correspond to displacements measured by pendulums (five radial and five tangential), and four to leakage flow. Several variables of different types were considered in order to obtain more reliable conclusions. The details of the available data are included in the article, whereas the location of each monitoring device is depicted in Figure 2.
Figure 2: La Baells Dam geometry and location of the monitoring devices considered. Left:
view from downstream. Right: highest cross-section. |
The specific features of dam monitoring data analysis were taken into account to design the experiment. In all cases, approximately 40% of the records (from 1998 to 2008) were left out as the testing set. This is a large proportion compared with previous studies, which typically leave 10-20 % of the available data for testing [20], [17], [43]. A larger test set was selected in order to increase the reliability of the results.
On another note, it is well known that the early years of operation often correspond to a transient state, non-representative of the quasi-stationary response afterwards [4]. In such a scenario, using those years for training a predictive model would be inadvisable. This might lead to question the optimal size of the training set in achieving the best accuracy ([51], [6]). The available time series for La Baells dam span from 1979 to 2008. To analyse this issue, four different training sets were chosen to fit each model, spanning five, 10, 15 and 18 years of records. In all cases, the training data used correspond to the closest time period to the test set (e.g. periods 1993-1997, 1988-1997, 1983-1997, and 1979-1997, respectively).
The predictor set included inputs related to the environmental actions: air temperature and hydrostatic load. A time-dependent term was also added, to account for possible variations in dam behaviour over the period of analysis. Several variables derived from those actually measured at the dam site (reservoir level and the average daily temperature) were also included. They are listed in Table 1.
Table 1. Predictor variables considered.
Code | Group | Type | Period (days) |
Level | Hydrostatic load | Original | - |
Lev007 | 7 | ||
Lev014 | 14 | ||
Lev030 | 30 | ||
Lev060 | 60 | ||
Lev090 | 90 | ||
Lev180 | 180 | ||
Tair | 1 | ||
Tair007 | 7 | ||
Tair014 | 14 | ||
Tair030 | 30 | ||
Tair060 | 60 | ||
Tair090 | 90 | ||
Tair180 | 180 | ||
Rain | 1 | ||
Rain030 | 30 | ||
Rain060 | 60 | ||
Rain090 | 90 | ||
Rain180 | 180 | ||
NDay | - | ||
Year | - | ||
Month | Season | Original | - |
n010 | 10 | ||
n020 | 20 | ||
n030 | 30 |
The variable selection was performed according to dam engineering practice. Both displacements and leakage are strongly dependant on hydrostatic load. Air temperature is well known to affect displacements, in the form of a delayed action. It may also influence leakage flow (as Seifart et al. reported for Itaipú Dam [53]), although it is uncertain (Simon et al. observed no dependency [7]). Both the air temperature and some moving averages were included in the analysis.
A relatively large set of predictors was used to capture every potential effect, overlooking the high correlation among some of them. The comparison sought to be as unbiased as possible, thus all the models were built using the same inputs1 and data pre-process (only normalisation was performed when necessary). While it is acknowledged that this procedure may favour the techniques that better handle noisy or scarcely important variables, theoretically all learning algorithms should discard them automatically during the model fitting.
(1) with the exceptions of MARS and HST, as explained in the article
Table 2, contains the mean absolute error (MAE) for each target and model, computed as:
|
(3.5) |
where is the size of the training (or test) set, are the observed outputs and the predicted values.
Table 2. MAE for each output and model, fitted on the whole training set (18 years). The values within 10% from the minimum are highlighted in bold, and the minimum MAE are also underlined. The results correspond to the test set.
llcccccc Type | Target | RF | BRT | NN | SVM | MARS | HST |
P1DR1 | 1.70 | 0.93 | 0.58 | 0.75 | 2.32 | 1.35 | |
P1DR4 | 1.05 | 0.71 | 0.68 | 0.76 | 1.50 | 1.37 | |
P2IR4 | 0.94 | 0.97 | 1.02 | 1.05 | 0.85 | 1.12 | |
P5DR1 | 0.86 | 0.70 | 0.64 | 1.35 | 0.89 | 0.88 | |
P6IR1 | 1.47 | 0.69 | 0.72 | 0.60 | 1.67 | 0.91 | |
P1DT1 | 0.24 | 0.25 | 0.52 | 0.35 | 0.55 | 0.47 | |
P1DT4 | 0.15 | 0.15 | 0.18 | 0.19 | 0.22 | 0.20 | |
P2IT4 | 0.13 | 0.11 | 0.13 | 0.12 | 0.14 | 0.10 | |
P5DT1 | 0.40 | 0.22 | 0.19 | 0.38 | 0.47 | 0.18 | |
P6IT1 | 0.28 | 0.27 | 0.39 | 0.94 | 0.39 | 0.51 | |
AFMD50PR | 1.24 | 0.90 | 2.11 | 4.25 | 1.74 | 2.24 | |
AFMI90PR | 0.18 | 0.15 | 0.07 | 0.33 | 0.25 | 0.28 | |
AFTOTMD | 1.82 | 1.60 | 3.04 | 5.38 | 1.85 | 2.60 | |
AFTOTMI | 0.91 | 0.42 | 0.83 | 1.49 | 1.49 | 1.11 |
It can be seen that models based on ML techniques mostly outperform the reference HST method. NN models yield the highest accuracy for radial displacements, whereas BRT models are better on average both for tangential displacements and leakage flow. It should be noted that the MAE for some tangential displacements is close to the measurement error of the device ().
The effect of the training set size is depicted in Figure 3, where the model accuracy is measured in terms of the average relative variance (ARV) [54]:
|
(3.6) |
where is the output mean. Given that ARV denotes the ratio between the mean squared error (MSE) and the variance (), it accounts both for the magnitude and the deviation of the target variable. Furthermore, a model with ARV=1 is as accurate a prediction as the mean of the observed outputs.
Although the use of the whole training set is optimal for six out of 14 targets, significant improvements are reported in some cases by eliminating some of the early years. Surprisingly, for two of the outputs, the lower MAE corresponds to a model trained over five years, which in principle was assumed to be too small a training set. MARS is especially sensitive to the size of the training data. The MARS models trained on five years improve the accuracy for P1DR4 and P6IT1 by 13.3 % and 14.8 % respectively.
These results strongly suggest that it is advisable to select carefully the most appropriate training set size. This should be done by leaving an independent test set.
It was found that the accuracy of currently applied methods for predicting dam behaviour can be substantially improved by using ML techniques.
The sensitivity analysis to the training set size shows that removing the early years of dam life cycle can be beneficial. In this work, it has resulted in a decrease in MAE in some cases (up to 14.8% Hence, the size of the training set should be considered as an extra parameter to be optimised during training.
Some of the techniques analysed (MARS, SVM, NN) are more susceptible to further tuning than others (RF, BRT), given that they have more hyper-parameters and are more sensitive to the presence of correlated or uninformative inputs. As a consequence, the former might have a larger margin for improvement than the latter.
However, both detailed tuning and careful variable selection increase the computational cost and complicate the analysis. Since the objective is the extension of these techniques for the prediction of a large number of variables of many dams, the simplicity of implementation is an aspect to be considered in model selection.
In this sense, BRT showed to be the best choice: it was the most accurate for five of the 14 targets; easy to implement; robust with respect to the training set size; able to consider any kind of input (numeric, categorical or discrete), and not sensitive to noisy and low relevant predictors.
As a result of the comparative analysis, BRT was selected as the most appropriate tool to achieve the research objectives. In this stage, the possibilities of interpretation were investigated to:
For this purpose, the same data from La Baells Dam were employed, though the analysis focused on 12 variables: 8 corresponded to radial displacements measured by pendulums (along the upstream-downstream direction), and four to leakage flow. The location of each monitoring device is depicted in Figure 4.1.
[h!] ./Figures/Fig_01_Interpretation.pdf Geometry and location of the targets considered for model interpretation. Left: view from downstream. Right: highest cross-section.
Since BRT models automatically discard those predictors not associated with the output [55], the initial model considered the same inputs as described in section 3. All the calculations were performed on a training set covering the period 1980-1997, and the model accuracy was assessed for a validation set correspondent to the years 1998-2008.
BRT models are built by combining two algorithms: a set of single models are fitted by means of decision trees [56], and their output is combined to compute the overall prediction using boosting [57]. For the sake of completeness, a short description of both techniques follow, although excellent introductions can be found in [58], [59], [60], [19].
Regression trees were first proposed as statistical models by Breiman et al. [56]. They are based on the recursive division of the training data in groups of “similar” cases. The output of a regression tree is the mean of the output variable for the observations within each group.
When more than one predictor is considered (as usual), the best split point for each is computed, and the one which results in greater error reduction is selected. As a consequence, non-relevant predictors are automatically discarded by the algorithm, as the error reduction for a split in a low relevant predictor will generally be lower than that in an informative one.
Other interesting properties of regression trees are:
By contrast, regression trees are unstable, i. e., small variations in the training data lead to notably different results. Also, they are not appropriate for certain input-output relations, such as a straight line [60].
Boosting is a general scheme to build ensemble prediction models [57]. It is based on the generation of a (frequently high) number of simple models (also referred to as “weak learners”) on altered versions of the training data. The overall prediction is computed as a weighted sum of the output of each model in the ensemble. The rationale behind the method is that the average of the prediction of many simple learners can outperform that from a complex one [61].
The idea is to fit each learner to the residual of the previous ensemble. The main steps of the original boosting algorithm when using regression trees and the squared-error loss function can be summarised as follows [62]:
|
|
|
|
It is generally accepted that this procedure is prone to over-fitting, because the training error decreases with each iteration [62]. To overcome this problem, it is convenient to add a regularization parameter , so that step (d) turns into:
|
Some empirical analyses showed that relatively low values of (below 0.1) greatly improve generalisation capability [57]. In practice, it is common to set the regularisation parameter and consider a number of trees such that the training error stabilises [58]. Subsequently, a certain number of terms are pruned using for example cross-validation. This is the approach employed in this work, with and a maximum of 1,000 trees. It was verified that the training error reached the minimum before adding the maximum number of trees.
Five-fold cross-validation was applied to determine the amount of trees in the final ensemble. The process was repeated using trees of depth 1 and 2 (interaction.depth), and the most accurate for each target was selected. The rest of the parameters were set to their default values [63].
All the calculations were performed in the R environment [64].
Several procedures to interpret ML models, often termed “black box” models, can be found in the literature. In this work, the relative influence (RI) of each predictor and the partial dependence plots (PDP) were employed.
BRT models are robust against the presence of uninformative predictors, as they are discarded during the selection of the best split. Moreover, it seems reasonable to think that the most relevant predictors are more frequently selected during training. In other words, the relative influence (RI) of each input is proportional to the frequency with which they appear in the ensemble. Friedman [57] proposed a formulation to compute a measure of RI for BRT models based on this intuition. Both the relative presence and the error reduction achieved are considered in the computation. The results are normalised so that they add up to 100.
Based on this measurement, the most influential variables were identified for each output, and the results were interpreted in relation to dam behaviour. In order to facilitate the analysis, the RI was plotted as word clouds [65]. These plots resemble histograms, with the advantage of being more appropriate to visualise a greater set of variables. The code representing each predictor was displayed with a font size proportional to its relative influence with the library “wordcloud” [66].
Furthermore, two degrees of variable selection were applied, based on the RI of each predictor. First, a BRT model (M1) was trained with all the variables considered (section 5.2.3). Second, the inputs with were selected to build a new model (M2). This criteria is heuristic and based on the 1-SE rule proposed by Breiman et al. [56]. Finally, a model with three predictors was generated (M3), featuring the more relevant variables of each group: temperature, time and reservoir level for radial displacements, and rainfall, time and level for leakage flows.
These three versions were generated to analyse the effect of the presence of uninformative variables in the predictor set. Moreover, the simplest model facilitates the analysis, as the effect of each action is concentrated in one single predictor.
In this sense, the temporal evolution is particularly relevant for dam safety evaluation, as it can help to identify a progressive deterioration of the dam or the foundation, which might result in a serious fault if not corrected.
Multi-linear regression models and HST in particular are based on the assumption that the input variables are statistically independent, so the prediction is computed as the sum of their contributions. As a result, the effect of each predictor in the response can be easily identified, by plotting .
This method is not appropriate for BRT models, as interactions among predictors are accounted for. While this results in more flexibility, it also implies that the identification of the relation between predictors and response is not straightforward.
Nonetheless, it is possible to examine the predictor-response relationship by means of the partial dependence plots [57]. This tool can be applied to any black box model, as it is based on the marginal effect of each predictor on the output, as learned by the model. Let be the variable of interest. A set of equally spaced values are defined along its range: . For each of those values, the average of the model predictions is computed:
|
(4.7) |
where is the value for all inputs other than for the observation .
Similar plots can be obtained for interactions among inputs: the average prediction is computed for couples of fixed , where takes two different values. Hence, the results can be plotted as a three-dimensional surface (section 4.3.3). In this work, partial dependence plots were restricted to the simplest model, which considered three predictors. Therefore, three 3D plots allowed investigating the pairwise interactions among all the inputs considered in the simplified model.
The complete process comprised the following steps:
Table 4.3.1 contains the error indices for each target. For those models with variable selection, the predictors are also listed. The results show that BRT efficiently discarded irrelevant inputs, since the fitting accuracy was similar for each version in most cases (i.e., the presence of uninformative predictors did not damage the fitting accuracy).
[h!] 0.9 !
Train | Validation | ||||
Target | MAE | ARV | MAE | ARV | Inputs |
0.64 | 0.03 | 0.91 | 0.08 | All | |
0.68 | 0.03 | 0.81 | 0.06 | Tair090,Level,NDay,Lev007,Lev014 | |
0.69 | 0.03 | 0.78 | 0.06 | NDay,Tair090,Level | |
0.46 | 0.03 | 0.65 | 0.08 | All | |
0.50 | 0.03 | 0.66 | 0.08 | Level,Tair090,NDay,Lev007,Lev014,Lev030 | |
0.51 | 0.03 | 0.67 | 0.08 | NDay,Tair090,Level | |
0.66 | 0.03 | 1.03 | 0.09 | All | |
0.85 | 0.05 | 1.09 | 0.09 | Tair090,Level,Lev007,Lev014 | |
0.71 | 0.04 | 0.98 | 0.08 | NDay,Tair090,Level | |
0.48 | 0.05 | 0.90 | 0.14 | All | |
0.61 | 0.06 | 0.93 | 0.14 | Level,Tair090,Lev007,Lev014,Lev030 | |
0.53 | 0.06 | 0.94 | 0.16 | NDay,Tair090,Level | |
0.66 | 0.05 | 0.82 | 0.08 | All | |
0.64 | 0.05 | 0.87 | 0.10 | Tair060,Level,Tair030 | |
0.83 | 0.08 | 0.93 | 0.11 | NDay,Tair060,Level | |
0.25 | 0.03 | 0.47 | 0.21 | All | |
0.33 | 0.05 | 0.55 | 0.22 | Tair060,Level,Tair030 | |
0.31 | 0.04 | 0.52 | 0.24 | NDay,Tair060,Level | |
0.60 | 0.04 | 0.80 | 0.09 | All | |
0.65 | 0.05 | 0.78 | 0.08 | Tair060,Tair030,Level,NDay | |
0.83 | 0.08 | 0.85 | 0.1 | NDay,Tair060,Level | |
0.23 | 0.02 | 0.40 | 0.08 | All | |
0.37 | 0.05 | 0.67 | 0.17 | Tair060,Level,Tair030 | |
0.29 | 0.03 | 0.43 | 0.09 | NDay,Tair060,Level | |
1.28 | 0.16 | 0.93 | 0.19 | All | |
1.45 | 0.17 | 1.36 | 0.28 | Level,Lev014,Lev007 | |
1.16 | 0.14 | 1.23 | 0.48 | NDay,Rain090,Level | |
0.08 | 0.09 | 0.15 | 0.51 | All | |
0.08 | 0.10 | 0.12 | 0.45 | Lev007,NDay,Level,Lev014,Lev030 | |
0.08 | 0.10 | 0.12 | 0.46 | NDay,Rain030,Lev007 | |
1.64 | 0.15 | 1.67 | 0.37 | All | |
1.87 | 0.19 | 1.73 | 0.45 | Level,Lev007,Lev014 | |
1.69 | 0.18 | 1.97 | 0.52 | NDay,Rain180,Level | |
0.41 | 0.11 | 0.44 | 0.40 | All | |
0.44 | 0.12 | 0.44 | 0.42 | NDay,Lev060,Lev014,Lev007,Lev030,Lev180,Lev090,Level | |
0.54 | 0.18 | 0.46 | 0.60 | NDay,Rain180,Lev060 |
Accuracy of each model and target for the training and validation sets. The results and inputs considered by the most accurate version are highlighted in bold.
The analysis of the wordclouds of RI allowed identifying some interesting features of La Baells dam behaviour. As for the radial displacements, (Figure 4.3.2), the thermal inertia was observed as higher RI for Tair060 and Tair090 than for Tair (which in fact resulted negligible). By contrast, the reservoir level at the date of the record was always more influential than all the moving averages, what reveals an immediate response of the dam to this load.
Other conclusions derived from Figure 4.3.2 are:
./Figures/Fig_03_Interpretation Word clouds for the radial displacements analysed.
The same analysis for the leakage flows revealed a clear different behaviour between the right (AFMD50PR and AFTOTMD) and the left margins (AFMI90PR and AFTOTMI). While the former responded mainly to the hydrostatic load, with little inertia, the latter showed a remarkable dependence on time, as well as a greater relevance of several rolling means of reservoir level. Figure 4.3.2 shows the word clouds for the leakage flows.
./Figures/Fig_05_Interpretation.pdf Word clouds for the leakage measurement locations analysed.
The low inertia with respect to the hydrostatic load suggests that most of the leakage flow comes from the reservoir, while the effect of rainfall is negligible.
The resulting PDPs allowed verifying that the dam “behaved as expected”, in terms of the first question posed by Lombardi. Figure 4.3.3 contains the univariate PDP for P1DR1, which shows that higher hydrostatic load and lower air temperature are associated with displacement towards downstream and vice-versa.
./Figures/P1DR1_1d_PDP.pdf Partial dependence plot for P1DR1. Movement towards downstream correspond to lower values in the vertical axis, and vice-versa.
Similar plots can be generated in 3D, which allow investigating the pairwise interactions for all the inputs considered (Figure 4.3.3).
./Figures/P1DR1_2d_PDP.pdf 3D PDPs for the main acting loads and P1DR1.
The analysis of the leakage flows (Figure 4.3.3) confirmed that the time effect was irrelevant in the right abutment, except by certain erratic behaviour in the first two years and in the last three. On the contrary, a sharp decrease in leakage flow was revealed around 1983 for both locations in the left abutment, and a lower decrease in later years.
The shape of the effect of the hydrostatic load is sensibly exponential, with low influence for reservoir level below 610 m.a.s.l.
./Figures/Fig_10_Interpretation Partial dependence plot for leakage flows.
The PDPs also provide information to answer the second and third questions, by means of analysing the partial dependence on time. In the particular case of P1DR1, these plots show a step around 1991-1992 for the whole ranges of level and temperature, which might represent some change in dam response (Figures 4.3.3 and 4.3.3. This issue was object of further verification.
First, an HST model was fitted and similarly interpreted (Figure 4.3.3). The time effect was a linear trend towards downstream, in contrast with the step suggested by the BRT model.
On another note, the average reservoir level in the period 1991-1997 was significantly higher than before 1991, and might be the cause of the step registered in Figures 4.3.3 and 4.3.3: it represents a greater displacement towards downstream in the most recent period, which is consistent with the higher average hydrostatic load.
./Figures/Fig_08_Interpretation.pdf Contribution of time, temperature and hydrostatic load on P1DR1, as derived from the interpretation of HST.
To clarify the divergence in the results, a new BRT model was fitted to artificial data generated by plugging actual time series of reservoir level into the HST model, while removing the time-dependent terms:
|
The artificial time series data maintains the original reservoir level variation, and thus the higher load in the 1991-1997 period. Figure 4.3.3 contains the partial dependence plot for this BRT model, which clearly shows that the independence of the artificial data with respect to time was correctly captured. This result confirms that the step in the time dependence captured by BRT is not a consequence of the higher hydrostatic load in 1991-1997.
./Figures/P1DR1_1d_PDP_noTime.pdf Partial dependence plot for the artificial time-independent data. P1DR1. It should be noted that time influence is negligible.
The interpretation of BRT models resulted in meaningful information on dam behaviour and the effect of each input variable. It allowed verifying that the dam response was in agreement with intuition (e.g. higher hydrostatic load generated displacement towards downstream), and isolating the evolution over time.
The observation of the relative influence of each predictor allowed detecting the thermal inertia of the dam, its symmetrical behaviour, as well as the high variation over time for the leakage flows in the left abutment.
Moreover, the analysis of the time effect suggested that partial dependence plots based on BRT models are more effective to identify performance changes, as they are not coerced by the shape of the regression functions that need to be defined a priori for HST.
In the precedent sections, the first three questions posed in Chapter 1 were answered: BRT models allowed to study the dam response to the main loads, the relevance of each of the potential inputs, and the evolution over time. The high accuracy of BRTs imply that the conclusions drawn from the model interpretation are reliable.
However, the main objective of dam safety is to prevent failures, for which anomalies need to be detected at early stage. This refers to the fourth question: “was any anomaly in the behaviour of the dam detected?” [4]. The capability of predictive models to identify anomalies has been much less frequently studied than their accuracy. Mata et al. []mata2014construction developed a model based on linear discriminant analysis for the early detection of developing failure scenarios. This methodology belongs to the Type 2 among those defined by Hodge and Austin [67]: the system is trained with both normal and abnormal behaviour data, and classifies new inputs as belonging to one of those categories. The drawback of this approach is that the failure mode must be defined beforehand and simulated with sufficient accuracy to provide the training data. Hence, the system is specific for the failure mode considered.
Jung et al. [68] used a similar approach: abnormal situations were defined based on the discrepancy between model predictions and observed data. They focused on embankment dam piezometer data, and only the reservoir level was considered as external variable (although they acknowledge that the rainfall can also be influential). It is not clear whether this methodology could be applied to other dam typologies or response variables.
Cheng and Zeng [42] presented a methodology based on the definition of some control limits, which depend on the prediction error of a regression model. In addition, they proposed a classification of anomalies based on the trend of the deviation and on how the overall deviance is distributed among the devices considered. It has the advantage of being simultaneously applied to a set of devices, although the case study presented is simple and the test period considered very short (30 days), as compared to the available data (1,555 days).
Other examples of application of advanced tools together with prediction intervals have been published by Gamse and Oberguggenberger [69], who employed the procedure of probabilistic quality control, Yu et al. [10], based on principal component analysis (PCA), Kao and Loh [46], who used PCA together with neural networks (NN), Li et al. []li_towards_2013, who considered the autocorrelation of the residuals and Loh et al. [47], who presented models for short and long term prediction.
Most of these works follow a conceptually similar methodology: a prediction model is built, the density function of the residuals is calculated and used to define the prediction intervals, which are applied to detect anomalies. In all cases, the efficiency is verified by means of its application to a short period of records. As an exception, Jung et al. []jung2015exploration and Mata et al. []mata2014construction used abnormal data obtained from finite element models (FEM).
In this Chapter, the results of the previous stages are implemented in a methodology for early detection of anomalies, with the following innovative features:
The outputs considered correspond to the same radial displacements employed in Chapter 4 (Figure 4.1).
As mentioned above, most of the published works on the application of data-based models in dam monitoring are limited to the assessment of the model accuracy. However, the main practical utility of these models is the early detection of anomalies, for which it is necessary to compare the predictions with monitoring readings, and verify whether they fall within a predefined range. If the residual density function follows a normal distribution, that range can be defined in terms of the standard deviation of the residuals. For example, Kao and Loh []kao2013monitoring presented the 99% prediction intervals for models based on neural networks, while Jung et al. [68] tested 1, 2 and 3 standard deviations of the residuals as the width of the prediction interval.
Based on the results of a preliminary study [71], the prediction interval was set to , being and the mean and the standard deviation of the residuals, respectively. Special attention was paid to the determination of a realistic residual distribution. It is well known that the accuracy of a machine learning prediction model must be calculated from a data set not used for model fitting []hyndman2014forecasting (validation set). In the case of time series, this validation set should be more recent in time than the training data, since in practice the model is used for predicting a time period subsequent to the training data [50].
The hold-out cross-validation method meets this requirement, with the most recent data in the hold-out set (Figure 4).
Figure 4: Hold-out cross-validation scheme. |
However, this implies discarding the most recent data for the model fit, which are generally the most useful, since they represent the most similar behaviour to that to be predicted (assuming there may be a gradual change in behaviour over time). Moreover, the validation data may be biased, if they correspond, for instance, to a especially warm (or cold) period.
To overcome these drawbacks while maintaining good estimate of the prediction error, an approach based on the hold-out cross validation method suggested by Arlot and Celisse [50] for non-stationary time series data was employed.
The proposed method takes into account the following specific aspects of dam behaviour: a) changes in the dam-foundation system are generally gradual, and b) dam behaviour models are typically revised annually, coinciding with the update of safety reports.
Let us consider that a behaviour model is to be fitted at the beginning of year , to be applied for anomaly detection during that year. The available data corresponds to the years , with being the initial year of dam operation. With the simple hold-out method, a model is fitted with data in years , whose accuracy is evaluated on data in .
In this work, a minimum training period of 5 years was considered. This value was chosen in view of the results of previous studies [21], and the evolution of model accuracy on the reference data, as described in section 5.3.2. Then, an iterative process was followed to reduce potential bias in the loads during . A set of predictions is generated as follows:
At the end of the process, residuals for a set of models are obtained, with the particularity that they are computed over different time periods, always subsequent to the training set . That is, the amount of observations in the training sample increases, and are used to predict the following year. The potential bias of some abnormal loads for one year is compensated by averaging, while a realistic prediction error is achieved, since it is always based on precedent data. A similar approach was employed by Herrera et al. to estimate demand in water supply networks, who employed the term growing window strategy [52].
Additionally, since the model accuracy typically increases as the training data grows, the actual model accuracy for the application period (year ) will be more similar to that obtained for . Hence, is more representative of the expected model performance for . To account for this issue, the prediction intervals are based on a weighted average of and . In particular, the weights for each year decrease geometrically from the most recent to the first available. A schematic representation of the procedure is included in Figure 5.
Finally, to take advantage of all the available data, a model is fitted with the entire period , with which the predictions for the following year () are computed.
Since the test set becomes part of the validation period in the subsequent years, the residuals generated during the application of the model in the test period can be added to those computed for previous years, so that there is no need to repeat the whole process: the previous residuals can be employed to obtain the new prediction interval, after updating the correspondent weights.
BRT models are robust against the presence of uninformative or highly correlated predictors [57], [72]. Hence, variable selection is much less influential for tree-based methods than for other machine learning tools [55]. This property was employed to build BRT models of three types.
The first is a causal model, as that described in section 3.2, which considers as predictors those inputs related to air temperature, hydrostatic load and time (Table 1). A priori, a model of this type is expected to detect reading errors and changes in dam behaviour. However, its accuracy might be improved, since the response of the dam may depend on variables not considered, such as the maximum and minimum daily temperatures, or the solar radiation.
The second version is the Non-Causal model. In addition to the predictors described above, dam response variables were also considered as inputs. This means that each radial displacement is included in the input set to predict other radial displacements. This version will in principle give greater precision, since the record from a neighbouring device (e.g. another station of the same pendulum) implicitly contains the effect of external variables not considered in the causal version. By contrast, this model might not be able to detect anomalies affecting several devices. For example, a slide in a block of a concrete gravity dam will be reflected in all stations of the correspondent plumb line; therefore, the relation between the hydrostatic load and the displacement would be abnormal, while the relationship between several readings of the same pendulum could be normal.
Finally, an auto-regressive with exogenous inputs (ARX) [73] model was also fitted for each output, where the lagged values of all radial displacements were added to the Non-Causal model input set1. Specifically, the response at time is estimated based on the readings at and , both for the variable to predict and other response variables.
One of the objectives of this work is to test the ability of all three models to detect various types of abnormalities, and draw conclusions for practical purposes.
(1) The ARX model is also non-causal, in the sense that variables with non-causal relation with the outputs are included as predictors. The acronym ARX was employed to distinguish both models when necessary, although they are occasionally jointly referred to as “non-causal models”. For the sake of clarity, the capitalised version (“Non-Causal”) is used to specifically refer to the second model, excluding the ARX.
As in previous analyses, La Baells arch dam was also selected as the case study (Section 3.2). In this case, the air temperature and the reservoir level time series were considered as inputs to a FEM model. The results of this model in terms of radial displacements at the location of the pendulums were extracted and compared to the actual measurements. The objective was to check that the FEM model could provide realistic data to generate reference time series of dam behaviour. These artificial data are free from any temporal variation (the reference numerical model does not vary with time; only environmental loads do).
The dam was considered as a three-dimensional solid discretised in hexahedral serendipity 27-node elements. A portion of the foundation was also included, resulting in a total of 13,029 nodes and 2,530 elements. The thermal and mechanical problems were solved separately on the resulting finite element mesh (Figure 5.2.3). The material properties are shown in table 3.
[!h]
Property | Dam | Foundation |
Young modulus | ||
Poisson ratio | 0.25 | 0.25 |
Density | 2,400 | 3,000 |
Thermal conductivity | 2.4 | 2.2 |
Thermal expansion coefficient | ||
Specific heat | 982 | 950 |
[!htpb] ./Figures/Fig03a.eps ./Figures/Fig03b.eps FEM model.
For the thermal problem, a transient computation was run over the 1981-2008 period with time step of 30 days. The temperature was imposed in both dam faces, with different values for the wet and dry areas. For the boundaries below the reservoir level, the temperature was considered as equal to that of the water, which in turn was estimated by means of the Bofang formula [74]. Although it allows accounting for the temperature variation with depth, a unique value was considered in this work for all the wetted boundaries, equal to that obtained for 50% depth. For the dry faces, the 30-days moving average of air temperature was imposed, to take into account the thermal inertia. The result was increased by 2 degrees to account for the solar radiation, following the approach proposed by Pérez and Martínez for Spanish dams in the North-East region [75]. The temperature evolution for the first year was repeated 4 times to ensure that the result was not influenced by the initial conditions.
The mechanical response was assumed to be elastic and instantaneous (without inertia), hence for each time step, the hydrostatic load correspondent to the actual reservoir level was applied.
The results of both models (thermal and mechanical) were added, and the displacement evolution at the location of the monitoring devices were extracted. The model results, which are generated in global axes, were later transformed to the local axes correspondent to the radial displacements, as measured by the monitoring devices.
Finally, weekly values were obtained via interpolation, according to the average reading frequency for the available data.
In addition to radial displacements, also the temperature evolution in the dam body was compared to observed data from several thermometers embedded in the dam body.
The goodness of fit of the FE model was computed in terms of the mean absolute error (MAE) (equation 3.5).
As described in the previous section, the reference time series were those obtained with the FEM model for the 1980-2008 period, where the boundary conditions and loads correspond to the reservoir level and air temperature actually measured in the dam site. Three different types of anomalies were later introduced to modify those data:
It is important to note that the anomaly of scenario 3 affects differently to each of the devices analysed. Since a displacement in the left abutment was imposed, the results in the left half of the dam body are anomalous. However, those in the right half are not affected. This can be observed in Figure 6, which depicts the displacement field in the dam body generated by the imposed anomaly with .
Figure 6: Displacement field resulting from the anomaly in scenario 3. View from downstream. |
Table 4 contains the mean absolute deviation between the reference and the anomalous time series for each device for . Since the anomaly in scenario 3 does not affect to some devices, those values considered as abnormal by the system will be false positives.
[]
Device | MAE (mm) | Device | MAE (mm) |
P1DR1 | 0.61 | P5DR1 | 1.42 |
P1DR4 | 0.52 | P5DR3 | 1.05 |
P2IR1 | 0.10 | P6IR1 | 0.02 |
P2IR4 | 0.13 | P6IR3 | 0.01 |
For each scenario, the performance of the three models considered (causal, Non-Causal and auto-regressive) was analysed. 4,000 anomalous cases were generated, where the following parameters were randomly selected:
Each anomalous case was presented to all three models to compare their ability for anomaly detection. This was computed in terms of the detection time (), defined as the elapsed time from the start of the anomaly until the first observation considered anomalous by each model, measured in days (Figure 7). Since the abnormal period was limited to 1 year, the models which did not detect any anomaly were assigned a value of 365 days.
Moreover, the effectiveness of an anomaly detection system also depends on the number of false positives (observations considered abnormal by the model, which are actually normal) and false negatives (abnormal values not detected as such by the model). The two most commonly used metrics to account for these are precision (equation 5.9) and recall (equation 5.10). The comparison was mainly based on the index [68], which jointly considers precision and recall, giving more importance to the latter (Eq. 5.11).
|
(5.9) |
|
(5.10) |
|
(5.11) |
However, these indexes are not useful for model performance assessment when analysing the unaffected devices in scenario 3. In these cases, there are not true positives (all records are normal, since these devices are not affected by the anomaly). Hence, both precision and recall equal zero. Nonetheless, it is highly relevant to know whether the proposed models correctly identify these records within the prediction interval. For that purpose, scenario 3 was analysed by means of the amount of false positives, whose computation depends on the device. For those in the left half of the dam body (as viewed from upstream), which are actually anomalous, the observations above the upper limit of the prediction interval are considered as false positives, since they would imply a deviation towards upstream (while the actual anomaly corresponds to a displacement in the downstream direction). By contrast, for the unaffected devices, every record outside the prediction interval is a false positive, both above the upper limit and below the lower limit of the interval.
In general, model accuracy is dependent on the values of the input variables. The more input data available for similar situations to that to be predicted, the more accuracy is to be expected. In dam behaviour, it will depend on the thermal and hydrostatic loads.
This effect is more important when input values are out of the training data range [76]. In particular, the accuracy of data-based models as BRTs may decrease dramatically when extrapolating.
Cheng et al. [42] defined a possible abnormal state of the dam (State 3), that “may be caused by extreme environmental values variables”. In this work, this issue was explicitly verified, and out-of-range (OOR) instances were considered as potential false positives.
This verification was carried out following an original procedure, specifically designed for the dam behaviour problem, where there are three main loads: thermal, mechanical (hydrostatic head) and temporal.
If the behaviour of the dam does not change over time, the importance of time variable is negligible. This was checked when fitting BRT models to the reference data, which correspond to time-independent dam behaviour. The inclusion of these variables is useful for retrospective analysis, as confirmed in Chapter 4. In practice, a previously trained model is employed to predict future values. Hence, it is obvious that the model prediction is an extrapolation in time axis and thus does not need to be verified.
As for the other two loads (thermal and hydrostatic), the simplest approach would be to check whether their values for the test period are greater (lower) than the maximum (minimum) within the training data set. However, that would not consider that both effects are coupled: the water temperature is different to that of the air, hence the water surface elevation affects the boundary condition in the upstream dam face and, as a result, conditions the thermal response of the dam [25].
Moreover, there is not a widely accepted agreement on what extrapolation is and how to handle it [76]. In dam behaviour modelling, it seems obvious that a hydrostatic load above the maximum in the training set is out-of-range. However, a more detailed definition seems appropriate to account for the “empty space phenomenon” [77], i.e., the existence of areas without training samples within the range of the inputs.
To account for this issue, a procedure that takes into consideration the combination of both loads is proposed:
With this procedure, it is taken into account that the predictive accuracy can be poor for a load combination not previously presented, even though their values, if considered separately, are within the training range. An example of this issue is presented in Figure 7.
Figure 8 shows the comparison between the observed radial displacements for P1DR1 and those obtained with the FE model for the period 1994-2008. Results for other outputs are similar (Table 5). The FEM model accuracy is comparable to that obtained in previous Chapters with data-based models 2.
Figure 8: FEM results versus observations for P1DR1. |
[]
Output | MAE (mm) | Output | MAE (mm) |
P1DR1 | 0.70 | P5DR1 | 0.81 |
P1DR4 | 0.65 | P5DR3 | 1.01 |
P2IR1 | 1.08 | P6IR1 | 0.96 |
P2IR4 | 0.98 | P6IR3 | 0.58 |
As regards the temperature, Figure 9 shows the numerical results and the observed data for 4 thermometers and the January 2007 - June 2008 period. Both the devices and the time period correspond to the results published by Santillán et al. [14], who employed a highly detailed thermal model for the same case study.
Figure 9: Comparison between numerical and measured temperature in 4 locations within the dam body. |
Since predicting the thermal response is not the main objective of this analysis, relevant simplifications were employed to generate the reference data (neglecting the variation in water temperature with depth, using a relatively large time step). Nonetheless, the temperature within the dam body was well captured.
This, together with the results for displacements, confirm that the resulting data series mostly reproduce the dam response to the main loads. Therefore, they are representative of the normal behaviour of the dam and useful to evaluate the ability of the methodology to detect anomalies.
The performance of all models on the reference data (without anomalies) was first assessed. The objectives are:
For that purpose, the iterative process described in section 5.2.1 was followed, i.e., each model is re-fitted yearly over an increasing training set, and the prediction interval is updated as a function of the actualised value of the weighted average of the residual standard deviation. Since the dam-foundation behaviour is time-independent for the reference case, the variation in model accuracy is due to the increase of training data.
Figure 10 shows the evolution of both the raw and the weighted average of the residual standard deviation for all devices and models. Some conclusions can be drawn:
Figure 10: Time evolution of the prediction accuracy for all models and outputs. Top: standard deviation of residuals per year. Bottom: weighted average. |
Table 6 contains the amount of false positives for all targets and models, as well as those correspondent to out-of-range inputs. Although the prediction interval for the causal model is wider (due to the higher residual standard deviation), it also generates a greater quantity of false positives. However, the average amount is low in all cases, as compared to the total amount of records (1,464). Moreover, the procedure to identify out-of-range inputs reduces the false positives by 27 % for the causal model and by 45% for both the non-causal and the ARX. As a result, the mean percentage of false positives is 8.0, 2.8 and 2.6 % respectively. It should be noticed that the results for the non-causal and ARX models are lower than the theoretical percentage of values outside the interval within 2 times the standard deviation in a normal distribution (5%
[]
Model | Causal | Non-Causal | ARX | |||
Target | False pos. | OOR | False pos. | OOR | False pos. | OOR |
P1DR1 | 179 | 53 | 91 | 40 | 82 | 35 |
P1DR4 | 178 | 54 | 89 | 42 | 75 | 38 |
P2IR1 | 184 | 54 | 89 | 41 | 85 | 35 |
P2IR4 | 198 | 54 | 95 | 50 | 75 | 38 |
P5DR1 | 125 | 31 | 50 | 21 | 51 | 21 |
P5DR3 | 164 | 49 | 72 | 31 | 68 | 30 |
P6IR1 | 129 | 31 | 51 | 21 | 50 | 21 |
P6IR3 | 171 | 42 | 63 | 27 | 65 | 28 |
Mean | 166 | 46 | 75 | 34 | 69 | 31 |
Figure 11 (a) shows the results as a function of the model and the anomaly magnitude for scenarios 1 and 2. As expected, the larger anomalies were more easily detected in all cases. As for the input variables, Non-Causal model performed better on average, especially for small anomalies and as compared to the causal model. Again, the inclusion of lagged variables generated a minor effect, in this case towards slightly poorer performance.
Figure 11: index for scenarios 1 and 2. |
The results for Scenario 3 are more interesting to analyse, since they correspond to a realistic anomaly affecting the overall dam behaviour. Since the effect of this anomaly is different on each output, the results are presented in terms of the true detection time per device, i. e., the elapsed time until the first record identified as a deviation towards downstream. Figure 12 shows the results.
Figure 12: Detection time (days) per target and model for scenario 3. |
A perfect model would feature null detection time for the affected devices (P1DR1, P1DR4, P5DR1 and P5DR3), and 365 days for the remaining (P2IR1, P2IR4, P6IR1 and P6IR3). Both the Non-Causal and the ARX models showed almost perfect performance. As regards the causal model, the anomaly in the most affected devices (P5DR1 and P5DR3) is detected almost instantly, but is less effective for P1DR1 and P1DR4, whose deviation from the reference behaviour is low (see Table 5). The detection time for P1DR1 and P1DR4 is around two months, with high variation up to 300 days.
A complete assessment of the model performance requires analysing the amount of false positives. They correspond to any value outside the prediction interval for the targets in the right half of the dam body, and to anomalies correspondent to deviations towards upstream for those in the left region. Figure 13 shows these results.
Figure 13: False positives per target and model for scenario 3. |
It can be observed that the causal model is clearly more effective in this regard: both the Non-Causal and the ARX models classify around half of the observations for the unaffected devices as abnormal (there are 52 observations in the period of analysis). This result is due to the nature of the inputs for each model. For example, the Non-Causal model generates a prediction for P6IR1 based on the value of P5DR1 (among other inputs, but this is particularly important for being symmetrical within the dam body). In scenario 3, P5DR1 deviates towards downstream with respect to the reference (training) period. Since that input is anomalous, the resulting prediction is also wrong. In this case, the model interprets that the value of P6IR1 falls in the upstream side of the prediction interval.
This issue is highly relevant, since the final aim of the system is not only to detect a potentially anomalous behaviour, but also to support the correct identification of the cause, and then the decision making. In fact, similar results would have been obtained had the devices been analysed jointly in scenarios 1 and 2: a real deviation towards downstream in some device is (in general) correctly identified by the non-causal models, but that same value would generate an incorrect prediction for other devices, of opposite sign.
Causal models do not give these spurious results, since they predict the dam response only based on the external variables, at the cost of a generally higher detection time.
A straightforward option to avoid this behaviour is to discard non-causal models. However, their good performance for detecting true anomalies suggests that they can be useful overall.
As an alternative, the outputs whose value is identified as anomalous by the Non-Causal model can be removed from the input set. This requires re-training, but it can still offer accurate results, thanks to the flexibility of BRTs.
A new set of 240 cases was run for scenario 3 and the Non-Causal model. The results shown in Figure 14 confirm that the removal of abnormal variables is effective against false positives, while maintaining the ability for anomaly detection. The model performance is only poorer for P2IR1 (unaffected by the anomaly in scenario 3): the detection time is lower than 365 days, which indicates the existence of false positives. Nonetheless, the average detection time is still 270 days, and the total amount of false positives is lower than 10 %
Figure 14: Detection time and false positives per target for scenario 3 and the Non-Causal model, once the anomalous variables are removed from the input set. |
This approach was implemented in a new interactive tool, which was developed to present the results for all devices involved. It is based on the shiny library [78], and includes two plots for each model (Figure 15).
Figure 15: Interface of the dam monitoring data analysis tool for a case from scenario 3. The imposed displacement in the left abutment is correctly identified. |
First, each device is plotted on its actual location within the dam body, with a symbol that is a function of the deviation between prediction and observation for the date under consideration. Then, the evolution of observations and predictions for the most recent period is plotted for two devices selected by the user. Figure 15 shows the application interface for one of the anomalies from scenario 3. It can be observed that the anomaly is correctly localised.
With this tool, the user jointly receives the overall information on all devices under consideration, and a more detailed plot of the selected output, where the value of the deviation, as well as the trend, can be observed. In this version, devices whose residuals are lower than two times the standard deviation are plotted in green; those between two and three times are depicted in yellow, and those above three times are shown in red. The shapes correspond to the direction of the deviation (upstream or downstream), as interpreted by each model. This criterion can be tailored to the user preferences.
A methodology for early detection of anomalies in dam behaviour was presented, which includes a prediction model based on BRT, a criterion for detecting anomalies based on the residual density function, and a procedure for realistic estimation of the prediction interval. Also, extraordinary loads are identified by jointly considering the two most important external loads (hydrostatic load and temperature).
Causal models (which only consider external variables) and non-causal (including both internal and lagged variables as predictors) were compared in terms of detection time for three different anomaly scenarios. The results showed that non-causal models are more effective for the detection of anomalies, both affecting to isolated devices (Scenarios 1 and 2), and those resulting from an overall malfunction of the dam (Scenario 3).
In the case study considered, the inclusion of lagged variables had minor effect both in the model accuracy and the detection time. This suggests that the Non-Causal model (without lagged variables) might be a better choice due to its higher simplicity.
Causal models were more robust as regards the precision (when accounting for false positives). In abnormal periods, the prediction of non-causal models for unaffected devices is often wrong because it is partially based on anomalous data (that from the devices actually affected by the anomaly). This type of behaviour is a consequence of the nature of the model itself, and is the price to pay in exchange for a greater ability for early detection of anomalies.
However, an updated version of the Non-Causal model, where the anomalous variables are removed from the input set, avoided the above-mentioned issue, and showed to be as effective for anomaly detection as the original Non-Causal, and even more robust against false positives than the causal model. Hence, this approach is the best option to provide useful information to the dam safety managers. To that end, it was implemented in an interactive on-line tool, which shows the devices whose behaviour is interpreted as potentially abnormal by the predictive model, together with the plot of the evolution of predictions and observations for all relevant outputs.
This tool can be used as a support for decision making, since it facilitates the identification of a potential deviation from normal behaviour. Thus, it can be used as an indicator to generate a warning which might lead to intensify the dam safety monitoring activity.
A comprehensive literature review on data-based models for dam behaviour estimation was performed. A selection of articles was analysed, paying attention to the essential aspects of model building and assessment. The weaknesses of the published works were highlighted, and conclusions were drawn on criteria for building data-based dam behaviour models.
The possibilities of 5 state-of-the-art machine learning algorithms for dam behaviour modelling were analysed. Two of them had seldom been applied in this field before (neural networks and support vector machines), while the rest (random forests, boosted regression trees and multi-adaptive regression splines) had, to the best of my knowledge, never been used in dam safety to date. Their prediction accuracy was computed for 14 output variables of three different types (radial and tangential displacements, and leakage), correspondent to a real 100-m high arch dam. Issues related to the training algorithms and criteria to determine the value of the meta-parameters were addressed.
As a result of the previous analysis, BRT models were selected for further assessment. Based on the same case study, the effectiveness of the available tools (partial dependence plots and variable importance measure) for BRT model interpretation was verified. The results of the variable importance measure were presented in an innovative way: as wordclouds. This kind of plots are well known and often employed in other fields, and showed to be useful for agile interpretation of the results.
The effect of the inclusion of non-causal inputs was assessed, leading to the non-causal models. They showed to be even more accurate, though new issues arose regarding their implementation in dam safety assessment. Criteria for overcoming them were proposed, as well as for the practical implementation of data-based predictive models for the early detection of anomalies:
These criteria were applied to develop an interactive tool for dam monitoring data analysis and anomaly detection that allows on-line control of dam performance at a glance. Both the code of the application and images of the user interface are included in Section 9.3.
A second interactive tool was also developed, which makes use of the “shiny” [78] and “ggplot2” [79] libraries within RStudio [80]. It has the following functionalities:
The output of the application is a plot with predictions and observations, together with the residuals and the MAE for the training and prediction sets.
The main conclusions of the research can be summarised as follows:
Future research lines can be drawn from the results of the work, as well as from identified open issues:
[1] Duffaut, Pierre. (2013) "The traps behind the failure of Malpasset arch dam, France, in 1959", Volume 5. Elsevier. Journal of Rock Mechanics and Geotechnical Engineering 5 335–341
[2] International Commission on Large Dams. (2000) "Automated dam monitoring systems. Guidelines and case histories". ICOLD B-118
[3] International Commission on Large Dams. (2012) "Dam surveillance guide". ICOLD B-158
[4] Lombardi, G. (2004) "Advanced data interpretation for diagnosis of concrete dams". CISM
[5] Swiss Committee on Dams. (2003) "Methods of analysis for the prediction and the verification of dam behaviour". ICOLD
[6] Chouinard, Luc and Roy, Vincent. (2006) "Performance of Statistical Models for dam Monitoring Data" 14–16
[7] Simon, A. and Royer, M. and Mauris, F. and Fabre, J.P. (2013) "Analysis and Interpretation of Dam Measurements using Artificial Neural Networks"
[8] Lombardi, G. and Amberg, F. and Darbre, G.R. (2008) "Algorithm for he prediction of functional delays in the behaviour of concrete dams". Hydropower and Dams 3 111-116
[9] Papadrakakis, Manolis and Papadopoulos, Vissarion and Lagaros, Nikos D and Oliver, Javier and Huespe, Alfredo E and Sánchez, Pablo. (2008) "Vulnerability analysis of large concrete dams using the continuum strong discontinuity approach and neural networks", Volume 30. Elsevier. Structural Safety 3 217–235
[10] Yu, Hong and Wu, ZhongRu and Bao, TengFei and Zhang, Lan. (2010) "Multivariate analysis in dam monitoring data with PCA", Volume 53. Science China Technological Sciences 4 1088–1097
[11] Willm, G. and Beaujoint, N. (1967) "Les méthodes de surveillance des barrages au service de la production hydraulique d'Electricité de France-Problemes ancients et solutions nouvelles" 529-550
[12] Tatin, M and Briffaut, M and Dufour, F and Simon, A and Fabre, J-P. (2015) "Thermal displacements of concrete dams: Accounting for water temperature in statistical models", Volume 91. Elsevier. Engineering Structures 26–39
[13] Amberg, F. (2009) "Interpretative models for concrete dam displacements"
[14] Santillán, D and Salete, E and Vicente, DJ and Toledo, MÁ. (2014) "Treatment of Solar Radiation by Spatial and Temporal Discretization for Modeling the Thermal Response of Arch Dams", Volume 140. American Society of Civil Engineers. Journal of Engineering Mechanics 11
[15] Salazar, Fernando and Morán, Rafael and Toledo, Miguel Á and Oñate, Eugenio. (2015) "Data-Based Models for the Prediction of Dam Behaviour: A Review and Some Methodological Considerations". Springer. Archives of Computational Methods in Engineering 1–21
[16] Rankovi, Vesna and Grujovi, Nenad and Divac, Dejan and Milivojevi, Nikola. (2014) "Development of support vector regression identification model for prediction of dam structural behaviour", Volume 48. Elsevier. Structural Safety 33–39
[17] J. Mata. (2011) "Interpretation of concrete dam behaviour with artificial neural network and multiple linear regression models", Volume 3. Engineering Structures 3 03 - 910
[18] Demirkaya, Seyfullah. (2010) "Deformation analysis of an arch dam using ANFIS" 21–31
[19] Auret, Lidia and Aldrich, Chris. (2011) "Empirical comparison of tree ensemble variable importance measures", Volume 105. Elsevier. Chemometrics and Intelligent Laboratory Systems 2 157–170
[20] Rankovi, Vesna and Grujovi, Nenad and Divac, Dejan and Milivojevi, Nikola and Novakovi, Aleksandar. (2012) "Modelling of dam behaviour based on neuro-fuzzy identification", Volume 35. Elsevier. Engineering Structures 107–113
[21] Salazar, F and Toledo, MA and Oñate, E and Morán, R. (2015) "An empirical comparison of machine learning techniques for dam behaviour modelling", Volume 56. Elsevier. Structural Safety 9–17
[22] Li, Fuqiang and Wang, Zhenyu and Liu, Guohua. (2013) "Towards an Error Correction Model for dam monitoring data analysis based on Cointegration Theory", Volume 43. Structural Safety 12–20
[23] Breiman, Leo and others. (2001) "Statistical modeling: The two cultures (with comments and a rejoinder by the author)", Volume 16. Institute of Mathematical Statistics. Statistical Science 3 199–231
[24] Bonelli, Stéphane and Félix, H. "Interpretation of measurement results, delayed response analysis of temperature effect"
[25] Tatin, M. and Briffaut, M. and Dufour, F. and Simon, A. and Fabre, J.P. (2013) "Thermal Displacements of Concrete Dams: Finite Element and Statistical Modelling"
[26] Penot, Isabelle and Daumas, Bruno and Fabre, J.P. (2005) "Monitoring behaviour". Water Power and Dam Construction
[27] Carrere, A. and Noret-Duchene, C. (2001) "Interpretation of an arch dam behaviour using enhanced statistical models"
[28] Stojanovic, B. and Milivojevic, M. and Ivanovic, M. and Milivojevic, N. and Divac, D. (2013) "Adaptive system for dam behavior modeling based on linear regression and genetic algorithms", Volume 65. Advances in Engineering Software 182–190
[29] Bonelli, Stéphane and Radzicki, Krzysztof. (2008) "Impulse response function analysis of pore pressure in earthdams", Volume 12. European Journal of Environmental and Civil Engineering 3 243–262
[30] Guedes, Q.M. and Coelho, P.S.M. (1985) "Statistical behaviour model of dams" Q56-R16, 319-334
[31] Sánchez Caro, Francisco Javier. (2007) "Dam safety: contributions to the deformation analysis and monitoring as an element of prevention of pathologies of geotechnical origin"
[32] Popovici, A. and Ilinca, C. and Ayvaz, T. (2013) "The performance of the neural networks to model some response parameters of a buttress dam to environment actions"
[33] Crépon, O. and Lino, M. (1999) "An analytical approach to monitoring". Water Power and Dam Construction
[34] Bonelli, Stéphane and Royet, P. (2001) "Delayed response analysis of dam monitoring data"
[35] Piroddi, Luigi and Spinelli, William. (2003) "Long-range nonlinear prediction: a case study", Volume 4. IEEE 3984–3989
[36] Mata, J. and Tavares de Castro, A. and Sá da Costa, J. "Constructing statistical models for arch dam deformation", Volume 21. Structural Control Health Monitoring 3
[37] Chouinard, L. and Bennett, D. and Feknous, N. (1995) "Statistical Analysis of Monitoring Data for Concrete Arch Dams", Volume 9. Journal of Performance of Constructed Facilities 4 286–301
[38] Santillán, D. and Fraile-Ardanuy, J. and Toledo, M.Á. (2014) "Seepage prediction in arch dams by means of artificial neural networks", Volume V. Water Technology and Science 3
[39] Tayfur, Gokmen and Swiatek, Dorota and Wita, Andrew and Singh, Vijay P. (2005) "Case study: Finite element method and artificial neural network models for flow through Jeziorsko earthfill dam in Poland", Volume 131. Journal of Hydraulic Engineering 6 431–440
[40] Hastie, Trevor and Tibshirani, Robert and Firedman, Jerome. (2009) "The Elements of Statistical Learning - Data Mining, Inference, and Prediction". Springer, 2 Edition
[41] Xu, HongZhong and Li, XueHong. (2012) "Inferring rules for adverse load combinations to crack in concrete dam from monitoring data using adaptive neuro-fuzzy inference system", Volume 55. Science China Technological Sciences 1 136–141
[42] Cheng, Lin and Zheng, Dongjian. (2013) "Two online dam safety monitoring models based on the process of extracting environmental effect", Volume 57. Elsevier. Advances in Engineering Software 48–56
[43] Saouma, VICTOR and Hansen, ERIC and Rajagopalan, BALAJI. (2001) "Statistical and 3D Nonlinear Finite Element Analysis of Schlegeis Dam" 17–19
[44] Demirkaya, S. and Balcilar, M. (2012) "The contribution of Soft Computing Techniques for the interpretation of Dam Deformation"
[45] Rankovi, Vesna and Novakovi, Aleksandar and Grujovi, Nenad and Divac, Dejan and Milivojevi, Nikola. (2014) "Predicting piezometric water level in dams via artificial neural networks", Volume 24. Springer. Neural Computing and Applications 5 1115–1121
[46] Kao, Ching-Yun and Loh, Chin-Hsiung. (2013) "Monitoring of long-term static deformation data of Fei-Tsui arch dam using artificial neural network-based approaches", Volume 20. Wiley Online Library. Structural Control and Health Monitoring 3 282–303
[47] Loh, Chin-Hsiung and Chen, Chia-Hui and Hsu, Ting-Yu. (2011) "Application of advanced statistical methods for extracting long-term trends in static monitoring data from an arch dam", Volume 10. SAGE Publications. Structural Health Monitoring 6 587–601
[48] Panizzo, A. and Petaccia, A. (2009) "Analysis of monitoring data for the safety control of dams using neural networks". Springer 344–347
[49] Santillán, D and Fraile-Ardanuy, Jesús and Toledo, MA. (2013) "Dam seepage analysis based on artificial neural networks: The hysteresis phenomenon". IEEE 1–8
[50] Arlot, Sylvain and Celisse, Alain and others. (2010) "A survey of cross-validation procedures for model selection", Volume 4. The author, under a Creative Commons Attribution License. Statistics surveys 40–79
[51] De Sortis, A and Paoliani, P. (2007) "Statistical analysis and structural identification in concrete dam monitoring", Volume 29. Elsevier. Engineering Structures 1 110–120
[52] Herrera, Manuel and Torgo, Luís and Izquierdo, Joaquín and Pérez-García, Rafael. (2010) "Predictive models for forecasting hourly urban water demand", Volume 387. Elsevier. Journal of Hydrology 1 141–150
[53] Seifard, L.A. and Szpilman, A. and Piasentin, C. (1985) "Itaipu structures. Evaluation of their performance" 287-317
[54] Weigend, Andreas S and Huberman, Bernardo A and Rumelhart, David E. (1992) "Predicting sunspots and exchange rates with connectionist networks", Volume 12. Addison-Wesley, Redwood, CA 395–432
[55] Friedman, Jerome H and Meulman, Jacqueline J. (2003) "Multiple additive regression trees with application in epidemiology", Volume 22. Wiley Online Library. Statistics in medicine 9 1365–1381
[56] Breiman, Leo. (1984) "Classification and regression trees". Chapman & Hall/CRC
[57] Friedman, J.H. (2001) "Greedy function approximation: a gradient boosting machine". JSTOR. Annals of Statistics 1189 - 1232
[58] Ridgeway, Greg. (2007) "Generalized Boosted Models: A guide to the gbm package"
[59] Leathwick, JR and Elith, J and Francis, MP and Hastie, T and Taylor, P. (2006) "Variation in demersal fish species richness in the oceans surrounding New Zealand: an analysis using boosted regression trees", Volume 321. Marine Ecology Progress Series 267–281
[60] Elith, Jane and Leathwick, John R and Hastie, Trevor. (2008) "A working guide to boosted regression trees", Volume 77. Wiley Online Library. Journal of Animal Ecology 4 802–813
[61] Schapire, Robert E. (2003) "The boosting approach to machine learning: An overview". Springer 149–171
[62] Alexandre Michelis. (2012) "Traditional versus non-traditional boosting algorithms"
[63] G. Ridgeway with contributions from others. (2013) "gbm: Generalized Boosted Regression Models"
[64] R Core Team. (2013) "R: A Language and Environment for Statistical Computing". R Foundation for Statistical Computing
[65] Kaser, Owen and Lemire, Daniel. (2007) "Tag-cloud drawing: Algorithms for cloud visualization". arXiv preprint cs/0703109
[66] Ian Fellows. (2014) "wordcloud: Word Clouds"
[67] Hodge, Victoria J and Austin, Jim. (2004) "A survey of outlier detection methodologies", Volume 22. Springer. Artificial Intelligence Review 2 85–126
[68] Jung, In-Soo and Berges, Mario and Garrett, James H and Poczos, Barnabas. (2015) "Exploration and evaluation of AR, MPCA and KL anomaly detection techniques to embankment dam piezometer data", Volume 29. Elsevier. Advanced Engineering Informatics 4 902–917
[69] Gamse, Sonja and Oberguggenberger, Michael. (2016) "Assessment of long-term coordinate time series using hydrostatic-season-time model for rock-fill embankment dam". Wiley Online Library. Structural Control and Health Monitoring
[70] Mata, J and Leito, N Schclar and de Castro, A Tavares and da Costa, J Sá. (2014) "Construction of decision rules for early detection of a developing concrete arch dam failure scenario. A discriminant approach", Volume 142. Elsevier. Computers & Structures 45–53
[71] Salazar, F and González, JM and Toledo, MA and Oñate, E. (2016) "A methodology for dam safety evaluation and anomaly detection based on boosted regression trees"
[72] Salazar, Fernando and Toledo, Miguel Á and Oñate, Eugenio and Suárez, Benjamín. (2016) "Interpretation of dam deformation and leakage with boosted regression trees", Volume 119. Elsevier. Engineering Structures 230–251
[73] Palumbo, P. and Piroddi, L. and Lancini, S. and Lozza, F. (2001) "NARX modeling of radial crest displacements of the Schlegeis Arch Dam"
[74] Bofang, Z. (1997) "Prediction of water temperature in deep reservoirs", Volume 8. REED BUSINESS PUBLISHING. Dam Engineering 13–26
[75] Pérez, JL and Martínez, E . (1995) "La acción térmica del medio ambiente como solicitación de diseño en proyectos de presas españolas", Volume 3349. Rev Obras Públicas 79–90
[76] Ebert, Tobias and Belz, Julian and Nelles, Oliver. (2014) "Interpolation and extrapolation: Comparison of definitions and survey of algorithms for convex and concave hulls". IEEE 310–314
[77] Verleysen, Michel and others. (2003) "Learning high-dimensional data", Volume 186. IOS PRESS. Nato Science Series Sub Series III Computer And Systems Sciences 141–162
[78] Winston Chang and Joe Cheng and JJ Allaire and Yihui Xie and Jonathan McPherson. (2016) "shiny: Web Application Framework for R"
[79] Hadley Wickham. (2009) "ggplot2: elegant graphics for data analysis". Springer New York
[80] RStudio Team. (2015) "RStudio: Integrated Development Environment for R". RStudio, Inc.
[81] Dan Vanderkam and JJ Allaire and Jonathan Owen and Daniel Gromer and Petr Shevtsov and Benoit Thieurmel. (2016) "dygraphs: Interface to 'Dygraphs' Interactive Time Series Charting Library"
Title: Data-based models for the prediction of dam behaviour. A review and some methodological considerations First Author: Fernando Salazar González. CIMNE - International Center for Numerical Methods in Engineering Second Author: Rafael Morán Moya. Technical University of Madrid (UPM). Department of Civil Engineering: Hydraulics, Energy and Environment. Third Author: Miguel Á. Toledo Municio. Technical University of Madrid (UPM). Department of Civil Engineering: Hydraulics, Energy and Environment. Fourth Author: Eugenio Oñate Ibáñez de Navarra. CIMNE - International Center for Numerical Methods in Engineering Journal: Archives of Computational Methods in Engineering D.O.I. 10.1007/s11831-015-9157-9 Impact Factor 4.214
Title: Discussion on “Thermal displacements of concrete dams: Accounting for water temperature in statistical models” First Author: Fernando Salazar González. CIMNE – International Center for Numerical Methods in Engineering
Second Author: Miguel Á. Toledo Municio. Technical University of Madrid (UPM). Department of Civil Engineering: Hydraulics, Energy and Environment. Journal: Engineering Structures D.O.I. 10.1016/j.engstruct.2015.08.001. Impact Factor 1.893
Title: An empirical comparison of machine learning techniques for dam behaviour modelling
First Author: Fernando Salazar González. CIMNE – International Center for Numerical Methods in Engineering Second Author: Miguel Á. Toledo Municio. Technical University of Madrid (UPM). Department of Civil Engineering: Hydraulics, Energy and Environment. Third Author: Eugenio Oñate Ibáñez de Navarra. CIMNE - International Center for Numerical Methods in Engineering Fourth Author: Rafael Morán Moya. Technical University of Madrid (UPM). Department of Civil Engineering: Hydraulics, Energy and Environment. Journal: Structural Safety D.O.I. 10.1016/j.strusafe.2015.05.001 Impact Factor 2.086
Title: Interpretation of dam deformation and leakage with boosted regression trees First Author: Fernando Salazar González. CIMNE - International Center for Numerical Methods in Engineering Second Author: Miguel Á. Toledo Municio. Technical University of Madrid (UPM). Department of Civil Engineering: Hydraulics, Energy and Environment. Third Author: Eugenio Oñate Ibáñez de Navarra. CIMNE - International Center for Numerical Methods in Engineering Fourth Author: Benjamín Suárez Arroyo. CIMNE - International Center for Numerical Methods in Engineering Journal: Engineering Structures D.O.I. 10.1016/j.engstruct.2016.04.012 Impact Factor 1.893
Title: Posibilidades de la inteligencia artificial en el análisis de auscultación de presas First Author: Fernando Salazar González. CIMNE - International Center for Numerical Methods in Engineering Second Author: Miguel Á. Toledo Municio. Technical University of Madrid (UPM). Department of Civil Engineering: Hydraulics, Energy and Environment. Third Author: Eugenio Oñate Ibáñez de Navarra. CIMNE - International Center for Numerical Methods in Engineering Conference: III Jornadas de Ingeniería del Agua. La protección contra los riesgos hídricos (JIA 2013) Date-Location: October 2013 - Valencia (Spain) ISBN 978-84-267-2070-2
Title: Avances en el tratamiento y análisis de datos de auscultación de presas First Author: Fernando Salazar González. CIMNE - International Center for Numerical Methods in Engineering Second Author: León Morera. Technical University of Madrid (UPM). Department of Civil Engineering: Hydraulics, Energy and Environment. Third Author: Miguel Á. Toledo Municio. Technical University of Madrid (UPM). Department of Civil Engineering: Hydraulics, Energy and Environment. Fourth Author: Rafael Morán. Technical University of Madrid (UPM). Department of Civil Engineering: Hydraulics, Energy and Environment. Fifth Author: Eugenio Oñate Ibáñez de Navarra. CIMNE – International Center for Numerical Methods in Engineering Conference: X Jornadas Españolas de Presas Date-Location: February 2015 - Sevilla (Spain)
Title: Nuevas técnicas para el análisis de datos de auscultación de presas y la definición de indicadores cuantitativos de su comportamiento First Author: Fernando Salazar González. CIMNE - International Center for Numerical Methods in Engineering Second Author: Miguel Á. Toledo Municio. Technical University of Madrid (UPM). Department of Civil Engineering: Hydraulics, Energy and Environment. Third Author: Eugenio Oñate Ibáñez de Navarra. CIMNE - International Center for Numerical Methods in Engineering Fourth Author: León Morera. Technical University of Madrid (UPM). Department of Civil Engineering: Hydraulics, Energy and Environment. Fifth Author: Rafael Morán. Technical University of Madrid (UPM). Department of Civil Engineering: Hydraulics, Energy and Environment. Conference: III Jornadas de Ingeniería del Agua. La precipitación y los procesos erosivos (JIA 2015) Date-Location: October 2013 - Córdoba (Spain)
Title: A methodology for dam safety evaluation and anomaly detection based on boosted regression trees First Author: Fernando Salazar González. CIMNE - International Center for Numerical Methods in Engineering Second Author: José M. González. CIMNE - International Center for Numerical Methods in Engineering Third Author: Miguel Á. Toledo Municio. Technical University of Madrid (UPM). Department of Civil Engineering: Hydraulics, Energy and Environment. Fourth Author: Eugenio Oñate Ibáñez de Navarra. CIMNE - International Center for Numerical Methods in Engineering Conference: 8 European Workshop on Structural Health Monitoring Date-Location: July 2016 - Bilbao (Spain)
In this appendix, the code for the interactive tools is included. They all make use of the Shiny library and are formed by three files:
All files should be placed in the same directory, together with a data folder where the input data should be stored in an appropriate format to be read from global.R
Figure 16: Dam Monitoring App. Welcome tab. File upload. |
Figure 17: Tab for data exploration. User interface for scatterplot. |
Figure 18: Tab for data exploration. User interface for time series plot. |
Figure 19: Tab for model fitting. User interface. |
Figure 20: Tab for model interpretation. User interface. |
./BRTLoadAnon/global.R
./BRTLoadAnon/ui.R
./BRTLoadAnon/server.R
This application requires an image of the dam, also stored in the “data” folder.
Figure 21: Anomaly detection application. User interface |
./AnomApp/global.R
./AnomApp/ui.R
./AnomApp/server.R
Published on 12/02/18
Submitted on 12/02/18
Licence: CC BY-NC-SA license
Are you one of the authors of this document?