{"id":32,"date":"2016-03-01T16:02:16","date_gmt":"2016-03-01T16:02:16","guid":{"rendered":"http:\/\/wp.lancs.ac.uk\/basin-network\/?page_id=32"},"modified":"2016-04-13T14:43:23","modified_gmt":"2016-04-13T14:43:23","slug":"modelling","status":"publish","type":"page","link":"http:\/\/wp.lancs.ac.uk\/basin-network\/modelling\/","title":{"rendered":"SMART Models"},"content":{"rendered":"

<\/p>\n

SMART Models<\/p>\n


\n\t\t\t\t\t\t\t\t <\/p>\n

<\/a>
\n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/p>\n

SMART Models<\/p>\n


\n\t\t\t\t\t\t\t\t <\/p>\n

<\/a>
\n\t\t\t\t\t\t\t\t\t\t\t\t\t<\/p>\n

SMART Models<\/p>\n


\n\t\t\t\t\t\t\t\t <\/p>\n

<\/a><\/p>\n

\/* INLINE WIDGET CSS *\/
\n\t\t\t\t#layers-widget-slide-27-698 { background-color: #444; background-repeat: no-repeat;background-position: center;background-image: url(‘http:\/\/wp.lancs.ac.uk\/basin-network\/files\/2016\/03\/danum_cropped-e1457087686292.jpg’);}
\n #layers-widget-slide-27-758 { background-color: #444; background-repeat: no-repeat;background-position: center;background-image: url(‘http:\/\/wp.lancs.ac.uk\/basin-network\/files\/2016\/03\/towy_cropped-e1457087387612.jpg’);}
\n #layers-widget-slide-27-453 { background-color: #444; background-repeat: no-repeat;background-position: center;background-image: url(‘http:\/\/wp.lancs.ac.uk\/basin-network\/files\/2016\/03\/DSCF4953-e1456917168904.jpg’);}<\/p>\n

SMART Models for Hydroclimatology, Hydrology and Water Quality
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\tThe time-series derived from\u00a0SMART sensors can be\u00a0rich in\u00a0information, and can help to develop understanding of watershed functioning. To achieve this\u00a0we need to\u00a0extract the dominant dynamics from these time-series\u00a0using robust model identification tools that are subject to explicit uncertainty analysis.<\/p>\n

\/* INLINE WIDGET CSS *\/
\n\t\t\t\t#layers-widget-column-71 { background-repeat: no-repeat;background-position: center;}
\n #layers-widget-column-71 .section-title h3.heading,#layers-widget-column-71.section-title div.excerpt{ color: #000000;}<\/p>\n

RIVC Algorithm
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\tWe have published example applications\u00a0using\u00a0SMART models in hydrology and water chemistry using the RIVC algorithm (or \u2018Refined Instrumental Variable Continuous-time Box-Jenkins identification algorithm\u2019) of Young (2008).<\/a>\u00a0The algorithm is able to extract the dominant dynamics contained within the high-frequency\u00a0hydrological and water quality time-series that we derived using SMART sensors<\/a>. This algorithm is capable of identifying data-based models that incorporate dynamic delays and storage. RIVC\u00a0uses an iterative instrumental variable (IV) method for estimating general transfer functions\u00a0capturing dynamic relationships between input (e.g., rainfall) and output (e.g., DOC concentration or load) variables using rational polynomial expressions in operator s (in continuous time), which directly translate to differential equations driven by the input variable. Full details are given in Jones et al. 2014 (ES&T).<\/a>\u00a0<\/p>\n

Rationale for use of RIVC algorithm for model identification (adapted from Jones et al. 2014, ES&T<\/a>\u00a0SI):A\/ In one numerical experiment RIVC can identify the structure and parameters of a range of purely static models and models that include dynamic components,B\/ Dynamic Response Characteristics (DRCs) that have a physical interpretation can be derived from the identified model parameters,C\/ The covariance matrix for each identified model can be used directly to estimate uncertainty in the model parameter estimates,D\/ An optimal model structure can be selected using a combination of this uncertainty information, heuristic measures of the parsimony (to avoid over-parameterisation) and a feasible physical interpretation. This is the Data-Based Mechanistic (DBM) approach to modelling.<\/p>\n

\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/p>\n

Conceptual systems diagram showing an identified two pathway response in the modelling of rainfall to DOC load.<\/p>\n

E\/ Model estimation involves iterative pre-filtering of the signals to remove the high frequency noise inherent within environmental data that affects identification of accurate parameter values. F\/ The routine can estimate transfer functions in continuous-time (CT-TF) that maybe more difficult to estimate compared to discrete-time\u00a0transfer function\u00a0models but are considered more accurate for systems with responses almost as fast as the monitoring time-step, andG\/ RIVC is computationally efficient, with its results permitting rapid Monte Carlo uncertainty analysis of the parameter ranges. The Instrumental Variable (IV) approach guarantees that the parameter estimates are asymptotically unbiased. <\/p>\n

Example RIVC application
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\tWe have used the RIVC algorithm to identify models\u00a0of\u00a0stream hydrogen ion load from a\u00a0rainfall input<\/a>, and the\u00a0first model of dissolved organic carbon (DOC) load from a rainfall input<\/a>\u00a0through a sequence of contiguous storms at four watersheds at Llyn Brianne. In both cases the optimal model identified\u00a0is a purely linear second-order continuous-time transfer-function model. These are derived directly from the high-frequency (i.e. 15-min) rainfall, DOC and\u00a0pH data collected using our SMART sensors. The dominant dynamics in these water quality variables\u00a0through storm periods could not have been identified using infrequently sampled data (even 7 hourly sampling would have been insufficient). <\/p>\n

\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/p>\n

Above: Observed DOC (red line) and simulated DOC (black line) in mg\/L through three contiguous storms. Simulated DOC was\u00a0modelled from rainfall (blue) in mm\/15-min using the RIVC algorithm for the four instrumented watersheds at Llyn Brianne. The model is a purely linear, second-order transfer function.\u00a0Source: Jones et al, 2014<\/a>.<\/p>\n

\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/p>\n

Above: The second-order transfer function model of DOC(LOAD)\u00a0can be decomposed by partial fraction expansion into two parallel, first-order transfer functions representing different response pathways.\u00a056% of DOC delivery followed a fast pathway at Nant-y-Craflwyn (LI3), and 44% of response followed a slow pathway. Source: presentation at SWIG<\/a> meeting, Glasgow, 2014.<\/p>\n

\/* INLINE WIDGET CSS *\/
\n\t\t\t\t#layers-widget-column-77 { background-repeat: no-repeat;background-position: center;}
\n #layers-widget-column-77 .section-title h3.heading,#layers-widget-column-77.section-title div.excerpt{ color: #000000;}
\n #layers-widget-column-77-637 { background-repeat: no-repeat;background-position: center;}
\n #layers-widget-column-77-637 h5.heading a,#layers-widget-column-77-637h5.heading,#layers-widget-column-77-637div.excerpt,#layers-widget-column-77-637div.excerpt p{ color: #000000;}
\n #layers-widget-column-77-733 { background-repeat: no-repeat;background-position: center;}
\n #layers-widget-column-77-733 h5.heading a,#layers-widget-column-77-733h5.heading,#layers-widget-column-77-733div.excerpt,#layers-widget-column-77-733div.excerpt p{ color: #000000;}
\n #layers-widget-column-77-416 { background-repeat: no-repeat;background-position: center;}
\n #layers-widget-column-77-416 h5.heading a,#layers-widget-column-77-416h5.heading,#layers-widget-column-77-416div.excerpt,#layers-widget-column-77-416div.excerpt p{ color: #000000;}
\n #layers-widget-column-77-961 { background-repeat: no-repeat;background-position: center;}
\n #layers-widget-column-77-961 h5.heading a,#layers-widget-column-77-961h5.heading,#layers-widget-column-77-961div.excerpt,#layers-widget-column-77-961div.excerpt p{ color: #000000;}
\n #layers-widget-column-77-861 { background-repeat: no-repeat;background-position: center;}
\n #layers-widget-column-77-861 h5.heading a,#layers-widget-column-77-861h5.heading,#layers-widget-column-77-861div.excerpt,#layers-widget-column-77-861div.excerpt p{ color: #000000;}
\n #layers-widget-column-77-188 { background-repeat: no-repeat;background-position: center;}
\n #layers-widget-column-77-188 h5.heading a,#layers-widget-column-77-188h5.heading,#layers-widget-column-77-188div.excerpt,#layers-widget-column-77-188div.excerpt p{ color: #000000;}<\/p>\n

Example Analysis Tool: CAPTAIN Toolbox for Matlab<\/p>\n

The model identification using the RIVC algorithm described above is implemented using the Computer-Aided Program for Time-Series Analysis and Identification of Noisy Systems (CAPTAIN) Toolbox<\/a> for Matlab, developed at Lancaster University.The CAPTAIN Toolbox<\/a> contains algorithms for aspects of non stationary time series analysis, system identification, signal processing and forecasting, using unobserved components models, time variable parameter models, state dependent parameter models and multiple input transfer function models. The routines are implemented following a Data-Based Mechanistic (DBM) approach to modelling dynamic systems, following these steps:1\/ Identify as many potential model structures as possible, minimising prior assumptions about processes \u2013 that are often unknown,2\/ Reject most model structures using objective statistical & mathematical criteria (incorporating \u2018Principles of Parsimony\u2019 via heuristic measures),3\/ Reject further models that have no physical (e.g., hydrological) interpretation \u2013 giving models for testing against independent observations (e.g., dynamics within component flow paths).<\/p>\n

\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/p>\n

Captain Toolbox for Matlab<\/a><\/p>\n

\/* INLINE WIDGET CSS *\/
\n\t\t\t\t#layers-widget-column-86 { background-repeat: no-repeat;background-position: center;}
\n #layers-widget-column-86 .section-title h3.heading,#layers-widget-column-86.section-title div.excerpt{ color: #000000;}
\n #layers-widget-column-86-73 { background-repeat: no-repeat;background-position: center;}
\n #layers-widget-column-86-73 h5.heading a,#layers-widget-column-86-73h5.heading,#layers-widget-column-86-73div.excerpt,#layers-widget-column-86-73div.excerpt p{ color: #000000;}
\n #layers-widget-column-86-548 { background-repeat: no-repeat;background-position: center;}<\/p>\n

The Generalized Likelihood Uncertainty Estimation (GLUE) methodology
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\tExplicit uncertainty analysis is a key part of SMART modelling. The widely used GLUE methodology provides a method for accounting for calibration and uncertainty estimation of distributed models through the use of generalised likelihood methods. The framework includes the possibility of different sets of parameter values being equally likely simulators of watersheds within a given model structure and errors in definition of boundary conditions and observed variables (Beven and Binley, 1992<\/a>).Example publications:Beven, K.J. and Binley, A.M 2014. GLUE: 20 years on. Hydrological Processes, 28: 5897-5918.<\/a>Beven, K.J and Binley, A.M. 1992. The future of distributed models: model calibration and uncertainty prediction. Hydrological Processes, 6: 279-298.<\/a>Software for GLUE is available here: http:\/\/www.uncertain-future.org.uk\/WinSoftware.htm#Generalised_Likelihood_Uncertainty_Estimation_(GLUE)<\/a><\/p>\n

\/* INLINE WIDGET CSS *\/
\n\t\t\t\t#layers-widget-column-88 { background-repeat: no-repeat;background-position: center;}
\n #layers-widget-column-88 .section-title h3.heading,#layers-widget-column-88.section-title div.excerpt{ color: #000000;}<\/p>\n

TOPMODEL
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\tTOPMODEL is a rainfall-runoff model (Beven and Kirkby, 1979<\/a>) that uses topographic information (specific watershed area and wetness index) relating to runoff generation. It is a physically based, distributed watershed model, and can be used with the GLUE methodology of uncertainty estimation, thereby making it a SMART model. Follow this link for implementation in R<\/a>.A new version of TOPMODEL that allows simulation of dynamically variable upslope contributing areas was presented by Beven and Freer (2001). <\/a>Example publications:Beven, K. and Freer, J. 2001. A dynamic TOPMODEL. Hydrological Processes, 15: 1992-2011.<\/a>Beven, K.J. and Kirkby, M.J. 1979. A physically based, variable contributing area model of basin hydrology. Hydrological Sciences Bulletin, 24: 43-69.<\/a><\/p>\n

\/* INLINE WIDGET CSS *\/
\n\t\t\t\t#layers-widget-column-79 { background-repeat: no-repeat;background-position: center;}
\n #layers-widget-column-79 .section-title h3.heading,#layers-widget-column-79.section-title div.excerpt{ color: #000000;}<\/p>\n

Some example Lancaster University publications using SMART models:
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\tKretzschmar, A., Tych, W., Chappell, N.A. and Beven, K.J. 2016. Reversing hydrology: quantifying the temporal aggregation effect of catchment rainfall estimation using sub-hourly data. Hydrology Research, 47: in press. DOI: 10.2166\/nh.2015.076 view online<\/a>.Jones, T.D., Chappell, N.A. and Tych, W. 2014. First dynamic model of dissolved organic carbon derived directly from high frequency observations through contiguous storms. Environmental Science & Technology, 48: 13289-13297. view online<\/a>.Jones, T.D. and Chappell, N.A. 2014. Streamflow and hydrogen ion interrelationships identified using Data-Based Mechanistic modelling of high frequency observations through contiguous storms. Hydrology Research, 45(6): 868-892. view online<\/a>.Kretzschmar, A., Tych, W., and Chappell, N.A. 2014. Reversing Hydrology: estimation of sub-hourly rainfall time-series from streamflow. Environmental Modelling and Software, 60: 290-301. doi: 10.1016\/j.envsoft.2014.06.017 view online<\/a>.Beven, K.J. and Binley, A.M. 2014. GLUE: 20 years on. Hydrological Processes, 28: 5897-5918. view online<\/a>.Leedal, D., Weerts, A.H., Smith, P.J. and Beven, K.J. 2013. Application of data-based mechanistic modelling for flood forecasting at multiple locations in the Eden catchment in the National Flood Forecasting System (England and Wales). Hydrology and Earth System Sciences, 17: 177-185. view online<\/a>.Chappell, N.A., Bonell, M., Barnes, C.J., and Tych, W. 2012. Tropical cyclone effects on rapid runoff responses: quantifying with new continuous-time transfer function models. In: Revisiting Experimental Catchment Studies in Forest Hydrology, Webb, A.A., Bonell, M. Bren, L. Lane, P.N.J., McGuire, D., Neary, D.G., Nettles, J., Scott, D.F., Stednik J. & Wang, Y. (eds) IAHS Publication 353, Wallingford, IAHS Press. 82-93. view online<\/a>.Chappell, N.A., and Tych, W. 2012. Identifying step changes in single streamflow and evaporation records due to forest cover change. Hydrological Processes, 26, 100-116 doi:10.1002\/hyp.8115. view online.<\/a>Ockenden M.C. and Chappell, N.A. 2011. Identification of the dominant runoff pathways from the data-based mechanistic modelling of nested catchments in temperate UK. Journal of Hydrology, 402, 71-79. view online.<\/a>Beven, K. and Freer, J. 2001. A dynamic TOPMODEL. Hydrological Processes, 15: 1992-2011. view online.<\/a>Taylor, C.J., Pedregal, D.J., Young, P.C. and Tych, W. 2007. Environmental time series analysis and forecasting with the Captain Toolbox. Environmental Modelling and Software, 22: 797-814. view online<\/a>.<\/p>\n

\/* INLINE WIDGET CSS *\/
\n\t\t\t\t#layers-widget-column-87 { background-repeat: no-repeat;background-position: center;}
\n #layers-widget-column-87 .section-title h3.heading,#layers-widget-column-87.section-title div.excerpt{ color: #000000;}<\/p>\n


\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/a><\/p>\n

Presentation made at the British Hydrological Society National Symposium (Sept 2014)\u00a0on \u2018Modelling water quality in UK upland streams using high-frequency observations’, including RIVC and CAPTAIN\u00a0click\u00a0here\u00a0to access<\/a>.<\/p>\n

We would like to hear of other smart models for inclusion here, please contact us<\/a> with any suggestions.<\/p>\n

\/* INLINE WIDGET CSS *\/
\n\t\t\t\t#layers-widget-column-78 { background-repeat: no-repeat;background-position: center;}
\n #layers-widget-column-78-861 { background-repeat: no-repeat;background-position: center;}
\n #layers-widget-column-78-861 h5.heading a,#layers-widget-column-78-861h5.heading,#layers-widget-column-78-861div.excerpt,#layers-widget-column-78-861div.excerpt p{ color: #000000;}
\n #layers-widget-column-78-273 { background-repeat: no-repeat;background-position: center;}
\n #layers-widget-column-78-273 h5.heading a,#layers-widget-column-78-273h5.heading,#layers-widget-column-78-273div.excerpt,#layers-widget-column-78-273div.excerpt p{ color: #000000;}<\/p>\n","protected":false},"excerpt":{"rendered":"

SMART Models SMART Models SMART Models \/* INLINE WIDGET CSS *\/ #layers-widget-slide-27-698 { background-color: #444; background-repeat: no-repeat;background-position: center;background-image: url(‘http:\/\/wp.lancs.ac.uk\/basin-network\/files\/2016\/03\/danum_cropped-e1457087686292.jpg’);} #layers-widget-slide-27-758 { background-color: #444; background-repeat: no-repeat;background-position: center;background-image: url(‘http:\/\/wp.lancs.ac.uk\/basin-network\/files\/2016\/03\/towy_cropped-e1457087387612.jpg’);} #layers-widget-slide-27-453 { background-color: #444; background-repeat: no-repeat;background-position: center;background-image: url(‘http:\/\/wp.lancs.ac.uk\/basin-network\/files\/2016\/03\/DSCF4953-e1456917168904.jpg’);} SMART Models for Hydroclimatology, Hydrology and Water Quality The time-series derived from\u00a0SMART sensors can be\u00a0rich in\u00a0information, and can help to […]<\/p>\n","protected":false},"author":479,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"builder.php","meta":{"footnotes":""},"class_list":["post-32","page","type-page","status-publish","hentry"],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/P9rr27-w","jetpack_likes_enabled":true,"jetpack-related-posts":[],"_links":{"self":[{"href":"http:\/\/wp.lancs.ac.uk\/basin-network\/wp-json\/wp\/v2\/pages\/32","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/wp.lancs.ac.uk\/basin-network\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/wp.lancs.ac.uk\/basin-network\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/wp.lancs.ac.uk\/basin-network\/wp-json\/wp\/v2\/users\/479"}],"replies":[{"embeddable":true,"href":"http:\/\/wp.lancs.ac.uk\/basin-network\/wp-json\/wp\/v2\/comments?post=32"}],"version-history":[{"count":328,"href":"http:\/\/wp.lancs.ac.uk\/basin-network\/wp-json\/wp\/v2\/pages\/32\/revisions"}],"predecessor-version":[{"id":2261,"href":"http:\/\/wp.lancs.ac.uk\/basin-network\/wp-json\/wp\/v2\/pages\/32\/revisions\/2261"}],"wp:attachment":[{"href":"http:\/\/wp.lancs.ac.uk\/basin-network\/wp-json\/wp\/v2\/media?parent=32"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}