Day 7 - Looking forward

We really enjoyed to work with this year students. We had an average synchronous participation of 25 but others were following asynchronously. The work is not finished until everybody who wants complete their exercise on a catchment. That will be the also the requirement to have recognized  the credits, besides the certificate of participation. The GEOframe crew will be happy to give you support for the next two months for complete the tasks required. New stuff is incoming in GEOframe that is a living a growing system. For that you will be alerted through the WinterSchool mailing list and the post in this blog. 

The first news is that we are:

• smoothing down the process to create HRUs with the help of  the friends of Hydrologis. A preview of the tool is working under the stand-alone Horton Machine, of which you can learn in this AboutHydrology blogpost. 

The second, this is an old new)  is that GEOframe is not limited to models based on partial differential equations. We have also WHETGEO 1D (and 2D incoming) which stands for Water, HEat and Transport in GEOframe:

• WHETGEO-1D. Developed by Niccolò Tubini for his P.h.D. e used it extensively in our class of hydrology. Therefore for the documentation in Italian, you can give a look to here.  We will provide soon documentation in English
• Lysimeter GEO.  Being developed by Concetta D'Amato for her Ph.D. , building on the shoulders of Niccolò and dr. Michele Bottazzi's  (GS) Prospero model.  On Lysimeter Pro you can find two webinar in English that can also partially serve to introduce WHETGEO-1D. They are at this link. 

The local (uniTrento) GEOframe crew repeated indefinitely within the screens. From left: Giuseppe , a little in front, Concetta , on the back Riccardo, then Martin and Niccolò.

Next year School will be in two session. The first one in December, possibly the 15-16-17 to make installations, extracting the geomorphology of the catchments, preparing and interpolating the datasets. This will be held in remote, as this year. The second one, between 10 and 14 of January, both included, for evaporation, transpiration, rainfall-runoff, exploring alternatives, finalizing student's work.  Use GEOframe and spread it around! If you would like to become a developer, please let's us know. We will provide the appropriate training. 

Previous Day

Index of The School

GWS2021 - Day 6 - Adding features to the rainfall-runoff modelling

GEOframe aims to simulate the whole hydrological cycle. About evaporation and transpiration was already talked about on Day 4 However, several other aspects can be accounted for in GEOframe for obtaining a realistic representation of the hydrological cycle. The scope of this day is to progressively introduce new aspects and features. 

• Simplified snow models
• VIMEO2021
• For more information about snow

• Adding features: Interception, Propagation, Muskingum, adding a reservoir
• VIMEO2021
• About the .sim files fields to run Net3
• VIMEO2021
• A video that helps to create ERM .sim files

References about GEOframe/NewAGE/ERM

Previous Day

Index of The School

Next Day

GWS2021 - Day 5 - Rainfall Runoff

Finally we go to the core of the School, the modelling of the Hydrological cycle. However treating the geomorphology and the inputs was hydrological modelling too. According to the rule garbage in - garbage out, whatever the core models are, their result cannot be any good if the inputs are wasted.

• What are models in Hydrology ? (Vimeo2021, YouTube2020)
• Hydrological Dynamical Systems (Vimeo 2021)
• The representation of Hydrological Dynamical System  (Vimeo 2021)
• Further readings: a blogpost from EGU

• A few reservoirs connected together (single catchment/node)
• Vimeo2021
• Quickly browsing the .sim file of these few reservoirs
• The Net3 Graph  
• Vimeo2021
• Another view of the Net3 graph (for sending in parallel various independent measurements (Vimeo2021)

• A little about models calibration
• Generalities 
• VIMEO 2021
• Illustrating the .sim file of a subset of the Embedded Reservoir models
• VIMEO 2021

General references to Rainfall-Runoff

Beven, K. (2012), Ranfall Runoff, the primer, Wiley-Blackwell

Rigon, R., Bancheri, M., Formetta, G., & de Lavenne, A. (2015). The geomorphological unit hydrograph from a historical-critical perspective. Earth Surface Processes and Landforms, http://doi.org/10.1002/esp.3855

References besides the one already used

For seeing how to represent lumped hydrological models (you can give a look to this paper here)

• Abera, W.W. (2016), Modelling water budget at a basin scale using JGrass-NewAge system. PhD thesis, University of Trento
• Bancheri, Marialaura (2017) A flexible approach to the estimation of water budgets and its connection to the travel time theory. PhD thesis, University of Trento.
• Bancheri, M., Serafin, F., & Rigon, R. (2019). The Representation of Hydrological Dynamical Systems Using Extended Petri Nets (EPN). Water Resources Research, 8(01), 159–27. http://doi.org/10.1029/2019WR025099
• Bancheri, M., Rigon, R., & Manfreda, S. (2020). The GEOframe-NewAge Modelling System Applied in a Data Scarce Environment. Water, 12(1), 86–24. http://doi.org/10.3390/w12010086
• Formetta, Giuseppe (2013) Hydrological modelling with components: the OMS3 NewAge-JGrass system. PhD thesis, University of Trento.
• Formetta, G., Antonello, A., Franceschi, S., David, O., & Rigon, R. (2014). Hydrological modelling with components: A GIS-based open source framework, 55(C), 190–200. http://doi.org/10.1016/j.envsoft.2014.01.019
• Patta, C, Costruzione di un modello idrologico di stima della disponibilità idrica in area pedemontana, Tesi di laurea (in Italian), Politecnico di Torino, 2018
• 
  
• For open questions about rainfall-runoff see also the Meledrio Posts.

Previous Class

School Index

Next Class

Day 3 - Exercises by Students

 Participants to the GEOframe Winter School are assumed to perform the analysis of a catchment. Here we are collecting their work  areas, and in the next weeks, hopefully, the result of their work. 

So, please do not hesitate to communicate to us which catchment you are thinking about. in FIFO order:

• Poschiavo valley - Roberta Perico 
• Sarca River - Sara Modanesi
• Blue Nile - Martin Jean-Luc Emile Morlot
• A little bibliography here: Abera, Wuletawu, Luca Brocca, and Riccardo Rigon. 2016. “Comparative Evaluation of Different Satellite Rainfall Estimation Products and Bias Correction in the Upper Blue Nile (UBN) Basin.” Atmospheric Research 178-179 (September): 471–83.
  
  Abera, Wuletawu, Giuseppe Formetta, Luca Brocca, and Riccardo Rigon. 2017. “Modeling the Water Budget of the Upper Blue Nile Basin Using the JGrass-NewAge Model System and Satellite Data.” Hydrology and Earth System Sciences 21 (6): 3145–65.
• Isarco/Eisack - Sofia Farina
• Rio Gadera  - Valentina Premier
• Vijosa - Marta Crivellaro
• Guadalfeo  - Pedro Torralbo Muñoz
• Flumendosa (see picture here) - Salvatore Urru e Alessandro Seoni
• Hydrological impacts of surface elevation and spatial resolution in statistical correction approaches: Case study of Flumendosa Basin, Italy, Perra, E., Viola, F., Deidda, R., Caracciolo, D., Paniconi, C., Langousis, A.., Journal of Hydrologic Engineering, 2020, 25(9), 05020032
• Investigating the effect of different downscaling techniques on the simulated hydrologic cycle of a Mediterranean catchment. Perra, E., Viola, F., Deidda, R., Caracciolo, D., Paniconi, C., Langousis, A.  EGU 2019, Vienna.
• Torrente Galitello (Basento) - Arianna Mazzarielli
• Brahmaputra - Walter Samuel 
• El Awali (Lebanon) - Nicola D'Alberton
• Nera (Italy) - Shima Azimi
• Mella (Italy) - Paolo Colosio
• Sesia (Italy) - Gaia Roati

• What else - Who Else ?

Previous day

Index of the School

Next day

Material for day second (January 8 2021) - Spatial interpolation and kriging

 

You can download the material for day second (January 8 2021) from this link.

 

 

After unzipping the folder you can see the typical structure of a OMS project. This is better explained in this previous blogpost. If you are reading this in advance, please take a little time to understand what OMS is and why it is like this.

 

During day 2 (8 Jan 2021) we will move to the "classical" interpolation problem: kriging algorithm will be explained and applied for interpolating measured rainfall and air temperature to each hillslope of the main river basin. All the material come with the .zip file, however, for your convenience, the slides are also available separately at the link below.

 

The theoretical part of the class in subdivided in three parts:

•    The spatial interpolation problem and the kriging algorithm: the concept 

•    The kriging algorithm: the equations 

Data Analysis with Pithon, Jupyter and Pandas

• The experimental and theoretical variogram

• The leave-one-out (LOO)

Exercises

In the OMS3 project distribute you will find:

•    data, a folder containing the model input

•    simulations, a folder containing the scripts for executing the models.

•    doc containing the pdf of the lectures

•    Jupyter containing a group of notebooks which illustrate the inputs and outputs of the simulations

What the other folders contain is explained in the OMS3 related post (see The OMS working environment).

Further information on the tools used and reference to the material of the previous Winter Schools can be found here.

 

References

•    Bancheri, M., Serafin, F., Bottazzi, M., Abera, W., Formetta, G., and Rigon, R.: The design, deployment, and testing of kriging models in GEOframe with SIK-0.9.8, Geosci. Model Dev., 11, 2189–2207, https://doi.org/10.5194/gmd-11-2189-2018, 2018

•    Kitanidis, P. K. (1997). Introduction to geostatistics: applications in hydrogeology. Cambridge university press.

Material for day first (January 7 2021) - Catchment delineation and Geomorphology

 You can download the material for day first (January 7 2021) from this link.

After unzipping the folder you can see the typical structure of a OMS project. This is better explained in this previous blogpost. If you are reading this in advance, please take a little time to understand what OMS is and why it is like this.

During day 1 (7 Jan 2021) we will focus on the geomorphological analysis of a river basin. Starting from a digital elevation model we will extract the main river basin and we will split it the hillslope-link structure appropriate for executing the GEOframe models. All the material come with the .zip file, however, for your convenience, the slides are also available separately at the link below.

 The theoretical part of the class in subdivided in three parts:

•   Principal geomorphological attributes theory 

• Principal gemorphological attributes practice

• Principal derived quantities and river network extraction

• Principal derived quantities with the Horton Machine

• Watershed Partitioning

• Watershed partitioning in practice

• A python script is also available for some additional work on maps (waiting for the definitive HortonMachine Tool). The python script is PyQGIS.py

For the exercises

In the OMS3 project distribute you will find:

•    data, a folder containing the model input

•    simulations, a folder containing the scripts for executing the models.

•    doc containing the pdf of the lectures

•    Jupyter containing a group of notebooks which illustrate the inputs and outputs of the simulations

What the other folders contain is explained  in the OMS3 related post (see The OMS working environment).

Further information on the tools used and reference to the material of the previous Winter Schools can be found here.

 

References

 

•    Various information from the AboutHydrology Blog

•    Rigon, R., I. Rodriguez-Iturbe, A. Rinaldo, A. Maritan, A. Giacometti and D. Tarboton, On Hack’s law, Water Resources Research, 32(11), 3367, 1996

•    R.Rigon, E. Ghesla, C. Tiso and A. Cozzini, The Horton Machine, pg. viii, 136, ISBN 10:88-8443-147-6, University of Trento, 2006

•    W. Abera, A. Antonello, S. Franceschi, G. Formetta, R Rigon , "The uDig Spatial Toolbox for hydro-geomorphic analysis" in Geomorphological Techniques, v. 4, n. 1 (2014), p. 1-19

Previous topic/day

Index of the GWS2021

Next Topic (Spatial interpolation of data)

GWS2021 Participants

 Not yet a complete list of all of the participants. Many are to shy to send their two slides resume (someone put 4).  If you want to  see them, click on the figure below.

Enjoy for their enthusiasm!

Previous topic/day

Index of the GWS2021

Next Topic (Geomorphology and Catchment delineation)

Installations for Mac Users

The main reference for Mac OS users remains the first post. Please give a look in any case to the slides and the videos.  

First installation is made with the installer found at the Anaconda site:

https://www.anaconda.com/products/individual

You have 2 options: Installing the graphical interface or installing the command line (Teminal) interface.

graphic interface: https://repo.anaconda.com/archive/Anaconda3-2020.11-MacOSX-x86_64.pkg

terminal interface: https://repo.anaconda.com/archive/Anaconda3-2020.11-MacOSX-x86_64.sh

After having installed Anaconda, please dowload the Python4GEOframe env:

https://github.com/geoframecomponents/python4GEOframe

if you download the zip file, you have subsequently to unzip it. Then within the terminal go into the directory/folder where you have save the unzipped files and execute:

(base) your environment here ~ % conda env create -f geoframe_rossano.yaml

The environment creation can take several minutes. After it has been created you can start the Jupiter lab environment by issuing the command:

(base) your environment here ~ % jupyter lab

You finally get the entry point for workin in Jupyter lab. Several Kernel are visible. During the GWS2021 we'll use the Python 3 Kernel, the first one on the top left.

Previous topic/day

Index of the GWS2021

Next Topic (Participants to GWS2021)

Some essentials about the Object Modelling System

This post is to give people the taste of what OMS is. For the Installations, please refer to the Installation page.  The user manual introduction can be found below:

• OMS User Manual - Introduction (pdf, epub) 

• The philosophy behind OMS/GEOframe (YouTube video 2019, YouTube2020)
• The GEOframe deployment (YouTube2020)
• A brief introduction to the Object Modelling System (Vimeo2021, older version of it: YouTube video 2019,YouTube2020, Also on VIMEO2020)
• OMS User Manual - Introduction (pdf, epub) 
• The OMS working environment (Vimeo 2021, an older version: YouTube video 2020)
• OMS User Manual - The working Environment (pdf, epub)
• The structure of a .sim file (Vimeo2021, an older version of it: YouTube video 2019, YouTube2020)
• The existing manual excerpt (outdated but still useful) (pdf, epub)
• The OMS console (YouTube2020)
• Examples 2020.
• Examples 2019 (All the material in the .zip files. Notebooks in /docs folder)
• ex_00 (zip files)
• Examples-basic (zip files). Please find Jupyter notebook shown in video below in the doc directory of the zipped files.
• Example 001 (YouTube video 2019)
• Controlling Iteration (Ex 05) YouTube video 2019.
• Going on with examples: Again on You Tube Video Iteration, Bulk connect, Feedbacks
• Exercises 1&2
• Watertank  Example (zip files). Documentation in the doc folder.
• Water Tank example - Part I YouTube video 2019
• Exercises 3&4
• Creating a notebook from the scratch (Live YouTube video 2019 by Niccolò Tubini)

Radiation for hydrologists

At the Winter School we usually skip this part on radiation, not because it is not important. It is a fundamental part for getting right evaporation, transpiration and the snow budget.  However time is really constrained and we have to do some choices. Please, the interested reader can give a look to slides and concept themselves. 

Some very elementary slides about the sun:

• The Sun
• Stefan-Boltzmann law
• From Sun to Earth

Now some more complicate topics

• Copying with Earth Surface
• Shortwave absorptions by the atmosphere (Vimeo2020, YouTube video)
• Considering clouds (Vimeo2020, YouTube video)
• Shortwave-Terrain geometries (Vimeo2020, YouTube video)
• Longwave radiation (Vimeo2020, YouTube video)
• Table of Symbols

References

Corripio, J. G. (2002). Modelling the energy balance of high altitude glacierised basins in the Central Andes. Ph.D Dissertation, 1–175.

Corripio, J. G. (2003). Vectorial algebra algorithms for calculating terrain parameters from DEMs and solar radiation modelling in mountainous terrain, 17(1), 1–23.

Formetta, G., Rigon, R., Chávez, J. L., & David O. (2013). Modeling shortwave solar radiation using the JGrass-NewAge system. Geoscientific Model Development, 6(4), 915–928. http://doi.org/10.5194/gmd-6-915-2013

Formetta, G., Bancheri, M., David, O., & Rigon, R. (2016). Performance of site-specific parameterizations of longwave radiation. Hydrology and Earth System Sciences, 20(11), 4641–4654. http://doi.org/10.5194/hess-20-4641-2016

Installations of the 2021 GEOframe environment for Linux operative systems

Installation of the 2021 GEOframe environment on Linux

Credits to: Martin Morlot, martin.morlot@unitn.it

 

1) Install anaconda & openjdk-8:

check https://docs.anaconda.com/anaconda/install/linux/ and https://openjdk.java.net/install/ for instuctions for your distributions

 

2) create GeoFrame folder and change directory to it (in terminal):

mkdir GeoFrame

cd GeoFrame

 

3) Clone python4GEOframe  github repository (in terminal):

git clone git@github.com:geoframecomponents/python4GEOframe.git

 

4) Download, oms-console,  Ex01 and notebook test using your browser:

https://alm.engr.colostate.edu/cb/wiki/16961

https://osf.io/5e9jp/download

https://osf.io/fzy5g/download

- unzip them inside the Geoframe folder using your choice of file-extractor for the purpose.

 

5) Change directory to where you cloned python4GEOframe, and to anaconda_envs (using previously opened terminal):

cd python4GEOframe/Anaconda_envs

 

6)Activate anaconda in linux (in a terminal):

source /opt/anaconda/bin/activate root

 

7) Create environment for geoframe:

conda env create -f geoframe_rossano.yaml (will take some time)

 

8) activate the environmental created:

conda activate geoframe_rossano

 

9) set your conda java_home

export  JAVA_HOME=~/.conda/envs/geoframe_rossano/jre/

 

10) execute console.sh in new terminal:

cd GeoFrame/oms-3.6.28-console

./console.sh

 

11) set /home/$USERNAME/.conda/envs/geoframe_rossano/jre/ while replacing $USERNAME with your username  in the OMS console java home setting as in the instructions slides (slide 11)

 

12) run ex_1 as in the instructions slides that you can find at https://osf.io/xes9y/ (slide 12, 13) to check that it works.

 

13) run the notebook excercise: open jupyter notebook with your preferred jupyter editor (ie. Vscode, spyder) set interpreter to conda env created python ( ~/.conda/envs/geoframe_rossano/bin/python3) then run the notebook as specified in the instructions (slide 17)

Go to Installations on Windows

Go to Installations for Mac

Installations of the 2021 GEOframe environment and related information

 In this post you will find all what is requested to run the GEOframe models and tools.  GEOframe requires Python and Java and it is built upon the OMS3 infrastructure. However, you are not requested or assumed to know them for using GEOframe. We will communicate the appropriate notions during the classes but the interested can find plenty of courses on the web.

A presentation was prepared to explain what to install and how. You can find it by clicking on the figure below.

Installations of OMS and GEOframe environment 2021.1 from Ri Rigon on Vimeo.

An installation of the OMS3/GEOframe environment 2020.1 - "Rossano" from Ri Rigon on Vimeo.

For any problem contact us through the mailing list https://groups.google.com/forum/#!forum/geoframe-winter-schools. 

What is actually installed and why

• Java. GEOframe and OMS are written in Java and they require to have installed Java on your computer. Here you can find instructions to install Java on your computer.  Java JDK is installed using the Anaconda package manager. So, essentially you do not have to take care of it.  If you want to do it differently,  please note that you need the Java Development Toolkit (JDK) installed not the Java Runtime Environment (JRE).  You can watch several videos for Windows here but Windows user can follow our previous blogpost.  For Macs, look at here. Googling you can get more videos and information. 
• OMS v 3 Console. It is possible to use Docker to execute the programs but, after the experience of the last year with Docker installations on Windows, we preferred to use directly the Console. The OMS system installation traditional information can be found here: https://alm.engr.colostate.edu/cb/wiki/16961 and https://alm.engr.colostate.edu/cb/wiki/17107.
  

• To start the Console from Windows, just click on the .bat file
• To start the Console from Mac OSX or Linux, open a Terminal and execute:
• % ./console.sh &
• The "&" just free the command line back and gives it back to you. 

• During the School we will use Jupyter and Python 3 for data management and visualisation. It would be great if you could arrive with Jupyter installed.
• The post at this link contains all the information needed. For installation of the software, we suggest Anaconda. 
• To understand what a Jupyter notebook is about, please see its manual. However, we will use Jupyterlab.  (You can see a YouTube video about here).  One can think that Jupyter was heavily based on the look-and-feel of Mathematica notebooks: but Jupyterlab is a step ahead to something different. Installing Anaconda, you also have already installed Jupyter notebook. You can open Jupyter lab by the Anaconda Console, or issuing the command  Jupyter lab at a terminal (called DOS prompt in Windows).

• The manual of Jupyterlab is here.
• BTW, it will be useful to have also a GIS of your choice installed. We suggest QGIS.

Go to Installations for Linux

Go to the Index

Go to the next task (Radiation for hydrologists)

The GEOframe Winter School 2021

The third edition of the Winter School on GEOframe (GWS2021) will be held between January 7 and 16, 2021 in Trento, Italy. The course is devoted to Ph.D. Students, Post-docs, Young researchers (and Professionals!) interested in estimating all the components of the hydrological cycle (rainfall, evapotranspiration, snow-melting, and river discharge). The system allows to work out catchments from very small to continental (e.g. Abera et al., 2017a,b), up to build operational solutions, as the one used in in Basilicata. The aim of the course is to enable participants to run their own simulations and, eventually, on their own catchments and estimate the hydrological budget components. Previous Winter school material is freely available at the GEOframe blog.
Compared to what was done in the past courses, there will be more practice and a more detailed work on evapotranspiration and rainfall-runoff. It will be much more focused on exercises and on getting the water budget performed under various hypotheses on models' structure.

Due to COVID-19/COVID-SARS-2 the lectures and the work will be limited to, at most, 10 people in presence but it will be possible to follow the class remotely either synchronous online and asynchronous online (we’ll use a “blended” type of teaching based on Zoom). There is no fee or subscription for the asynchronous classes (and no personal support, just the support coming through the geoframe users mailing list). Synchronous  classes with no personal support though require subscription and the payment of a small fee of 10 Euros or (for Italians) a subscription to the Italian Hydrological Society. However, who requires a certificate of participation, and want personal support, must pay a fee (150 euros). Getting the certificate will be subject to present a report and an analysis of a catchment performed with the GEOframe tools. Tourists are  welcomed but obviously real learning requires exercise and some effort.

Instructors will be

• Prof. Riccardo Rigon, Ph.D. (GS)
• Prof. Giuseppe Formetta, Ph.D. (GS)
• Ing. Marialaura Bancheri, Ph.D. (GS)
• Ing. Niccolò Tubini, Ph.D. candidate
• Ing. Concetta D’Amato, Ph.D student

Participants

• Participants resumè

Topics:

• Homework to do before the School - Installations and introduction to the Object Modelling System Infrastructure and Jupyter
• Homework -  Radiation for Hydrologists
• Day 1- Hydrologic Response Units delineation and treatment of spatial features
• Day 2- Interpolation of hydrometeorological datasets 
• Day 3 - Exercise with your own catchments under instructors supervision
• Day 4 - Evaporation and Transpiration with GEOframe-Prospero
• Day 5 - Modelling lumped models with GEOframe-ERM
• Day 6 - Adding features to your modellingg with ERM
• Day 7 - Looking forward

Next Day/Task

Subscriptions for having credits for this class and support can be obtained all year long after January 15,  2021: please visit https://webapps.unitn.it/form/en/Web/Application/winterschool/GEOframeWS2021 and compile the form or write to abouthydrology@gmail.con with subject: GWS2021 if you need more information. After payment of the fee you can have individual support and gain the participation certificate if you setup and perform an exercise with the GEOframe tools. You can do it on a your own catchment or we can provide you with a catchment and the required data.