Professional Documents
Culture Documents
And the
Free and open source approach
Mike Spencer
@MikeRSpencer
scottishsnow.wordpress.com
m.spencer@ed.ac.uk
Outline
● What are raster time series data?
● What can you do with them?
● Why are they a challenge?
● The technical bit
● Where can you get them?
Definitions
Raster data
OS Terrain50 DTM
© Crown Copyright/database right 2014. An
Ordnance Survey/EDINA supplied service.
Time series data
http://www.geos.ed.ac.uk/Weathercam/station/month.html
Combined!
What are they?
http://www.metoffice.gov.uk
What are they?
● Weather
– Radar rainfall
– Model outputs (temp/precip/etc)
● Satellites
– Atmosphere
– Land
– Cryosphere
– Ocean
● Repeat LiDAR
● Gridded model outputs
http://lca.usgs.gov/lca/africalulc/approach.php
Are they just pictures?
https://metofficenews.wordpress.com/tag/satellite-imagery/
What can you do?
http://scottishsnow.wordpress.com/2014/09/14/british-hydrological-society-2014-symposium-poster/
Easy!
Why is this a challenge?
● Two tiles cover Scotland
● Two MODIS satellites pass every day
● 1460 tiles per year...
http://catalystnz.blogspot.co.uk/2012/06/24-hour-flashed-in-pan.html
Tools
● Programming language
● GDAL
● Data container(s)
● Plotting tool
Workflow
● Download dataset
– Think time and disc space
● File format and reprojection
● Read into container
● Analysis
● Write results to container
● Plot results
Workflow
● Download dataset
– Think time and disc space
● File format and reprojection
● Read into container
● Analysis
● Write results to container
● Plot results
GDAL
● File format (gdal_translate)
● Merging (gdal_merge.py)
● Reprojection (gdalwarp)
● Natively in Python
● Use in R via
– rgdal
– gdalUtils
Analysis
● r.mask – select only areas of interest
● r.mapcalc – general sums
– Also good for combining sources
● r.stats – summary of raster
● 161 installed modules (v6.4.5)
● Write results to SQLite
How?
Some data sources
● Met Office
– http://www.metoffice.gov.uk/climatechange/science/monitoring/ukcp09/download/index.html
● NASA
– http://modis.gsfc.nasa.gov/data/dataprod/index.php