2008.03.06 - Exploiting a VRE for Earth Observation (Overview on

Community Meeting
March 6th 2008
FAO HQ
Exploiting a VRE for Earth Observation
(Overview on the DILIGENT inheritance)
www.d4science.org
www.d4science.org
Why in DILIGENT
EO scientists should be able to create
on-demand
shared workspaces
containing data / text / images / information
from existing distributed sources
equipped with
services
to
search, browse, annotate, processing etc
2
www.d4science.eu
The ImpECt use case
Scope: demonstration of a repetitive typical complex task
EO data and derived information contribute to many
regular national and international reports on the
“status of the environment”
Target: generate a periodical report
To contribute to periodic technical reporting on EU
environment, with updated statistics and maps
using the same calculations as other times, but
with updated input!
3
www.d4science.eu
Starting point
Grid infrastructure
Processing services accessible via web interfaces
Information sources for the test-bed
(e.g. eoportal, EEA portal, GeoNetwork… )
4
www.d4science.eu
Grid infrastructure @ESRIN
gLite only; 1CE, 7WNs, 1SE
Set-up and tested since long time
Extremely secure in terms of network infrastructure
High quality hw (in RAID)
8TB storage (in RAID) / RAM can increase on need
28CPUs
basic sw (OS, grid middleware, ad hoc licenses where
needed)
grid monitoring tools used (passive): Ganglia + Job
Monarch, FWLogWatch, WebMin System and Server
Status component. Migration to Nagios is foreseen by
2008.
5
www.d4science.eu
Brief
Satellites witness lowest Arctic ice coverage
in history,
ƒ The area covered by sea ice in the
Arctic has shrunk to its lowest level this
week since satellite measurements
began nearly 30 years ago, opening up
the Northwest Passage – a long-sought
short cut between Europe and Asia that
has been historically impassable.
ƒ Each mosaic contains approximately 200 Envisat images
processed by the Earth Observation G-POD (Grid
Processing On Demand) operated at ESA/ESRIN. G-POD
is a powerful GRID-based environment coupled with large
online archives of Earth Observation data products.
see: http://www.esa.int/esaEO/SEMYTC13J6F_planet_0.html
6
www.d4science.eu
Brief
G-POD
accessible from website
http://eogrid.esrin.esa.int
http://miravi.eo.esa.int/
for “selected” scientists applying to ESA
open call
to run own&shared applications,
to access large EO datasets, and
to use ‘simple’ user workspace
7
www.d4science.eu
Brief
EEA portal
http://www.eea.europa.eu
eoportal
http://www.eoportal.org
Geonetwork
http://www.fao.org/geonetwork
8
www.d4science.eu
Brief
Satellite data to deliver ‘stateof-the-art’ air quality
information
ƒ The 'Integrated Air Quality
Platform for Europe’ service was
developed to provide end-users
information about air quality and
is currently providing forecasts for
up to 72 hours at a resolution of
50 km. The service includes data
on ozone, nitrogen dioxide and
particulate matter (the sum of all
particles suspended in air,
including dust, smoke, pollen,
etc.). .
http://www.esa.int/esaEO/SEMDC5PR4CF_environment_1.html
9
www.d4science.eu
Achievements
Retrieval of information via full-text / geospatial search
Annotate data sources via text / images
Access objects metadata in different formats
Basket information
Define document templates
Aggregate information
Interface to ESA G-POD service
10
www.d4science.eu
Demo scenario
Topic
monitoring of vegetation
Objective
use vegetation mapping to detect burnt
and agricultural areas over EU
Countries and integrate such
information in report docs
(data from Landsat7 and Envisat EO missions)
11
www.d4science.eu
Comment on exploitation
Testbed capabilities being assessed
ƒ Integration in the same workspace of different “objects” is a key feature
ƒ Demonstration of testbed with end-users still to be attempted
Issues
ƒ System: need stability, reduce complexity…
ƒ User aspects: guarantee available web functionalities
Project focus:
ƒ deviations from the roadmap following technical wishes
Planned
Planned
testbed User view over time
testbed
functions
functions
Implemented
Planned
Implemented
Planned
Testbed
testbed
Testbed
We need
testbed
functions
functions
functions
functions
Wider, generalised
But, partially
meeting user needs
Implemented
Implemented
revised
Testbed
Testbed
user
functions
functions
needs
12
www.d4science.eu
What does ESA expect from d4s
To manage EO contents and services via one ‘selfcontained’ environment, the EM reference platform, based
on a customized installation of gCube placed in ESRIN
13
www.d4science.eu
Thank You
14
www.d4science.eu