the full presentation document
Transcription
the full presentation document
Geoclip the Observatory Generator----------- eMc3 - SARL with a capital of 44 000 € – RCS Toulouse 431 429 091 – APE : 6311Z 26 chemin de Bellevue – 31140 Pechbonnieu – Ph: +(33)5 34 27 45 17 www.geoclip.fr – [email protected] – [email protected] Table of Contents 1. Introduction 4 2. The Geoclip Interface 6 An ergonomic design that facilitates navigation within the information space 6 The user interface is organized around three major areas 7 A wide range of thematic analysis 7 Intuitive Geographical Navigation 9 Indicator choice: child's play! 10 Diverse selection tools 12 To Find out More: Map and Data Export 13 To Explore the Temporal Dimension 15 Data Import from a Spread Sheet 16 How to Sort, Filter and Export Tables 17 How to Customize a Geoclip Application 18 How to Produce a Territorial Portrait 19 How to Display Supplementary Geographical Layers 20 How to Facilitate Exchanges and Collaborative Work 21 Geoclip Application Accessibility 22 3. Geoclip Management Module 24 Management Module How to Build a Geoclip Application How to Create Indicators Multi-Language Support is Built-In 24 24 25 26 4. Geoclip General Overview Basic Principle of Geoclip Model Interactive cartography based on the Flash format: Optimized Software for Fluid Display and Transitions The Geoclip Server: Light, Quick, and Portable Base Map Management Geoclip Database Model Interoperability Security 28 28 28 28 29 30 30 31 31 Geoclip the Observatory Generator - 2/38 5. Typical Project Building Steps 32 Ergonomics and Functional Specifications How to Prepare Base Maps Modelling and construction of the database Specific Developments Project Phases 32 32 32 33 33 6. References of Major Contributors 34 A dynamic and performing team Productions Projects In Production 34 36 38 Geoclip the Observatory Generator - 3/38 1. Introduction The Geoclip model in development at emc3 will deliver easy access, fluid navigation, and fast display. Data are assembled, documented and structured within a database, which means it is easy to update the data. A well designed management tool lets the administrator perform maintenance tasks, both on the statistical data and on the geographical data. Geoclip was created by statisticians so it will beautifully and pedagogically create online repositories of structured and documented data. New Geoclip features have led us to create a new version named Geoclip O3. The increasing power of the technologies we use lets us offer a wide array of functionality that makes Geoclip O3 a genuine builder of customized observatories. Cartographical representation remains one of Geoclip's central pillars. Indeed, thematic presentations provide particularly effective images to illustrate and analyse local statistical data. Geoclip's reputation was built on its capacity to create maps that are both rigorous and visually neat. To arrive at genuine territorial observatories, other tools complete the cartography application: automatic tables, graphical representations, reports, dashboards and other territorial portraits. The new Geoclip O3 interface has been entirely revised to take advantage of the latest technologies, offers users even more fluidity and flexibility, and lets them explore information progressively. France découverte (http://franceo3.geoclip.fr/#l=en) is a demonstration application built with Geoclip O3 and gives users a chance to explore new functionality. Geoclip can be deployed with no effort and at no extra cost within organizations that are very decentralized. Geoclip is the solution of choice for demanding customers and for ambitious productions built for the general public. More than a hundred applications are currently active, build from version 2 of Geoclip Server. Over the years Geoclip Server has become the reference for interactive cartography applications. Some applications are even older and still work to this day. For example the map that displays the location of health providers originally implemented by ATIH in the early 2000s and the CartoS@nté application, deployed by the Urcams network between 2001 and 2006, are still accessible from the regional health agencies websites (for instance the ARS in Midi-Pyrénées: http://www.ars.midipyrenees.sante.fr/ARS-Midi-Pyrenees.midipyrenees.0.html). The indicators branch of the Datar "Observatoire des Territoires" http://territoires.gouv.fr/observatoireGeoclip the Observatory Generator - 4/38 des-territoires/fr is one of the foundation projects for Geoclip Server and has been on-line since 2004. Moreover, a renovation project is in progress; it will integrate the two original branches, Zones and Indicators, and will take advantage of new features in Geoclip O3. The statistical and prospective services of the Ministry of Agriculture have begun the publication of the results of the 2010 agricultural census on its website (Agreste). The solution chosen for cartography is Geoclip O3, the new version of Geoclip Server: http://www.agreste.agriculture.gouv.fr/recensementagricole-2010/les-cartes-en-ligne-727/. This application is the first one produced with O3. To this day there are about twenty applications based on O3 either already produced or in progress, including the conversion of some applications that are currently running in the previous version. Because a third of our activity is outside of France, emc3's Geoclip is already an internationally recognized platform. Many of our applications can be viewed online at www.geoclip.fr, which will let each user appreciate for themselves the tool's ergonomic features and performance in various contexts. For a complete overview of the ergonomics offered in Geoclip O3, we recommend that you explore France découverte (http://franceo3.geoclip.fr/#l=en), the statistical atlas of France by municipality, canton, department, and regions. It will let you access a wide variety of public statistical data. The purpose of this document is to introduce Geoclip: How does it work for the user? How does it work for the administrator? How does the Geoclip data model work? What is it like building a project with Geoclip? Geoclip the Observatory Generator - 5/38 2. The Geoclip Interface An ergonomic design that facilitates navigation within the information space Over the last ten years and countless experiences building data-rich cartography sites for all sorts of customers, emc3 has built a solid foundation of knowledge on what works in consultation ergonomics. Key ideas are as follows: Maximize the space utilized by cartography in order to best utilise the user's screen. Vectorial formats make it possible for us stretch the display automatically according to the space available. The cartography interface integrates navigation items that lets users change indicators, year of reference, coverage, and level of analysis. That way data export is never more than a few clicks away. Gradual access to information: users get quick access to predefined formatted data, then can add complementary layers (zones, networks), zoom-in on a territory, define their own geographical selections and access all related detailed information. Thematic analysis are rigorously built and annotated and some parameters used to build them are made accessible to the users so they can better grasp representation concepts. To find out more : http://www.o3geoclip.blogspot.com/2011/12/o-3-fiche-technique.html Geoclip the Observatory Generator - 6/38 The user interface is organized around three major areas In Geoclip O3 the map area retains its central place. It is surrounded by the data area and text area which are sliding panes to the right and left of the map area. The data are provides other ways to represent the data, as a statistical table and/or graphical representation. The text area is new with O3 and its content can take many forms: this area lets users access documents, analyses and synthesis, news, map repositories, webquests, as well as link to other resources, etc. The three buttons on the top right of the screen let users display or hide the various areas on demand: text and maps or maps and data. The vertical borders along the areas let users fold down the various panes. The content and appearance of the various areas is customizable: style sheets let the administrator choose colours, fonts, logos and visual design. The objective is to obtain a genuine territorial observatory, complete and autonomous, within which each user can navigate freely. We made the choice to reduce the number of buttons on the interface to offer a more streamlined and refined appearance. If necessary a tool tip will appear when hovering to give more details. Extra functionality appears in the contextual menu when right-clicking in the map area. To find out more: http://www.o3geoclip.blogspot.com/2011/11/pour-decouvrir-la-nouvelle-interface.html A wide range of thematic analysis Geoclip has mastered the art of building cartographical representations within the rules laid out by cartographical semiology. They are implemented in a rigorous and coherent way in all our applications of dynamic and interactive cartography, no matter what their objectives are. It can offer a wide range of representation modes adapted to the kind of indicator presented. The most important methods used by Geoclip are the following: Analysis by colour ranges (or choropleth for continual variables) to represent ratios and percentages. For example: share of persons over age 75 in 2008 by municipality. It is possible to adjust some parameters: colour palette, discretization method. It is also possible to obtain variants: continuous coloration, density of deviation from the mean, smoothing, etc. Geoclip the Observatory Generator - 7/38 Analysis by proportional symbols, for the representation of absolute quantities. For example: the number of persons over age 75 in 2008 by municipality. It is possible to adjust some parameters: shape, colour, symbol size. It is also possible to obtain variants: temperature map (smoothing), density of plot points, etc. Analysis by individual values, for the representation of quantitative variables (typologies). For example: municipality typology by 2010 urban areas. A Geoclip application is also capable of creating thematic analysis on geographical layers made of punctual objects (equipment, establishments, etc.) or linear objects (sections of roads, sections of rivers, etc.). The points can change colour, shape, or size. The lines can change colours and thickness. Geoclip can handle peculiar cases. Two-tone palettes are suggested for the representation of indicators that can have either positive or negative values be it for analysis by proportional symbols (for example a balance) or for choropleth (for example an evolution rate). The existence of stand-out values is taken into consideration. We can also handle statistical secret. Whenever possible, the representation of two supplementary indicators can be overlapped. It is possible to have an analysis by proportional symbols on top of a choropleth analysis, or an analysis of points or lines on top of a choropleth analysis. Overlapping the representation of indicators can reveal interesting spatial relationships and so can their representation on two maps side by side. Two juxtaposed maps can also represent the same indicator on different territories or at different dates. Geoclip the Observatory Generator - 8/38 No matter what mode of representation is used, you will always have a legend which is a major element that gives life to the map. The panel Options and settings can adjust representation parameters. The legend frame is automatically placed on the side of the map in order not to hide the territory being mapped. They can also be moved by click and drag. To find out more: http://www.o3geoclip.blogspot.com/2011/11/ faire-de-jolies-cartes-sans-effort.html Intuitive Geographical Navigation Generally speaking Geoclip is designed to present the most flexible geographical navigation possible. For instance there are many ways to move around the map, zoom-in and zoom-out, etc. You will find all the tools you are used to on virtual globes such a Google Maps and others. For instance you can click and drag directly on the map, or you can use the mouse wheel or the arrows on the keyboard. The navigation map at the bottom right of the screen hides automatically and makes it easy to zoom-in on directly onto a specific territory. The right-click contextual menu offers convenient shortcuts to frame a territory. The place search tool lets users find a city with just a few letters from its name. Fluid transitions are also worthy of note and let users move in continuous motion or in different directions. We invite you to see for yourself and explore our demonstration: France découverte (http://franceo3.geoclip.fr/#l=en). Another example of how powerful geographical navigation functions are: The ability to change geographical view. For example, within two clicks one can go from the municipal level to the regional level. The current framing is kept. The current indicator is also kept if it is available and can be calculated for this view. Two items characterize a view: the geographical level (land registry sections, iris, neighbourhoods, cities, etc.) and the global territory (agglomeration communities, departments, region, etc.) Geoclip the Observatory Generator - 9/38 Indicator choice: child's play! A Geoclip application is usually made of a great many indicators. To help users manage the complexity, indicators are sorted in a two-tier tree: they are grouped by themes and themes are grouped by domain. This is a summary of the panel that lets users view all available data: Geoclip the Observatory Generator - 10/38 You can load a group of indicators, even if they're not all within the same themes or domains. The names of all loaded indicators are above the map. Only one indicator can be represented on the map, or possibly two if their representation modes are compatible. To toggle between indicators, click on the name of the indicator you wish to display. When displaying two maps, click and drag to switch an indicator from one map to the other. Each indicator is documented in detail: label, date, source, definition, available geographical levels, reference statistical values, etc. This documentation is accessible from an indicator's information panel. For each indicator two more dimensions can be defined: temporal criteria which is a recurring indicator (years, trimesters, months, etc.) and filtering criteria, if the indicator can be ranked by categories (business sector, equipment type, etc.). Geoclip the Observatory Generator - 11/38 A search tool can give you the list of all indicators with a name containing a given key-word. To obtain a list of indicators in which different representation modes are outlined with a colour (see illustration) you can either choose a domain and theme or search from a keyword. Diverse selection tools One of Geoclip's strength is to offer an interactive map in which each cartographical object reacts to the mouse, hovering action, and click. Consequently, geographical selection tools let users act directly on the map with the mouse; either by clicking on geographical objects one after the other, or by drawing a circle or polygon: These circular and polygonal selection tools are also used to measure distances. You will find them from the search and selection panel (View Menu). This panel also offers a selection tool from a selection help Geoclip the Observatory Generator - 12/38 geographical layer. For example this lets users select with one click all municipalities that belong to a county. The function Selection by request from indicator values lets users find geographical units that match a specific criteria, for example cities within the department of Haute-Garonne where the annual population variation level is negative (see How to Sort, Filter and Export Tables). A geographical selection gives access to different reports about this selection: tables, graphics, comparative profiles, dashboards or data exports on this selection. To Find out More: Map and Data Export The maps can be printed on a high resolution printer or exported in various image formats. An intermediary step lets users get a print preview so they can verify the layout. Interactive items disappear but mandatory items are kept: title and copyright. The title can be modified and a custom comment can be added as well as the items contained in the documentation for indicators. Many dimensions are possible and you can print either in portrait or landscape mode. Maps can be exported in jpg format so they can easily be integrated into another document or in a pdf. Geoclip the Observatory Generator - 13/38 Example of jpg printout: To let users continue to explore and analyse data, the option to export to a spread sheet is presented. Data marked with statistical secret are not displayed. Data export can be restricted to the current geographical selection. Geoclip the Observatory Generator - 14/38 Example of xls export: To Explore the Temporal Dimension Some indicators are shown as series and can be presented as such in the Geoclip data model. The frequency can be per year, trimester, month, etc. A dropdown list is shown after the indicator label lets users choose the period, the most recent one being chosen by default. It is possible to display an animation based on the automatic scrolling of periods, presented as a small movie. The animation can be played either automatically or step by step with a cursor. The major interest of this visualization is to show how a phenomenon is Geoclip the Observatory Generator - 15/38 spread out over space and time. A temporal indicator can be represented as an evolution curve. This curve compares the geographical selection to the reference area. Data Import from a Spread Sheet Users can include their own data to make them accessible for cartography from an easy cut and paste from a spread sheet. The data bloc must include in the first line the name of variables to import and in the first column the list of geographical codes that match the geographical codes so they are paired with the base maps. The tool analyses the pasted data and automatically representation offers modes: default proportional symbols for integer values, choropleth analysis for decimals numbers. It is possible to modify these representation types and choose a representation by individual values when there is a code that matches a typology. Geoclip the Observatory Generator - 16/38 Data integrated in that way is then accessible in the same manner as other data in the database. This data set can also be saved to be reused later or transmitted to another user (see How to Facilitate Exchanges and Collaborative Work). How to Sort, Filter and Export Tables The new Data pane contains a table and can also contain graphical representations. The table displays the data found in the Maps pane. On the lines you will find geographical levels chosen from the cartography view: for example regions, departments, municipalities, etc. On the columns you will find indicators loaded in the Maps area. If a geographical selection was established previously on the map, it is also used in the table. Above the column headers there is a filtering tool. For instance this would let users locate cities in a given area where the population is superior to 10,000 inhabitants and has diminished between the last two censuses. The result of the filter can be reflected on the map. The contents of the table can be exported to a spread sheet or pdf format. The documentation about exported indicators is included in the exported files. Geoclip the Observatory Generator - 17/38 How to Customize a Geoclip Application A Geoclip Server application is entirely autonomous, it is always displayed in the same way in the browser, no matter what browser you use. It constitutes by itself a complete territorial observatory. This observatory is custom-made for every publisher. The customization comes primarily from the contents of the observatory: the territories being mapped, domains, themes and indicators being displayed. The graphical appearance is also customized to provide a specific visual identity to each application. Specific banners are at the top of the screen and various outputs. They incorporate a logo. Something new that brings a lot of customization possibilities with Geoclip O3 is the text pane. This pane is composed of several tabs. The first tab is a home page; it shows a general description of the application and direct links to important items in the observatory: indicator selections or reports, presentation videos, etc. The second tab is a documentation tab, for example it presents the sources of information used in the observatory. The news tab outlines the latest updates to the observatory. The contact tab gives the publisher's contact information. Another tab can for example include guided courses to be selected from a drop-down list (see illustration). Each guided course contains some predefined maps that illustrate for instance a particular problem. Geoclip the Observatory Generator - 18/38 This text pane can be viewed in several languages such as French and English. All of the interface is entirely available both in French and English. Other languages are also possible: Spanish, Italian, German, as well as other languages that work with other character sets since full UTF8 compatibility is available. The text is made more accessible: character size, contrast mode (see Accessibility within the Geoclip application). How to Produce a Territorial Portrait As soon as a geographical selection is defined, users can get different types of reports about this selection: lists, graphics, comparative profiles, dashboards. Dashboards are most elaborate and aim at create a complete portrait of the territory selected. This portrait is made of a set of thematic pages with statistical tables and diagrams in a standard A4 layout. You can also include maps in this portrait. It is used to compare a selection to an area of reference, for example the rest of the country. The themes suggested in these pages match the themes found in the database. The types of possible graphics are pie charts, bar charts (horizontal or vertical) and line charts for temporal data. The population pyramid is a special type of representation. It is possible to choose a page to display from the drop-down menu. All pages can be printed. Geoclip the Observatory Generator - 19/38 How to Display Supplementary Geographical Layers The application is based upon main geographical layers that are the basis of thematic analysis. It is possible also to display other (or supplementary) graphical layers that assist in understanding the map. First, these layers can be complementary layers: major cities, roads network, rivers network or rail network. It can also be background geographical layers from virtual globes such as Géoportail, Bing Maps or Open Street Map. Parameters can be adjusted, for example on Google Maps the style can be more or less detailed, city names can be displayed, or be in map view, satellite view, or relief view. Geoclip the Observatory Generator - 20/38 In the illustration the representation of weather stations is overlapped with a Google Maps relief map. To find out more : http://o3geoclip.blogspot.com/2011/12/o-3-google-maps-et-geoportail-de-lign.html It is also possible to load a WMS layer (Web Map Service). A first drop-down list proposes several prerecorded server addresses. You can also enter the URL of a server that is not already in the list. As soon as a server is selected, the list of available layers is displayed in a tree. It can be necessary to zoom in to see some layers. This makes it possible to superimpose thematic analysis performed in the application with information that comes from external sources. Please note that the Geoclip application is not responsible for the information and loading delays of layers that come from external servers. Finally, a Geoclip application can itself behave like a WMS server: a thematic analysis that comes from a Geoclip application can also be read by another WMS client. A Geoclip application can load a WMS layer that comes from another Geoclip server. How to Facilitate Exchanges and Collaborative Work As we have seen, Geoclip is the way to share a high value dataset with a large number of users. Data can be organized by theme and domain in order to manage hundreds of indicators and let them evolve in various geographical levels. Users can save the map they just created at any time by clicking on the capture button and creating a geo-bookmark. We also reviewed how users can import and share data not yet in the database (see Data Import from a Spread Sheet). A map created in this manner can also be saved as a geo-bookmark. Each geo-bookmark is placed in a list that creates a study. By creating a study, users save a series of maps as a file that can be saved, shared, and reused. For each study, here is what is saved: mapped indicators, cartography parameters, geographical level, and framing. If the map necessitates imported data, these data are also saved. Geoclip the Observatory Generator - 21/38 To find out more: http://www.o3geoclip.blogspot.com/2012/02/mode-demploi-comment-faire-uneetude.html Geoclip Application Accessibility Website accessibility is a drive to make the internet more accessible to handicapped persons that have motor or visual disabilities (for instance they cannot use the mouse or they cannot see colours well). Geoclip offers solutions to this type of situation in several ways. Users can navigate from the keyboard: tab key, arrows, space bar. Several keyboard shortcuts let users get direct access to main function: (I) opens the indicator panel choice, (Z) defines a zoom-in frame, (C) defines a circular selection, (D) cancels the selection, (R) displays the navigation map, etc. These shortcuts are designated in the menus and matching panes. Graphical navigation is based on the space bar, +, -, home, up arrow, down arrow, left and right arrows. These let users zoom in or out, reframe, and move in various directions Text panes are the natural entry-way into a Geoclip observatory. They present the objectives of the tool and major functions. They make it accessible within one click and show examples that can be viewed directly. Text readability can be improved by making the font larger and/or invert the contrast from the buttons. Text can be read out loud using screen reading software such as Jaws, the most widely used product in that category. Geoclip the Observatory Generator - 22/38 For choropleth cartography representations, the choice of colour palettes includes palettes optimized for persons who suffer from a colour perception visual impairment. The palettes that include colours with more contrast are the result of research by cartographer Cynthia Brewer and her team (http://colorbrewer2.org/). Geoclip the Observatory Generator - 23/38 3. Geoclip Management Module Management Module The database must be updated as often as necessary. The database administrator must have complete autonomy in order to further develop database content. To do so, the administrator can login to a management module from a browser. This module lets the administrator create new indicators with descriptions and all associated meta-data. From this module the administrator can add any new thematic analysis, modify the parameters of an existing analysis (number of classes, colours, etc.), set the nature and contents of restitutions (titles, legend headings, legal stipulations, etc.). This module reads and writes management information into the database. This module also lets the administrator view tool usage statistics by indicator and by date (view, export, print, etc.) and also manages different user profiles. How to Build a Geoclip Application The management module is a tool that offers the administrator maximum flexibility in managing the application. The interface is built on Flash, accessible from a browser and protected by login and password. We chose Flash for the management module and interface in order to obtain a polished ergonomics. With this management module the administrator will be able to: Create new themes or update existing themes Create or update geographical levels Define indicators (labels, definitions, geographical levels, calculation formulas, etc.) Import data and aggregates Export data Assemble geographical layers to build cartographical views Define parameters for cartographical representations of indicators (thresholds, colours, etc.) Configure the contents of the text pane Design dashboards Manage statistical secret Manage user profiles View the application usage statistics For example, it is possible to define user groups that will get access to only specified datasets via the user's profile management. Geoclip the Observatory Generator - 24/38 Data accessibility is defined either for all the indicators of a theme or by indicator and geographical level. Each user belongs to a profile defined and attributed by the administrator. For example, the administrator indicates that the "Agriculture" theme or the "Typology of agricultural businesses" in the municipality is accessible (or not) for each of the profiles. How to Create Indicators The parameters that make up thematic analysis (discretization methods, colour palettes, etc.) are defined first in the management module. The management module, delivered with the application, lets administrators update and manage the contents of the database. The example above comes from management module for the "France découverte" Geoclip demonstration application. It shows the definition of thematic analysis parameters. The indicators are sorted by domains and themes . For each indicator, define labels (labels, definitions, source), its name in the database or calculation formula , geographical level(s) for which it is available, Geoclip the Observatory Generator - 25/38 parameters and cartography representation . The management module is designed to give autonomy and facilitates the work of the application's administrator. All geographical levels are not necessarily accessible for a given variable. All available levels are defined in the management module. Multi-Language Support is Built-In Users choose a language as soon as they enter the application. The choice can be modified while browsing. By design, the Geoclip interface can be in different languages. The code of the application is clearly separated from all the text that appears on the screen. Text items are managed in separate files, one per language. The application administrator can easily edit these files. Theme labels, variables, geographical levels, and metadata are stored in the database. The management module makes it possible to edit this information in all the languages. Geoclip the Observatory Generator - 26/38 The example above comes from management module for the "France découverte" Geoclip demonstration application and shows how labels are managed for the English language. Geoclip the Observatory Generator - 27/38 4. Geoclip General Overview Basic Principle of Geoclip Model The Geoclip model we offer today is based on many years of experience in interactive cartography on the internet or intranet. It benefits from a powerful database on the server and the nimbleness and speed of the Flash plugin on the user's browser. It is based on two software layers optimized for display speed and ease of browsing of a data-rich system. It is a modular and open solution, developed and entirely by the emc3 team. Geoclip brings value and accessibility to statistical information via many tools based on cartographical representations, automatic tables, and graphics. Maps react to hovering or clicking, users build their own geographical framing and select what territories are of interest. Printing, pdf outputs, xls outputs allow users to continue to take advantage of the information outside of the browser. All of this happens without needing to install or maintain complex software on the server or user's client computer. Interactive cartography based on the Flash format: Among the various dynamic cartography solutions on the internet (or intranet), we have favoured the Flash format for many years for the following reasons: Power and speed: the base map and data are loaded independently in an ultra-compact format. Tool stability: it behaves in the same way on all PCs and Flash (a free tool) is present on 95% of all computers. A new version of the browser cannot "break" how the application works. Rich functionality: the browser itself draws the maps in the best resolution no matter what zoom-in is requested by the user. Users can import data with cut and paste, export maps or data as a spread sheet or image, save studies locally without going to the server. Because of lower demands, the server can better manage peak times. Because we take full advantage of the browser, it provides unsurpassed ease of navigation. We are also investing in the new API HTML 5 which is now being handled by new version of browsers. It should equal Flash possibilities progressively. HTML 5 covers a series of specifications that are being defined and implementation are not done in the same way between the various browsers. New tablet environments, which are more modern and better handled, will soon benefit from an HTML 5 version of Geoclip. Optimized Software for Fluid Display and Transitions Over its long-term development, emc3 has accumulated everything it needs to optimize response time: Geoclip the Observatory Generator - 28/38 The database is standardized, filtering criteria are indexed, SQL requests are optimized with a systematic iterative search of the best order and filtering criteria combination. Statistical data are sent back, after a server query, to the user's browser in a Flash/swf format. This format is very compact, binary, and readable without being encoded by the cartography interface: it is quickly transferred and quickly processed. Calculations are spread out between the server and the client workstation: the Flash reader associated to the user's browser is able to handle some sorting, zooming in and out, object colour changes, and all of this much faster than a remote server! Calculations handled by the user's workstation are themselves optimized to take as few resources as possible. The Geoclip Server: Light, Quick, and Portable Cartography servers are generally large machines capable to build on the fly bitmap images and sometimes reactive areas. Geoclip works differently because it displays vectorial objects without distorting the source base maps. The Geoclip Server layer is based on some PHP scripts that transfer the information between the database (MySQL for example) and the end user's computer. These scripts are simply dropped on the server, a very simple operation for any kind of machine. No complicated installation that modifies system files or forces a reboot with every update. The files are the same on a Windows or Linux server, MySQL database, PostgreSQL, Oracle, or SQL Server. For example, this lets us put a local version of the website on the PC of the administrator for tests and validation before publication, or on a Linux production server. Each of these scripts typically follow three steps: 1) Receive parameters from the browser and verify their validity. 2) Query the database (SQL query), extract a dataset, process this dataset (decreasing sort, discretization, smoothing, etc.). 3) Encode the dataset (s) produced in the swf format to send back to the client's browser.A dynamic server cache also lets us increase performances considerably. The Geoclip Server PHP layer queries the database as needed (column call, indicator tree structure read, etc.), and transmits these numbers columns or labels to the users' machines in a compact binary format named swf. It is lightweight and optimized to minimize the load on the machine and to facilitate upgrades to the software. Geoclip the Observatory Generator - 29/38 Base Map Management Base maps are sent to the user's machine as overlapping layers that are put together by the Flash interface. Geoclip O3 is designed with a new format that still runs a native Flash format, but is even more compact before. than It is highly evolutive and can now encode base maps with more than 50,000 objects. The transfer format is swf and it protects the data being transmitted transfer, (binary not text). Geographical layers are converted first from the Mapinfo or Shape format to swf. All the server has to do is deliver a physical file readable directly from the client workstation. Once loaded, it is put in the cache and there will be no further calls to the server. The administrators rely on a Mapinfo or Shape conversion tool. This converter is self-executable, very easy to use, and the conversion operation only takes a few seconds. Open base maps and launch the conversion, that's it! .swf files are generated and ready for use with Geoclip. Geoclip Database Model The database contains three types of tables that contain the following: Statistical data, one table per dataset and per geographical layer. Themes description and indicators definition. Assembly parameters and application page layout. These tables are created and edited with the Geoclip management module. The tables are imported into the database by the administrator from source data organized in a standard format (Excel, dbf, Access, etc.) Geoclip the Observatory Generator - 30/38 Extract from the model of a typical database: The s_xxx tables contain basic statistical data, the other tables contain the application parameters, themes, indicators, etc. Interoperability Geoclip supports several web services and standards: TJS (Table Joining Service) makes it possible to exchange geo-referenced statistical data on the internet. Google Maps, Géoportail (from IGN), OpenStreetMap, with automatic projection of geographical layers as necessary. Google Analytics to collect and fine-tune the usage and consultation statistics. WMS (Web Map Service) makes it possible to display images in a jpg or png format. Other standards will be supported in upcoming versions (CSW catalogues, Inspire, etc.) Security Geoclip security is always taken into account when developing the software at all levels: verification of values and received parameter types, user profile connection verification, injection controls (SQL, XSS, etc.), encrypted passwords, etc. Also of note, the server environment is kept up to date (namely php, apache/IIS, the database, etc.) and strict configurations make it impossible for non-authorized connection to break in from the outside. Geoclip the Observatory Generator - 31/38 5. Typical Project Building Steps Ergonomics and Functional Specifications The first specification document is validated before we start development. This cartographical charter will detail how the application will work (ergonomics): description of all graphical map components, their layout and the nature of interactions. If necessary it will take into account the constraints established by a previously existing graphical charter. This charter will be accompanied by the first version of a technical document that will describe the general architecture of the application, data organization and server technical characteristics. This document will be completed at the end of the project and will give the details of all software involved. If there are no constraints arising from the organization of the current information system, we will propose a technical solution that involves a database (for example MySQL), queried from the PHP script language. The database contains all data to be represented in the application as well as application management data. How to Prepare Base Maps The original base maps are supplied in the MapInfo or Shape format. Preparations include two main steps: To build various geographical layers: base maps that are the infrastructure of thematic analysis, layer for overlap (for example: major cities, roads network, rivers network, zones, etc.). Convert these layers to flash format directly. Base maps that need to be superimposed must have the same precision and projection. A simple naming rule is determined to facilitate the update and assembly of layers at various levels of geographical nomenclature. Modelling and construction of the database The data is provided in a standard exchange format (for example: Excel). The data will then be organized and optimized in the database format and completed with management tables unique to this application. It is important to insure that space nomenclature is coherent between statistical data and base maps. The data model describes precisely the database structure and the relationships between tables. Geoclip the Observatory Generator - 32/38 Specific Developments The Geoclip interface functionalities are enriched with time and new versions in order to bring new possibilities to end users and more comfort to the administrator. On top of the wide range of functionality that come standard with a Geoclip application, any additional functionality can be implemented specifically for customers to bring you an application that fits your needs perfectly. Project Phases Typically, a project has four steps: Specifications Development The application being developed will be regularly copied to a web server, accessible via the internet, to a specific address. Acceptance Testing Tests are conducted on how the application in development works and how administration tasks are handled. Delivery Delivery consists of a set of files: MySQL database, PHP scripts, Flash files compiled as swf, all described in a technical document. It also generally includes installation help or application management training. Geoclip the Observatory Generator - 33/38 6. References of Major Contributors A dynamic and performing team Eric Mauvière Training: Polytechnicien-ENSAE Professional experience: At Insee, I was in charge of studies and information diffusion at the regional headquarters of the Limousin region, then Midi-Pyrénées. Accustomed to managing studies and statistical studies, I emphasized the importance of the presentation of results via new publications that were attractive, took a global view, and used maps. Then I worked for two and a half years as the manager of the ARH Midi-Pyrénées in charge of information systems where I was able to learn in depth about the health field, and where I developed web sites for internet and intranet use. As the creator and manager of emc3, I work to develop data access via publications, internet sites, a strong emphasis on cartography, and as an advisor for information systems organization. From its birth in 2003, the Geoclip framework has become a reference in the area of interactive statistical cartography. Isabelle Coulomb Training: ENSAE Paris Tech and ETPA (Photography and Digital Arts Academy) in Toulouse, Advanced Technician Certificate in the fields of Computer Graphics and Multimedia. Professional experience: statistician at the Insee. Research officer, field survey manager, diffusion tools and products manager (at the regional offices of Picardie and Midi-Pyrénées and at the Midi-Pyrénées regional agricultural statistical office, SRSA). Insee national trainer in the areas of cartography, the development of automatic cartography applications, cartographical semiology, editor-in-chief of regional publications at the Picardie Insee and at the Midi-Pyrénées SRSA, design project manager for the BIP CD, a digital publications library. Since Oct 2000 has been working as a statistician, cartography and computer graphics, www.geoclip.fr webmaster, and communications director for emc3. Geoclip the Observatory Generator - 34/38 Yannick Lafont Training: DUT in Computer Science at the IUT of Limousin, then IUP NTIE in Computer Science at the University of Toulouse. Working on his fifth year in a Master 2 NTIE program. Professional experience: at first I worked for a service company in Toulouse and for two years I developed an accounting software package for small and medium size business. I was hired at emc3 in September 2005. For one year I worked there part-time, now I am full time. My objective is to reinforce the team with my knowledge of design and interactive cartography software development. Thibault Heinrich Training: Telecom Saint-Étienne, and an exchange year with the University of Quebec in Montreal. Initially trained in the newest computer technologies, I discovered cartography in Quebec. Computer technology and cartography naturally led me to Geoclip. Employed full-time since September 2009 upon completing my practicum, I bring technical and communication skills to the team. Elodie Bergonnier Training: INSA in Toulouse (Applied Sciences), then followed by an exchange program at the Ecole Polytechnique de Montréal (Quebec). Professional experience: after my training in applied statistics, I became involved with two cartography projects during my practicum. From these experiences I was able to see that cartography follows from statistics. After working for 3 years as a statistics research officer and geomarketing at a polling company, I consolidated my experience in data validation. Since starting at emc3 in June 2010, I have worked on communications and Geoclip product development. Geoclip the Observatory Generator - 35/38 Productions Geoclip Server V2 Sister interactive cartography application for the Regional council of Basse- Normandie (https://sister.crbn.fr/). Interactive cartography application for the General council of Finistère (atlas-finistere.cg29.fr) and the General council of Gers (https://www.carto32.fr/geoclip/). Collaborative cartography (intranet) applications for the General council of Languedoc-Roussillon, the data control services of the Pays de Savoie, the General council of Aube, the General council of Gironde. Interactive cartography, statistics and geography applications Géoïdd, for the observatory and statistical services of the ministry of ecology, energy, durable development and planning (www.statistiques.developpement-durable.gouv.fr/cartographie/ article/cartographie-interactive-geoidd-france.html). Interactive cartography application for the Coast Observatory (Observatoire du littoral) on behalf of the Ministry of Ecology observation and statistics services (formerly known as Institut français de l’environnement) (www.littoral.ifen.fr/Cartographie.6.0.html). "Indicateurs", the interactive cartography application of the Territories Observatory of the Datar (www.territoires.gouv.fr/observatoire-des-territoires/fr/node) which allows for the observation of several thousands of indicators at the regional, national and European levels. Thematic cartography of the "local statistics" portal of the Insee (www.statistiqueslocales.insee.fr/esl/accueil.asp). Production of the local implantation diagnostic tool (Odil) for Insee (www.insee.fr/fr/publics/default.asp?page=entreprises/odil.htm). Production of the regional health information system (Sirsé) in the Paca region on behalf of the health regional observatory (www.sirsepaca.org). Cartography of health supply in Ile-de-France (www.soignereniledefrance.org) for the regional union of doctors in private practice in the Ile-de-France. National and regional applications of Cartostats cartography for the French Youth and Health Minister (intranet). Production of an economy observatory in Midi-Pyrénées for the Regional Chamber of Commerce and Industry of Midi-Pyrénées (www.obseco.fr). Production of an economy and social issues observatory Ores for the Sem of the Pays de la Loire (http://ores.paysdelaloire.fr/). Production of the Cartobenef application for the Agency of Services and Payments (Agence de Geoclip the Observatory Generator - 36/38 Services et de Paiement) about the beneficiaries of European funds (http://cartobenef.asppublic.fr/cartobenef/). Production of the Géoss application for POSS-LR, the health and social protection observation platform of Languedoc-Roussillon (http://www.poss-lr.net/geosaccueil_POSS-LR.php). Production of the Sagess-pro application for the Regional Chamber of social and solidarity economy (Chambre régionale de l’économie sociale et solidaire) of the Paca region (www.sagess.pro/). Cartography of the Parhtage national project (www.parhtage.sante.fr) : healthcare supply, eHealth, healthcare restructuring for the Ministry of Health. Cartography about medical demography for the network of regional unions of disability insurance companies (www.ars.sante.fr/C-rtoSante.92760.0.html). Interactive intranet cartography application for the management of regional and departmental services of agriculture, the environment, and infrastructure of Midi-Pyrénées www.geomip.fr (password protected). Interactive cartography applications for the management of regional infrastructure of the Limousin and Lorraine regions. Geoclip Server application for the regional observatory of employment, training and qualifications of the Lorraine region (www.orefq.fr/rubrique.php?uid=54). Production of an updated dashboard on employment policies (www.travail-emploi- sante.gouv.fr/spip.php?page=article&id_article=7395) for Dares (Direction de l’Animation de la Recherche, des Etudes et des Statistiques) for the Ministry of employment. Cartography and dashboard of the medico-social offer for handicapped persons of the Drass of Ilede-France. Interactive cartography application of major risks in the Tarn department (www.tarn.gouv.fr/Cartographie-des-risques,914). Cartography analysis tools and geo-marketing for major private national chains (banks, food distributors, radio stations). Production of an interactive atlas of the Pyrenees on behalf of the statistical institutes of the Pyrenees regions: Aquitaine, Midi-Pyrénées, Languedoc-Roussillon, Catalogne, Andorre, Aragon, Navarre, Pays Basque (http://atlas.ctp.org/site_fr/index_fr.php). Construction of a health profile tool « Health Profiles » for the SPH-NHS in England, the group in charge of public health tools development (www.localhealth.org.uk). Production of an online cartography module for the New York State Council on Children and Family, as part of its website Kids’ Well-being Indicators Clearinghouse (www.nyskwic.org/data_tools/map_builder.cfm). Production of a cartography module of the internet portal of the statistical institute of Geoclip the Observatory Generator - 37/38 Luxembourg (www.statistiques.public.lu/stat/NavMaps/navMap.aspx?IF_Language=fra). Production of a cartography database about communities for the Canadian ministry of agriculture (www.cid-bdc.ca). Production of interactive atlases for the Canadian council on apprenticeship: interactive map of the composite index of apprenticeship (www.cli-ica.ca/fr.aspx and literacy maps (www.ccl- cca.ca/CCL/Home/index-2.html). Statistical atlas of the canton of Vaud (www.scris.vd.ch/cartostat), statistical atlas of the canton of Neuchâtel (www.ne.ch/cartostat), statistical atlas of the state of Geneva, statistical atlas of the city of Basel (www.statistik-bs.ch/karten), Switzerland. Online interactive cartography tools for the geography institute of the University of Lausanne (www.unil.ch/igul/page64582.html), Switzerland. Geoclip O3 Cartography dissemination tools for the 2010 agricultural census published on the Agerste site of the statistical and prospective services of the Ministry of Agriculture (www.acces.agriculture.gouv.fr/cartostat/). Cartography space of the Moroccan Industry Observatory (OMI), published by the Moroccan industry ministry, presenting the results of the annual survey of businesses in the Moroccan hospitality industry (www.omi.gov.ma/Espacecartographie/Pages/Presentation.aspx). Update and upgrade of CartoStats, the statistical cartography tool launched a few years ago as an intranet for the municipal services of the Urban community of Greater Toulouse and partners. Other examples of our productions are presented on www.geoclip.fr, as well as Geoclip template demonstration applications about France organized by municipality (France découverte: france.geoclip.fr). European data is organized by Nomenclature of Territorial Units for Statistics, world data by country, USA data by state and county, and England and Wales data by census area. Projects In Production A cartography application for the Opsa project, the Trans-Alp observatory for the promotion of health, a French-Italian project based on four border regions, for the publication of comparative indicators on public health. Publication of a statistical cartography tool for the publication of an observatory of society and the economy for the Pyrenees SIG-Pyrénées www.sig-pyrenees.net. The new version of the cartography of the territory observatory of Datar. The new version of the Cartostats application of the ministry in charge of sports. Geoclip the Observatory Generator - 38/38