report of the broadcast of northern lights 2013 - Sky

Transcription

report of the broadcast of northern lights 2013 - Sky
REPORT OF THE BROADCAST OF
NORTHERN LIGHTS 2013
CREDITS
The Seventh Framework Programme of the European Union (EU, FP7/2007-2013,
INFRASTRUCTURES-2011-2, INFRA-2011-1.2.1: e-Science environments) has promoted the
broadcast under the GLORIA – “Global Robotic telescopes Intelligent Array for e-Science”
project (Grant Agreement – Number 283783).
INFRASTRUCTURE
1.- Broadcasting Web Portal.
The infrastructure deployed by CanarCloud (www.canarcloud.es) was based on a VMware
vSphere Cluster 5 (www.canarcloud.es/vmware/), based on an Intel Nehalem architecture
interconnected to an iSCSI RAID centralized storage system capable of supporting the load of
thousands of petitions against the broadcasting portal, with a DNS balancer, which
interconnected all web instances, both physical and virtual, of all the partners, ensuring
equitable load sharing of all website visits.
REPORT OF TECHNICAL BROADCAST OF AURORAS 2013
REPORT BY ALEJANDRO HERNÁNDEZ GALTIER ON BEHALF OF CANARCLOUD (WWW.CANARCLOUD.ES) FOR GLORIA
1
This architecture operated as follows:
●
Clients made a request to the broadcasting website, designed so that its size (in bytes)
was minimized.
● A load balancing system decided which server in the cluster should answer each
incoming request.
● The client was dealt with by the server selected by the load balancing system.
Web Partners
Assistance was requested from public and private institutions, associations, foundations, etc. to
aid in the dissemination via the Internet of the broadcast portal (live.gloria-project.eu) in an
attempt to prevent collapse due to an overload of requests.
Basic Web Collaborators
In this type of collaboration, the institution, organization, association, etc. temporarily attached
a machine or set of machines to the cluster. These machines, grouped together, served the
web portal with all the contents of the broadcast.
●
●
●
Gloria Project [1 web server] www.gloria-project.eu
The Centre of Serveis científics i acadèmics de Catalunya [1 web server] www.cesca.cat
TOTAL [2 web servers]
Advanced Web Collaborators
REPORT OF TECHNICAL BROADCAST OF AURORAS 2013
REPORT BY ALEJANDRO HERNÁNDEZ GALTIER ON BEHALF OF CANARCLOUD (WWW.CANARCLOUD.ES) FOR GLORIA
2
Collaborators with one or more machines compatible with VMware vSphere 5 with more than 4
GB of RAM, more than 4 cores, 3 or more IPs and a bandwidth of 100 Mbps or more have
collaborated to integrate these machines as remote nodes of the cluster.
●
●
●
●
●
CanarCloud [1 cluster vSphere 5 + 2 nodes + 2 VPS] www.canarcloud.es
Chile University [1 node vSphere 5 + 1 VPS] www.uchile.cl
University College Dublin [1 node vSphere 5 + 1 VPS] www.ucd.ie
Instituto de Astrofísica de Canarias [1 node vSphere 5 + 2 VPS] www.iac.es
TOTAL [6 VPS]
Websites with embedded player
Along with the previous contributors, additional websites requested the addition of a player
for their websites, taking our video signal, but independently supporting the web visits.
●
SINC Agency
www.agenciasinc.es/Retransmisiones/EN-DIRECTO-Auroras-boreales-desde-Groenlan
dia-2013
● Canarias7.es www.canarias7.es/auroras2013.cfm
● Yahoo.es www.yahoo.es
2.- Video Streaming.
The infrastructure deployed by CanarCloud (www.canarcloud.es) is based on a cluster of
instances of Wowza 3.6.2. on Amazon Elastic Compute Cloud (Amazon EC2) in a configuration of
multi-repeaters along with the DNS balancer, which will interconnect all repeater instances to
support up to 5,000 simultaneous visits, ensuring equitable sharing of the load from all visits
among all instances.
REPORT OF TECHNICAL BROADCAST OF AURORAS 2013
REPORT BY ALEJANDRO HERNÁNDEZ GALTIER ON BEHALF OF CANARCLOUD (WWW.CANARCLOUD.ES) FOR GLORIA
3
The performance of this architecture is as follows:
Streams Generation
● Live – (24th -29th August) – Video stream from the Sky (00:30-01:30 UT, 02:30-03:30
CET)
○ Every day from our installation in Spain we connect directly to a Mobotix
WebCam with Night Vision located in Greenland obtaining a signal "MJPEG,
320x240, 1fps" and converting it to "H264, 320x240, 15fps"
○ The final signal was sent to the instance auroras2013.canarcloud.tv for
distribution through the CDN (Computer Data Network).
● Timelapses
○ Different channels with timelapses created in some broadcasts, from previous
days or from past expeditions.
Live through the portal of the broadcast
● The users who accessed the portal of the broadcast (live.gloria-project.eu) found a
player that obtained the signals from each channel making a request to
auroras2013.gloria-project.eu
● Users could also connect directly to auroras2013.gloria-project.eu, assuming they
had the correct player.
● A load balancing system decided which of all instances that were part of the cluster
attended each request for access in auroras2013.gloria-project.eu.
REPORT OF TECHNICAL BROADCAST OF AURORAS 2013
REPORT BY ALEJANDRO HERNÁNDEZ GALTIER ON BEHALF OF CANARCLOUD (WWW.CANARCLOUD.ES) FOR GLORIA
4
●
The client was served by the repeater instance selected by the load balancing system.
Live through the Partners
● The partners with their own infrastructure obtained the video relay signal directly from
a reserved instance in the CDN and redistributed it using their own infrastructure so
that viewers could access the broadcast directly through the websites of these
collaborators.
● Those partners who did not have their own infrastructure for Video Relay or, for
technical problems, could not connect that infrastructure to ours, could apply to use
their own infrastructure, reserving a % of it depending on the expected number of
visitors.
Video Collaborators
Wowza Collaborators
Partners with one or more machines compatible with VMware vSphere 5 with more than 4 GB
of RAM, more than 4 cores, 3 or more IPs and a bandwidth of 1 Gbps collaborated integrating
these machines as remote nodes of the cluster and allowing the deployment of 3.6.2 Wowza
instances joining those deployed by CanarCloud.
●
CanarCloud [CDN consisting of m1.large Wowza Amazon EC2 instances]
www.canarcloud.es
Televisions and Repeaters
Partners with their own Live-Stream infrastructure have redeployed our signal through their
web portals or television:
●
●
CanarCloud Blog www.canarcloud.tv/blog/2013/08/22/auroras-boreales-2013
Sky-Live.TV www.sky-live.tv
REPORT OF TECHNICAL BROADCAST OF AURORAS 2013
REPORT BY ALEJANDRO HERNÁNDEZ GALTIER ON BEHALF OF CANARCLOUD (WWW.CANARCLOUD.ES) FOR GLORIA
5
STATISTICS
1.- Web Portal broadcasting
To obtain statistics of visits to the broadcasting web portal (live.gloria-project.eu), Google
Analytics was enabled. This allowed collection of global data from the portal and the Awstat
collector was used to analyze the contribution of each partner.
The period analyzed includes visits from the 23rd (0h UT) to the 30th (0h UT) of August, 2013.
Google Analytics
Under this service we can see that in the analyzed period we obtained 69.201 visits and
124.166 page views, as shown in the following graph .
Top 10
Country of Origin
Spain
Chile
Mexico
Portugal
Uruguay
Poland
Argentina
United States
Costa Rica
Colombia
37,95%
16,49%
9,75%
7,66%
4,92%
2,85%
2,46%
2,10%
1,99%
1,86%
Browser
Chrome
Firefox
Safari
Internet
Explorer
Android
Browser
Safari (in-app)
Opera
BlackBerry
Opera Mini
Maxthon
41,41%
17,35%
15,69%
12,44%
6,89%
3,95%
1,04%
0,32%
0,26%
0,18%
Operating System
Windows
63,11%
iOS
15,51%
Android
10,20%
Macintosh
8,05%
Linux
2,21%
Windows
0,35%
Phone
BlackBerry
0,35%
(not set)
0,09%
SymbianOS
0,05%
Nokia
0,02%
REPORT OF TECHNICAL BROADCAST OF AURORAS 2013
REPORT BY ALEJANDRO HERNÁNDEZ GALTIER ON BEHALF OF CANARCLOUD (WWW.CANARCLOUD.ES) FOR GLORIA
6
Analyzing data from the separate broadcast of each night, we get the following results:
●
Range 23 (0h UT)-25 (0h UT). 24 August broadcast
○
○
●
Range 24(0h UT)-26 (0h UT). 25 August broadcast
○
○
●
Broadcast: A maximum of 2.017 visits and 3.827 page views.
Out of broadcast: A maximum of 1.300 visits and 2.221 page views.
Broadcast: A maximum of 2.132 visits and 5.498 page views.
Out of broadcast: A maximum of 2.017 visits and 3.827 page views.
Range 25(0h UT)-27 (0h UT). 26 August broadcast
○
○
Broadcast: A maximum of 1.035 visits and 2.878 page views.
Out the broadcast: A maximum of 2.132 visits and 5.498 page views.
REPORT OF TECHNICAL BROADCAST OF AURORAS 2013
REPORT BY ALEJANDRO HERNÁNDEZ GALTIER ON BEHALF OF CANARCLOUD (WWW.CANARCLOUD.ES) FOR GLORIA
7
●
Range 26(0h UT)-28 (0h UT). 27 August broadcast
○
○
●
Range 27(0h UT)-29 (0h UT). 28 August broadcast
○
○
●
Broadcast: A maximum of 599 visits and 1.260 page views.
Out of broadcast: A maximum of 1.035 visits and 2.878 page views.
Broadcast: A maximum of 641 visits and 1.305 page views.
Out of broadcast: A maximum of 735 visits and 1.173 page views.
Range 28(0h UT)-30 (0h UT). 29 August broadcast
○
○
Broadcast: A maximum of 382 visits and 805 page views.
Out the broadcast: A maximum of 735 visits and 1.173 page views.
Awstat
According to the statistics collection tool, Awstat, locally installed in most of the web partners,
we can see the contribution of each of the collaborators to the total percentage of hits, pages
REPORT OF TECHNICAL BROADCAST OF AURORAS 2013
REPORT BY ALEJANDRO HERNÁNDEZ GALTIER ON BEHALF OF CANARCLOUD (WWW.CANARCLOUD.ES) FOR GLORIA
8
and broadcast traffic.
Totalling the data obtained from those collaborators with Awstat installed, we note that the
portal live.gloria-project.eu has received 119.248 visits and 3.987.360 page views, providing
80,12 GBytes of data.
Web sites with an embedded player (own or assigned)
If we analyze the data provided by those collaborators who have publicized the event in their
own web pages using both our player as their own infrastructure we find the following
information:
CanarCloud Blog (www.canarcloud.tv/blog/2013/08/22/auroras-boreales-2013)
Through the CanarCloud Blog 227 visits and 312 page views were obtained.
Analyzing data from each night of the broadcast separately, we get the following:
●
●
●
●
●
●
Night 23-24 - A maximum of 6 visits and 9 page views.
Night 24-25 - A maximum of 23 visits and 27 page views.
Night 25-26 - A maximum of 23 visits and 25 page views.
Night 26-27 - A maximum of 7 visits and 9 page views.
Night 27-28 - A maximum of 1 visits and 1 page views.
Night 28-29 - A maximum of 1 visits and 1 page views.
REPORT OF TECHNICAL BROADCAST OF AURORAS 2013
REPORT BY ALEJANDRO HERNÁNDEZ GALTIER ON BEHALF OF CANARCLOUD (WWW.CANARCLOUD.ES) FOR GLORIA
9
Sky-Live.TV (www.sky-live.tv)
Through Sky-Live.TV 21.286 visits and 26.794 page views were obtained.
Analyzing data from each night of the broadcast separately, we get the following:
●
●
●
●
●
●
Night 23-24 - A maximum of 826 visits and 1080 page views.
Night 24-25 - A maximum of 1120 visits and 1844 page views.
Night 25-26 - A maximum of 310 visits and 519 page views.
Night 26-27 - A maximum of 224 visits and 286 page views.
Night 27-28 - A maximum of 120 visits and 177 page views.
Night 28-29 - A maximum of 106 visits and 183 page views.
SINC Agency
(www.agenciasinc.es/Retransmisiones/EN-DIRECTO-Auroras-boreales-desde-Groenlandia-2
013)
Through the portal of the SINC Agency 2.617 visits and 3.695 page views were obtained.
Analyzing data from each night of the broadcast separately, we get the following:
●
●
●
●
●
●
Night 23-24 - A maximum of 566 visits and 865 page views.
Night 24-25 - A maximum of 566 visits and 796 page views.
Night 25-26 - A maximum of 1020 visits and 1354 page views.
Night 26-27 - A maximum of 264 visits and 394 page views.
Night 27-28 - A maximum of 117 visits and 173 page views.
Night 28-29 - A maximum of 84 visits and 113 page views.
Canarias7.es (www.canarias7.es/auroras2013.cfm)
Through the portal of Canarias7.es 1.319 visits and 1.492 page views were obtained.
Analyzing data from each night of the broadcast separately, we get the following:
●
●
●
●
●
●
Night 23-24 - A maximum of 212 visits and 238 page views.
Night 24-25 - A maximum of 464 visits and 528 page views.
Night 25-26 - A maximum of 308 visits and 341 page views.
Night 26-27 - A maximum of 193 visits and 225 page views.
Night 27-28 - A maximum of 136 visits and 154 page views.
Night 28-29 - A maximum of 6 visits and 6 page views.
2.- Video Streaming.
To obtain live statistics, CanarCloud has developed a collection service, REST, that monitors
each of the Wowza instances at one minute intervals.
According to this service, we can see that during the 5 retransmissions a total of 11.426 visitors
REPORT OF TECHNICAL BROADCAST OF AURORAS 2013
REPORT BY ALEJANDRO HERNÁNDEZ GALTIER ON BEHALF OF CANARCLOUD (WWW.CANARCLOUD.ES) FOR GLORIA
10
connected to the live broadcast, of which 1.248 visitors simultaneously observed any
broadcast, reaching a maximum total bandwidth of 134,53 MBps and a data traffic of 48,30
GB.
Televisions and Repeaters
Because the SINC Agency as Canarias7.es and Yahoo.es asked for a percentage of our CDN to
distribute our signals through each of the partners’ portals, the above statistics encompass
these visitors.
If we break down the data obtained according to the source from which the signals were
consumed in each of the broadcasts, we obtain the following data:
Night Broadcast 24-25
Night Broadcast 25-26
REPORT OF TECHNICAL BROADCAST OF AURORAS 2013
REPORT BY ALEJANDRO HERNÁNDEZ GALTIER ON BEHALF OF CANARCLOUD (WWW.CANARCLOUD.ES) FOR GLORIA
11
Night Broadcast 28-29
TOTAL and COMPARATIVE
Web Event
Video
Visits
144,747
11,426
Maximum
2132
1248
Figure 1.- Comparative visits to the website of the broadcasting of the various events: TSE-2010 (Total Solar Eclipse,
11th July 2010, from Easter Island), TLE-2010 (Total Lunar Eclipse, 20 December 2010, Teide ), TLE-2011 (Total Lunar
REPORT OF TECHNICAL BROADCAST OF AURORAS 2013
REPORT BY ALEJANDRO HERNÁNDEZ GALTIER ON BEHALF OF CANARCLOUD (WWW.CANARCLOUD.ES) FOR GLORIA
12
Eclipse, 15 June 2011, Teide), NL-2011 (Northern Lights, August 2011, Greenland), VT-2012 (Venus Transit, 6 June
2012, Australia/Japan/Norway), NL-2012 (Northern Lights, August 2012, Greenland), TSE-2012 (Total Solar Eclipse, 13th
November, 2013, Australia), NL-2013 (Northern Lights, August 2013, Greenland).
REPORT OF TECHNICAL BROADCAST OF AURORAS 2013
REPORT BY ALEJANDRO HERNÁNDEZ GALTIER ON BEHALF OF CANARCLOUD (WWW.CANARCLOUD.ES) FOR GLORIA
13