English Manual Template

OPERATION
MANUAL
TabulaTrack
optical object tracker for live graphics
enhancement
Version 1.0
© 2008 TrackMen Ltd. All rights reserved. Except as otherwise permitted by TrackMen Ltd., this publication, or parts
thereof, may not be reproduced in any form, by any method, for any purpose.
Disclaimer
THIS PUBLICATION AND THE INFORMATION CONTAINED HEREIN IS MADE AVAILABLE BY
TRACKMEN Ltd. "AS IS." TRACKMEN LTD. DISCLAIMS ALL WARRANTIES, EITHER EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO ANY IMPLIED WARRANTIES OF MERCHANTABILITY
OR FITNESS FOR A PARTICULAR PURPOSE REGARDING THESE MATERIALS.
Published by:
TrackMen Ltd.
Foerstchen 12
D-42799 Leichlingen
Germany
Table of Contents
TabulaTrack ..................................................................................................................................1
Getting started with TabulaTrack ..................................................................................................2
General Concept .......................................................................................................................2
1. Initial Operation.........................................................................................................................4
1-1. Hardware Preparations ......................................................................................................4
1-2. License Configuration ........................................................................................................5
1-3. Network Configuration .......................................................................................................8
1-4. Data Output Configuration ...............................................................................................10
1-5. Video Configuration .........................................................................................................12
1-6. Configuration Management..............................................................................................13
2. Daily Operation .......................................................................................................................14
2-1. Chroma Key Adjustment ..................................................................................................14
2-2. Multiple Tabulas...............................................................................................................18
2-3. Display .............................................................................................................................19
3. Advanced Configuration..........................................................................................................20
3-1. Object Tab .......................................................................................................................20
3-2. Mode Tab.........................................................................................................................25
4. General Notes.........................................................................................................................28
TabulaTrack
TabulaTrack offers an intuitive technique to present any graphics or video in a unique way during
live broadcasts. Using the camera video picture only, TabulaTrack automatically tracks a
single-coloured Tabula of any size, called the Tabula, inside your video picture in real-time and
transmits it to a live graphics system.
This enables the live graphics system to display any 2D or 3D graphics or live video exactly within
this frame, even during movements of the camera or the object. The talent can even hold, rotate,
move or carry the graphics with the help of the real board.
Especially for electronic news gathering outside a well-prepared studio environment TabulaTrack
immediately turns the Tabula into a video screen of any size or shape, with no time for set-up or
calibration. Even if the camera or the presenter moves, the virtual screen does its job.
Original camera picture
Live presentation with TabulaTrack
1
Getting started with TabulaTrack
TabulaTrack is always preinstalled on the delivered PC hardware. After booting or rebooting the PC
the Online Level appears automatically.
General Concept
The general concept of the TabulaTrack Graphical User Interface (GUI) offers three different
levels:
•
•
•
Online Level
Configuration Level
Advanced Configuration Level
The Online Level is the standard mode during operation. It automatically starts after start up or
reboot. For real-time productions this level should be used only. Please be aware that at this
level the displayed screen always freezes for performance reasons. To display the input video
you open the Configuration level. If you do not use the user interface for more than 1 minute,
TabulaTrack will automatically switch back to the Online Level in order to prevent on-air
failures.
The Configuration Level allows you to check the proper functionality of TabulaTrack in front of
a production or for the daily usage. If the camera settings, the light or the studio environment are
changed, the input picture of TabulaTrack will change as well. Depending on the amount and
style of the changes, it might be necessary to adopt TabulaTrack accordingly.
2
The Advanced Configuration Level is needed only for the initial setup of TabulaTrack and
fundamental configurations.
3
1. Initial Operation
This chapter explains the initial installation of TabulaTrack step by step.
The TabulaTrack software is pre-installed already.
If the TabulaTrack soft- and hardware is installed once, usually you do not need to change it’s
settings for the regular production within the same studio. You need the Configuration Level only.
1-1. Hardware Preparations
camera
camera
signal
TabulaTrack
PC
network
graphics
computer
Video Input
TabulaTrack requires a video input signal of the employed camera. Depending on the type of
the video signal, you must provide an adequate signal to the BNC connector of the video
input card at the TabulaTrack PC.
For the proper operation of the software it is mandatory that you feed the camera signal
directly to the TabulaTrack PC without any signal delay! Otherwise the generated tracking
data and therewith the keyed graphics are delayed as well.
Data Output
TabulaTrack transmits the calculated tracking data to the graphics computer. A regular
10/100 Mbit Ethernet (IEEE 802.3) network connection and a standard TCP/IP- and
UDP/IP-protocol (RFCs 793, 791 and 768) are used.
The TabulaTrack PC must be connected to all graphics computers which should receive the
tracking data. Multiple computers could receive the full data set at the same time. It is
possible to send the data to a broadcast address instead of a single IP address.
For real-time productions it is highly recommended to build up an exclusive network between
the TabulaTrack PC and all receiving graphics computers.
In order to receive the tracking data properly please see the manual of your graphics
software for details.
4
1-2. License Configuration
Configuration > Advanced Configuration > License Update
You use this menu to check the validity of your license and to update your time limited license.
After the initial turn on and boot the following screen appears.
Fig.1
The TabulaTrack software is protected against piracy by a hardware USB dongle.
If TabulaTrack could not detect a valid dongle, the following message will be displayed:
License = 0
To operate TabulaTrack, the USB dongle needs to be plugged to an USB port on the backside
of the TabulaTrack PC. This dongle should remain at this plug at all times, even during
shutdown and boot.
If the dongle holds a valid license the license number will be displayed.
It could take up to 15 seconds for TabulaTrack to detect the dongle.
5
Fig 2
There are two different kinds of licenses, temporally limited and unlimited licenses. For limited
licenses the number of remaining days to operate TabulaTrack is displayed.
If the dongle is plugged to the TabulaTrack PC, but the license is still displayed as not valid,
please go to License Management at the Configuration Level.
Fig 3
6
In order to extend a temporally limited license you need to replace the license with an unlimited
one. You first need to create a license authentification file. This file contains a unique description
of your employed soft- and hardware and is mandatory to generate any type of licenses.
Procedures
To update your license:
1 Press Create License Authentification file
2 You will be asked to plug in an USB memory stick with free memory available.
3 Now TabulaTrack automatically writes the License Authentification file to this USB
memory stick.
4 Send this file to the FOR-A reseller by email.
5 FOR-A sends back your new license.
6 Copy the new license file to an USB memory stick.
7 Plug this USB memory stick into the TabulaTrack PC.
8 Click Update License.
9 TabulaTrack installs the new license automatically.
10 Click Exit to leave the License Manager.
TIP
Check if the new license is displayed at the Online Level.
7
1-3. Network Configuration
Configuration > Advanced Configuration > Network Setup
You use this menu to configure the network settings of the TabulaTrack PC.
IMPORTANT
The TabulaTrack PC must share the same network with the graphics computer. Other
clients should be avoided.
Fig 4
Procedures
To configure the network address:
1 enter the desired IP address at Static, IP Address
2 enter the desired Subnet Mask; usually 255.255.255.0
3 Optional: Type in the desired Gateway and Name Server
4 click Apply
5 click Exit to leave the menu
IMPORTANT
It is recommended to use static IP addresses instead of using DHCP. In this case the
correlated check box at Dynamic must be deactivated.
8
Fig 5
TIP
After you finished the network configuration, please make sure to press Apply, otherwise
just using Exit to leave the network setup will discard all changes.
The new network setup is now displayed at the online level as well.
9
1-4. Data Output Configuration
Configuration > Advanced Configuration > Data Out
TabulaTrack transmits the calculated tracking data to the graphics computer. You use this
menu to configure the network setting for the tracking data destinations.
Fig 6
Procedures
1 Click New. A dialog appears that allows you to configure the network settings.
2 Enter the IP address of the receiving graphics computer.
3 Enter the UDP port number of the receiving graphics computer.
See manual of the employed graphics package for details.
4 Click OK to save the settings or click cancel to leave the menu without changes.
Edit
Allows editing of existing entries; destinations must be selected first
Delete
Deletes selected destinations
10
Up/Down
Changes the order of the destinations. First entry will be sent first. Because the time
difference is very small, in general one could say that they will be nearly sent at the same
time.
TIP
If you are going to use multiple machines which should receive the tracking data, it is
also possible to type in a broadcast address instead of multiple IP address of single
machines.
11
1-5. Video Configuration
Configuration > Advanced Configuration > Video In
You use this menu to configure the Video Input of the TabulaTrack PC.
Fig 8
Procedures
To configure the video input:
1 click the desired video input format
2 the video input signal appears immediately at the video screen within this menu
IMPORTANT
All grey entries are not accessible with the installed video grabber card. In case you like to
use those formats, please contact TrackMen for a hardware update.
IMPORTANT
Please also make sure to choose the correct connector type. Analog formats might require
two or three plugs and the breakout cable.
Going back to the online level you will be asked to save all changes. These configurations could
be managed at the Configuration level.
12
1-6. Configuration Management
> Configuration
You use this menu to manage existing configuration settings.
Procedures
To load existing settings:
1 click the pull down menu at Current Configuration
2 choose the desired configuration
TIP
TabulaTrack is preinstalled with the factory settings. Those settings will not
completely match your studio environment.
Procedures
To edit existing configuration files:
1 click Manage Configurations
2 create new configuration names, rename or delete existing files
Now the Online Level should not show any further error messages.
Fig 9
13
2. Daily Operation
For the daily production, usually TabulaTrack operates unchanged.
But if the camera settings, the light or the studio environment are changed, the input picture of
TabulaTrack will change as well. Depending on the amount and style of the changes, it might be
necessary to adjust TabulaTrack accordingly.
The Configuration level of the TabulaTrack user interface is designed for the regular configurations
in order to adapt TabulaTrack to a changed environment.
IMPORTANT
During real-time productions the Online Level has to be used only.
2-1. Chroma Key Adjustment
> Configuration
You use procedures below to adjust the Chroma Key to the actual video input.
Procedures
1 Prepare the production as usual: light the studio properly, adjust and match all cameras,
use the Tabula you are going to use for the production
2 Place the Tabula and camera at a typical situation as it is used during the production
Fig 10
3 Set Tolerance to 0
4 Switch the video display mode to Keyed
5 Start with Chroma Keying > Hue: adjust the hue value as long as the Tabula gets as dark
as possible. Please keep in mind that it will never get black!
14
TIP
The Ideal starting value for a blue board is 240 and 120 for a green board.
Fig 11
6 Proceed with Chroma Keying > Tolerance: start to adjust the tolerance value at zero and
increase the value slowly as long as the noise disappears. Non blue/green objects like the
background should appear separated from the TabulaTrack board.
15
Fig 12a
7 Switch the video display mode to Binarized
8 With Binarizing > Threshold: start to adjust the threshold value at zero and increase the
value slowly as long as the Tabula is the completely black and non blue/green objects like
the background appear separated.
Fig 13
16
If you set the threshold value to low, the keying fails at darker areas. Typically when tilting down
the Tabula, the studio lights do not light the Tabula well enough. Then usually noise appears as
shown below.
Fig 13a
In such cases you should enlarge the Threshold value as long as the noise disappears and you
could see the whole Tabula area as a solid rectangle.
Fig 13b
17
The final adjustment should look like the following picture: all four edges of the Tabula are
detected properly and marked with white lines.
Fig 14a
2-2. Multiple Tabulas
For this version of TabulaTrack, up to two different coloured Tabulas can be tracked at the
same time. The standard green or blue colour which is usually used for Chroma Keying is highly
recommended as the Tabula colours.
Procedures
1 Choose one colour for the first Tabula
2 Choose Keyer 0 and choose On in order to enable it
3 Adjust the keying for the first Tabula as described in section 2-1. “Chroma Key
Adjustment.”
4 Choose a different colour for the second Tabula
5 Choose Keyer 1 and choose On in order to enable it
6 Adjust the keying for the second Tabula as described in 2-1. “Chroma Key Adjustment.”
IMPORTANT
If you are using two Tabulas and Complete, both Tabulas must have the same
dimensions. Otherwise the completion fails.
18
2-3. Display
In order to judge the quality of your adjustments you can display some graphical elements.
Points
Displays a coloured rectangle around each detected Tabula corner. Each corner rectangle has a
different colour.
Lines
Displays white lines along the Tabula edges. Those lines are extended to infinity in order to
detect noise and other artefacts more easily.
3D Cube
Displays a simple wire-frame cube with the Tabula as it’s base. This three-dimensional object
can be used in order to judge the quality of the three-dimensional data.
Edges
Displays the Tabula edges itself. Each edge has a different colour. Edge pixels which are not
taken into account are displayed in red.
19
3. Advanced Configuration
Configuration > Advanced Configuration
You may use this menu to adapt TabulaTrack to different environments and situations.
Part of the Advanced Configuration level was already described during the initial setup. Therefore
here the missing items are described only.
Fig 15
3-1. Object Tab
Configuration > Advanced Configuration > Object
You may adjust some of the parameters for the object detection. But in general these values are
well defined and the operator does not need to change it.
Minimum Cluster Size
Sets the minimum number of adjacent pixels building an object/cluster. If multiple objects with
the same colour like the Tabula are in view, the largest cluster will be tracked as the Tabula (see
Fig 16a).
If you set the Tabula value to high, the Tabula cannot be detected (see Fig 16b).
Standard value is 1000. Dimension is pixel.
20
Fig 16a
Fig 16b
21
Minimum Cluster Gap
Sets the minimum gap between objects/cluster to be observed separately. Especially for noisy
situations, the picture of the TabulaTrack board will remain as one object for higher values.
Standard value is 8. Dimension is pixel. Range is between 1 and the full resolution of the used
video format.
Center Distance
Sets the minimum distance of a detected edge towards the centre of the Tabula in order to be
taken as the real Tabula edge. If objects or the hand or arm of the moderator partly occludes the
Tabula, it may happen that TabulaTrack detects this object edge as a wrong Tabula edge (see
Fig 18). Those wrong edges are closer to the Tabula centre than the real Tabula edges.
Therefore higher values are more restrictive.
Reset returns to the standard value 0.5. Dimension is the ratio between the minimum distance
of the detected Tabula edge towards the centre and the distance from the Tabula edge towards
the centre. The range is between 0 and 1.
Fig 18
Edge Noise
Sets the maximum variation of the edge pixel position along the Tabula border. Only pixels
within the maximum variation are used for the border line calculation. The position of the edge
pixels may be noisy due to the quality of the video source, the chroma keying or occlusions by
other objects.
To display the used edge pixels mark the check box /Configuration/Display/Edges and clear
the check box /Configuration/Display/Lines. All edge pixels used for the calculation of the
border lines are displayed in four different colours depending on which border line they belong to.
Edge pixels which are excluded from the calculation are drawn with read colour.
Reset returns to the standard value 6.5. Dimension is pixel. Range is between 0 and 100.
22
Fig 22
Fig. 22 shows that the left Tabula edge is not detected properly (red edge pixel) because the
Edge Noise value is set to low.
Fig 23
Fig. 23 shows that for a proper Edge Noise value the left Tabula edge is detected properly (no
further red edge pixel).
23
Field Smoothing
Smoothes the field position of the Tabula in order to avoid field jitter. Otherwise the Tabula
position is calculated for every single field only. But then even for a non moving Tabula its final
position would change by one line between odd and even fields. This would cause a jitter of the
Tabula between two values. Field Smoothing reduces this effect. Its usage is highly
recommended.
Critical Flag
Usually all four edges of the Tabula must be in view in order to determine stable tracking values.
However, in some situations the position of the missing Tabula parts could still be estimated
while the Tabula leaves the picture frame. But the more the Tabula disappears, the more critical
the tracking data gets. Therefore TabulaTrack transmits a warning signal to the graphics
software, the critical flag. When receiving the critical flag, the graphics could e.g. fade to black.
You set the Threshold value to define when the critical flag is sent. You set the Threshold to 0
if the critical flag should be sent immediately if the board is leaving the picture frame. You set the
Threshold to 10 if the critical flag should be sent only if tracking is not possible any longer.
Standard value is 5. Range is between 0 and 10.
Grab Image
Grabs the currently displayed video input image and saves it to an USB memory stick. Please
make sure that the USB memory stick is plugged in and enough space is available. Each
grabbed image is saved with a unique number. Therefore you can grab multiple images without
overwriting the former ones.
24
3-2. Mode Tab
Configuration > Advanced Configuration > Mode
For a reliable tracking all four edges of the Tabula must be in view. Typically the Tabula is not
being tracked if it leaves the picture frame. Not having all four edges in view can lead to certain
disturbances of the tracking and therefore the keyed graphics. Same is valid if the Tabula is
covered by other objects or body parts like the arm or hand.
However, if the Tabula is partly outside the picture frame, TabulaTrack determines the most
likely position of the missing object parts. Because of mathematical reasons, this calculation
must fail if only two sides of the Tabula are in view.
Especially when the Tabula comes back into view, a correct calculation is possible only, if the
Tabula is completely inside the picture frame.
In addition, due to mathematical reasons it is not possible to determine the correct 3D pose of
the TabulaTrack board, if the board is perpendicular to the optical axis of the employed camera.
In order to achieve most reliable results all settings at Mode has to be edited carefully.
Fig 24
Complete
Enables the estimation of parts of the board which are outside the picture frame.
Tabula Width/Height
Enter the correct dimensions of the Tabula without any dimension.
IMPORTANT
The dimension does not matter. Finally only the ratio between both values is used.
Therefore e.g. even 16 and 9 are reasonable values if the board dimensions are 48 x
27 cm.
25
Fig 25 a
Fig. 25a shows that the left edge of the Tabula is not identical with the image border while using
Complete. The known dimensions of the board are used to estimate its position.
Fig 25b
Fig. 25b shows that the left edge of the Tabula is identical with the image boarder while not
using Complete. The keyed graphic will be distorted.
26
Compensate AD
Compensates for the non-square pixels of some analog video signals. For the digitized video
signal of analog cameras the black horizontal blanking might be seen as black bars on the left
and right edge of the video input screen. In such cases you must compensate by checking this
option.
Minimum Samples
Sets the minimum number of pixels a Tabula edge must consist of. Lower values enable the
tracking of the Tabula even for very huge rotation angles (up to 90 degrees of horizontal or
vertical rotation in relation to the optical axis of the camera). Higher values produce more stable
tracking results, especially for three-dimensional graphics.
Standard value is 10. Dimension is pixel. Range is between 0 and 100.
Cropping
Sets the active area of analog video input signals. For the digitized video signal of analog
cameras the black horizontal and vertical blanking might be seen as black areas on the edges of
the video input screen. In such cases you must crop the black areas by adjusting the related
sliders exactly to the edge of the active video image. Then the black regions outside the active
video picture are ignored.
Standard value is 0. Dimension is pixel. Range is between 0 and the number of horizontal or
vertical pixel.
27
4. General Notes
TabulaTrack detects a single-coloured Tabula within the camera picture. For this version of
TabulaTrack, up to two different coloured Tabulas can be tracked at the same time. The standard
green or blue colour which is usually used for Chroma Keying is highly recommended as the Tabula
colour.
TabulaTrack uses a standard Chroma Keying technique to separate the Tabula from the
background. Please make sure that the Tabula is properly lighted, as it should be for regular
Chroma Keying. Especially when the Tabula is tilted towards the floor, the light intensity usually
drops down. This disturbs the proper Chroma Key and the detection of the Tabula fails.
The TabulaTrack Tabula can have any size. But the rectangular shape is mandatory. To support
any other shapes like circles or irregular shapes, the rectangular Tabula can be placed on top of
this shape. In such case the outer shape can be covered by the graphical object by using a simple
linear key or overlay.
For a reliable tracking all four edges of the Tabula must be in view.
Not having all four edges in view can lead to certain disturbances of
the tracking and therefore the keyed graphics.
Typically the Tabula is not being tracked if it leaves the picture frame.
While using Complete, TabulaTrack determines the most likely
position of the missing object parts. Because of mathematical
reasons, this calculation must fail if only two sides of the Tabula are
in view (see picture). Especially when the Tabula comes into view, a
correct calculation is possible first and only, if the Tabula is
completely inside the picture frame.
Same is valid if the Tabula is covered by other objects or body parts like the arm or hand.
Fig 27
Fig 28
Fig 27 and Fig 28 show a false arm position for holding the Tabula. Instead of the real Tabula
border the arm of the talent is detected as the Tabula edge.
All camera settings and adjustments should be finished before applying TabulaTrack. Especially if
multiple cameras are in use, it is highly recommended to match all cameras properly. Otherwise
TabulaTrack’s Chroma Key settings are not valid for all cameras. This disturbs the quality of the
tracking.
As usual for all Chroma Key shoots, the clothes of the talent or any other surrounded objects must
have a different colour as the TabulaTrack Tabula. Otherwise it is not possible for the image
processing to distinguish between the Tabula and the background.
28
06/30/2008 Printed in Japan
FOR-A COMPANY LIMITED
Head Office
Overseas Division
Japan Branch Offices
R&D/Production
: 3-8-1 Ebisu, Shibuya-ku, Tokyo 150-0013, Japan
Phone: +81 (0)3-3446-3936, Fax: +81 (0)3-3446-1470
: Osaka/Okinawa/Fukuoka/Hiroshima/Nagoya/Sendai/Sapporo
: Sakura Center/Sapporo Center
FOR-A America Corporate Office
11125 Knott Ave., Suite #A, Cypress, CA 90630, USA
Phone: +1 714-894-3311 Fax: +1 714-894-5399
FOR-A America East Coast Office
1065 Avenue of the Americas Suite #1701A New York,NY 10018, USA
Phone: +1 212-861-2758 Fax: +1 212-861-2793
FOR-A America Distribution & Service Center
2400 N.E. Waldo Road, Gainesville, FL 32609, USA
Phone: +1 352-371-1505 Fax: +1 352-378-5320
FOR-A Corporation of Canada
425 Queen Street West, Suite 211, Toronto, Ontario M5V 2A5, CANADA
Phone: +1 416-977-0343 Fax: +1 416-977-0657
FOR-A Latin America & the Caribbean
5200 Blue lagoon Drive,
Suite 760, Miami, FL 33126, USA
Phone: +1-305-931-1700 Fax: +1-305-264-7890
FOR-A UK Limited
UNIT C71, Barwell Business Park, Leatherhead Road, Chessington Surrey, KT9 2NY, UK
Phone: +44 (0)20-8391-7979 Fax: +44 (0)20-8391-7978
FOR-A Italia S.r.l.
Viale Europa 50 20093, Cologno Monzese (MI), Milan, ITALY
Phone: +39 02-254-3635/6 Fax: +39 02-254-0477
FOR-A Corporation of Korea
801 Dangsan Bld., 53-1 Dangsan-Dong, Youngdeungpo-Gu, Seoul 150-800, Korea
Phone: +82 (0)2-2637-0761 Fax: +82 (0)2-2637-0760
FOR-A China Limited
Room C302 Tia Hao International Building,
116 Zizhu-Yuan Road, Haidiang Discrict, Beijing, China
Phone: +86 (0)10-5170-9870 Fax: +86 (0)10-5170-9772
*The contents of this manual are subject to change without notice.