Requirements
Transcription
Requirements
Many people want to use Skype to bring in a remote talent to use during production. While there are many solutions on how this can be done, this paper will explain a method that will allow you connect a single Skype session into a TriCaster and send a return feed of the entire production back to the Skype user. The unique aspect of this method is that it works completely over Ethernet so no additional video hardware is required. The methods described below are built on top of previous white papers that I’ve written. While you don’t need these white papers to make it work, it might be helpful to go through them first. Once you understand what is happening in those papers, these workflows will be easier to understand. Starting with TriCaster rev 2-2-131211 these white papers can be found on your TriCaster by going on the Home screen to Help > Addenda. The two papers you want to read are named: iVGA Pro and Audio Loopback Real-time encoding using VLC Some of the software needed is commercial, there are trial versions available so you can do all of your testing to make sure it works before you purchase. The software will cost about $50 US. Requirements A TriCaster XD410, XD460, XD860 or XD8000 system. Another computer that will be the Skype system running on Windows 7 64-bit. This system should have at least an Intel i5 processor to handle real-time media processing. VLC Media Player v2.0.2 E2ESoft’s ‘VCam’ Virtual Camera software E2ESoft’s ‘VSC’ Virtual Sound Card software Skype for Windows NewTek’s iVGA Pro Gigabit network between the systems being used. 1 VLC Media Player is going to receive a video/audio stream from the TriCaster. It will then output the video to the VCam application and the audio to VSC application to get the feed into Skype. The plug-in that is needed by VCam is designed to work with VLC v2.0.2 and does not appear to work with later versions of VLC. Here is a link to download VLC 2.0.2. http://download.videolan.org/pub/videolan/vlc/2.0.2/win32/vlc-2.0.2-win32.exe VCam is the software that will allow us to connect video from VLC to the Skype webcam input. Do not purchase this software until you have tested it and determine that it works for your needs. The trial version will have a watermark on the webcam output. http://www.e2esoft.cn/vcam/ If you need to download the VLC plug-in for VCam, below is the link. This plug-in should install automatically with the main VCam installer and this separate download should not be needed. http://www.e2esoft.cn/downloads?f=vcam_vlcplugin Virtual Sound Card (VSC) is used to get audio into and out of Skype, you can download the trial software at the link below. If you are already using Virtual Audio Cable (VAC) on your system it is possible to use it in place of VSC (instructions on how to use VAC are found at the end of this document). Do not purchase this software until you have tested it and determined that it works for your needs. The trial version of VSC will say ‘trial’ on the audio channel every few seconds. http://www.e2esoft.cn/vsc/ Skype can be downloaded from the Skype website. http://www.skype.com iVGA Pro is a free tool available from NewTek. It allows you to display anything on your computer desktop into a NET input on the TriCaster system. iVGA Pro is required because it supports audio. If you already have iVGA Pro, make sure you check the version you are using, latency reductions were introduced starting in v1.0.0.32. You can download the latest version of iVGA Pro under the ‘Codecs and Utilities’ category from this link. http://www.newtek.com/support/documentation.html 2 Application Workflow Here are how all of these applications are going to work together. This paper will take you step by step on what you need to configure to make this happen, but these diagrams will help you understand the data flow from one application to the next. TriCaster to Skype Workflow: Skype to TriCaster Workflow: Install Skype and iVGA Pro. Then, install VLC; finally install VCam and Virtual Sound Card software. Use the default install settings for all of the applications. Software Configuration Let first setup the Virtual Sound Card software. Open the ‘e2esoft VSC’ tool found in the Start menu. From the window that opens, click on the ‘Option’ button and in the window that appears click on the ‘Driver’ tab. Set the Instance count to ‘2’ and press OK to close the window. After you change this setting, close the application. Wait a few moments for the new driver to register into the operating system and reopen e2eSoft VSC again. 3 Now that there are two virtual soundcard in the system, let set them up. In the main VSC interface, set the number of transfer channels to two and then set them as shown in the image below. Now press the >> icons on each audio channel to start them up. You can now minimize this software, but do not close it as it needs to be running for the audio transfers to take place. Now let’s configure VLC. Launch VLC and from the ‘Tools’ menu, choose ‘Preferences’. In the window that appears, choose the Video category on the left side of the window, and then set the Output to ‘e2eSoft VCam’ 4 Now select the ‘Audio’ category on the left side of the window and set the Output module to ‘DirectX audio output’, then set the Device to ‘Speaker #2 (e2eSoft VAudio)’. Now let us configure VCam to work with the output of VLC. Run ‘e2eSoft VCam’ from the start menu. In the VCam Manager application, click the ‘Options’ menu. In the Options window choose the Camera Settings. Set the Default video size to 852x480. You can play with different options to find the best resolution for your system, but this value is a good starting point. Also make sure the default video frame rate matches the video standard that you are using. 5 Once you have configured the Camera Settings, click on okay. From the main VCam Manager window, select the ‘Source’ option and from the drop down menu, choose ‘External Source’. The External Video Source screen will appear. Press the ‘Start’ button to active VCam. You can now minimize VCam, but do not close the application or it will shut down the video processing function we need it to do. 6 Now that we have VCam running, we need to configure Skype’s webcam and audio devices. Open Skype and from the ‘Tools’ menu, select ‘Options’. From the ‘Audio Settings’ menu on the left, set the Microphone to ‘Line in #2 (e2eSoft VAudio)’ and set the Speakers to ‘Speaker (e2eSoft VAudio)’. Now select the ‘Video settings’ from the options list and for your webcam choose ‘e2eSoft VCam’. Transfer media from TriCaster to Skype Now that we have the applications configured, lets perform the actions need to get a video and audio feed from TriCaster to Skype. Open your TriCaster session and click the gear found on the program output window. In the Output Settings window, activate the checkbox called ‘Network’. Under the video dropdown you can choose what channel you want to return to the Skype user. If you want them to see the program output, leave it set on ‘Follow 1’. However some people might find it easier to talk if they always see the 7 head shot of the show host continuously on Skype, so another option is to set it to a camera input. From the audio dropdown list, select Aux 1, 2 as the audio channel. We also need to configure the audio output for the Skype user. Most people have a difficult time speaking if they hear their own voice delayed. To avoid this problem we want to create a mix-minus setup in the TriCaster audio mixer. This will allow the Skype user to hear all audio except their own voice. In our example we are going use NET2 for the Skype input, click on the gear on NET2 in the audio mixer. In the Audio Configuration panel, under Routing, uncheck the ‘A, B - Aux 1’ checkbox. All other channels that you want sent to the Skype user need to have Aux 1 checked, which is the default for all audio channels in a TriCaster session. TriCaster is now sending out a signal, go to your Skype system and open up VLC. From the VLC interface, choose Open Network Stream. In the window that opens, type in the URL of your TriCaster system exactly as shown from the Network URL in the TriCaster Output Configuration Window. Click the checkbox called ‘Show more options’. The window will expand showing you additional controls. Find the one called Caching and change its value to zero. This will make VLC play the video with as little latency as possible. Some system might need some cache, so if you are having drop outs in the network video feed, then increase this value, but keep it as small as possible. The larger this value, the more latency will be introduced on Skype return feed. Now press the Play button and VLC will start receiving the stream and the VCam plug-in will send it to the VCam application. Do not worry if the video shown in the VLC application has distorted colors, it will still be correctly displayed in the VCam app. 8 At this point, the rest of the applications should be doing their work. If you look at the VCam app, you will see video showing up in its display. If it isn’t showing, try pressing the ‘Stop’ button and then restart the External Source in the VCam Manager application. If you open up the Webcam preferences in Skype, you will see the video show up as well. You can minimize VLC and VCam and they will continue to send video from TriCaster to Skype. Transfer media from Skype into TriCaster Now we need to open up iVGA Pro and set it to pull in the correct information from Skype and sent it to TriCaster. Select the Destination on your TriCaster that you want to Skype to show up in. In out example we will be using NET2. Set the Audio Source to ‘Line In (e2eSoft VAudio)’ at the bottom of the window. Then press the Send button and you will see your computer desktop appear in the NET2 input on TriCaster. Now start your Skype session, once you have your talent visible in Skype, display your Skype video call full screen for the highest resolution possible. Your talent should be able to see and hear everything happening on your TriCaster program output (except for hearing themselves). If you look on TriCaster’s NET2 input you will see the Skype video and audio coming in. Since the audio for NET2 is only routed to Program out, everyone else will hear the audio from the Skype user. Skype does display a PIP overlay of the source webcam on its screen. If you click on this overlay it will shrink to its smallest size, but it isn’t possible to remove the PIP overlay. You can place it in the other corners of the screen, so position it where it will be least visible. Also you can put the NET2 input into a M/E and use the positional controls to crop or resize the NET2 input to remove the PIP portion of the image if needed. Congratulations! You now have TriCaster and Skype working with each other. 9 Other Workflow Solutions This workflow isn’t just limited to compatibility with Skype, but it will work with any application that is expecting a webcam as an input. For example, Google Hangouts is a video chat platform that people are interested in connecting to TriCaster and these same tools will allow operation with it. Another possibility is to feed the webcam input of conferencing solutions like WebEx or GoToMeeting. It doesn’t have to be a two directional transfer of media either, if you need the ability to stream to more than one CDN, you can use the ‘TriCaster to Skype’ workflow to route content into Adobe Flash Media Live Encoder for a secondary streaming output. Some CDN’s also have their own streaming app for their service and this would allow you to feed into these applications as well. These tools can also be used to play media files from VLC through iVGA Pro into a TriCaster NET input. By configuring iVGA Pro’s Video Source to ‘e2eSoft VCam’ and the Audio Source to the matching VLC audio output device you will have iVGA Pro setup to receive any file or stream that you play in VLC, which in turn will be sent to a TriCaster NET input. This would give you the ability to use VLC as a manually controlled media player routed directly into your TriCaster. Setting for Best Quality and Lowest Latency Skype’s video isn’t designed for interlace video signals, when possible use either 1080p or 720p session video format for the best image quality. If a 1080i session format is required and the #2 video output channel isn’t being used, you can configure this channel to send out a 720 progressive format and set your Network output to ‘Follow 2’. There is also a De-Interlace option at the bottom of the Network output drop down list, use this option if a interlace session format must be used and the #2 output isn’t available. The higher frame rates of the 720p format might help slightly for reducing latency in the overall workflow. The amount of latency on the network output can vary each time you connect to it. You can get an idea of the latency by looking at the TriCaster program output and see how long before it is visible in VLC player. If it seems higher than usual, reconnect the Network Stream in VLC Player to see if it sets up with lower latency. Reconnecting the VLC Network Stream will cause a short disruption in the Skype return video feed, but it will not disconnect the Skype call. It’s best to check this before your production, in case you want to perform this reconnection. The latency can vary slightly over time, but its best to try to start with the lowest latency stream from the beginning. Bandwidth is another factor you need to take into account. If you are streaming along with performing a Skype video call, you need to have adequate network bandwidth. Skype doesn’t have controls to limit its bandwidth usage and can go up to 1.5Mbit/s in both directions (see Skype bandwidth usage). Usually downstream isn’t an issue, but upstream bandwidth can be congested with all of this network traffic. If enough upstream bandwidth isn’t available, it can cause stuttering video or even dropping of the network stream. If you need to relieve some upstream bandwidth, you can try adjusting the VCam Manager’s Camera Settings (shown on page 5). The default resolution we setup in this document is 852x480, but you can choose a lower resolution which should lower the amount of bandwidth used by Skype. In a worst case scenario, you might need to perform an audio only call out to your Skype client and have them send video/audio back to the TriCaster. The CPU performance for the Skype system can also be a factor. The VCam plug-in is CPU intensive to perform the real-time media processing, having a CPU with multiple cores is desired so that all of the 10 applications will have enough performance to operate. If you are using iVGA Pro at the same time, this can stress the GPU on the system, having a good performance graphics card can be important as well. Make sure you perform testing using the entire workflow at the settings you will typically be using to make sure the system can keep up. Testing has been performed on a laptop with an Intel i5 2.5GHz Dual Core CPU and it was fast enough to keep up with the entire workflow. If the system can’t keep up you can look at lowering some of the settings. Adjusting the virtual Camera Settings in VCam or sending a SD resolution Network output from the TriCaster (using the down convert on output #2) are two adjustments that can help. If you are using other applications in place of Skype, perform testing with that application. For example, GoToMeeting uses more CPU power for its webcam video encoding than what Skype uses, so a more powerful system will be required. Virtual Audio Cable If you have already purchased Virtual Audio Cable from my previous white paper about getting audio loopback working with iVGA Pro, you can use it in place of VSC so you don’t have to purchase a different audio loopback solution. All you need to do is create a second audio cable, which can be done in the ‘Virtual Audio Cable Control Panel’ application. You do need to have administrator privileges to be able to make these changes. From the Start menu, find the Virtual Audio Cable program group, but instead of left clicking on VAC Control Panel, right click on it instead and from the menu that appears, choose the option ‘Run as Administrator’. You will need to confirm that you are an administrator and then the VAC Control Panel will open. In the Control Panel window, set the number of cables to ‘2’ and then press the ‘Set’ button. You will now have a Line 1 and a Line 2 audio cable available for use. Set Line 1 to work with iVGA Pro Audio Source and the Skype Speaker output. Use Line 2 for the Microphone input of Skype and VLC’s DirectX audio output. If your soundcard supports native audio loopback, you will still need to purchase VSC for the TriCaster/Skype workflow to operate. We need to have two sound channels running through the system to get separate audio from VLC to Skype and then Skype to iVGA Pro. Your native sound card audio loopback can work in place of the Skype to iVGA Pro connection, but you will still need VSC to handle the VLC to Skype audio connection. 11