Mobile devices are the definitive everyday technology, and many artists are integrating smartphones in their performance and installation works. This tutorial demonstrates how to get a live feed from a mobile device camera or display into Isadora wirelessly!
We will be taking advantage of the built-in features in iOS and Android which support wirelessly streaming video from your device to a receiver. Typically, this feature is used with platforms such as an AppleTV or a Google Chromecast. However, a few clever desktop-based applications can also receive the stream, which can then be picked up by Isadora via Syphon.
We’ll be focusing on two of these applications: AirServer and EpocCam HD. Both applications are available for Android and iOS devices. Unfortunately, these applications do not support Spout on Windows. While both Android and iOS devices may be used for the camera source, the receiving computer running Isadora must be Mac OS only.
At the end of this article, we have also included a few best practices for working with mobile wireless devices.
Warning! Every time we have used a mobile phone in a performance, it has been dropped at some point during rehearsal or the run. It is basically inevitable. Although smartphones case are very strong, we have seen devices break even with the toughest protective cases. If possible, have a second mobile phone on site as a backup device. Having only one phone for your project is an invitation for someone to drop and shatter it.
EpocCam Overview
Available at http://www.kinoni.com/ and the iOS App Store/ Google Play
Price: approximately $5.99. The paid version is necessary for a Syphon feed.
EpocCam streams the camera feed from your mobile device. The video received is “clean”, which means it’s stripped away of any interface elements. The application is a perfect solution for handheld live camera work. Even more, EpocCam supports up to four simultaneous camera feeds.
However, application requires a few moments to connect properly. If disconnected, the application needs to be restarted.
Installing EpocCam
EpocCam requires you to purchase and install the EpocCam HD app on your mobile device.
This application is available on the App Store or Google Play. To install, search for “EpocCam HD” in Google Play or the App Store, and follow the on-screen instructions to purchase and install the application on your smartphone.
You will also need to install the EpocCam Viewer Pro application on your computer. It is available at http://www.kinoni.com/
AirServer Overview
Available at https://www.airserver.com/
Price: approximately $19.99. Commercial and educational pricing is available.
AirServer streams the display of your smartphone, which allows virtually any mobile app — such as a game, text messaging application, or web site — to be used as a video source. Note that when you use AirServer with the default camera app on a smartphone, you will see the “interface” elements of the camera feed in the video stream.
We have found AirServer to provide an extremely reliable and quick connection, but only supports one feed at a time.
Installing AirServer
AirServer utilizes the built-in screen casting features of your mobile device, so you do not need to install any additional applications on your smartphone. You should make sure you are using an up-to-date version of your smartphone operating system.
AirServer requires you download and install AirServer on your computer. You can find AirServer here:
Mac OS — https://www.airserver.com/Mac
Windows — https://www.airserver.com/PC
Using EpocCam with Isadora
1) Verify that your computer and your mobile device are correctly connected to the same wireless network.
2) Launch the EpocCam Viewer Pro desktop app. A black window will appear, which displays your network name in the bottom left hand corner:
3) Verify that the network listed in the bottom corner is the correct wireless network you wish to use.
4) Launch the EpocCam HD App on your smartphone. You’ll see this on the screen of your device.
5) Note that the screen displays both the name of your mobile device, and the name of the wireless network.
6) EpocCam Viewer and the mobile app will automatically detect each other after a few moments. Once connected, the display of your mobile device will change to the camera input, and the EpocCam viewer on your computer will begin receiving the camera feed as well! Notice that the interface buttons on the mobile app do not appear in the final result on your computer.
7) Launch Isadora and begin a new project.
8) Add the Syphon Receiver actor to your Isadora scene:
9) Click the 'Server' input box on the Syphon Receiver actor. A dropdown menu appears, showing the Syphon feeds detected:
10) You’ll see at least four options: Cam 1 thru Cam 4. Since we are only using one device, choose "Cam 1". If you are using more than one device, EpocCam assigns them camera numbers in the order they are connected. You will need to have once unique Syphon Receiver for each camera feed.
11) Add a Projector actor to your scene.
12) Connect the 'video' output of the Syphon Receiver to the 'video' input of the Projector actor, or combine with other actors to produce unique effects!
Using AirServer with Isadora (iOS)
1) Verify that your computer and your mobile device are correctly connected to the same wireless network.
2) Launch the AirServer desktop app. Note that no window appears for AirServer: the application appears in the System Tray instead. You can access AirServer’s preferences from this system tray icon.
3) Swipe up from the bottom of the screen to reveal the Control Centre. This gesture can be a little difficult to perform, the key is to start with your finger OFF the screen!
Note for iPhone X users: You’ll need to swipe down from the upper-right corner of the screen to access the Control Center instead.
4) Tap “Screen Mirroring”. Another menu appears:
5) This menu lists all the AirPlay devices your mobile phone has detected on the network. You should see at least one option: your computer. In the above image, we have two options: an Apple TV and a computer, which are both on the same network.
6) Select the option for your computer. After a moment, a check mark appears.
7) A new window will appear on your computer’s desktop, showing the display of your smartphone. You can now leave the Control Centre and operate your mobile device normally. To stop mirroring, you will need to return to the Control Centre screen mirroring settings and choose the “Stop Mirroring” option which now appears there.
8) Launch Isadora and begin a new project.
9) Add the Syphon Receiver actor to your Isadora patch
10) Click the 'Server' input box on the Syphon Receiver actor. A dropdown menu appears, showing the Syphon feeds detected:
11) You’ll see an option which says something like “User’s iPhone” followed by the resolution and “AirServer”. Choose it.
12) Add a Projector actor to your scene. Then connect the “video” output of the “Syphon Receiver” to the video input of the Projector actor, or combine with other actors to produce unique effects!
Best Practice #1 - Prepare your Mobile Device
One of the largest risks when using a mobile device in a live performance are all the buttons, beeps, and other system features which can impact the performance. Whenever possible, do not use a personal mobile device for a live performance (unless, of course, that’s exactly the point!). If the device does not need to perform it’s usual communication functions as part of your piece, we recommend removing the SIM card and signing out of any e-mail or messaging accounts so that unwanted notifications do not appear on the device. However, there’s a few extra steps you can perform to ensure smooth operation.
Best Practice #2 - Disable Screen Timeout
As part of their default power-saving settings, most mobile devices automatically go into sleep mode after 30 seconds to 5 minutes of idle time. However, the connection to Epoccam and AirServer may be interrupted should your device go into sleep mode. If this happens, it can be necessary to re-set the connection. This can be time consuming in the middle of a performance work, so it is strongly recommended that you disable the auto-sleep or auto-lock functions on your show device.
iOS
- Launch the Settings app.
- Select “Display and Brightness”
- Select “Auto-Lock”
- Choose “Never”
This will prevent the device from going to sleep entirely.
Android
Many android devices unfortunately do not include a “never” option. The longest is 10 minutes.
- Launch the Settings app.
- Select “Display"
- Select "Screen Timeout"
- Choose “10 minutes”
Note that disabling screen timeout or auto look will drastically decrease the battery life of the device. Most smartphones can hold a full charge while their screen is lit for at least an hour, but older devices or large-screen devices may need to be recharged swiftly.
Best Practice #3 - Use Kiosk Mode aka Guided Access Mode on iOS
Even when a mobile device is set to never go into sleep mode, all mobile devices include sleep/ wake buttons, home buttons, back buttons, volume buttons, ect which can accidentally leave the app you wish to display, put the device to sleep, or cause undesired interface elements to appear on screen. While it’s possible to train a performer to exercise care not to press these buttons, in practice this is much more difficult! Fortunately, iOS devices devices include “kiosk” modes which lock the device into a particular app and disable many of the buttons on the device.
iOS calls its “kiosk” mode “Guided Access”. When activated, Guided Access mode allows you to temporarily restrict iOS to a single app, disable buttons on the device, and even disable areas of the screen. This is a great way to ensure a performer doesn't accidentally exit an application or perform an unwanted function.
Setting Up Guided Access
Tap Settings > General > Accessibility > Guided Access to set up Guided Access. From there, here's what you can do:
- Turn Guided Access on or off
- Set a passcode that controls the use of Guided Access and prevents someone from leaving an active session
- Set whether the device can go to sleep during a session
Activating Guided Access
To start a Guided Access session, follow these steps:
- Open the app you want to use.
- Triple-click the Home button.
- Adjust settings for the session, and then tap Start.
Best Practice #4 - Battery Life
Running the camera and screen consistently on a smartphone rapidly drains battery life. As part of your pre-show and post-show checklists, make sure the devices are connected to a power source and fully charged.
Best Practice #5 - Wireless Networks
Transmitting a video feed from your mobile phone wirelessly during a live performance is a risky task. Carefully test your wireless network to determine the best configuration for your project. However, here are a few best practices:
- Use a network that is not open to audience members or others in the area. If you are using wireless networking for other applications during your piece, consider using a separate network just for the wireless camera.
- Do not rely on your venue to provide a network for you. Bring your own networking hardware (routers, wireless access points, and cables). AirServer and EpocCam do not require internet access to function, they only require a wireless network itself.
- Position your wireless access point centrally in your space. If you are working in a large venue, you may want to research how to set up multiple wireless access points distributed evenly across the performance space.
- Minimize obstructions, walls, or other objects which may disrupt or interfere with the connection between the wireless access point and the mobile phone.
- Use a wired connection between the control computer and the network router when possible.