By Marc Levoy
Open iTunes to buy and download apps.
Have you ever wished you could take an iPhone picture that had a shallow depth of field like an SLR? Or a picture in a dark room that didn't come out noisy? Or a tilt-shift shot that makes the world look like a miniature model? This app lets you do all these things.
To use it, first find a scene that isn't moving (except for objects you'd like to blur out). Point the camera at a foreground object and press Record (red button). Make sure the object has some details the app can lock onto. Slowly move the phone left, right, up, and down, while keeping it aimed straight ahead. Don't tilt the camera, don't move it forward or backward, and don't move too far; an inch in each direction should suffice. After 10-15 seconds, press Pause (black bars) to view your "synthetic aperture photograph". The foreground object should appear sharp and the background blurry, like the first screenshot below. Photographers call this blur "bokeh". If the foreground comes out blurry instead, then tracking has failed. Touch to focus on a object with more detail, and try moving slower. This takes some practice.
For shooting in low light, do the same thing but record for only a second or two and hold the camera still. The app will track your subject, removing camera shake and sensor noise. The 4th screenshot below is a single frame, and the 5th screenshot is a 3-second recording. Although the goal is usually to translate the camera instead of tilting it, you can produce some cool effects if you break the rules. Read the description below (under What's New in Version 2.0) on simulating a tilt-shift lens.
How does SynthCam work? There are lots of apps out there that capture a single image and blur it to simulate a shallow depth of field. This app is different. Every 30th of a second it captures a video frame, tracks the object you pointed at, aligns it to the same object in previous frames you captured, and blends the frames together. You don't see this happening, and you don't see the result until you press Pause, but your iPhone is very, very busy. By the way, the native iPhone camera app lets you touch to focus, and objects you don't focus on are blurry. But because the iPhone's lens is small these objects are not very blurry. Using this app, you can create a much shallower depth of field. The tradeoff is that the output image is HD video resolution, not still photo resolution.
This app has been tested on an iPhone 4, iPhone 3GS, and iPod Touch 4. It may also work on an iPad 2, but it isn't optimized for that. If the app doesn't work for you, press Preferences (the gear icon), then Help, and read the Troubleshooting section. This help text, along with screenshots, examples, and some instructional videos, are available at http://marclevoy.com. If you come up with a great image, or think of a use for SynthCam I haven't mentioned here or on marclevoy.com, send me email! (Use firstname.lastname@example.org.)
What's New in Version 2.0
- SynthCam now offers multi-point focusing and tilted focal planes. The
number icon on the toolbar cycles through 1, 2, 3, and 4-point modes. In
each mode the solid square shows where the camera itself is metering and
focusing, and the open reticles show other points the app is tracking and
keeping sharp. These squares and reticles can be moved or resized by
dragging or pinching them.
If you had trouble producing sharp images using Version 1, then you should
try version 2. Being able to distribute multiple focusing points across
the foreground object makes a big difference. The 1st screenshot below
used 2 points, at the top and bottom of the cactus flower. The 2nd
screenshot shows what 4-point mode looks like before pressing Record.
Multi-point focusing not only lets you align the focal plane with any
collection of objects in the scene; it also lets you simulate a tilt-shift
lens. To do this, place 2 or 3 points along a line through the scene, then
rotate the phone slowly and continuously while recording. With some
practice you can take pictures that make the world look like a miniature
model. Look at the 3rd screenshot below. For a quick visual tutorial on
how to use multi-point focusing, check out the video at
- Synthetic images are sharpened when stored in the Camera Roll. Tracking
and resampling induce a consistent 1-pixel blur, so mild unsharp masking
works well for this purpose. The level of sharpening is adjustable on the
- A collection of algorithms that makes tracking more robust: by predicting
where the focusing square might go next and moving it there, by detecting a
wandering focus square and freezing it before it starts jumping around,
etc. The accelerometer is still used to correct pitching and rolling as
in version 1.1, but only in 1-point focusing mode.
Minor improvements and bug fixes:
- Redesigned focusing square to make it visible against any background.
- Tuned what things get reset on single and double tap of Reset button.
- Tracked features can be closer to the edge of the screen than before.
- More graceful if tracking is lost or a tracked feature wanders offscreen.
Needs an Update...
It's great, believe it or not. I love using it for those times where before I actually begin making a photo, I begin with this if it's around an area or time the iPod touch's camera is doing terribly.
And what it needs to be updated on, is that we need compatibility with the front-facing camera. Or maybe it's just me. The reason why is because of the simple fact that this app reduces noise even better than the Photoshop app from my experience, and that's amazing and not what I expect. I take some self-portraits and hate them because they're so grainy and such detail's already lost.
This app reduces noise and actually also retains some detail. It's great. That's why I'd also like to have use of the front-facing camera.
Nice idea, limited by the video capabilities
I often shoot images with wide open apertures (f/1.4) with 50mm and 85mm lenses on my DSLR, so the promise of SynthCam was intriguing to me. In theory it's an excellent idea, and the implementation in the app is quite good- it takes some practice, but you really can generate some interesting images that are otherwise not possible.
The problem is that the resolution of the resulting images is severely limited by Apple's video resolution on their mobile devices (iPhone 4 for me). There's not much way around it, either.
Unfortunately the resulting resolution of the images (smaller for normal video, larger for HD video) just isn't adequate for anything more than posting images online. Thus for me, the app is a novelty-- a good one-- but not particularly useful in its current implementation. That said, I think the developer has done a great job given the limitations.
One of the most unique photography apps out there
Unlike most photo apps, SynthCam isn't a filter. It's a truly unique app that has become one of my most used apps. It takes practice and skill to use, but that's probably part of the appeal to me. It's fun to have an app that's more than just a filter, but it's also fun to experiment with.
SynthCam isn't just a tilt shift effect, it can be used to remove people from crowded scenes, or help provide a more even view in dark settings or landscapes. With practice you can even get it to glitch out in unusual ways. This app isn't for everyone, but if you are addicted to iPhone photography and what something totally different for your camera bag, this is a great tool!
- Category: Photo & Video
- Updated: Mar 14, 2011
- Version: 2.0
- Size: 3.2 MB
- Language: English
- Seller: Marc Levoy
- © 2011 Marc Levoy
Compatibility: Requires iOS 4.2 or later. Compatible with iPhone 3GS, iPhone 4, iPhone 4S, iPhone 5, iPhone 5c, iPhone 5s, iPhone 6, iPhone 6 Plus, iPad 2 Wi-Fi, iPad 2 Wi-Fi + 3G, iPad Wi-Fi (3rd generation), iPad Wi-Fi + Cellular (3rd generation), iPad Wi-Fi (4th generation), iPad Wi-Fi + Cellular (4th generation), iPad mini Wi-Fi, iPad mini Wi-Fi + Cellular, iPad Air, iPad Air Wi-Fi + Cellular, iPad mini 2, iPad mini 2 Wi-Fi + Cellular, iPad Air 2, iPad Air 2 Wi-Fi + Cellular, iPad mini 3, iPad mini 3 Wi-Fi + Cellular, iPod touch (4th generation), iPod touch (5th generation), and iPod touch (6th generation).