By Marc Levoy
Open iTunes to buy and download apps.
Have you ever wished you could take an iPhone picture that had a shallow depth of field like an SLR? Or a picture in a dark room that didn't come out noisy? Or a tilt-shift shot that makes the world look like a miniature model? This app lets you do all these things.
To use it, first find a scene that isn't moving (except for objects you'd like to blur out). Point the camera at a foreground object and press Record (red button). Make sure the object has some details the app can lock onto. Slowly move the phone left, right, up, and down, while keeping it aimed straight ahead. Don't tilt the camera, don't move it forward or backward, and don't move too far; an inch in each direction should suffice. After 10-15 seconds, press Pause (black bars) to view your "synthetic aperture photograph". The foreground object should appear sharp and the background blurry, like the first screenshot below. Photographers call this blur "bokeh". If the foreground comes out blurry instead, then tracking has failed. Touch to focus on a object with more detail, and try moving slower. This takes some practice.
For shooting in low light, do the same thing but record for only a second or two and hold the camera still. The app will track your subject, removing camera shake and sensor noise. The 4th screenshot below is a single frame, and the 5th screenshot is a 3-second recording. Although the goal is usually to translate the camera instead of tilting it, you can produce some cool effects if you break the rules. Read the description below (under What's New in Version 2.0) on simulating a tilt-shift lens.
How does SynthCam work? There are lots of apps out there that capture a single image and blur it to simulate a shallow depth of field. This app is different. Every 30th of a second it captures a video frame, tracks the object you pointed at, aligns it to the same object in previous frames you captured, and blends the frames together. You don't see this happening, and you don't see the result until you press Pause, but your iPhone is very, very busy. By the way, the native iPhone camera app lets you touch to focus, and objects you don't focus on are blurry. But because the iPhone's lens is small these objects are not very blurry. Using this app, you can create a much shallower depth of field. The tradeoff is that the output image is HD video resolution, not still photo resolution.
This app has been tested on an iPhone 4, iPhone 3GS, and iPod Touch 4. It may also work on an iPad 2, but it isn't optimized for that. If the app doesn't work for you, press Preferences (the gear icon), then Help, and read the Troubleshooting section. This help text, along with screenshots, examples, and some instructional videos, are available at http://marclevoy.com. If you come up with a great image, or think of a use for SynthCam I haven't mentioned here or on marclevoy.com, send me email! (Use firstname.lastname@example.org.)
What's New in Version 2.0
- SynthCam now offers multi-point focusing and tilted focal planes. The
number icon on the toolbar cycles through 1, 2, 3, and 4-point modes. In
each mode the solid square shows where the camera itself is metering and
focusing, and the open reticles show other points the app is tracking and
keeping sharp. These squares and reticles can be moved or resized by
dragging or pinching them.
If you had trouble producing sharp images using Version 1, then you should
try version 2. Being able to distribute multiple focusing points across
the foreground object makes a big difference. The 1st screenshot below
used 2 points, at the top and bottom of the cactus flower. The 2nd
screenshot shows what 4-point mode looks like before pressing Record.
Multi-point focusing not only lets you align the focal plane with any
collection of objects in the scene; it also lets you simulate a tilt-shift
lens. To do this, place 2 or 3 points along a line through the scene, then
rotate the phone slowly and continuously while recording. With some
practice you can take pictures that make the world look like a miniature
model. Look at the 3rd screenshot below. For a quick visual tutorial on
how to use multi-point focusing, check out the video at
- Synthetic images are sharpened when stored in the Camera Roll. Tracking
and resampling induce a consistent 1-pixel blur, so mild unsharp masking
works well for this purpose. The level of sharpening is adjustable on the
- A collection of algorithms that makes tracking more robust: by predicting
where the focusing square might go next and moving it there, by detecting a
wandering focus square and freezing it before it starts jumping around,
etc. The accelerometer is still used to correct pitching and rolling as
in version 1.1, but only in 1-point focusing mode.
Minor improvements and bug fixes:
- Redesigned focusing square to make it visible against any background.
- Tuned what things get reset on single and double tap of Reset button.
- Tracked features can be closer to the edge of the screen than before.
- More graceful if tracking is lost or a tracked feature wanders offscreen.
It can take some great pictures.
However, moving from an iPod touch 4 to an iPhone 4, I notice that when actually recording a photo, it only updates what the camera sees on screen every two or three seconds, whereas on the iPod touch 4 I would see smooth video on the screen, like I was recording it.
The iPhone 4 has a better camera, and it does have extra things such as autofocus, but those can be locked during capture, so I don't see why it has to be extremely laggy. Photos still come out beautiful, but only because I knew what I was doing based off of how it ran on an iPod touch.
I doubt this app will get updated, I don't even think that the 1080p resolution of the iPhone 4s has been taken advantage of, so I suppose I'll just have to live with it... If others get this app and it's laggy for them and they have no idea what they are doing, then it may just be another 1-star review. :-/ (but based off of the time that the last update came out, I bet the developer has forgotten about the app anyway.)
Biggest flaw is resolution
If the developer could figure out how to do this with full res photos, might be useful. As it is, a 960 pixel wide final image just doesn't cut it in 2011
Needs an Update...
It's great, believe it or not. I love using it for those times where before I actually begin making a photo, I begin with this if it's around an area or time the iPod touch's camera is doing terribly.
And what it needs to be updated on, is that we need compatibility with the front-facing camera. Or maybe it's just me. The reason why is because of the simple fact that this app reduces noise even better than the Photoshop app from my experience, and that's amazing and not what I expect. I take some self-portraits and hate them because they're so grainy and such detail's already lost.
This app reduces noise and actually also retains some detail. It's great. That's why I'd also like to have use of the front-facing camera.
- Category: Photo & Video
- Updated: Mar 14, 2011
- Version: 2.0
- Size: 3.2 MB
- Language: English
- Seller: Marc Levoy
- © 2011 Marc Levoy
Compatibility: Requires iOS 4.2 or later. Compatible with iPhone 3GS, iPhone 4, iPhone 4S, iPhone 5, iPhone 5c, iPhone 5s, iPad 2 Wi-Fi, iPad 2 Wi-Fi + 3G, iPad Wi-Fi (3rd generation), iPad Wi-Fi + Cellular (3rd generation), iPad Wi-Fi (4th generation), iPad Wi-Fi + Cellular (4th generation), iPad mini Wi-Fi, iPad mini Wi-Fi + Cellular, iPad Air, iPad Air Wi-Fi + Cellular, iPad mini with Retina display, iPad mini with Retina display Wi-Fi + Cellular, iPod touch (4th generation), and iPod touch (5th generation).