1/31/2024 0 Comments Google app photoscanWhile that model is quite powerful and can remove a variety of obstructions, it is too computationally expensive to be run on smartphones. However, the algorithm we originally proposed was based on a generative model where the motion and appearance of both the main scene and the obstruction layer are estimated. It uses similar principles to remove various types of obstructions from the field of view. Our technique is inspired by our earlier work published at SIGGRAPH 2015, which we dubbed “ obstruction-free photography”. Right: If we stabilize the images on the photo, we can see just the glare moving, covering different parts of the photo. Left: The captured, input images (5 in total). The challenge is that the images need to be aligned very accurately in order to combine them properly, and this processing needs to run very quickly on the phone to provide a near instant experience. While no single view may be glare-free, we can combine multiple pictures of the printed photo taken at different angles to remove the glare. In most cases we found that every pixel of the photo is likely not to be covered by glare in at least one of the pictures. But if we take several pictures of the photo while moving the camera, the position of the glare tends to change, covering different regions of the photo. Moreover, the glare may often saturate regions in the picture, rendering it impossible to see or recover the parts of the photo underneath it. When taking a single picture of a photo, determining which regions of the picture are the actual photo and which regions are glare is challenging to do automatically. Right: Glare-free digital output from PhotoScan Left: A regular digital picture of a physical print. To create this feature, we developed a unique blend of computer vision and image processing techniques that can carefully align and combine several slightly different pictures of a print to separate the glare from the image underneath. One of the key features of PhotoScan is the ability to remove glare from prints, which are often glossy and reflective, as are the plastic album pages or glass-covered picture frames that host them. Yesterday, we released an update to PhotoScan, an app for iOS and Android that allows you to digitize photo prints with just a smartphone. Posted by Ce Liu, Michael Rubinstein, Mike Krainin and Bill Freeman, Research Scientists
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |