Abstract
Human faces are remarkably similar in global properties, including size, aspect ratios, and locations of main features, but can vary considerably in details across individuals, gender, race, or due to facial expression. We propose a novel method for 3D shape recovery of a face from a single image using a single 3D reference model of a different person’s face. The method uses the input image as a guide to mold the reference model to reach a desired reconstruction. Assuming Lambertian reflectance and rough alignment of the input image and reference model, we seek shape, albedo, and lighting that best fit the image while preserving the rough structure of the model. We demonstrate our method by providing accurate reconstructions of novel faces overcoming significant differences in shape due to gender, race, and facial expressions.
Chapter PDF
Similar content being viewed by others
References
Horn, B.: Obtaining Shape from Shading Information. The Psychology of Computer Vision. McGraw-Hill, New York (1975)
Horn, B., Brooks, M. (eds.): Shape from Shading. MIT Press, Cambridge (1989)
Rouy, E., Tourin, A.: A viscosity solutions approach to shape-from-shading. SIAM Journal of Numerical Analysis 29(3), 867–884 (1992)
Zhang, R., Tsai, P., Cryer, J., Shah, M.: Shape from shading: A survey. PAMI 21(8), 690–706 (1999)
Pentland, A.: Finding the illuminant direction. Journal Optical Society of America, 448–455 (1982)
Zheng, Q., Chellappa, R.: Estimation of illuminant direction, albedo, and shape from shading. PAMI 13(7), 680–702 (1991)
Tsai, P., Shah, M.: Shape from shading with variable albedo. Optical Engineering, 121–1220 (1998)
Moses, Y., Edelman, S., Ullman, S.: Generalization to novel images in upright and inverted faces. Perception 25, 443–461 (1996)
Shimshoni, I., Moses, Y., Lindenbaum, M.: Shape re-construction of 3d bilaterally symmetric surfaces. IJCV 39(2), 97–100 (2000)
Zhao, W., Chellappa, R.: Symmetric shape-from-shading using self-ratio image. IJCV 45, 55–75 (2001)
Atick, J., Griffin, P., Redlich, A.: Statistical approach to shape from shading: Reconstruction of three-dimensional face surfaces from single two-dimensional images. Neural Computation 8(6), 1321–1340 (1996)
Blanz, V., Vetter, T.: A morphable model for the synthesis of 3d faces. SIGGRAPH I, 187–194 (1999)
Zhou, S.K., Chellappa, R., Jacobs, D.W.: Characterization of human faces under illumination variations using rank, integrability, and symmetry constraints. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 588–601. Springer, Heidelberg (2004)
Smith, W., Hancock, E.: Recovering facial shape and albedo using a statistical model of surface normal direction. ICCV, 588–595 (2005)
Romdhani, S., Vetter, T.: Efficient, robust and accurate fitting of a 3d morphable model. ICCV (2003)
Dovgard, R., Basri, R.: Statistical symmetric shape from shading for 3D structure recovery of faces. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3022, pp. 99–113. Springer, Heidelberg (2004)
Sim, T., Kanade, T.: Combining models and exemplars for face recognition: An illuminating example. In: CVPR Workshop on Models versus Exemplars (2001)
Zhang, L., Samaras, D.: Face recognition under variable lighting using harmonic image exemplars. In: CVPR, vol. I, pp. 19–25 (2003)
Shashua, A., Riklin-Raviv, T.: The quotient image: Class based re-rendering and recognition with varying illuminations. PAMI 23(2), 129–139 (2001)
Basri, R., Jacobs, D.: Lambertian reflectance and linear subspaces. PAMI 25(2), 218–233 (2003)
Ramamoorthi, R., Hanrahan, P.: On the relationship between radiance and irradiance: Determining the illumination from images of a convex lambertian object. JOSA 18(10), 2448–2459 (2001)
Frolova, D., Simakov, D., Basri, R.: Accuracy of spherical harmonic approximations for images of lambertian objects under far and near lighting. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 574–587. Springer, Heidelberg (2004)
Dupuis, P., Oliensis, J.: An optimal control formulation and related numerical methods for a problem in shape reconstruction. The Annals of Applied Probability 4(2), 287–346 (1994)
Kimmel, R., Sethian, J.: Optimal algorithm for shape from shading and path planning. Journal of Mathematical Imaging and Vision 14(3), 237–244 (2001)
Georghiades, A., Belhumeur, P., Kriegman, D.: From few to many: generative models for recognition under variable pose and illumination. PAMI 23(6), 643–660 (2001)
USF DARPA Human-ID 3D Face Database: Courtesy of Prof. Sudeep Sarkar, University of South Florida, Tampa, FL, http://marthon.csee.usf.edu/HumanID/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kemelmacher, I., Basri, R. (2006). Molding Face Shapes by Example. In: Leonardis, A., Bischof, H., Pinz, A. (eds) Computer Vision – ECCV 2006. ECCV 2006. Lecture Notes in Computer Science, vol 3951. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11744023_22
Download citation
DOI: https://doi.org/10.1007/11744023_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33832-1
Online ISBN: 978-3-540-33833-8
eBook Packages: Computer ScienceComputer Science (R0)Springer Nature Proceedings Computer Science
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.