PT Journal AU Stroia-Williams, P Hilton, A Grau, O TI Reflectance Transfer for Material Editing and Relighting SO JVRB - Journal of Virtual Reality and Broadcasting PY 2010 VL 7(2010) IS 6 DI 10.20385/1860-2037/7.2010.6 DE Editing; GPGPU; Material; Non-parametric; Reflectance Transfer; Relighting; Shape From Shading; Statistics AB We present a new approach to diffuse reflectance estimationfor dynamic scenes.Non-parametric image statistics are used to transferreflectance properties from a static example set to adynamic image sequence.The approach allows diffuse reflectance estimationfor surface materials with inhomogeneous appearance,such as those which commonly occur with patterned ortextured clothing. Material editing is also possible bytransferring edited reflectance properties.Material reflectance properties are initially estimatedfrom static images of the subject under multipledirectional illuminations using photometric stereo.The estimated reflectance together with the correspondingimage under uniform ambient illuminationform a prior set of reference material observations.Material reflectance properties are then estimatedfor video sequences of a moving person captured underuniform ambient illumination by matching theobserved local image statistics to the reference observations.Results demonstrate that the transfer ofreflectance properties enables estimation of the dynamicsurface normals and subsequent relighting combinedwith material editing. This approach overcomeslimitations of previous work on material transferand relighting of dynamic scenes which was limitedto surfaces with regions of homogeneous reflectance.We evaluate our approach for relighting3D model sequences reconstructed from multipleview video. Comparison to previous model relightingdemonstrates improved reproduction of detailed textureand shape dynamics. ER