Shunsuke Saito

Facebook Reality Labs

Name Shunsuke Saito
Interest Effective Data Representations for Deep Human Digitization
Email {firstname}.{lastname}16 (at) gmail.com

Shunsuke Saito

I am a Research Scientist at Facebook Reality Labs in Pittsburgh. I finished my Ph.D. at University of Southern California, where I worked with Prof. Hao Li. Prior to USC, I spent one year at University of Pennsylvania as Visiting Researcher. I obtained B.Eng. and M.Eng. in Applied Physics at Waseda University in 2013 and 2014 (Early graduation).


Deep Relightable Appearance Models for Animatable Faces
SIGGRAPH 2021      [Project (video, paper)]
Sai Bi, Stephen Lombardi*, Shunsuke Saito*, Tomas Simon, Shih-En Wei, Kevyn McPhail, Ravi Ramamoorthi, Yaser Sheikh, Jason Saragih (* - equal contribution)


SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networks
CVPR 2021 (Oral Presentation)      [Project (video, paper)]
CVPR Best Paper Nominee!!
Shunsuke Saito, Jinlong Yang, Qianli Ma, Michael J. Black


SCALE: Learning to Model Clothed 3D Humans with a Surface Codec of Articulated Local Elements
CVPR 2021      [Project (video, paper)]
Qianli Ma, Shunsuke Saito*, Jinlong Yang*, Siyu Tang, Michael J. Black (* - equal contribution)


Pixel-Aligned Volumetric Avatars
CVPR 2021    [Project (video)]
Amit Raj, Michael Zollhöfer, Tomas Simon, Jason Saragih, Shunsuke Saito, James Hays, Stephen Lombardi


Monocular Real-Time Volumetric Performance Capture
ECCV 2020, SIGGRAPH RTL (Best in Show Award)    [Project (video, code)]
Ruilong Li*, Yuliang Xiu*, Shunsuke Saito, Zeng Huang, Kyle Olszewski, Hao Li (* - equal contribution)


PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitization
CVPR 2020 (Oral Presentation)    [Project (video, code)]
Shunsuke Saito, Tomas Simon, Jason Saragih, Hanbyul Joo


Learning to Infer Implicit Surfaces without 3D Supervision
NeurIPS 2019    
Shichen Liu, Shunsuke Saito, Weikai Chen, Hao Li


PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization
ICCV 2019      [Project]
Shunsuke Saito*, Zeng Huang*, Ryota Natsume*, Shigeo Morishima, Angjoo Kanazawa, Hao Li (* - equal contribution)


SiCloPe: Silhouette-Based Clothed People
CVPR 2019 (Oral Presentation - Best Paper Finalist)      [Supplemental]
Ryota Natsume*, Shunsuke Saito*, Zeng Huang, Weikai Chen, Chongyang Ma, Hao Li, Shigeo Morishima (* - equal contribution)


3D Hair Synthesis Using Volumetric Variational Autoencoders
ACM Transaction on Graphics (SIGGRAPH Asia 2018)    
Shunsuke Saito, Liwen Hu, Chongyang Ma, Hikaru Ibayashi, Linjie Luo, Hao Li


paGAN: Real-time Avatars Using Dynamic Textures
ACM Transaction on Graphics (SIGGRAPH Asia 2018)    
Koki Nagano, Jaewoo Seo, Jun Xing, Lingyu Wei, Zimo Li, Shunsuke Saito, Aviral Agarwal, Jens Fursund, Hao Li


High-Fidelity Facial Reflectance and Geometry Inference From an Unconstrained Image
ACM Transaction on Graphics (SIGGRAPH 2018)    
Shugo Yamaguchi*, Shunsuke Saito*, Koki Nagano, Yajie Zhao, Weikai Chen, Kyle Olszewski, Shigeo Morishima, Hao Li (* - equal contribution)


Mesoscopic Facial Geometry inference Using Deep Neural Networks
CVPR 2018 (Spotlight Presentation)  
Loc Huynh, Weikai Chen, Shunsuke Saito, Jun Xing, Koki Nagano, Andrew Jones, Hao Li, Paul Debevec


Avatar Digitization from a Single Image for Real-Time Rendering
ACM Transaction on Graphics (SIGGRAPH Asia 2017)    
Liwen Hu*, Shunsuke Saito*, Lingyu Wei*, Koki Nagano, Jaewoo Seo, Iman Sadeghi, Jens Fursund, Yen-Chun Chen, Hao Li (* - equal contribution)


Quasi-Developable Garment Transfer for Animals
SIGGRAPH ASIA 2017 Technical Brief  
Fumiya Narita, Shunsuke Saito, Tsukasa Fukusato, Shigeo Morishima


Outside-in Monocular IR Camera based HMD Pose Estimation via Geometric Optimization
VRST 2017    
Pavel A. Savkin, Shunsuke Saito, Jarich Vansteenberge, Tsukasa Fukusato, Lochlainn Wilson, Shigeo Morishima


Learning Dense Facial Correspondences in Unconstrained Images
ICCV 2017    
Ronald Yu, Shunsuke Saito, Haoxiang Li, Duygu Ceylan, Hao Li


Realistic Dynamic Facial Textures From a Single Image Using GANs
ICCV 2017    
Kyle Olszewski*, Zimo Li*, Chao Yang*, Yi Zhou, Ronald Yu, Zeng Huang, Sitao Xiang, Shunsuke Saito, Pushmeet Kohli, Hao Li (* - equal contribution)


Production-Level Facial Performance Capture Using Deep Convolutional Neural Networks
SCA 2017    
Samuli Laine, Tero Karras, Timo Aila, Antti Herva, Shunsuke Saito, Ronald Yu, Hao Li, Jaakko Lehtinen


Photorealistic Facial Texture Inference Using Deep Neural Networks
CVPR 2017 (Spotlight Presentation)    
Shunsuke Saito*, Lingyu Wei*, Liwen Hu, Koki Nagano, Hao Li (* - equal contribution)
featured in fx guide, Gizmodo, Daily Mail, Seamless, 3ders, and Wired


Multi-View Stereo on Consistent Face Topology
Eurographics 2017    
Graham Fyffe, Koki Nagano, Loc Huynh, Shunsuke Saito, Jay Bush, Andrew Jones, Hao Li, Paul Debevec


High-Fidelity Facial and Speech Animation for VR HMDs
ACM Transaction on Graphics (SIGGRAPH Asia 2016)      
Kyle Olszewski, Joseph J. Lim, Shunsuke Saito, Hao Li


Real-Time Facial Segmentation and Performance Capture from RGB Input
ECCV 2016        [Data]
Shunsuke Saito, Tianye Li, Hao Li


Garment Transfer for Quadruped Characters
Eurographics 2016, short paper      
Fumiya Narita, Shunsuke Saito, Takuya Kato, Tsukasa Fukusato, Shigeo Morishima


Computational Bodybuilding: Anatomically-based Modeling of Human Bodies
ACM Transaction on Graphics (SIGGRAPH 2015)      
Shunsuke Saito, Zi-Ye Zhou, Ladislav Kavan


PatchMove: Patch-based Fast Image Interpolation with Greedy Bidirectional Correspondence
Pacific Graphics 2014, short paper      
Shunsuke Saito, Ryuuki Sakamoto, Shigeo Morishima


Macroscopic and Microscopic Deformation Coupling in Up-sampled Cloth Simulation
Computer Animation and Virtual Worlds Journal (CASA 2014)    
Shunsuke Saito, Nobuyuki Umetani, Shigeo Morishima


Character Transfer: Example-based individuality retargeting for facial animations
International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision 2014 (WSCG 2014)    
Takuya Kato, Shunsuke Saito, Masahide Kawai, Tomoyori Iwao, Akinobu Maejima, Shigeo Morishima


Estimating Cloth Simulation Parameter from 3D Cloth Motion Separating Dynamic from Static Motion
ACM SIGGRAPH EuroGraphics Symposium on Computer Animation (SCA 2012), poster  
Shunsuke Saito, Ryusuke Sagawa, Naoya Iwamoto, Shigeo Morishima

Shunsuke Saito

Web: www-scf.usc.edu/~saitos/
E-mail: shunsuke.saito16 (at) gmail.com

Technical Paper Reviewer:

ECCV, ICCV, IJCV, SIGGRAPH, CVPR, TPAMI, ToG, AAAI, WACV, 3DV, ACCV, TVCG, Signal Processing, SIGGRAPH ASIA, CGF, PG, Eurographics, etc.

Internship:

MPI Tübingen(2020), FAIR, Adobe Research (2019), Pinscreen (2018), FRL (2017), FOVE (2015), Yahoo! Japan (2012-13)

Talk:

MPI Saarbruecken/Tuebingen, Industrial Light & Magic, Dagstuhl Seminar (2019), University of Tokyo, CMU Graphics Group, VC Symposium (2018), VC/GCAD Symposium, Autodesk Research (2015)

Scholarship and Awards:

Outstanding Reviewer (3DV2020, ACCV2020),
CVPR Best Paper Finalist (2019),
Super Creator, IPA Exploratory Software (2015),
ACM Student Research Competition Semi-Finalist (2014),
MIRU Interactive Presentation Award, Okayama, Japan (2014),
UCLA CSST Scholarship Program $9,036 (2013),
Okuma Memorial Special Scholarship $5,000 (2011)