Senior Research Scientist ByteDance Inc 250 Bryant St. Mountain View, CA 94041 Email: hongyixu@bytedance.com

Biography

I am currently a Senior Research Scientist at Intelligent Creation Lab, ByteDance Inc. Before that, I worked as a Senior Research Scientist at Google Research and I was a Postdoctoral Research Associate at Disney Research Zurich. I graduated with the Ph.D. degree at Computer Science Department of University of Southern California in August 2017, under supervision of Prof. Jernej Barbič . Before that, I graduated with the B. Eng degree from Computer Science and Technology Department in Zhejiang University, China in 2012.

My research interests are in computer graphics/vision, physically based animation, 3d human modeling and reconstruction, computational robotics, contact and interactive physics.

Education

2012.08-2017.08

• Computer Science, University of Southern California

2008.09-2012.06

• Major: Computer Science and Technology, Zhejiang University

• Minor: Advanced Class of Engineering Education, Chu KoChen Honors College

Publications

• Hongyi Xu, Thiemo Alldieck, Cristian Sminchisescu: H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motion, The Conference on Neural Information Processing Systems (Neurips, Spotlight), 2021.

• Thiemo Alldieck*, Hongyi Xu*, Cristian Sminchisescu: imGHUM:Implicit Generative Models of 3D Human Shape and Articulated Pose, The International Conference on Computer Vision (ICCV), 2021.

• Andrei Zanfir, Eduard Gabriel Bazavan, Hongyi Xu, William T.Freeman, Rahul Sukthankar, Cristian Sminchisescu: Weakly Supervised 3D Human Pose and Shape Reconstruction with Normalizing Flows, The European Conference on Computer Vision (ECCV, Spotlight), 2020.

• Hongyi Xu, Eduard Gabriel Bazavan, Andrei Zanfir, William T.Freeman, Rahul Sukthankar, Cristian Sminchisescu: GHUM & GHUML: Generative 3D Human Shape and Articulated Pose Models, The IEEE Conference on Computer vision and Pattern Recognition (CVPR, Oral), 2020.

• Ran Luo, Weiwei Xu, Tianjia Shao, Hongyi Xu, Yin Yang: Accelerated Complex Step Finite Difference for Expedient Deformable Simulation, ACM Transactions on Graphics 38(SIGGRAPH Asia 2019).

• Shayan Hoshyari, Hongyi Xu, Espen Knoop, Stelian Coros, Moritz Bächer: Vibration-Minimizing Motion Retargeting for Robotic Characters, ACM Transactions on Graphics 38(SIGGRAPH 2019).

• Hongyi Xu*, Espen Knoop*, Stelian Coros, Moritz Bächer: Bend-It: Design and Fabrication of Kinetic Wire Characters, ACM Transactions on Graphics 37 (SIGGRAPH Asia 2018), 2018.

• Dimitar Dinev, Thabo Beeler, Derek Bradley, Moritz Bächer, Hongyi Xu, Ladislav Kavan: User-Guided Lip Correction for Facial Performance Capture, Symposium on Computer Animation, 2018.

• Hongyi Xu: Interactive Material and Damping Design, PhD thesis, Computer Science Department, University of Southern California, August 2017.

• Hongyi Xu, Jernej Barbič: Example-based Damping Design, ACM Transactions on Graphics 36(4) (SIGGRAPH 2017), Los Angeles, CA, USA.

• Hongyi Xu, Jernej Barbič: 6-DoF Haptic Rendering using Continuous Collision Detection Between Points and Signed Distance Fields, IEEE Transactions on Haptics, 2016.

• Yijing Li, Hongyi Xu, Jernej Barbič: Enriching Triangle Mesh Animations With Physically Based Simulation, IEEE Transactions on Visualization and Computer Graphics, 2016.

• Hongyi Xu, Jernej Barbič: Pose-Space Subspace Dynamics, ACM Transactions on Graphics 35(4) (SIGGRAPH 2016), Anaheim, CA, USA.

• Hongyi Xu, Jernej Barbič: Adaptive 6-DoF Haptic Contact Stiffness Using the Gauss Map, IEEE Transactions on Haptics,9(3),2016.

• Hongyi Xu, Fun Shing Sin, Yufeng Zhu, Jernej Barbič: Nonlinear Material Design using Principal Stretches, ACM Transactions on Graphics (SIGGRAPH 2015), 34(4), 2015, Los Angeles, CA, USA

• Hongyi Xu, Yijing Li, Yong Chen, Jernej Barbič: Interactive Material Design Using Model Reduction, ACM Transactions on Graphics (TOG), 34(2), 2015 (Presented in SIGGRAPH 2015)

• Hongyi Xu, Jernej Barbič: Continuous Collision Detection Between Points and Signed Distance Field ,Workshop on Virtual Reality Simulation and Physical Simulation, 2014

• Hongyi Xu, Jernej Barbič: Signed Distance Fields for Polygon Soup Meshes, Graphics Interface 2014, Montreal, Canada

• Hongyi Xu*, Yili Zhao*, Jernej Barbič: Implicit Multibody Penalty-based Distributed Contact, IEEE Transactions on Visualization and Computer Graphics, 20(9), 2014