Dynamic view synthesis aims to enable users to watch dynamic 3D scenes from arbitrary views for immersive experiences. This is an important technique for many AR/VR applications, such as volumetric filmmaking, virtual telepresence, and video games. Recent methods have achieved impressive progress on novel view synthesis of static scenes. For instance, NeRF and its follow-up works are able to efficiently produce high-quality 3D scene representation that supports real-time rendering. However, it is not trivial to extend the success on static scenes to dynamic scenes. A dynamic scene can be seen as a large number of static scenes along the temporal dimension. Therefore, to enable high-fidelity and interactive AR/VR applications, dynamic scenes will require much more than static scenes on the model capacity and reconstruction speed, while expecting much smaller model storage per frame for transmission
This workshop aims to bring researchers from the field of dynamic view synthesis together to discuss the latest progress and important technical challenges of this task. More concretely, we have the following question to talk about:
More broadly, given the rapid advancements in AR/VR glasses, we hope that this workshop will facilitate discussions on how dynamic view synthesis techniques can be optimized to enhance content capture and display on these devices.
| 01:30 pm - 01:40 pm | Opening remarks |
| 01:40 pm - 02:10 pm | Invited talk: Jingyi Yu |
| 02:10 pm - 02:40 pm | Invited talk: Yaser Sheikh |
| 02:40 pm - 03:10 pm | Invited talk: Lingjie Liu |
| 03:10 pm - 03:20 pm | Invited talk: Zhen Xu |
| 03:20 pm - 04:30 pm | Poster session / Coffee break |
| 04:30 pm - 05:00 pm | Invited talk: Deva Ramanan |
| 05:00 pm - 05:30 pm | Invited talk: Changil Kim |
| 05:30 pm - 05:40 pm | Concluding remarks |
Jingyi Yu is currently the Faculty Search Committee Directora and the SIST Tenure & Promotion Committee Director. Prof. Jingyi Yu is a professor and executive dean of the School of Information Science and Technology at ShanghaiTech University. His research interests span a range of topics in computer vision and computer graphics, especially on computational photography and non-conventional optics and camera designs.
Yaser Sheikh is an Associate Professor at the Robotics Institute (on leave), Carnegie Mellon University, with appointments in the Mechanical Engineering Department. He founded and directs Facebook Reality Lab in Pittsburgh focused on pursuing ”metric telepresence”: remote interactions in AR/VR that are indistinguishable from reality. His research is focused on machine perception and rendering of social behavior, spanning sub-disciplines in computer vision, computer graphics, and machine learning.
Deva Ramanan is a Professor in the Robotics Institute at Carnegie-Mellon University and the director of the CMU Argo AI Center for Autonomous Vehicle Research. His research interests span computer vision and machine learning, with a focus on visual recognition. He was named a National Academy of Sciences Kavli Fellow in 2013. He has many impressive works on dynamic scene reconstruction, such as Dynamic 3D Gaussians and BANMo
Lingjie Liu is the Aravind K. Joshi Assistant Professor in the Department of Computer and Information Science at the University of Pennsylvania, where she leads the Penn Computer Graphics Lab. Her research interests are at the interface of Computer Graphics, Computer Vision, and AI, with a focus on Neural Scene Representations, Neural Rendering, and 3D Reconstruction.
Changil Kim is a Research Scientist at Meta, specializing in the convergence of computer graphics, vision, and machine learning. He holds a PhD from ETH Zurich, where he collaborated with Disney Research. His notable recognitions include the Swiss National Science Foundation Postdoctoral Fellowship and the Sony Focused Research Award.
Zhen Xu is a PhD student in Computer Science at Zhejiang University, under the guidance of Prof. Xiaowei Zhou. He completed his Bachelor’s degree in Computer Science at the same institution in 2022. His research primarily explores 3D/4D neural reconstruction and rendering, as well as digital humans. He has many impressive works on 3D/4D neural reconstruction and rendering, such as 4K4D and EasyVolcap.
Sida Peng is an Assistant Professor at the School of Software Technology, Zhejiang University. He received his Ph.D. degree from College of Computer Science and Technology at Zhejiang University in 2023, and obtained his bachelor degree in Information Engineering from Zhejiang University in 2018. His research interests include 3D reconstruction, rendering, and 3D generation. He received the 2020 CCF-CV Excellent Young Researcher Award and was selected as the 2022 Apple Scholar in AI/ML.
Yiyi Liao is an assistant professor at Zhejiang University. She received her Ph.D. in Control Science and Engineering from Zhejiang University. Her research interest lies in 3D computer vision, including 3D reconstruction, scene understanding, and 3D-aware generative models. She co-organized the ICCV 2021 Workshop on Differentiable 3D Vision and Graphics.
Xiaowei Zhou is a tenured Associate Professor of Computer Science at Zhejiang University, China. He obtained his PhD degree from The Hong Kong University and Science and Technology, after which he was a postdoctoral researcher at the GRASP Lab, University of Pennsylvania. His research interests include 3D reconstruction, understanding and synthesis of objects, humans and scenes, with applications in VR/AR and robotics. He is on the editorial board of IJCV, served as area chairs of CVPR’21 and ICCV’21, and co-organized the series of Geometry Meets Deep Learning Workshops (GMDL).
Andreas Geiger is a Professor of computer science heading the Autonomous Vision Group (AVG). His group is part of the University of T¨ubingen and the MPI for Intelligent Systems located in T¨ubingen, Germany at the heart of CyberValley. His research group is developing machine learning models for computer vision, natural language and robotics with applications in self-driving, VR/AR and scientific document analysis. His work has been recognized with several prizes, including the Longuet-Higgins Prize, the Mark Everingham Prize, the IEEE PAMI Young Investigator Award, and the Heinz Maier Leibnitz Prize. He is the Program Chair of CVPR 2023. He co-organized several Autonomous Driving Workshops at ECCV 2018, CVPR 2021.