Beijia Lu

Hi there! I am a Master's student in Computer Vision (MSCV) at CMU Robotics Institute, supervised by Prof. Jun-Yan Zhu.

Prior to this, I graduated from Department of Mathematics, City University of Hong Kong. I am honored to be advised by Prof. Alan Yuille, Prof. Mike Z. Shou, Prof. Ziwei Liu, Prof. Yuan Liu.

Email / Google Scholar / GitHub / twitter

Research

My research interests lie in generative modeling at the intersection of computer vision and machine learning, with the goal of building systems that see and interact with the world like humans.

Geometry-aware representations: introducing 3D structure and physical priors into predominantly 2D generative image and video models.
Efficient and Interactive Generative Systems: designing inductive biases and architectural innovations that move beyond brute-force scaling, enabling data-efficient and computationally lightweight generative models.
Unified Multimodal Learning: integrating vision, language, and audio to support coherent reasoning and controllable multimodal generation.

	Input-Aware Sparse Attention for Real-Time Co-Speech Video Generation Beijia Lu, Ziyi Chen, Jing Xiao, Jun-Yan Zhu SIGGRAPH Asia, 2025 paper / project page / code
	AniFeats: Animate 3D Feature Meshes for Character Video Generation Beijia Lu, Zekai Gu, Zhiyang Dou, Haotian Yuan, Chenyang Si, Yukang Cao, Yuming Jiang, Yuan Liu, Wenping Wang, Ziwei Liu Submitted to IEEE Transactions on Visualization and Computer Graphics (TVCG) paper / project page
	PAT3D: Physics-Augmented Text-to-3D Scene Generation Guying Lin, Kemeng Huang, Michael Liu, Ruihan Gao, Hanke Chen, Lyuhao Chen, Beijia Lu, Taku Komura, Yuan Liu, Jun-Yan Zhu, Minchen Li arXiv
	ColonNeRF: Hierarchical Neural Radiance Fields for High-Fidelity Long-Sequence Colon Reconstruction Yufei Shi, Beijia Lu, Jia-Wei Liu, Ming Li, Mike Zheng Shou Neurocomputing paper / project page
	Adding 3D Geometry Control to Diffusion Models Wufei Ma, Qihao Liu, Jiahao Wang, Xiaoding Yuan, Angtian Wang, Yi Zhang, Zihao Xiao, Guofeng Zhang, Beijia Lu, Ruxiao Duan, Yongrui Qi, Adam Kortylewski, Yaoyao Liu, Alan Yuille ICLR, 2024 (Spotlight)* paper / project page / code
	SemTrack: A Large-scale Dataset for Semantic Tracking in the Wild Pengfei Wang, Xiaofei Hui, Jing Wu, Zile Yang, Kian Eng Ong, Xinge Zhao, Beijia Lu, Dezhao Huang, Evan Ling, Weiling Chen, Keng Teck Ma, Minhoe Hur, Jun Liu ECCV, 2024* paper / project page / code

Miscellaneous

• Sunny is always a clingy little baby, btw can you find Sunny's eyes in the image?
• Huahua and Fugui often fight, but they are also a pair of siblings who can't be without each other.
• They give me the inspiration to strive, and I will love them forever. ❤

Template stolen from Jon Barron.