Zhenjun Zhao Profile
Zhenjun Zhao

@zhenjun_zhao

3,158
Followers
478
Following
1,353
Media
1,572
Statuses

PhD student in CUHK for 3D computer vision/SLAM/SfM/localization/local feature (). Open to collaboration.

Hong Kong
Joined September 2022
Don't wanna be here? Send us removal request.
@zhenjun_zhao
Zhenjun Zhao
1 year
General Neural Gauge Fields Fangneng Zhan, @LingjieLiu1 , @AdamKortylewski , Christian Theobalt tl;dr: jointly end-to-end learn gauge transformation and neural fields
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
11
38
@zhenjun_zhao
Zhenjun Zhao
6 months
GS-SLAM: Dense Visual SLAM with 3D Gaussian Splatting Chi Yan, Delin Qu, Dong Wang, Dan Xu, Zhigang Wang, Bin Zhao, Xuelong Li tl;dr: 3D Gaussian meets SLAM
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
48
245
@zhenjun_zhao
Zhenjun Zhao
1 year
BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects Bowen Wen, et al. tl;dr: object-level SLAM, online pose graph optimization + Neural Object Field #CVPR2023
Tweet media one
Tweet media two
Tweet media three
Tweet media four
3
47
228
@zhenjun_zhao
Zhenjun Zhao
6 months
Compact 3D Gaussian Representation for Radiance Field Joo Chan Lee, Daniel Rho, Xiangyu Sun, Jong Hwan Ko, Eunbyung Park tl;dr: volume-based masking reduces the number of Gaussians; grid-based neural field->view-dependent colors
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
33
230
@zhenjun_zhao
Zhenjun Zhao
7 months
4D Gaussian Splatting for Real-Time Dynamic Scene Rendering Guanjun Wu, Taoran Yi, Jiemin Fang, Lingxi Xie, Xiaopeng Zhang, Wei Wei, Wenyu Liu, Qi Tian, Xinggang Wang tl;dr: deformation field->Gaussian motions+shape deformations
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
32
188
@zhenjun_zhao
Zhenjun Zhao
24 days
Learning with 3D rotations, a hitchhiker's guide to SO(3) A. René Geist, Jonas Frey, Mikel Zobro, Anna Levina, Georg Martius tl;dr: how to select suitable SO(3) for nn regression? SO(N)->Lipschitz continuity of the function->representation space
Tweet media one
Tweet media two
Tweet media three
Tweet media four
4
27
183
@zhenjun_zhao
Zhenjun Zhao
9 months
NeRFs: The Search for the Best 3D Representation Ravi Ramamoorthi tl;dr: review of NeRF author of NeRF
Tweet media one
Tweet media two
0
39
178
@zhenjun_zhao
Zhenjun Zhao
3 months
3D Gaussian as a New Vision Era: A Survey Ben Fei, Jingyi Xu, Rui Zhang, Qingyuan Zhou, Weidong Yang, Ying He tl;dr: 3D Gaussian Splatting survey
Tweet media one
Tweet media two
Tweet media three
1
45
173
@zhenjun_zhao
Zhenjun Zhao
3 months
Cameras as Rays: Pose Estimation via Ray Diffusion Jason Y. Zhang, Amy Lin, Moneish Kumar, Tzu-Hsuan Yang, @RamananDeva , @shubhtuls tl;dr: predict a separate ray passing through each patch in each input image->least-square->camera extrinsics&intrinsics
Tweet media one
Tweet media two
Tweet media three
Tweet media four
3
35
172
@zhenjun_zhao
Zhenjun Zhao
3 months
How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Survey @fabiotosi92 , Youmin Zhang, Ziren Gong, Erik Sandström, @s_matt , @Martin_R_Oswald , @mattpoggi tl;dr: SLAM in radiance fields
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
37
172
@zhenjun_zhao
Zhenjun Zhao
4 months
A Survey on 3D Gaussian Splatting Guikun Chen, Wenguan Wang tl;dr: in title
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
25
168
@zhenjun_zhao
Zhenjun Zhao
3 months
MESA: Matching Everything by Segmenting Anything Yesheng Zhang, Xu Zhao tl;dr: SAM->multi-relational graph->AMRF and ABN->energy minimization->Graph Cut->area matching->point matching
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
29
153
@zhenjun_zhao
Zhenjun Zhao
7 months
Segment Anything Model is a Good Teacher for Local Feature Learning Jingqian Wu, Rongtao Xu, Zach Wood-Doughty, Changwei Wang tl;dr: SAM->semantic relationship/grouping+edge map->distill->local feature
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
39
149
@zhenjun_zhao
Zhenjun Zhao
4 months
360ORB-SLAM: A Visual SLAM System for Panoramic Images with Depth Completion Network Yichen Chen, et al. tl;dr: panoramic image->features->panoramic triangulation->depth completion network->dense panoramic depth map
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
21
132
@zhenjun_zhao
Zhenjun Zhao
2 months
A New Split Algorithm for 3D Gaussian Splatting Qiyuan Feng, Gengchen Cao, Haoxiang Chen, Tai-Jiang Mu, Ralph R. Martin, Shi-Min Hu tl;dr: an 𝑁-dimensional Gaussian->two independent 𝑁-dimensional Gaussians->closed-form solution
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
18
132
@zhenjun_zhao
Zhenjun Zhao
5 months
GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfaces Yingwenqi Jiang, et al. tl;dr: simplified shading function->rendering equation; shortest axis directions of 3D Gaussians->normal estimation
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
18
131
@zhenjun_zhao
Zhenjun Zhao
3 months
GaussianObject: Just Taking Four Images to Get A High-Quality 3D Object with Gaussian Splatting Chen Yang, Sikuang Li, et al. tl;dr: represent and render 3D object with Gaussian splatting, that achieves high rendering quality with only 4 input images
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
21
130
@zhenjun_zhao
Zhenjun Zhao
11 months
LightGlue: Local Feature Matching at Light Speed @PhilippCSE , @pesarlin , @mapo1 tl;dr: exit mechanism+point prune between each layer in SuperGlue->adaptive stopping mechanism->fast inference of SuperGlue
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
24
129
@zhenjun_zhao
Zhenjun Zhao
2 months
NARUTO: Neural Active Reconstruction from Uncertain Target Observations Ziyue Feng, Huangying Zhan, Zheng Chen, Qingan Yan, Xiangyu Xu, Changjiang Cai, Bing Li, Qilun Zhu, Yi Xu tl;dr: reconstruction->uncertainty learning->multi-resolution hash-grid
Tweet media one
Tweet media two
Tweet media three
Tweet media four
3
29
129
@zhenjun_zhao
Zhenjun Zhao
3 months
4D Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenes Yuanxing Duan, Fangyin Wei, Qiyu Dai, Yuhang He, Wenzheng Chen, Baoquan Chen tl;dr: 4D spatial-temporal Gaussian ellipsoids sliced with different time queries->3D dynamics
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
25
124
@zhenjun_zhao
Zhenjun Zhao
1 year
NeRF-Supervised Deep Stereo Fabio Tosi, Alessio Tonioni, Daniele De Gregorio, Matteo Poggi tl;dr: neural rendering+user-collected images->stereo training data; rendered stereo triplets+depth maps->occlusions and enhance fine details #CVPR2023
Tweet media one
Tweet media two
Tweet media three
2
22
117
@zhenjun_zhao
Zhenjun Zhao
6 months
SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering Antoine Guédon, Vincent Lepetit tl;dr: gaussians->surface of the mesh
Tweet media one
Tweet media two
Tweet media three
0
13
115
@zhenjun_zhao
Zhenjun Zhao
4 months
GARField: Group Anything with Radiance Fields Chung Min Kim, Mingxuan Wu, Justin Kerr, Ken Goldberg, Matthew Tancik, @akanazawa tl;dr: hierarchical grouping in 3D by training a scale-conditioned affinity field from multi-level masks
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
18
115
@zhenjun_zhao
Zhenjun Zhao
9 months
AnyLoc: Towards Universal Visual Place Recognition Nikhil Keetha, Avneesh Mishra, Jay Karhade, Krishna Murthy Jatavallabhula, Sebastian Scherer, Madhava Krishna, Sourav Garg tl;dr: foundation model features+unsupervised feature aggregation
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
34
112
@zhenjun_zhao
Zhenjun Zhao
6 months
GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting Yiwen Chen, Zilong Chen, Chi Zhang, Feng Wang, Xiaofeng Yang, Yikai Wang, Zhongang Cai, Lei Yang, Huaping Liu, Guosheng Lin tl;dr: Gaussian semantic tracing->editing control
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
23
109
@zhenjun_zhao
Zhenjun Zhao
5 months
The Importance of Coordinate Frames in Dynamic SLAM Jesse Morris, Yiduo Wang, Viorela Ila tl;dr: world/object-centric formulation in factor-graph-based Dynamic SLAM framework (use GTSAM) Really interesting!
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
23
106
@zhenjun_zhao
Zhenjun Zhao
1 month
SpatialTracker: Tracking Any 2D Pixels in 3D Space Yuxi Xiao, Qianqian Wang, Shangzhan Zhang, Nan Xue, @pengsida , Yujun Shen, @XiaoweiZhou5 tl;dr: frame->triplane encoder->triplane feature maps->transformer+ARAP constraint->3D trajectories
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
21
108
@zhenjun_zhao
Zhenjun Zhao
1 year
Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction Hansheng Chen, Jiatao Gu, Anpei Chen, Wei Tian, Zhuowen Tu, Lingjie Liu, Hao Su tl;dr: single-stage training jointly learns NeRF reconstruction and diffusion model
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
25
102
@zhenjun_zhao
Zhenjun Zhao
1 year
Anything-3D: Towards Single-view Anything Reconstruction in the Wild Qiuhong Shen, Xingyi Yang, Xinchao Wang tl;dr: BLIP+SAM+stable diffusion
Tweet media one
Tweet media two
2
24
103
@zhenjun_zhao
Zhenjun Zhao
1 year
Neural Radiance Fields (NeRFs): A Review and Some Recent Developments Mohamed Debbagh tl;dr: review the original NeRF framework
Tweet media one
1
28
104
@zhenjun_zhao
Zhenjun Zhao
9 months
Deep Learning for Visual Localization and Mapping: A Survey Changhao Chen, Bing Wang, Chris Xiaoxuan Lu, Niki Trigoni, Andrew Markham tl;dr: a comprehensive survey, and propose a taxonomy for the localization and mapping methods using deep learning
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
30
102
@zhenjun_zhao
Zhenjun Zhao
5 months
COLMAP-Free 3D Gaussian Splatting Yang Fu, Sifei Liu, Amey Kulkarni, Jan Kautz, Alexei A. Efros, @xiaolonw tl;dr: local 3D Gaussians->each image->relative pose; global 3D Gaussians->expansion of the 3D Gaussians->whole scene
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
17
102
@zhenjun_zhao
Zhenjun Zhao
3 months
GaussianPro: 3D Gaussian Splatting with Progressive Propagation Kai Cheng, @xxlong0 , Kaizhi Yang, Yao Yao, Wei Yin, Yuexin Ma, Wenping Wang, Xuejin Chen tl;dr: depth and normal+classical patch matching->new Gaussians
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
14
100
@zhenjun_zhao
Zhenjun Zhao
19 days
FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descent @omcamsmith , @DavidCharatan , @_atewari , @vincesitzmann tl;dr: min of LS objective->optical flow (depth&intrinsics&poses) & correspondences (optical flow&point tracking)
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
19
101
@zhenjun_zhao
Zhenjun Zhao
6 months
Relightable 3D Gaussian: Real-time Point Cloud Relighting with BRDF Decomposition and Ray Tracing Jian Gao, Chun Gu, et al. tl;dr: material & lighting decomposition for 3DGS; bounding volume hierarchy->point-based ray-tracing
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
19
100
@zhenjun_zhao
Zhenjun Zhao
2 months
VastGaussian: Vast 3D Gaussians for Large Scene Reconstruction Jiaqi Lin, Zhihao Li, Xiao Tang, Jianzhuang Liu, Shiyong Liu, Jiayue Liu, Yangdi Lu, Xiaofei Wu, Songcen Xu, Youliang Yan, Wenming Yang tl;dr: large scene->partitioning->multiple cells
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
14
99
@zhenjun_zhao
Zhenjun Zhao
2 months
Sora Generates Videos with Stunning Geometrical Consistency Xuanyi Li, Daquan Zhou, Chenxu Zhang, Shaodong Wei, Qibin Hou, Ming-Ming Cheng tl;dr: perspective of 3D reconstruction->design metrics->quality of the generated videos
Tweet media one
Tweet media two
Tweet media three
Tweet media four
3
17
98
@zhenjun_zhao
Zhenjun Zhao
9 months
Flexible Techniques for Differentiable Rendering with 3D Gaussians Leonid Keselman, Martial Hebert tl;dr: 3D Gaussians->Fuzzy Metaballs->shape reconstruction
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
17
98
@zhenjun_zhao
Zhenjun Zhao
11 months
Explicit Neural Surfaces: Learning Continuous Geometry With Deformation Fields Thomas Walker, Octave Mariotti, Amir Vaxman, Hakan Bilen tl;dr: sampling meshes->deformation fields->differentiable rasterization->neural deferred shader->predicted image
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
15
95
@zhenjun_zhao
Zhenjun Zhao
5 months
Nuvo: Neural UV Mapping for Unruly 3D Representations @_pratul_ , Stephan J. Garbin, @dorverbin , @jon_barron , @BenMildenhall tl;dr: neural field->UV mapping; sample visible points that affect the scene’s appearance
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
21
96
@zhenjun_zhao
Zhenjun Zhao
8 months
Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstruction Ziyi Yang, Xinyu Gao, Wen Zhou, Shaohui Jiao, Yuqing Zhang, Xiaogang Jin tl;dr: deformable 3D Gaussians Splatting method->explicit 3D Gaussians->monocular dynamic scenes
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
16
96
@zhenjun_zhao
Zhenjun Zhao
3 months
Neural Mesh Fusion: Unsupervised 3D Planar Surface Understanding Farhad G. Zanjani, Hong Cai, Yinhao Zhu, Leyla Mirvakhabova, Fatih Porikli tl;dr: deform surface triangle mesh and generate an embedding for unsupervised 3D planar segmentation
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
11
95
@zhenjun_zhao
Zhenjun Zhao
5 months
Segment Any 3D Gaussians Jiazhong Cen, Jiemin Fang, Chen Yang, Lingxi Xie, Xiaopeng Zhang, Wei Shen, Qi Tian tl;dr: SAM meets 3DGS
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
20
93
@zhenjun_zhao
Zhenjun Zhao
9 months
2D3D-MATR: 2D-3D Matching Transformer for Detection-free Registration between Images and Point Clouds Minhao Li, Zheng Qin, Zhirui Gao, Renjiao Yi, Chengyang Zhu, Kai Xu tl;dr: 2D-3D matching version of LoFTR
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
26
94
@zhenjun_zhao
Zhenjun Zhao
3 months
3D Reconstruction and New View Synthesis of Indoor Environments based on a Dual Neural Radiance Field Zhenyu Bao, Guibiao Liao, Zhongyuan Zhao, Kanglin Liu, Qing Li, Guoping Qiu tl;dr: density field->view-independent color component->SDF
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
15
93
@zhenjun_zhao
Zhenjun Zhao
7 months
UE4-NeRF:Neural Radiance Field for Real-Time Rendering of Large-Scale Scene Jiaming Gu, Minchao Jiang, Hongsheng Li, Xiaoyuan Lu, Guangming Zhu, Syed Afaq Ali Shah, Liang Zhang, Mohammed Bennamoun tl;dr: large scenes->subNeRFs->polygonal meshes
Tweet media one
Tweet media two
Tweet media three
2
15
92
@zhenjun_zhao
Zhenjun Zhao
1 month
Robust Gaussian Splatting François Darmon, Lorenzo Porzi, Samuel Rota-Bulò, Peter Kontschieder tl;dr: Gaussian distribution over camera poses->motion blur; off-focus plane correction->defocus blur; RGB decoder+per-image parameters->color inconsistencies
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
13
90
@zhenjun_zhao
Zhenjun Zhao
3 months
Gaussian Splashing: Dynamic Fluid Synthesis with Gaussian Splatting Yutao Feng, Xiang Feng, Yintong Shang, Ying Jiang, Chang Yu, Zeshun Zong, Tianjia Shao, Hongzhi Wu, Kun Zhou, Chenfanfu Jiang, Yin Yang tl;dr: position-based dynamics+3DGS
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
13
89
@zhenjun_zhao
Zhenjun Zhao
7 months
Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splatting Zeyu Yang, Hongye Yang, Zijie Pan, Xiatian Zhu, Li Zhang tl;dr: 4D Gaussians->spatio-temporal 4D volume of a dynamic scene
Tweet media one
Tweet media two
Tweet media three
0
13
90
@zhenjun_zhao
Zhenjun Zhao
2 months
Geometric Constraints in Deep Learning Frameworks: A Survey Vibhas K Vats, David J Crandall tl;dr: in title
Tweet media one
Tweet media two
0
28
91
@zhenjun_zhao
Zhenjun Zhao
4 months
Compressed 3D Gaussian Splatting for Accelerated Novel View Synthesis Simon Niedermayr, Josef Stumpfegger, Rüdiger Westermann tl;dr: directional colors and Gaussian parameters->sensitivity-aware vector quantization->compact codebooks
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
11
90
@zhenjun_zhao
Zhenjun Zhao
8 months
3D Reconstruction with Generalizable Neural Fields using Scene Priors Yang Fu, Shalini De Mello, Xueting Li, Amey Kulkarni, Jan Kautz, @xiaolonw , @SifeiL tl;dr: generalizable scene prior->fast, large-scale scene reconstruction of geometry and texture
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
16
90
@zhenjun_zhao
Zhenjun Zhao
5 months
SuperNormal: Neural Surface Reconstruction via Multi-View Normal Integration Xu Cao, Takafumi Taketomi tl;dr: directional finite difference and patch-based ray marching->SDF gradients
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
5
88
@zhenjun_zhao
Zhenjun Zhao
1 year
Point-SLAM: Dense Neural Point Cloud-based SLAM Erik Sandström, Yue Li, Luc Van Gool, @Martin_R_Oswald tl;dr: anchors neural features in a point cloud->mapping and tracking; dynamically adapting anchor point density to the information density of input
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
21
88
@zhenjun_zhao
Zhenjun Zhao
1 year
FastMESH: Fast Surface Reconstruction by Hexagonal Mesh-based Neural Rendering Yisu Zhang, Jianke Zhu, Lixiang Lin tl;dr: sample at the intersection of ray and mesh; space carving->initial mesh; hexagonal mesh regularization
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
21
87
@zhenjun_zhao
Zhenjun Zhao
6 months
LRM: Large Reconstruction Model for Single Image to 3D Yicong Hong, Kai Zhang, Jiuxiang Gu, Sai Bi, Yang Zhou, Difan Liu, Feng Liu, Kalyan Sunkavalli, Trung Bui, Hao Tan tl;dr: Create high-fidelity 3D object mesh from a single image in 5 seconds
Tweet media one
Tweet media two
Tweet media three
1
16
88
@zhenjun_zhao
Zhenjun Zhao
1 year
AutoRecon: Automated 3D Object Discovery and Reconstruction Yuang Wang, Xingyi He, Sida Peng, Haotong Lin, Hujun Bao, Xiaowei Zhou tl;dr: SfM->foreground objects localization+segmentation #CVPR2023
Tweet media one
Tweet media two
Tweet media three
Tweet media four
3
21
85
@zhenjun_zhao
Zhenjun Zhao
5 months
NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidance Hanlin Chen, Chen Li, @gimhee_lee tl;dr: 3DGS->point cloud->NeuS & NeuS->normals->3DGS
Tweet media one
Tweet media two
Tweet media three
0
16
84
@zhenjun_zhao
Zhenjun Zhao
6 months
Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Images Jaeyoung Chung, Jeongtaek Oh, Kyoung Mu Lee tl;dr: depth+3DGS
Tweet media one
Tweet media two
Tweet media three
1
21
85
@zhenjun_zhao
Zhenjun Zhao
4 months
3D Scene Geometry Estimation from 360∘ Imagery: A Survey Thiago Lopes Trugillo da Silveira, Paulo Gamarra Lessa Pinto, Jeffri Erwin Murrugarra Llerena, Claudio Rosito Jung tl;dr: in title
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
20
85
@zhenjun_zhao
Zhenjun Zhao
6 months
MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generation Zhiqi Li, Yiming Chen, Lingzhe Zhao, @PeidongLiu_ tl;dr: pretrained image diffusion network+trainable control network+SDS->controllable text-to-3D
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
15
83
@zhenjun_zhao
Zhenjun Zhao
6 months
An Efficient 3D Gaussian Representation for Monocular/Multi-view Dynamic Scenes Kai Katsumata, Duc Minh Vo, Hideki Nakayama tl;dr: representation for position and variance of 3D Gaussians as a function of time for modeling the motion of the scene
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
17
84
@zhenjun_zhao
Zhenjun Zhao
1 year
Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAM Hengyi Wang, Jingwen Wang, @LourdesAgapito tl;dr: joint coordinate and parametric encoding->scene #CVPR2023
Tweet media one
Tweet media two
Tweet media three
Tweet media four
3
20
81
@zhenjun_zhao
Zhenjun Zhao
7 months
Reconstructive Latent-Space Neural Radiance Fields for Efficient 3D Scene Representations Tristan Aumentado-Armstrong, Ashkan Mirzaei, Marcus A. Brubaker, Jonathan Kelly, Alex Levinshtein, @CSProfKGD , @igilitschenski tl;dr: autoencoder+NeRF
Tweet media one
Tweet media two
Tweet media three
0
10
84
@zhenjun_zhao
Zhenjun Zhao
5 months
Distributed Global Structure-from-Motion with a Deep Front-End Ayush Baid, John Lambert, Travis Driver, Akshay Krishnan, Hayk Stepanyan, @fdellaert tl;dr: deep-learning/classical front-ends+parallelizable and distributable global SfM with GTSAM
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
20
80
@zhenjun_zhao
Zhenjun Zhao
5 months
DUSt3R: Geometric 3D Vision Made Easy Shuzhe Wang, Vincent Leroy, Yohann Cabon, Boris Chidlovskii, Jerome Revaud tl;dr: regress a dense scene representation only from a pair of images, without prior info regarding camera calibration and viewpoint poses
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
16
80
@zhenjun_zhao
Zhenjun Zhao
8 months
2D-3D Pose Tracking with Multi-View Constraints Huai Yu, Kuangyi Chen, Wen Yang, @smash0190 , Gui-Song Xia tl;dr: a front-end hybrid flow estimation network for consecutive frames+a backend pose optimization module+a cross-modal consistency-based loss
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
24
81
@zhenjun_zhao
Zhenjun Zhao
5 months
Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fields Shijie Zhou, Haoran Chang, Sicheng Jiang, Zhiwen Fan, Zehao Zhu, Dejia Xu, Pradyumna Chari, Suya You, Zhangyang Wang, @AchutaKadambi tl;dr: 3DGS+distillation+2D model
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
13
80
@zhenjun_zhao
Zhenjun Zhao
1 year
Unsupervised Semantic Correspondence Using Stable Diffusion Eric Hedlin, Gopal Sharma, Shweta Mahajan, Hossam Isack, Abhishek Kar, @taiyasaki , @kwangmoo_yi tl;dr: no training or labels required, off-the-shelf diffusion models->semantic correspondences
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
22
78
@zhenjun_zhao
Zhenjun Zhao
5 months
ReconFusion: 3D Reconstruction with Diffusion Priors @ChrisWu6080 , @BenMildenhall , @philipphenzler , @KeunhongP , @RuiqiGao , @watson_nn , @_pratul_ , @dorverbin , @jon_barron , @poolio , @holynski_ tl;dr: diffusion prior->few-shot 3D reconstruction
Tweet media one
Tweet media two
Tweet media three
0
10
79
@zhenjun_zhao
Zhenjun Zhao
1 year
Neural Kernel Surface Reconstruction Jiahui Huang, @ZGojcic , @matanatzmon , @orlitany , @FidlerSanja , @frncswllms tl;dr: surface reconstruction algorithm using the neural kernel field representation #CVPR2023
Tweet media one
Tweet media two
Tweet media three
Tweet media four
3
14
77
@zhenjun_zhao
Zhenjun Zhao
2 months
GMKF: Generalized Moment Kalman Filter for Polynomial Systems with Arbitrary Noise Sangli Teng, Harry Zhang, David Jin, @Ashkan_Jasour , @GhaffariMaani , @lucacarlone1 tl;dr: batch setup->PoP+moment relaxations; filtering setup->PoP+moment relaxations
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
21
78
@zhenjun_zhao
Zhenjun Zhao
1 year
NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Images @YuanLiu41955461 , @Ashitaka1997 , Cheng Lin, Xiaoxiao Long, Jiepeng Wang, @LingjieLiu1 , Taku Komura, Wenping Wang tl;dr: direct+indirect lights->geometry+ BRDF
Tweet media one
Tweet media two
Tweet media three
Tweet media four
3
16
78
@zhenjun_zhao
Zhenjun Zhao
1 year
Neural Radiance Fields: Past, Present, and Future Ansh Mittal tl;dr: rendering, Implicit Learning, and NeRFs survey (in progress)
Tweet media one
1
15
75
@zhenjun_zhao
Zhenjun Zhao
11 months
ID-Pose: Sparse-view Camera Pose Estimation by Inverting Diffusion Models Weihao Cheng, Yan-Pei Cao, Ying Shan tl;dr: inverses the denoising diffusion process to estimate the relative pose given two input images
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
17
77
@zhenjun_zhao
Zhenjun Zhao
3 months
Local Feature Matching Using Deep Learning: A Survey Shibiao Xu, Shunpeng Chen, Rongtao Xu, Changwei Wang, Peng Lu, Li Guo tl;dr: Detector-based and Detector-free matching review since 2018
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
31
77
@zhenjun_zhao
Zhenjun Zhao
10 months
Neural 3D Scene Reconstruction from Multi-view Images without 3D Supervision Yi Guo, Che Sun, Yunde Jia, Yuwei Wu tl;dr: SDF+color+probability fields->scene; geometry constraints->complex geometry; plane constraints->low-textured planes
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
26
78
@zhenjun_zhao
Zhenjun Zhao
5 months
iComMa: Inverting 3D Gaussians Splatting for Camera Pose Estimation via Comparing and Matching Yuan Sun, et al. tl;dr: fixed 3DGS->rendered image+query->matching loss (via LoFTR) & comparing loss (via render-and-compare)
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
13
76
@zhenjun_zhao
Zhenjun Zhao
5 months
Zero-Shot Point Cloud Registration Weijie Wang, Guofeng Mei, Bin Ren, Xiaoshui Huang, Fabio Poiesi, Luc Van Gool, Nicu Sebe, Bruno Lepri tl;dr: novel transfer of image features from keypoints to the point cloud+3D geometric neighborhoods information
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
23
77
@zhenjun_zhao
Zhenjun Zhao
1 year
PermutoSDF: Fast Multi-View Reconstruction with Implicit Surfaces using Permutohedral Lattices Radu Alexandru Rosu, @SvenBehnke tl;dr: replace the voxel hash encoding with a permutohedral lattice #CVPR2023
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
15
76
@zhenjun_zhao
Zhenjun Zhao
1 month
GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyond Chongjie Ye, Yinyu Nie, Jiahao Chang, Yuantao Chen, Yihao Zhi, @XiaogHan tl;dr: in title+Gaussians->mesh extraction
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
12
76
@zhenjun_zhao
Zhenjun Zhao
25 days
SLAIM: Robust Dense Neural SLAM for Online Tracking and Mapping @VinceCartillier , @GrantSchindler , @irrfaan tl;dr: KL regularizer over ray termination distribution; image Gaussian pyramid filter (similar to hierarchical Lucas-Kanade optical flow)->NeRF
Tweet media one
Tweet media two
Tweet media three
Tweet media four
3
17
77
@zhenjun_zhao
Zhenjun Zhao
2 months
2D Gaussian Splatting for Geometrically Accurate Radiance Fields Binbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger, Shenghua Gao tl;dr: represent a 3D scene with 2D Gaussian primitives, each defining an oriented elliptical disk
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
12
76
@zhenjun_zhao
Zhenjun Zhao
4 months
Deblurring 3D Gaussian Splatting Byeonghyeon Lee, Howoong Lee, Xiangyu Sun, Usman Ali, Eunbyung Park tl;dr: 3D Gaussians->MLP->transformed 3D Gaussians->covariance matrix of 3D Gaussian->differentiable rasterizer->spatially changing blur
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
9
73
@zhenjun_zhao
Zhenjun Zhao
21 days
Unified Scene Representation and Reconstruction for 3D Large Language Models Tao Chu, et al. tl;dr: 2D encoder with SAM&CLIP+3D decoder+multi-scale GRU->3D geometric&semantic aware representation+reconstruction->LLMs->3D vision-language understanding
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
13
76
@zhenjun_zhao
Zhenjun Zhao
4 months
PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistency Yue Pan, Xingguang Zhong, Louis Wiesmann, Thorbjörn Posewsky, Jens Behley, Cyrill Stachniss tl;dr: implicit neural LiDAR SLAM
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
14
75
@zhenjun_zhao
Zhenjun Zhao
11 months
RePaint-NeRF: NeRF Editting via Semantic Masks and Diffusion Models Xingchen Zhou, Ying He, F. Richard Yu, Jianqiang Li, You Li tl;dr: NeRF+diffusion model->edit 3D content in NeRF
Tweet media one
Tweet media two
Tweet media three
0
13
73
@zhenjun_zhao
Zhenjun Zhao
5 months
PlatoNeRF: 3D Reconstruction in Plato's Cave via Single-View Two-Bounce Lidar Tzofi Klinghoffer, Xiaoyu Xiang, Siddharth Somasundaram, Yuchen Fan, @c_richardt , @raskarmit , Rakesh Ranjan tl;dr: NeRF->single-view two-bounce lidar time of flight->3D scene
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
14
74
@zhenjun_zhao
Zhenjun Zhao
9 months
Neural radiance fields in the industrial and robotics domain: applications, research opportunities and use cases Eugen Šlapak, Enric Pardo, Matúš Dopiriak, Taras Maksymyuk, Juraj Gazda tl;dr: NeRF industrial applications and future research endeavors
Tweet media one
Tweet media two
0
22
74
@zhenjun_zhao
Zhenjun Zhao
5 months
Multi-Scale 3D Gaussian Splatting for Anti-Aliased Rendering Zhiwen Yan, Weng Fei Low, Yu Chen, @gimhee_lee tl;dr: pixel coverage of 3D Gaussians->selective rendering
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
8
75
@zhenjun_zhao
Zhenjun Zhao
5 months
Splatter Image: Ultra-Fast Single-View 3D Reconstruction Stanislaw Szymanowicz, Christian Rupprecht, Andrea Vedaldi tl;dr: a 2D image-to-image network to map the input image to one 3D Gaussian per pixel
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
20
73
@zhenjun_zhao
Zhenjun Zhao
1 month
Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondences Axel Barroso-Laguna, @scriptide , @viprad , @eric_brachmann tl;dr: learn keypoint+confidence+descriptor+depth->3D keypoint->metric correspondences->metric relative pose
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
11
75
@zhenjun_zhao
Zhenjun Zhao
9 months
Color-NeuS: Reconstructing Neural Implicit Surfaces with Color Licheng Zhong, Lixin Yang, Kailin Li, Haoyu Zhen, Mei Han, Cewu Lu tl;dr: decouple the view-dependent process in neural volume rendering; relighting network to sustain volume rendering
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
17
73
@zhenjun_zhao
Zhenjun Zhao
1 month
Marrying NeRF with Feature Matching for One-step Pose Estimation Ronghan Chen, Yang Cong, Yu Ren tl;dr: initial pose+Instant-NGP->rendered img+target img->LoFTR->2D matches+rendered depth->3D points+2D points->PnP+RANSAC->final pose
Tweet media one
Tweet media two
Tweet media three
0
10
74
@zhenjun_zhao
Zhenjun Zhao
5 months
GS-IR: 3D Gaussian Splatting for Inverse Rendering Zhihao Liang, Qi Zhang, Ying Feng, Ying Shan, Kui Jia tl;dr: 3DGS->NVS+relighting; depth-derivationbased regularization->normal estimation; bakingbased occlusion->indirect lighting
Tweet media one
Tweet media two
Tweet media three
Tweet media four
0
11
72
@zhenjun_zhao
Zhenjun Zhao
11 months
iSLAM: Imperative SLAM Taimeng Fu, Shaoshu Su, @DrChenWang tl;dr: front-end +back-end->imperative learning->bi-level optimization; differentiable scale correction->front-end, pose-velocity graph optimization->back-end
Tweet media one
Tweet media two
Tweet media three
Tweet media four
3
15
72
@zhenjun_zhao
Zhenjun Zhao
8 months
On-the-Fly SfM: What you capture is What you get Zongqian Zhan, Rui Xia, Yifei Yu, Yibo Xu, Xin Wang tl;dr: learning-based global feature+vocabulary tree->fast image retrieval; least squares->correspondence refinement; hierarchical weighted local BA
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
17
72
@zhenjun_zhao
Zhenjun Zhao
5 months
Visual Geometry Grounded Deep Structure From Motion Jianyuan Wang, Nikita Karaev, @chrirupp , @davnov134 tl;dr:deep point tracker (not correspondence estimation)->track features+imgs->Transformer->initial cameras+3D points->differentiable BA with Theseus
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
10
70
@zhenjun_zhao
Zhenjun Zhao
3 months
Neural Rendering based Urban Scene Reconstruction for Autonomous Driving Shihao Shen, Louis Kerofsky, Varun Ravi Kumar, Senthil Yogamani tl;dr: multimodal 3D scene reconstruction
Tweet media one
Tweet media two
Tweet media three
Tweet media four
1
13
72
@zhenjun_zhao
Zhenjun Zhao
1 year
BundleRecon: Ray Bundle-Based 3D Neural Reconstruction Weikun Zhang, Jianke Zhu tl;dr: sample a patch of pixels using a bundle of rays to incorporate information from neighboring pixels
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
11
70