The overview of our method. (a) The upper branch learns parameterization by covering 3D points S generated from 2D samples U onto the sparse input P like a sheet. The lower branch generates denser 3D points G from 2D samples U′ to guide SDF learning. And the two branches share parameters. (b) We learn an SDF by sampling 3D queries Q and pulling them into Q′ to cover the sparse input P, and constrains signed distances at points in P.
We propose a novel method called SHS-Net for oriented normal estimation of point clouds by learning signed hyper surfaces, which can accurately predict normals with global consistent orientation from various point clouds. Almost all existing methods estimate oriented normals through a two-stage pipeline, i.e., unoriented normal estimation and normal orientation, and each step is implemented by a separate algorithm. However, previous methods are sensitive to parameter settings, resulting in poor results from point clouds with noise, density variations and complex geometries. In this work, we introduce signed hyper surfaces (SHS), which are parameterized by multi-layer perceptron (MLP) layers, to learn to estimate oriented normals from point clouds in an end-to-end manner. The signed hyper surfaces are implicitly learned in a high-dimensional feature space where the local and global information is aggregated. Specifically, we introduce a patch encoding module and a shape encoding module to encode a 3D point cloud into a local latent code and a global latent code, respectively. Then, an attention-weighted normal prediction module is proposed as a decoder, which takes the local and global latent codes as input to predict oriented normals. Experimental results show that our SHS-Net outperforms the state-of-the-art methods in both unoriented and oriented normal estimation on the widely used benchmarks.
The learning pipeline of the signed hyper surfaces for oriented normal estimation. We propose to implicitly learn signed hyper surfaces in the feature space for estimating oriented normals. This new surface representation is learned from patch encoding and shape encoding using our designed loss functions.
This dataset can be download from here.
Scene 1 | Scene 2 |
---|---|
|
|
@inproceedings{li2023shsnet,
author = {Li, Qing and Feng, Huifang and Shi, Kanle and Gao, Yue and Fang, Yi and Liu, Yu-Shen and Han, Zhizhong},
title = {{SHS-Net}: Learning Signed Hyper Surfaces for Oriented Normal Estimation of Point Clouds},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
pages = {13591-13600},
month = {June},
year = {2023},
doi = {10.1109/CVPR52729.2023.01306},
url = {https://doi.ieeecomputersociety.org/10.1109/CVPR52729.2023.01306},
}
@article{li2024shsnet-pami,
author = {Li, Qing and Feng, Huifang and Shi, Kanle and Gao, Yue and Fang, Yi and Liu, Yu-Shen and Han, Zhizhong},
title = {Learning Signed Hyper Surfaces for Oriented Point Cloud Normal Estimation},
booktitle = {IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)},
year = {2024},
doi = {10.1109/TPAMI.2024.3431221},
}