点云
计算机科学
云计算
点(几何)
代表(政治)
钥匙(锁)
语义计算
语义网格
语义学(计算机科学)
语义网络
人工智能
变压器
关系(数据库)
语义数据模型
情报检索
语义映射
芯(光纤)
理论计算机科学
语义相似性
数据挖掘
自然语言处理
组分(热力学)
知识表示与推理
信息模型
几何数据分析
作者
Zhensheng Zhou,Jianqing Liang,Jiye Liang,Zijin Du,Chenghao Fang
标识
DOI:10.1609/aaai.v40i16.38396
摘要
The primary goal of 3D point cloud completion is to reconstruct complete and high-resolution point clouds from incomplete and low-resolution inputs. While some recent approaches have achieved satisfactory completion performance by incorporating additional images, there remains room for improvement in fully exploiting and utilizing the rich geometric relation information contained in parts. To address this challenge, we propose a novel Semantic Guided Part Relation-aware Network (SGPRNet) for Point Cloud Completion. Its core innovation lies in establishing part semantic relations to guide the reconstruction of structurally consistent local geometries. Specifically, we utilize Large Multi-modal Models (LMMs) to automatically generate the specific text of 3D shape, which provides detailed geometric part relations descriptions. Building upon this, we design an Orthogonal Semantic Part Transfer (OSPT) module that learns transferable semantic relations between geometric parts. Subsequently, we develop a Semantic Geometric Relation-aware Transformer (SGRFormer) to progressively refine these semantic features, enhancing point cloud representation and guiding the generation of fine local structures. In addition, we establish a point-text pairs corpus, OmniObject3D-212/34 and Text-ViPC datasets based on existing OmniObject3D and ShapeNet-ViPC datasets, incorporating the specific text. Extensive experimental results demonstrate that our method outperforms existing state-of-the-art completion methods.
科研通智能强力驱动
Strongly Powered by AbleSci AI