Point2Part: Unified 3D Partitioning From Point Prompts

Hao-Tang Tsui, Yu-Rou Tuan, Xiaoxuan Ma, Nicolás Ugrinovic, Takaaki Shiratori, Kris Kitani

Carnegie Mellon University

Gallery

Given one point prompt per desired part, our model produces the parts as a complete partition of the whole.

generated parts drag to orbit · scroll to zoom · right-drag to pan
from a mesh
from one image

TL;DR/ Part decomposition as a partition of the whole

We formulate part decomposition as a joint partitioning of the entire shape, where parts are exclusive and exhaustive by construction, while enabling users to specify desired parts through point prompts.

Exclusive
Distinct parts have no volume overlap.
Exhaustive
Their union recovers the entire object.

Motivation/ Parts may leave gaps or overlap

Existing methods do not necessarily form a partition: parts may leave gaps (outlined) or overlap (red).

The same robot three ways, in one shared colouring: every part takes the colour of the ground-truth part it covers. On the left, a baseline decomposition assembled part by part from two published methods, three parts from CubePart and nine from X-Part, with the regions neither of them recovers left empty: first that decomposition, then a grey copy with the volume its parts claim twice painted red. On the right, our decomposition and our grey copy, which has no red on it.

Unified promptable model

Image-to-part generation, mesh-to-part generation, and part segmentation.

An image becomes a whole 3D shape, or a mesh is given directly; one point prompt is placed on each part of that shape; from there the model either generates a closed mesh per part or labels each face of the input mesh.

Controllable/ Point prompts make decomposition directly controllable

A 3D mesh admits valid decompositions at different granularities, set by the prompts.

The arm split into 2 parts
2 prompts
The arm split into 4 parts
4 prompts
The arm split into 6 parts
6 prompts

Method/ Unified promptable 3D decomposition

Results/ Best part quality on all three tasks

We lead on all part-quality metrics and improve geometric compatibility by an order of magnitude.

Single image → generated closed parts
Methodpart CD ↓part F1@.05 ↑pen % ↓watertight % ↑
Ours0.05340.6860.01100.0
OmniPart0.06430.6100.9694.7
PartPacker0.08110.5401.2586.0
PartCrafter0.12750.3002.4570.5
Mesh → generated closed parts
Methodpart CD ↓part F1@.05 ↑pen % ↓watertight % ↑
Ours0.02730.8440.06100.0
X-Part0.04530.7303.0590.8
CubePart0.04710.7402.09100.0
HoloPart + P3-SAM0.05290.7101.0132.6
Mesh → per-face labels
MethodmIoU ↑part CD ↓part F1@.05 ↑sec ↓
Ours69.800.02100.8700.3
PartField69.100.05310.7251.1
P3-SAM54.660.04330.74819.1
S2AM3D50.430.03160.8050.3
PartSAM50.310.03240.79236.6
Point-SAM39.120.05370.6871.2
Ours, 4 points per part74.840.01350.9180.3

Citation

Cite this work

The preprint is on arXiv as arXiv:2609.38180.

@article{tsui2026point2part,
  title   = {Point2Part: Unified 3D Partitioning from Point Prompts},
  author  = {Tsui, Hao-Tang and Tuan, Yu-Rou and Ma, Xiaoxuan and
             Ugrinovic, Nicol{\'a}s and Shiratori, Takaaki and Kitani, Kris},
  journal = {arXiv preprint arXiv:2609.38180},
  year    = {2026}
}