Lifting Freehand Concept Sketches into 3D - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles ACM Transactions on Graphics Year : 2020

Lifting Freehand Concept Sketches into 3D


We present the first algorithm capable of automatically lifting real-world, vector-format, industrial design sketches into 3D. Targeting real-world sketches raises numerous challenges due to inaccuracies, use of overdrawn strokes, and construction lines. In particular, while construction lines convey important 3D information, they add significant clutter and introduce multiple accidental 2D intersections. Our algorithm exploits the geometric cues provided by the construction lines and lifts them to 3D by computing their intended 3D intersections and depths. Once lifted to 3D, these lines provide valuable geometric constraints that we leverage to infer the 3D shape of other artist drawn strokes. The core challenge we address is inferring the 3D connectivity of construction and other lines from their 2D projections by separating 2D intersections into 3D intersections and accidental occlusions. We efficiently address this complex combinatorial problem using a dedicated search algorithm that leverages observations about designer drawing preferences , and uses those to explore only the most likely solutions of the 3D intersection detection problem. We demonstrate that our separator outputs are of comparable quality to human annotations, and that the 3D structures we recover enable a range of design editing and visualization applications, including novel view synthesis and 3D-aware scaling of the depicted shape.
Fichier principal
Vignette du fichier
LiftingSketches.pdf (49.46 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-02952509 , version 1 (29-09-2020)



Yulia Gryaditskaya, Felix Hähnlein, Chenxi Liu, Alla Sheffer, Adrien Bousseau. Lifting Freehand Concept Sketches into 3D. ACM Transactions on Graphics, 2020, Proceedings of SIGGRAPH Asia, ⟨10.1145/3414685.3417851⟩. ⟨hal-02952509⟩
190 View
92 Download



Gmail Mastodon Facebook X LinkedIn More