A reading list of papers related to sketch processing and applications. This is supplementary to the SGP 2024 course "Fundamentals and Applications of Sketch Processing" made by Mikhail Bessmeltsev and Chenxi Liu.
- 1. 2D Spline Construction
- 2. 3D Sketching Interface
- 3. Sketch Vectorization
- 4. Sketch Beautification
- 5. Sketch Interpolation
- 6. Sketch Topology
- 7. Sketch Cleanup/Simplification/Consolidation
- 8. Flat Colorization/Junction Reconstruction
- 9. 2D Sketch Lifting
- 10. 3D Sketch Surfacing
- 11. Sketch-Based Modeling
- 12. Sketch-Based Editing
- 13. Sketch-Based Animation Control
- 14. Sketch Perception
- 15. Vision Tasks on Sketches
| Paper | Source | Code/Project Link |
|---|---|---|
| Sketching Piecewise Clothoid Curves | SBIM 2009 | [project] |
| Sketching Clothoid Splines Using Shortest Paths | Eurographics 2010 | [code] |
| Neatening sketched strokes using piecewise French Curves | SBIM 2011 | [project] |
| Elasticurves: Exploiting Stroke Dynamics and Inertia for the Real-time Neatening of Sketched 2D Curves | UIST 2011 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| Interactive Sketch-Based Interfaces and Modelling for Design (Book Chapter 7-10) | River Publishers; 1st edition (2023) | [chapters] |
| Experimental Evaluation of Sketching on Surfaces in VR | CHI 2017 | [code] |
| ScafoldSketch: Accurate Industrial Design Drawing in VR | UIST 2021 | [project] |
| CASSIE: Curve and Surface Sketching in Immersive Environments | CHI 2021 | [project] |
| 3D-Layers: Bringing Layer-Based Color Editing to VR Painting | SIGGRAPH 2024 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| Learning to Simplify: Fully Convolutional Networks for Rough Sketch Cleanup | SIGGRAPH 2016 | [project] |
| Mastering Sketching: Adversarial Augmentation for Structured Prediction | SIGGRAPH 2018 | [project] |
| Real-Time Data-Driven Interactive Rough Sketch Inking | SIGGRAPH 2018 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| Topology-Driven Vectorization of Clean Line Drawings | SIGGRAPH 2012 | [project] |
| Fidelity vs. Simplicity: a Global Approach to Line Drawing Vectorization | SIGGRAPH 2016 | [project] |
| Vectorization of Line Drawings via PolyVector Fields | SIGGRAPH 2019 | [project] |
| A Benchmark for Rough Sketch Cleanup | SIGGRAPH Asia 2020 | [project] |
| Integer‐Grid Sketch Simplification and Vectorization | SGP 2020 | [project] |
| Keypoint-Driven Line Drawing Vectorization via PolyVector Flow | SIGGRAPH Asia 2021 | [project] |
| General Virtual Sketching Framework for Vector Line Art | SIGGRAPH 2021 | [project] |
| Deep Sketch Vectorization via Implicit Surface Extraction | SIGGRAPH 2024 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| An Automatic Beautifier for Drawings and Illustrations | SIGGRAPH 1985 | |
| Interactive Beautification: A Technique for Rapid Geometric Design | UIST 1997 | [video] |
| PaleoSketch: Accurate Primitive Sketch Recognition and Beautification | IUI 2008 | |
| Towards Beautification of Freehand Sketches Using Suggestions | SBIM 2009 | [project] |
| QuickDraw: Improving Drawing Experience for Geometric Diagrams | CHI 2012 | |
| Advanced Drawing Beautification with ShipShape | Computers & Graphics 2016 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| Betweenit An Interactive Tool For Tight Inbetweening | Eurographics 2010 | [project] [video] |
| Computer-Assisted Animation of Line and Paint in Disney’s Paperman | SIGGRAPH 2012 Talks | [project] [video] |
| Joint Stroke Tracing and Correspondence for 2D Animation | SIGGRAPH 2024 | [project] |
| Bounded Biharmonic Weights for Real-Time Deformation | SIGGRAPH 2011 | [project] |
| The Animation Transformer: Visual Correspondence via Segment Matching | ICCV 2021 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| Vector Graphics Complexes | SIGGRAPH 2014 | [project] |
| Vector Graphics Animation with Time-Varying Topology | SIGGRAPH 2015 | [project] |
| Flow-Complex-Based Shape Reconstruction From 3D Curve Sketches | SIGGRAPH 2014 | [project] |
| Differential Operators on Sketches via Alpha Contours | SIGGRAPH 2023 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| A Benchmark for Rough Sketch Cleanup | SIGGRAPH Asia 2020 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| A Mark-Based Interaction Paradigm for Free-Hand Drawing | UIST 1994 | |
| ILoveSketch: As-Natural-As-Possible Sketching System for Creating 3D Curve Models | UIST 2008 | [project] |
| Just DrawIt: A 3D Sketching System | SBIM 2012 |
| Paper | Source | Code/Project Link |
|---|---|---|
| Geometric Clustering for Line Drawing Simplification | EGSR 2005 | [project] |
| Efficient and Dynamic Simplification of Line Drawings | Eurographics 2008 | |
| Beautification of Design Sketches Using Trainable Stroke Clustering and Curve Fitting | TVCG 2011 | [data] |
| Closure-aware Sketch Simplification | SIGGRAPH 2015 | [project] |
| StrokeAggregator: Consolidating Raw Sketches into Artist-Intended Curve Drawings | SIGGRAPH 2018 | [project] |
| StripMaker: Perception-driven Learned Vector Sketch Consolidation | SIGGRAPH 2023 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| Sketch-Based 3D-Shape Creation for Industrial Styling Design | CG&A 2007 | |
| Beautification of Design Sketches Using Trainable Stroke Clustering and Curve Fitting | TVCG 2011 | [data] |
| StrokeStrip: Joint Parameterization and Fitting of Stroke Clusters | SIGGRAPH 2021 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| Vectorizing Cartoon Animations | TVCG 2009 | |
| LazyBrush: Flexible Painting Tool for Hand-drawn Cartoons | Eurographics 2009 | [project] |
| Color by Numbers: Interactive Structuring and Vectorization of Sketch Imagery | CHI 2021 | |
| Delaunay Painting: Perceptual Image Colouring from Raster Contours with Gaps | Eurographics 2022 | [video] |
| Paper | Source | Code/Project Link |
|---|---|---|
| Automatic Gap Closing for Freehand Drawing | SIGGRAPH 1994 Technical Sketch | |
| Dynamic Planar Map Illustration | SIGGRAPH 2007 | |
| Handling Gaps for Vector Graphics Coloring | CGI 2021 | [video] |
| A Fast and Efficient Semi-guided Algorithm for Flat Coloring Line-arts | Eurographics 2018 | |
| Endpoint Fusing Method for Axonometric Drawing of Online Freehand Sketched Polyhedrons | The Visual Computer 2020 | |
| Detecting Viewer-Perceived Intended Vector Sketch Connectivity | SIGGRAPH 2022 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| Joint Gap Detection and Inpainting of Line Drawings | CVPR 2017 | [code] |
| DanbooRegion: An Illustration Region Dataset | ECCV 2020 | [project] |
| User-Guided Line Art Flat Filling with Split Filling Mechanism | CVPR 2021 | [project] |
| FlatMagic: Improving Flat Colorization through AI-driven Design for Digital Comic Professionals | CHI 2022 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| Optimization-Based Reconstruction of a 3D Object From a Single Freehand Line Drawing | SIGGRAPH 2007 course | |
| OpenSketch: A Richly-Annotated Dataset of Product Design Sketches | SIGGRAPH Asia 2019 | [project] |
| Lifting Freehand Concept Sketches into 3D | SIGGRAPH Asia 2020 | [project] |
| Symmetry-driven 3D Reconstruction from Concept Sketches | SIGGRAPH 2022 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| SurfaceBrush: From Virtual Reality Drawings to Manifold Surfaces | SIGGRAPH 2019 | [project] |
| Variational Implicit Point Set Surface | SIGGRAPH 2019 | [code] |
| Piecewise-Smooth Surface Fitting onto Unstructured 3D Sketches | SIGGRAPH 2022 | [project] |
| Globally Consistent Normal Orientation for Point Clouds by Regularizing the Winding-number Field | SIGGRAPH 2023 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| Teddy: A Sketching Interface for 3D Freeform Design | SIGGRAPH 1999 | [project] |
| FiberMesh: Designing Freeform Surfaces with 3D Curves | SIGGRAPH 2007 | [project] |
| Ink-and-Ray: Bas-Relief Meshes for Adding Global Illumination Effects to Hand-Drawn Characters | SIGGRAPH 2014 | [project] |
| Modeling Character Canvases from Cartoon Drawings | SIGGRAPH 2015 | [project] |
| RodMesh: Two-handed 3D Surface Modeling in Virtual Reality | VMV 2019 | [project] |
| Monster Mash: A Single-View Approach to Casual 3D Modeling and Animation | SIGGRAPH Asia 2020 | [project] |
| ToonSynth: Example-Based Synthesis of Hand-Colored Cartoon Animations | SIGGRAPH 2018 | [project] |
| SmoothSketch: 3D free-form shapes from complex sketches | SIGGRAPH 2006 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| Analytic Drawing of 3D Scaffolds | SIGGRAPH Asia 2009 | [project] |
| CrossShade: Shading Concept Sketches Using Cross-Section Curves | SIGGRAPH 2012 | [project] |
| Sketch-to-Design: Context-based Part Assembly | Computer Graphics Forum 2013 | |
| True2Form: 3D Curve Networks from 2D Sketches via Selective Regularization | SIGGRAPH 2014 | [project] |
| SENS: Part-Aware Sketch-based Implicit Neural Shape Modeling | Eurographics 2024 | [project] |
| Sketch2CAD: Sequential CAD Modeling by Sketching in Context | SIGGRAPH Asia 2020 | [project] |
| Free2CAD: Parsing Freehand Drawings Into CAD Commands | SIGGRAPH 2022 | [project] |
| [3D Sketching using Multi-View Deep Volumetric Prediction] (https://dl.acm.org/doi/10.1145/3203197) | ACM Computer Graphics and Interactive Techniques | [project] |
| [Locally Attentional SDF Diffusion for Controllable 3D Shape Generation] (https://dl.acm.org/doi/10.1145/3592103) | SIGGRAPH 2023 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| SecondSkin: Sketch-based Construction of Layered 3D Models | SIGGRAPH 2015 | [project] |
| Interactive Sketching of Urban Procedural Models | SIGGRAPH 2016 | [project] |
| FoldSketch: Enriching Garments with Physically Reproducible Folds | SIGGRAPH 2018 | [project] |
| Interactive Liquid Splash Modeling by User Sketches | SIGGRAPH Asia 2020 | [project] |
| SketchHairSalon: Deep Sketch-based Hair Image Synthesis | SIGGRAPH Asia 2021 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| A Sketch-Based Interface for Detail-Preserving Mesh Editing | SIGGRAPH 2005 | [project] |
| Modeling from Contour Drawings | SBIM 2009 | |
| Sketching in Gestalt Space: Interactive Shape Abstraction through Perceptual Reasoning | Computer Graphics Forum 2018 | [project] |
| Sketch2Mesh: Reconstructing and Editing 3D Shapes from Sketches | ICCV 2021 | [code] |
| SKED: Sketch-guided Text-based 3D Editing | ICCV 2023 | [project] |
| SketchDream: Sketch-based Text-to-3D Generation and Editing | SIGGRAPH 2024 | [project] |
| Squidgets: Sketch-based Widget Design and Direct Manipulation of 3D Scenes | 2024 |
| Paper | Source | Code/Project Link |
|---|---|---|
| The Line of Action: an Intuitive Interface for Expressive Character Posing | SIGGRAPH Asia 2013 | [project] |
| Differential Blending for Expressive Sketch-Based Posing | SCA 2013 | [project] |
| Gesture3D: Posing 3D Characters via Gesture Drawings | SIGGRAPH Asia 2016 | [project] |
| Sketch2Pose: Estimating a 3D Character Pose from a Bitmap Sketch | SIGGRAPH 2022 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| Space-Time Sketching of Character Animation | SIGGRAPH 2015 | [project] |
| SketchiMo: Sketch-based Motion Editing for Articulated Characters | SIGGRAPH 2016 | [project] |
| Tangent-Space Optimization for Interactive Animation Control | SIGGRAPH 2019 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| Where Do People Draw Lines? | SIGGRAPH 2008 | [project] |
| How Well Do Line Drawings Depict Shape? | SIGGRAPH 2009 | [project] |
| Tracing Versus Freehand for Evaluating Computer-Generated Drawings | SIGGRAPH 2021 | [project] |
| DifferSketching: How Differently Do People Sketch 3D Objects? | SIGGRAPH Asia 2022 | [project] |
| The Role of Edges in Line Drawing Perception | Perception 2021 | |
| On expert performance in 3D curve-drawing tasks | SBIM 2009 | |
| Toward a Theory of Perspective Perception in Pictures | Journal of Vision 2024 | [project] |
| Principles of Gestalt Psychology | Routledge & K. Paul, 1955 | |
| Integration of contours: New Insights | Trends Cogn. Sci. 1999 |
| Paper | Source | Code/Project Link |
|---|---|---|
| Deep Learning for Free-Hand Sketch: A Survey | TPAMI 2022 | [project] |
| OpenSketch: A Richly-Annotated Dataset of Product Design Sketches | SIGGRAPH Asia 2019 | [project] |
| Creative Flow+ Dataset | CVPR 2019 | [project] |
| Deep Sketch-Based Modeling: Tips and Tricks | 3DV 2020 | [code] |
| Neural Strokes: Stylized Line Drawing of 3D Shapes | ICCV 2021 | [project] |
| CAD2Sketch: Generating Concept Sketches from CAD Sequences | SIGGRAPH Asia 2022 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| SketchDesc: Learning Local Sketch Descriptors for Multi-view Correspondence | TCSVT 2020 | [project] |
| SketchZooms: Deep Multi-view Descriptors for Matching Line Drawings | Computer Graphics Forum 2020 | [project] |
| SEVA: Leveraging Sketches to Evaluate Alignment between Human and Machine Visual Abstraction | NeurIPS 2023 | [project] |
| Paper | Source | Code/Project Link |
|---|---|---|
| CLIPasso: Semantically-Aware Object Sketching | SIGGRAPH 2022 | [project] |
| CLIPascene: Scene Sketching with Different Types and Levels of Abstraction | ICCV 2023 | [project] |
| SketchKnitter: Vectorized Sketch Generation with Diffusion Models | ICLR 2023 | [project] |
| Breathing Life Into Sketches Using Text-to-Video Priors | CVPR 2024 | [project] |
| Ridge-Valley Lines on Meshes via Implicit Surface Fitting | SIGGRAPH 2004 | |
| Apparent Ridges for Line Drawings | SIGGRAPH 2007 | [project] |