{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T08:17:10Z","timestamp":1774685830665,"version":"3.50.1"},"reference-count":91,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2023,7,26]],"date-time":"2023-07-26T00:00:00Z","timestamp":1690329600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2023,8]]},"abstract":"<jats:p>Point patterns are characterized by their density and correlation. While spatial variation of density is well-understood, analysis and synthesis of spatially-varying correlation is an open challenge. No tools are available to intuitively edit such point patterns, primarily due to the lack of a compact representation for spatially varying correlation. We propose a low-dimensional perceptual embedding for point correlations. This embedding can map point patterns to common three-channel raster images, enabling manipulation with off-the-shelf image editing software. To synthesize back point patterns, we propose a novel edge-aware objective that carefully handles sharp variations in density and correlation. The resulting framework allows intuitive and backward-compatible manipulation of point patterns, such as recoloring, relighting to even texture synthesis that have not been available to 2D point pattern design before. Effectiveness of our approach is tested in several user experiments. Code is available at https:\/\/github.com\/xchhuang\/patternshop.<\/jats:p>","DOI":"10.1145\/3592418","type":"journal-article","created":{"date-parts":[[2023,7,26]],"date-time":"2023-07-26T14:29:21Z","timestamp":1690381761000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Patternshop: Editing Point Patterns by Image Manipulation"],"prefix":"10.1145","volume":"42","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2769-8408","authenticated-orcid":false,"given":"Xingchang","family":"Huang","sequence":"first","affiliation":[{"name":"Max Planck Institute for Informatics, Saarbr\u00fccken, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1715-7306","authenticated-orcid":false,"given":"Tobias","family":"Ritschel","sequence":"additional","affiliation":[{"name":"University College London (UCL), London, United Kingdom"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1343-8613","authenticated-orcid":false,"given":"Hans-Peter","family":"Seidel","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Informatics, Saarbr\u00fccken, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8811-6889","authenticated-orcid":false,"given":"Pooran","family":"Memari","sequence":"additional","affiliation":[{"name":"Centre National de la Recherche Scientifique - Laboratoire d'informatique de l'\u00c9cole Polytechnique (LIX), Paris, France"},{"name":"INRIA, Paris, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0970-5835","authenticated-orcid":false,"given":"Gurprit","family":"Singh","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Informatics, Saarbr\u00fccken, Germany"}]}],"member":"320","published-online":{"date-parts":[[2023,7,26]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"crossref","unstructured":"Rameen Abdal Yipeng Qin and Peter Wonka. 2019. Image2stylegan: How to embed images into the stylegan latent space?. In ICCV. 4432--4441.","DOI":"10.1109\/ICCV.2019.00453"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2641963"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818139"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980218"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024181"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531392"},{"key":"e_1_2_2_7_1","volume-title":"Image Inpainting. In Proc. SIGGRAPH. 417--424","author":"Bertalmio Marcelo","year":"2000","unstructured":"Marcelo Bertalmio, Guillermo Sapiro, Vincent Caselles, and Coloma Ballester. 2000. Image Inpainting. In Proc. SIGGRAPH. 417--424."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508375"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276506"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00821"},{"key":"e_1_2_2_12_1","unstructured":"ClipDrop. 2023. Relight API. https:\/\/clipdrop.co\/relight"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/7529.8927"},{"key":"e_1_2_2_14_1","article-title":"Blue noise through optimal transport","volume":"31","author":"Goes Fernando De","year":"2012","unstructured":"Fernando De Goes, Katherine Breeden, Victor Ostromoukhov, and Mathieu Desbrun. 2012. Blue noise through optimal transport. ACM Trans. Graph. 31, 6 (2012).","journal-title":"ACM Trans. Graph."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8659.00396"},{"key":"e_1_2_2_16_1","doi-asserted-by":"crossref","unstructured":"Oliver Deussen and Tobias Isenberg. 2013. Halftoning and Stippling. In Image and Video-Based Artistic Stylisation Paul Rosin and John Collomosse (Eds.). Springer London 45--61.","DOI":"10.1007\/978-1-4471-4519-6_3"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661282"},{"key":"e_1_2_2_18_1","volume-title":"Dipp\u00e9 and Erling Henry Wold","author":"Mark A.","year":"1985","unstructured":"Mark A. Z. Dipp\u00e9 and Erling Henry Wold. 1985. Antialiasing through Stochastic Sampling. In SIGGRAPH. 69--78."},{"key":"e_1_2_2_19_1","volume-title":"Visual search and stimulus similarity. Psychological review 96, 3","author":"Duncan John","year":"1989","unstructured":"John Duncan and Glyn W Humphreys. 1989. Visual search and stimulus similarity. Psychological review 96, 3 (1989), 433."},{"key":"e_1_2_2_21_1","volume-title":"Freeman","author":"Efros Alexei A.","year":"2001","unstructured":"Alexei A. Efros and William T. Freeman. 2001. Image Quilting for Texture Synthesis and Transfer. In SIGGRAPH. 341--346."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766975"},{"key":"e_1_2_2_23_1","volume-title":"Color appearance models","author":"Fairchild Mark D","unstructured":"Mark D Fairchild. 2013. Color appearance models. John Wiley & Sons."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964943"},{"key":"e_1_2_2_25_1","doi-asserted-by":"crossref","unstructured":"Leon A. Gatys Alexander S. Ecker and Matthias Bethge. 2016. Image Style Transfer Using Convolutional Neural Networks. In CVPR. 2414--2423.","DOI":"10.1109\/CVPR.2016.265"},{"key":"e_1_2_2_26_1","article-title":"PATEX","volume":"35","author":"Guerrero Paul","year":"2016","unstructured":"Paul Guerrero, Gilbert Bernstein, Wilmot Li, and Niloy J. Mitra. 2016. PATEX: Exploring Pattern Variations. ACM Trans. Graph. 35, 4 (2016).","journal-title":"Exploring Pattern Variations. ACM Trans. Graph."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487228.2487233"},{"key":"e_1_2_2_28_1","doi-asserted-by":"crossref","unstructured":"Philipp Henzler Niloy J Mitra and Tobias Ritschel. 2019. Learning a Neural 3D Texture Space from 2D Exemplars. In CVPR.","DOI":"10.1109\/CVPR42600.2020.00838"},{"key":"e_1_2_2_29_1","article-title":"Monte Carlo Convolution for Learning on Non-uniformly Sampled Point Clouds","volume":"37","author":"Hermosilla Pedro","year":"2018","unstructured":"Pedro Hermosilla, Tobias Ritschel, Pere-Pau V\u00e1zquez, \u00c0lvar Vinacua, and Timo Ropinski. 2018. Monte Carlo Convolution for Learning on Non-uniformly Sampled Point Clouds. ACM Trans. Graph (Proc. SIGGRAPH Asia) 37, 5 (2018).","journal-title":"ACM Trans. Graph (Proc. SIGGRAPH Asia)"},{"key":"e_1_2_2_30_1","doi-asserted-by":"crossref","unstructured":"Aaron Hertzmann Charles E Jacobs Nuria Oliver Brian CNOurless and David H Salesin. 2001. Image analogies. In SIGGRAPH. 327--340.","DOI":"10.1145\/383259.383295"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376248"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.14596"},{"key":"e_1_2_2_33_1","volume-title":"Image-to-Image Translation with Conditional Adversarial Networks. CVPR","author":"Isola Phillip","year":"2017","unstructured":"Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A Efros. 2017. Image-to-Image Translation with Conditional Adversarial Networks. CVPR (2017)."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601125"},{"key":"e_1_2_2_35_1","doi-asserted-by":"crossref","unstructured":"Henrik Wann Jensen. 2001. Realistic image synthesis using photon mapping. AK Peters\/crc Press.","DOI":"10.1201\/b10685"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2982435"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417848"},{"key":"e_1_2_2_38_1","volume-title":"Mario Costa Sousa, and David S. Ebert","author":"Kim Sung Ye","year":"2009","unstructured":"Sung Ye Kim, Ross Maciejewski, Tobias Isenberg, William M. Andrews, Wei Chen, Mario Costa Sousa, and David S. Ebert. 2009. Stippling by Example. In Proc. NPAR. 41--50."},{"key":"e_1_2_2_39_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_2_40_1","doi-asserted-by":"crossref","unstructured":"Hans Knutsson and C-F Westin. 1993. Normalized and differential convolution. In CVPR. 515--523.","DOI":"10.1109\/CVPR.1993.341081"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141916"},{"key":"e_1_2_2_42_1","volume-title":"A Comparison of Methods for Generating Poisson Disk Distributions. Comp. Graph. Forum 27, 1","author":"Lagae Ares","year":"2008","unstructured":"Ares Lagae and Philip Dutre. 2008. A Comparison of Methods for Generating Poisson Disk Distributions. Comp. Graph. Forum 27, 1 (2008)."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.16.001575"},{"key":"e_1_2_2_44_1","unstructured":"Cheng-Han Lee Ziwei Liu Lingyun Wu and Ping Luo. 2020. MaskGAN: Towards Diverse and Interactive Facial Image Manipulation. In CVPR."},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356562"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03054.x"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559755.1559758"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1982.1056489"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964957"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2017.05.001"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2699645"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015750"},{"key":"e_1_2_2_53_1","article-title":"Analysis and synthesis of point distributions based on pair correlation","volume":"31","author":"Cengiz \u00d6ztireli A","year":"2012","unstructured":"A Cengiz \u00d6ztireli and Markus Gross. 2012. Analysis and synthesis of point distributions based on pair correlation. ACM Trans. Graph. 31, 6 (2012).","journal-title":"ACM Trans. Graph."},{"key":"e_1_2_2_54_1","unstructured":"Adam Paszke Sam Gross Soumith Chintala Gregory Chanan Edward Yang Zachary DeVito Zeming Lin Alban Desmaison Luca Antiga and Adam Lerer. 2017. Automatic differentiation in pytorch. (2017)."},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1833349.1778771"},{"key":"e_1_2_2_56_1","doi-asserted-by":"crossref","unstructured":"Fabio Pellacini James A Ferwerda and Donald P Greenberg. 2000. Toward a psychophysically-based light reflection model for image synthesis. In SIGGRAPH. 55--64.","DOI":"10.1145\/344779.344812"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276444"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015777"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201322"},{"key":"e_1_2_2_60_1","first-page":"458","article-title":"Perceptual and physical space of vowel sounds","volume":"46","author":"Pols Louis CW","year":"1969","unstructured":"Louis CW Pols, LJ Th Van der Kamp, and Reinier Plomp. 1969. Perceptual and physical space of vowel sounds. J ASA 46, 2B (1969), 458--467.","journal-title":"J ASA"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1026553619983"},{"key":"e_1_2_2_62_1","volume-title":"Pointnet: Deep learning on point sets for 3D classification and segmentation. CVPR","author":"Qi Charles R","year":"2017","unstructured":"Charles R Qi, Hao Su, Kaichun Mo, and Leonidas J Guibas. 2017. Pointnet: Deep learning on point sets for 3D classification and segmentation. CVPR (2017)."},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3119910"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417830"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508409"},{"key":"e_1_2_2_66_1","volume-title":"Image and Video-Based Artistic Stylisation","author":"Rosin Paul","unstructured":"Paul Rosin and John Collomosse. 2012. Image and Video-Based Artistic Stylisation. Springer Publishing Company, Incorporated."},{"key":"e_1_2_2_67_1","doi-asserted-by":"crossref","unstructured":"Tamar Rott Shaham Tali Dekel and Tomer Michaeli. 2019. SinGAN: Learning a Generative Model from a Single Natural Image. In ICCV.","DOI":"10.1109\/ICCV.2019.00467"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13111"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3550454.3555484"},{"key":"e_1_2_2_70_1","volume-title":"Graph. Forum","author":"Schmaltz Christian","year":"2010","unstructured":"Christian Schmaltz, Pascal Gwosdek, Andres Bruhn, and Joachim Weickert. 2010. Electrostatic Halftoning. Comp. Graph. Forum (2010)."},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478513.3480534"},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/508530.508537"},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3015461"},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.24.1.1193"},{"key":"e_1_2_2_75_1","volume-title":"Proc. ICLR, Yoshua Bengio and Yann LeCun (Eds.).","author":"Simonyan Karen","year":"2015","unstructured":"Karen Simonyan and Andrew Zisserman. 2015. Very Deep Convolutional Networks for Large-Scale Image Recognition. In Proc. ICLR, Yoshua Bengio and Yann LeCun (Eds.)."},{"key":"e_1_2_2_76_1","volume-title":"Analysis of Sample Correlations for Monte Carlo Rendering. Comp. Graph Form. (Proc. EGSR) 38, 2","author":"Singh Gurprit","year":"2019","unstructured":"Gurprit Singh, Cengiz Oztireli, Abdalla G.M. Ahmed, David Coeurjolly, Kartic Subr, Oliver Deussen, Victor Ostromoukhov, Ravi Ramamoorthi, and Wojciech Jarosz. 2019. Analysis of Sample Correlations for Monte Carlo Rendering. Comp. Graph Form. (Proc. EGSR) 38, 2 (2019)."},{"key":"e_1_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478513.3480549"},{"key":"e_1_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3092919.3092923"},{"key":"e_1_2_2_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/15886.15911"},{"key":"e_1_2_2_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323008"},{"key":"e_1_2_2_81_1","volume-title":"Point Pattern Synthesis via Irregular Convolution. Comp. Graph. Forum 38","author":"Tu Peihan","year":"2019","unstructured":"Peihan Tu, Dani Lischinski, and Hui Huang. 2019. Point Pattern Synthesis via Irregular Convolution. Comp. Graph. Forum 38 (2019)."},{"key":"e_1_2_2_82_1","volume-title":"Digital Halftoning","author":"Ulichney Robert","unstructured":"Robert Ulichney. 1987. Digital Halftoning. MIT Press."},{"key":"e_1_2_2_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601107"},{"key":"e_1_2_2_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778816"},{"key":"e_1_2_2_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964945"},{"key":"e_1_2_2_86_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559755.1559760"},{"key":"e_1_2_2_87_1","volume-title":"Ladybird: Quasi-Monte Carlo Sampling for Deep Implicit Field Based 3D Reconstruction with Symmetry. ECCV","author":"Xu Yifan","year":"2020","unstructured":"Yifan Xu, Tianqi Fan, Yi Yuan, and Gurprit Singh. 2020. Ladybird: Quasi-Monte Carlo Sampling for Deep Implicit Field Based 3D Reconstruction with Symmetry. ECCV (2020), 248--263."},{"key":"e_1_2_2_88_1","article-title":"A survey of blue-noise sampling and its applications","volume":"30","author":"Yan Dong-Ming","year":"2015","unstructured":"Dong-Ming Yan, Jian-Wei Guo, Bin Wang, Xiao-Peng Zhang, and Peter Wonka. 2015. A survey of blue-noise sampling and its applications. Journal of Comp. Sci. and Tech. 30, 3 (2015).","journal-title":"Journal of Comp. Sci. and Tech."},{"key":"e_1_2_2_89_1","volume-title":"Spectral consequences of photoreceptor sampling in the rhesus retina. Science 221, 4608","author":"Yellott John I","year":"1983","unstructured":"John I Yellott. 1983. Spectral consequences of photoreceptor sampling in the rhesus retina. Science 221, 4608 (1983)."},{"key":"e_1_2_2_90_1","volume-title":"Lsun: Construction of a large-scale image dataset using deep learning with humans in the loop. arXiv preprint arXiv:1506.03365","author":"Yu Fisher","year":"2015","unstructured":"Fisher Yu, Ari Seff, Yinda Zhang, Shuran Song, Thomas Funkhouser, and Jianxiong Xiao. 2015. Lsun: Construction of a large-scale image dataset using deep learning with humans in the loop. arXiv preprint arXiv:1506.03365 (2015)."},{"key":"e_1_2_2_91_1","doi-asserted-by":"crossref","unstructured":"Cheng Zhang Cengiz \u00d6ztireli Stephan Mandt and Giampiero Salvi. 2019. Active Mini-Batch Sampling Using Repulsive Point Processes. AAAI.","DOI":"10.1609\/aaai.v33i01.33015741"},{"key":"e_1_2_2_92_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185572"},{"key":"e_1_2_2_93_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201285"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3592418","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3592418","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:48:59Z","timestamp":1750182539000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3592418"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,26]]},"references-count":91,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,8]]}},"alternative-id":["10.1145\/3592418"],"URL":"https:\/\/doi.org\/10.1145\/3592418","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,26]]},"assertion":[{"value":"2023-07-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}