-
Beyond Blur: A Fluid Perspective on Generative Diffusion Models
Authors:
Grzegorz Gruszczynski,
Michal Jan Wlodarczyk,
Jakub J Meixner,
Przemyslaw Musialski
Abstract:
We propose a novel PDE-driven corruption process for generative image synthesis based on advection-diffusion processes which generalizes existing PDE-based approaches. Our forward pass formulates image corruption via a physically motivated PDE that couples directional advection with isotropic diffusion and Gaussian noise, controlled by dimensionless numbers (Peclet, Fourier). We implement this PDE…
▽ More
We propose a novel PDE-driven corruption process for generative image synthesis based on advection-diffusion processes which generalizes existing PDE-based approaches. Our forward pass formulates image corruption via a physically motivated PDE that couples directional advection with isotropic diffusion and Gaussian noise, controlled by dimensionless numbers (Peclet, Fourier). We implement this PDE numerically through a GPU-accelerated custom Lattice Boltzmann solver for fast evaluation. To induce realistic turbulence, we generate stochastic velocity fields that introduce coherent motion and capture multi-scale mixing. In the generative process, a neural network learns to reverse the advection-diffusion operator thus constituting a novel generative model. We discuss how previous methods emerge as specific cases of our operator, demonstrating that our framework generalizes prior PDE-based corruption techniques. We illustrate how advection improves the diversity and quality of the generated images while keeping the overall color palette unaffected. This work bridges fluid dynamics, dimensionless PDE theory, and deep generative modeling, offering a fresh perspective on physically informed image corruption processes for diffusion-based synthesis.
△ Less
Submitted 20 June, 2025;
originally announced June 2025.
-
FlatCAD: Fast Curvature Regularization of Neural SDFs for CAD Models
Authors:
Haotian Yin,
Aleksander Plocharski,
Michal Jan Wlodarczyk,
Mikolaj Kida,
Przemyslaw Musialski
Abstract:
Neural signed-distance fields (SDFs) have become a versatile backbone for geometric learning, yet enforcing developable, CAD-style behavior still hinges on Gaussian curvature penalties that require full Hessian evaluation and second-order automatic differentiation, both of which are costly in memory and runtime. We present a curvature proxy that regularizes only the mixed second-order term (Weinga…
▽ More
Neural signed-distance fields (SDFs) have become a versatile backbone for geometric learning, yet enforcing developable, CAD-style behavior still hinges on Gaussian curvature penalties that require full Hessian evaluation and second-order automatic differentiation, both of which are costly in memory and runtime. We present a curvature proxy that regularizes only the mixed second-order term (Weingarten term), allowing the two principal curvatures to adapt freely to data while suppressing unwanted warp. Two complementary instantiations realize this idea: (i) a finite-difference proxy that replaces each Hessian entry with four forward SDF evaluations and a single first-order gradient, and (ii) an autodiff proxy that computes the same mixed derivative via one Hessian-vector product, sidestepping explicit full Hessian assembly and remaining faster in practice. Both variants converge to the exact mixed second derivative, thus preserving the intended geometric bias without incurring full second-order graphs. On the ABC benchmarks, the proxies match or exceed the reconstruction fidelity of Hessian-based baselines while reducing GPU memory use and wall-clock time by a factor of two. Because the method is drop-in and framework-agnostic, it opens a practical path toward scalable, curvature-aware SDF learning for engineering-grade shape reconstruction.
△ Less
Submitted 19 June, 2025;
originally announced June 2025.
-
Pro-DG: Procedural Diffusion Guidance for Architectural Facade Generation
Authors:
Aleksander Plocharski,
Jan Swidzinski,
Przemyslaw Musialski
Abstract:
We present Pro-DG, a framework for procedurally controllable photo-realistic facade generation that combines a procedural shape grammar with diffusion-based image synthesis. Starting from a single input image, we reconstruct its facade layout using grammar rules, then edit that structure through user-defined transformations. As facades are inherently multi-hierarchical structures, we introduce hie…
▽ More
We present Pro-DG, a framework for procedurally controllable photo-realistic facade generation that combines a procedural shape grammar with diffusion-based image synthesis. Starting from a single input image, we reconstruct its facade layout using grammar rules, then edit that structure through user-defined transformations. As facades are inherently multi-hierarchical structures, we introduce hierarchical matching procedure that aligns facade structures at different levels which is used to introduce control maps to guide a generative diffusion pipeline. This approach retains local appearance fidelity while accommodating large-scale edits such as floor duplication or window rearrangement. We provide a thorough evaluation, comparing Pro-DG against inpainting-based baselines and synthetic ground truths. Our user study and quantitative measurements indicate improved preservation of architectural identity and higher edit accuracy. Our novel method is the first to integrate neuro-symbolically derived shape-grammars for modeling with modern generative model and highlights the broader potential of such approaches for precise and controllable image manipulation.
△ Less
Submitted 2 April, 2025;
originally announced April 2025.
-
Neural Surface Priors for Editable Gaussian Splatting
Authors:
Jakub Szymkowiak,
Weronika Jakubowska,
Dawid Malarz,
Weronika Smolak-Dyżewska,
Maciej Zięba,
Przemyslaw Musialski,
Wojtek Pałubicki,
Przemysław Spurek
Abstract:
In computer graphics and vision, recovering easily modifiable scene appearance from image data is crucial for applications such as content creation. We introduce a novel method that integrates 3D Gaussian Splatting with an implicit surface representation, enabling intuitive editing of recovered scenes through mesh manipulation. Starting with a set of input images and camera poses, our approach rec…
▽ More
In computer graphics and vision, recovering easily modifiable scene appearance from image data is crucial for applications such as content creation. We introduce a novel method that integrates 3D Gaussian Splatting with an implicit surface representation, enabling intuitive editing of recovered scenes through mesh manipulation. Starting with a set of input images and camera poses, our approach reconstructs the scene surface using a neural signed distance field. This neural surface acts as a geometric prior guiding the training of Gaussian Splatting components, ensuring their alignment with the scene geometry. To facilitate editing, we encode the visual and geometric information into a lightweight triangle soup proxy. Edits applied to the mesh extracted from the neural surface propagate seamlessly through this intermediate structure to update the recovered appearance. Unlike previous methods relying on the triangle soup proxy representation, our approach supports a wider range of modifications and fully leverages the mesh topology, enabling a more flexible and intuitive editing process. The complete source code for this project can be accessed at: https://github.com/WJakubowska/NeuralSurfacePriors.
△ Less
Submitted 7 February, 2025; v1 submitted 27 November, 2024;
originally announced November 2024.
-
Optimizing 3D Geometry Reconstruction from Implicit Neural Representations
Authors:
Shen Fan,
Przemyslaw Musialski
Abstract:
Implicit neural representations have emerged as a powerful tool in learning 3D geometry, offering unparalleled advantages over conventional representations like mesh-based methods. A common type of INR implicitly encodes a shape's boundary as the zero-level set of the learned continuous function and learns a mapping from a low-dimensional latent space to the space of all possible shapes represente…
▽ More
Implicit neural representations have emerged as a powerful tool in learning 3D geometry, offering unparalleled advantages over conventional representations like mesh-based methods. A common type of INR implicitly encodes a shape's boundary as the zero-level set of the learned continuous function and learns a mapping from a low-dimensional latent space to the space of all possible shapes represented by its signed distance function. However, most INRs struggle to retain high-frequency details, which are crucial for accurate geometric depiction, and they are computationally expensive. To address these limitations, we present a novel approach that both reduces computational expenses and enhances the capture of fine details. Our method integrates periodic activation functions, positional encodings, and normals into the neural network architecture. This integration significantly enhances the model's ability to learn the entire space of 3D shapes while preserving intricate details and sharp features, areas where conventional representations often fall short.
△ Less
Submitted 16 October, 2024;
originally announced October 2024.
-
Shrinking: Reconstruction of Parameterized Surfaces from Signed Distance Fields
Authors:
Haotian Yin,
Przemyslaw Musialski
Abstract:
We propose a novel method for reconstructing explicit parameterized surfaces from Signed Distance Fields (SDFs), a widely used implicit neural representation (INR) for 3D surfaces. While traditional reconstruction methods like Marching Cubes extract discrete meshes that lose the continuous and differentiable properties of INRs, our approach iteratively contracts a parameterized initial sphere to c…
▽ More
We propose a novel method for reconstructing explicit parameterized surfaces from Signed Distance Fields (SDFs), a widely used implicit neural representation (INR) for 3D surfaces. While traditional reconstruction methods like Marching Cubes extract discrete meshes that lose the continuous and differentiable properties of INRs, our approach iteratively contracts a parameterized initial sphere to conform to the target SDF shape, preserving differentiability and surface parameterization throughout. This enables downstream applications such as texture mapping, geometry processing, animation, and finite element analysis. Evaluated on the typical geometric shapes and parts of the ABC dataset, our method achieves competitive reconstruction quality, maintaining smoothness and differentiability crucial for advanced computer graphics and geometric deep learning applications.
△ Less
Submitted 3 October, 2024;
originally announced October 2024.
-
FaçAID: A Transformer Model for Neuro-Symbolic Facade Reconstruction
Authors:
Aleksander Plocharski,
Jan Swidzinski,
Joanna Porter-Sobieraj,
Przemyslaw Musialski
Abstract:
We introduce a neuro-symbolic transformer-based model that converts flat, segmented facade structures into procedural definitions using a custom-designed split grammar. To facilitate this, we first develop a semi-complex split grammar tailored for architectural facades and then generate a dataset comprising of facades alongside their corresponding procedural representations. This dataset is used t…
▽ More
We introduce a neuro-symbolic transformer-based model that converts flat, segmented facade structures into procedural definitions using a custom-designed split grammar. To facilitate this, we first develop a semi-complex split grammar tailored for architectural facades and then generate a dataset comprising of facades alongside their corresponding procedural representations. This dataset is used to train our transformer model to convert segmented, flat facades into the procedural language of our grammar. During inference, the model applies this learned transformation to new facade segmentations, providing a procedural representation that users can adjust to generate varied facade designs. This method not only automates the conversion of static facade images into dynamic, editable procedural formats but also enhances the design flexibility, allowing for easy modifications.
△ Less
Submitted 13 September, 2024; v1 submitted 3 June, 2024;
originally announced June 2024.
-
HOSC: A Periodic Activation Function for Preserving Sharp Features in Implicit Neural Representations
Authors:
Danzel Serrano,
Jakub Szymkowiak,
Przemyslaw Musialski
Abstract:
Recently proposed methods for implicitly representing signals such as images, scenes, or geometries using coordinate-based neural network architectures often do not leverage the choice of activation functions, or do so only to a limited extent. In this paper, we introduce the Hyperbolic Oscillation function (HOSC), a novel activation function with a controllable sharpness parameter. Unlike any pre…
▽ More
Recently proposed methods for implicitly representing signals such as images, scenes, or geometries using coordinate-based neural network architectures often do not leverage the choice of activation functions, or do so only to a limited extent. In this paper, we introduce the Hyperbolic Oscillation function (HOSC), a novel activation function with a controllable sharpness parameter. Unlike any previous activations, HOSC has been specifically designed to better capture sudden changes in the input signal, and hence sharp or acute features of the underlying data, as well as smooth low-frequency transitions. Due to its simplicity and modularity, HOSC offers a plug-and-play functionality that can be easily incorporated into any existing method employing a neural network as a way of implicitly representing a signal. We benchmark HOSC against other popular activations in an array of general tasks, empirically showing an improvement in the quality of obtained representations, provide the mathematical motivation behind the efficacy of HOSC, and discuss its limitations.
△ Less
Submitted 20 January, 2024;
originally announced January 2024.
-
Geometric Guidance for the Deployment of Elastic Geodesic Grids
Authors:
Stefan Pillwein,
Alexander Hentschel,
Markus Lukacevic,
Przemyslaw Musialski
Abstract:
Elastic gridshells are advanced free-form structures enabling curved target shapes and material-efficient large spans. This paper focuses on a novel type of gridshells recently proposed employing a scissor-like deployment mechanism. While recent form-finding advancements have produced fascinating outcomes, a significant challenge arises when architecturally implementing such mechanisms: for the re…
▽ More
Elastic gridshells are advanced free-form structures enabling curved target shapes and material-efficient large spans. This paper focuses on a novel type of gridshells recently proposed employing a scissor-like deployment mechanism. While recent form-finding advancements have produced fascinating outcomes, a significant challenge arises when architecturally implementing such mechanisms: for the realization of real-world structures, professional FEA is necessary. However, performing Finite Element simulations of these structures proves surprisingly complex due to the requirement of simulating the deployment -- a task nearly unachievable using uninformed approaches. Therefore, geometric guidance of the highly elastic gridshells while simulating the expansion is essential. Present solutions to this predicament primarily involve rudimentary trial-and-error methods, suitable only for the most basic shapes. We propose a solution involving the provision of geometric guidance via sequences of linear displacements synchronized with a universal time parameter. When applied to chosen positions, this allows for multi-step gridshell deployment and successfully avoids undesirable buckling issues. We conclude with successful demonstrations of our method, anticipating our work to pave the way for further quantitative explorations of these intriguing structures.
△ Less
Submitted 28 December, 2023;
originally announced December 2023.
-
LayoutEnhancer: Generating Good Indoor Layouts from Imperfect Data
Authors:
Kurt Leimer,
Paul Guerrero,
Tomer Weiss,
Przemyslaw Musialski
Abstract:
We address the problem of indoor layout synthesis, which is a topic of continuing research interest in computer graphics. The newest works made significant progress using data-driven generative methods; however, these approaches rely on suitable datasets. In practice, desirable layout properties may not exist in a dataset, for instance, specific expert knowledge can be missing in the data. We prop…
▽ More
We address the problem of indoor layout synthesis, which is a topic of continuing research interest in computer graphics. The newest works made significant progress using data-driven generative methods; however, these approaches rely on suitable datasets. In practice, desirable layout properties may not exist in a dataset, for instance, specific expert knowledge can be missing in the data. We propose a method that combines expert knowledge, for example, knowledge about ergonomics, with a data-driven generator based on the popular Transformer architecture. The knowledge is given as differentiable scalar functions, which can be used both as weights or as additional terms in the loss function. Using this knowledge, the synthesized layouts can be biased to exhibit desirable properties, even if these properties are not present in the dataset. Our approach can also alleviate problems of lack of data and imperfections in the data. Our work aims to improve generative machine learning for modeling and provide novel tools for designers and amateurs for the problem of interior layout creation.
△ Less
Submitted 5 October, 2022; v1 submitted 31 January, 2022;
originally announced February 2022.
-
Generalized Deployable Elastic Geodesic Grids
Authors:
Stefan Pillwein,
Przemyslaw Musialski
Abstract:
Given a designer created free-form surface in 3d space, our method computes a grid composed of elastic elements which are completely planar and straight. Only by fixing the ends of the planar elements to appropriate locations, the 2d grid bends and approximates the given 3d surface. Our method is based purely on the notions from differential geometry of curves and surfaces and avoids any physical…
▽ More
Given a designer created free-form surface in 3d space, our method computes a grid composed of elastic elements which are completely planar and straight. Only by fixing the ends of the planar elements to appropriate locations, the 2d grid bends and approximates the given 3d surface. Our method is based purely on the notions from differential geometry of curves and surfaces and avoids any physical simulations. In particular, we introduce a well-defined elastic grid energy functional that allows identifying networks of curves that minimize the bending energy and at the same time nestle to the provided input surface well. Further, we generalize the concept of such grids to cases where the surface boundary does not need to be convex, which allows for the creation of sophisticated and visually pleasing shapes. The algorithm finally ensures that the 2d grid is perfectly planar, making the resulting gridshells inexpensive, easy to fabricate, transport, assemble, and finally also to deploy. Additionally, since the whole structure is pre-strained, it also comes with load-bearing capabilities. We evaluate our method using physical simulation and we also provide a full fabrication pipeline for desktop-size models and present multiple examples of surfaces with elliptic and hyperbolic curvature regions. Our method is meant as a tool for quick prototyping for designers, architects, and engineers since it is very fast and results can be obtained in a matter of seconds.
△ Less
Submitted 16 November, 2021;
originally announced November 2021.
-
Design and Fabrication of Multi-Patch Elastic Geodesic Grid Structures
Authors:
Stefan Pillwein,
Johanna Kübert,
Florian Rist,
Przemyslaw Musialski
Abstract:
Elastic geodesic grids (EGG) are lightweight structures that can be deployed to approximate designer-provided free-form surfaces. Initially, the grids are perfectly flat, during deployment, a curved shape emerges, as grid elements bend and twist. Their layout is based on networks of geodesic curves and is found geometrically. Encoded in the planar grids is the intrinsic shape of the design surface…
▽ More
Elastic geodesic grids (EGG) are lightweight structures that can be deployed to approximate designer-provided free-form surfaces. Initially, the grids are perfectly flat, during deployment, a curved shape emerges, as grid elements bend and twist. Their layout is based on networks of geodesic curves and is found geometrically. Encoded in the planar grids is the intrinsic shape of the design surface. Such structures may serve purposes like free-form sub-structures, panels, sun and rain protectors, pavilions, etc. However, so far the EGG have only been investigated using a generic set of design surfaces and small-scale desktop models. Some limitations become apparent when considering more sophisticated design surfaces, like from free-form architecture. Due to characteristics like high local curvature or non-geodesic boundaries, they may be captured only poorly by a single EGG.
We show how decomposing such surfaces into smaller patches serves as an effective strategy to tackle these problems. We furthermore show that elastic geodesic grids are in fact well suited for this approach. Finally, we present a showcase model of some meters in size and discuss practical aspects concerning fabrication, size, and easy deployment.
△ Less
Submitted 23 June, 2021;
originally announced June 2021.
-
Analysis of a Reduced-Order Model for the Simulation of Elastic Geometric Zigzag-Spring Meta-Materials
Authors:
Kurt Leimer,
Przemyslaw Musialski
Abstract:
We analyze the performance of a reduced-order simulation of geometric meta-materials based on zigzag patterns using a simplified representation. As geometric meta-materials we denote planar cellular structures which can be fabricated in 2d and bent elastically such that they approximate doubly-curved 2-manifold surfaces in 3d space. They obtain their elasticity attributes mainly from the geometry…
▽ More
We analyze the performance of a reduced-order simulation of geometric meta-materials based on zigzag patterns using a simplified representation. As geometric meta-materials we denote planar cellular structures which can be fabricated in 2d and bent elastically such that they approximate doubly-curved 2-manifold surfaces in 3d space. They obtain their elasticity attributes mainly from the geometry of their cellular elements and their connections. In this paper we focus on cells build from so-called zigzag springs. The physical properties of the base material (i.e., the physical substance) influence the behavior as well, but we essentially factor them out by keeping them constant.
The simulation of such complex geometric structures comes with a high computational cost, thus we propose an approach to reduce it by abstracting the zigzag cells by a simpler model and by learning the properties of their elastic deformation behavior. In particular, we analyze the influence of the sampling of the full parameter space and the expressiveness of the reduced model compared to the full model. Based on these observations, we draw conclusions on how to simulate such complex meso-structures with simpler models.
△ Less
Submitted 13 November, 2021; v1 submitted 15 October, 2020;
originally announced October 2020.
-
Design and Fabrication of Elastic Geodesic Grid Structures
Authors:
Stefan Pillwein,
Johanna Kübert,
Florian Rist,
Przemyslaw Musialski
Abstract:
Elastic geodesic grids (EGG) are lightweight structures that can be easily deployed to approximate designer provided free-form surfaces. In the initial configuration the grids are perfectly flat, during deployment, though, curvature is induced to the structure, as grid elements bend and twist. Their layout is found geometrically, it is based on networks of geodesic curves on free-form design-surfa…
▽ More
Elastic geodesic grids (EGG) are lightweight structures that can be easily deployed to approximate designer provided free-form surfaces. In the initial configuration the grids are perfectly flat, during deployment, though, curvature is induced to the structure, as grid elements bend and twist. Their layout is found geometrically, it is based on networks of geodesic curves on free-form design-surfaces. Generating a layout with this approach encodes an elasto-kinematic mechanism to the grid that creates the curved shape during deployment. In the final state the grid can be fixed to supports and serve for all kinds of purposes like free-form sub-structures, paneling, sun and rain protectors, pavilions, etc. However, so far these structures have only been investigated using small-scale desktop models. We investigate the scalability of such structures, presenting a medium sized model. It was designed by an architecture student without expert knowledge on elastic structures or differential geometry, just using the elastic geodesic grids design-pipeline. We further present a fabrication-process for EGG-models. They can be built quickly and with a small budget.
△ Less
Submitted 15 October, 2020;
originally announced October 2020.
-
On Elastic Geodesic Grids and Their Planar to Spatial Deployment
Authors:
Stefan Pillwein,
Kurt Leimer,
Michael Birsak,
Przemyslaw Musialski
Abstract:
We propose a novel type of planar-to-spatial deployable structures that we call elastic geodesic grids. Our approach aims at the approximation of freeform surfaces with spatial grids of bent lamellas which can be deployed from a planar configuration using a simple kinematic mechanism. Such elastic structures are easy-to-fabricate and easy-to-deploy and approximate shapes which combine physics and…
▽ More
We propose a novel type of planar-to-spatial deployable structures that we call elastic geodesic grids. Our approach aims at the approximation of freeform surfaces with spatial grids of bent lamellas which can be deployed from a planar configuration using a simple kinematic mechanism. Such elastic structures are easy-to-fabricate and easy-to-deploy and approximate shapes which combine physics and aesthetics. We propose a solution based on networks of geodesic curves on target surfaces and we introduce a set of conditions and assumptions which can be closely met in practice. Our formulation allows for a purely geometric approach which avoids the necessity of numerical shape optimization by building on top of theoretical insights from differential geometry. We propose a solution for the design, computation, and physical simulation of elastic geodesic grids, and present several fabricated small-scale examples with varying complexity. Moreover, we provide an empirical proof of our method by comparing the results to laser-scans of the fabricated models. Our method is intended as a form-finding tool for elastic gridshells in architecture and other creative disciplines and should give the designer an easy-to-handle way for the exploration of such structures.
△ Less
Submitted 30 June, 2020;
originally announced July 2020.
-
Pose to Seat: Automated Design of Body-Supporting Surfaces
Authors:
Kurt Leimer,
Andreas Winkler,
Stefan Ohrhallinger,
Przemyslaw Musialski
Abstract:
The design of functional seating furniture is a complicated process which often requires extensive manual design effort and empirical evaluation. We propose a computational design framework for pose-driven automated generation of body-supports which are optimized for comfort of sitting. Given a human body in a specified pose as input, our method computes an approximate pressure distribution that a…
▽ More
The design of functional seating furniture is a complicated process which often requires extensive manual design effort and empirical evaluation. We propose a computational design framework for pose-driven automated generation of body-supports which are optimized for comfort of sitting. Given a human body in a specified pose as input, our method computes an approximate pressure distribution that also takes frictional forces and body torques into consideration which serves as an objective measure of comfort. Utilizing this information to find out where the body needs to be supported in order to maintain comfort of sitting, our algorithm can create a supporting mesh suited for a person in that specific pose. This is done in an automated fitting process, using a template model capable of supporting a large variety of sitting poses. The results can be used directly or can be considered as a starting point for further interactive design.
△ Less
Submitted 22 March, 2020;
originally announced March 2020.