-
Progressively Projected Newton's Method
Authors:
José Antonio Fernández-Fernández,
Fabian Löschner,
Jan Bender
Abstract:
Newton's Method is widely used to find the solution of complex non-linear simulation problems in Computer Graphics. To guarantee a descent direction, it is common practice to clamp the negative eigenvalues of each element Hessian prior to assembly - a strategy known as Projected Newton (PN) - but this perturbation often hinders convergence.
In this work, we observe that projecting only a small s…
▽ More
Newton's Method is widely used to find the solution of complex non-linear simulation problems in Computer Graphics. To guarantee a descent direction, it is common practice to clamp the negative eigenvalues of each element Hessian prior to assembly - a strategy known as Projected Newton (PN) - but this perturbation often hinders convergence.
In this work, we observe that projecting only a small subset of element Hessians is sufficient to secure a descent direction. Building on this insight, we introduce Progressively Projected Newton (PPN), a novel variant of Newton's Method that uses the current iterate residual to cheaply determine the subset of element Hessians to project. The global Hessian thus remains closer to its original form, reducing both the number of Newton iterations and the amount of required eigen-decompositions.
We compare PPN with PN and Project-on-Demand Newton (PDN) in a comprehensive set of experiments covering contact-free and contact-rich deformables (including large stiffness and mass ratios), co-dimensional, and rigid-body simulations, and a range of time step sizes, tolerances and resolutions. PPN consistently performs fewer than 10% of the projections required by PN or PDN and, in the vast majority of cases, converges in fewer Newton iterations, which makes PPN the fastest solver in our benchmark. The most notable exceptions are simulations with very large time steps and quasistatics, where PN remains a better choice.
△ Less
Submitted 27 May, 2025;
originally announced May 2025.
-
Pitfalls of Projection: A study of Newton-type solvers for incremental potentials
Authors:
Andreas Longva,
Fabian Löschner,
José Antonio Fernández-Fernández,
Egor Larionov,
Uri M. Ascher,
Jan Bender
Abstract:
Nonlinear systems arising from time integrators like Backward Euler can sometimes be reformulated as optimization problems, known as incremental potentials. We show through a comprehensive experimental analysis that the widely used Projected Newton method, which relies on unconditional semidefinite projection of Hessian contributions, typically exhibits a reduced convergence rate compared to class…
▽ More
Nonlinear systems arising from time integrators like Backward Euler can sometimes be reformulated as optimization problems, known as incremental potentials. We show through a comprehensive experimental analysis that the widely used Projected Newton method, which relies on unconditional semidefinite projection of Hessian contributions, typically exhibits a reduced convergence rate compared to classical Newton's method. We demonstrate how factors like resolution, element order, projection method, material model and boundary handling impact convergence of Projected Newton and Newton.
Drawing on these findings, we propose the hybrid method Project-on-Demand Newton, which projects only conditionally, and show that it enjoys both the robustness of Projected Newton and convergence rate of Newton. We additionally introduce Kinetic Newton, a regularization-based method that takes advantage of the structure of incremental potentials and avoids projection altogether. We compare the four solvers on hyperelasticity and contact problems.
We also present a nuanced discussion of convergence criteria, and propose a new acceleration-based criterion that avoids problems associated with existing residual norm criteria and is easier to interpret. We finally address a fundamental limitation of the Armijo backtracking line search that occasionally blocks convergence, especially for stiff problems. We propose a novel parameter-free, robust line search technique to eliminate this issue.
△ Less
Submitted 24 November, 2023;
originally announced November 2023.
-
SymX: Energy-based Simulation from Symbolic Expressions
Authors:
José Antonio Fernández-Fernández,
Fabian Löschner,
Lukas Westhofen,
Andreas Longva,
Jan Bender
Abstract:
Optimization time integrators have proven to be effective at solving complex multi-physics problems, such as deformation of solids with non-linear material models, contact with friction, strain limiting, etc. For challenging problems with high accuracy requirements, Newton-type optimizers are often used. This necessitates first- and second-order derivatives of the global non-linear objective funct…
▽ More
Optimization time integrators have proven to be effective at solving complex multi-physics problems, such as deformation of solids with non-linear material models, contact with friction, strain limiting, etc. For challenging problems with high accuracy requirements, Newton-type optimizers are often used. This necessitates first- and second-order derivatives of the global non-linear objective function. Manually differentiating, implementing and optimizing the resulting code is extremely time-consuming, error-prone, and precludes quick changes to the model.
We present SymX, a framework based on symbolic expressions that computes the first and second derivatives by symbolic differentiation, generates efficient vectorized source code, compiles it on-the-fly, and performs the global assembly of element contributions in parallel. The user only has to provide the symbolic expression of an energy function for a single element in the discretization and our system will determine the assembled derivatives for the whole model. SymX is designed to be an integral part of a simulation system and can easily be integrated into existing ones. We demonstrate the versatility of our framework in various complex simulations showing different non-linear materials, higher-order finite elements, rigid body systems, adaptive cloth, frictional contact, and coupling multiple interacting physical systems. Moreover, we compare our method with alternative approaches and show that SymX is significantly faster than a current state-or-the-art framework (up to two orders of magnitude for a higher-order FEM simulation).
△ Less
Submitted 22 February, 2023;
originally announced March 2023.
