-
LeGO: Leveraging a Surface Deformation Network for Animatable Stylized Face Generation with One Example
Authors:
Soyeon Yoon,
Kwan Yun,
Kwanggyoon Seo,
Sihun Cha,
Jung Eun Yoo,
Junyong Noh
Abstract:
Recent advances in 3D face stylization have made significant strides in few to zero-shot settings. However, the degree of stylization achieved by existing methods is often not sufficient for practical applications because they are mostly based on statistical 3D Morphable Models (3DMM) with limited variations. To this end, we propose a method that can produce a highly stylized 3D face model with de…
▽ More
Recent advances in 3D face stylization have made significant strides in few to zero-shot settings. However, the degree of stylization achieved by existing methods is often not sufficient for practical applications because they are mostly based on statistical 3D Morphable Models (3DMM) with limited variations. To this end, we propose a method that can produce a highly stylized 3D face model with desired topology. Our methods train a surface deformation network with 3DMM and translate its domain to the target style using a paired exemplar. The network achieves stylization of the 3D face mesh by mimicking the style of the target using a differentiable renderer and directional CLIP losses. Additionally, during the inference process, we utilize a Mesh Agnostic Encoder (MAGE) that takes deformation target, a mesh of diverse topologies as input to the stylization process and encodes its shape into our latent space. The resulting stylized face model can be animated by commonly used 3DMM blend shapes. A set of quantitative and qualitative evaluations demonstrate that our method can produce highly stylized face meshes according to a given style and output them in a desired topology. We also demonstrate example applications of our method including image-based stylized avatar generation, linear interpolation of geometric styles, and facial animation of stylized avatars.
△ Less
Submitted 22 March, 2024;
originally announced March 2024.
-
Fast and Accurate Single-Image Depth Estimation on Mobile Devices, Mobile AI 2021 Challenge: Report
Authors:
Andrey Ignatov,
Grigory Malivenko,
David Plowman,
Samarth Shukla,
Radu Timofte,
Ziyu Zhang,
Yicheng Wang,
Zilong Huang,
Guozhong Luo,
Gang Yu,
Bin Fu,
Yiran Wang,
Xingyi Li,
Min Shi,
Ke Xian,
Zhiguo Cao,
Jin-Hua Du,
Pei-Lin Wu,
Chao Ge,
Jiaoyang Yao,
Fangwen Tu,
Bo Li,
Jung Eun Yoo,
Kwanggyoon Seo,
Jialei Xu
, et al. (13 additional authors not shown)
Abstract:
Depth estimation is an important computer vision problem with many practical applications to mobile devices. While many solutions have been proposed for this task, they are usually very computationally expensive and thus are not applicable for on-device inference. To address this problem, we introduce the first Mobile AI challenge, where the target is to develop an end-to-end deep learning-based d…
▽ More
Depth estimation is an important computer vision problem with many practical applications to mobile devices. While many solutions have been proposed for this task, they are usually very computationally expensive and thus are not applicable for on-device inference. To address this problem, we introduce the first Mobile AI challenge, where the target is to develop an end-to-end deep learning-based depth estimation solutions that can demonstrate a nearly real-time performance on smartphones and IoT platforms. For this, the participants were provided with a new large-scale dataset containing RGB-depth image pairs obtained with a dedicated stereo ZED camera producing high-resolution depth maps for objects located at up to 50 meters. The runtime of all models was evaluated on the popular Raspberry Pi 4 platform with a mobile ARM-based Broadcom chipset. The proposed solutions can generate VGA resolution depth maps at up to 10 FPS on the Raspberry Pi 4 while achieving high fidelity results, and are compatible with any Android or Linux-based mobile devices. A detailed description of all models developed in the challenge is provided in this paper.
△ Less
Submitted 17 May, 2021;
originally announced May 2021.
-
Open top anodic Ta3N5 nanotubes for higher solar water splitting efficiency
Authors:
Sabina Grigorescu,
Seulgi So,
Jeong Eun Yoo,
Anca Mazare,
Robert Hahn,
Patrik Schmuki
Abstract:
In the present work we grow self-organized Ta2O5 nanotube layers in a H2SO4/NH4F electrolyte at various elevated temperatures. Under optimized conditions we obtain 4 μm long nanotubes that are well adherent to the substrate and can be grown very homogenous over large surface areas. Moreover, the key advantage of this approach is that an open top morphology (initiation layer free) is obtained. Afte…
▽ More
In the present work we grow self-organized Ta2O5 nanotube layers in a H2SO4/NH4F electrolyte at various elevated temperatures. Under optimized conditions we obtain 4 μm long nanotubes that are well adherent to the substrate and can be grown very homogenous over large surface areas. Moreover, the key advantage of this approach is that an open top morphology (initiation layer free) is obtained. After a suitable conversion treatment in NH3 atmosphere Ta3N5 nanotubes are obtained, that after (Co-Pi+Co(OH)x) modification provide, under AM 1.5G illumination conditions, a photoelectrochemical current response of 4.7 mA cm-2 at 1.23 V vs RHE.
△ Less
Submitted 17 October, 2016;
originally announced October 2016.
-
Tungsten doping of Ta3N5-Nanotubes for Band Gap Narrowing and Enhanced Photoelectrochemical Water Splitting Efficiency
Authors:
Sabina Grigorescu,
Benedikt Baerhausen,
Lei Wang,
Anca Mazare,
Jeong Eun Yoo,
Robert Hahn,
Patrik Schmuki
Abstract:
Ordered W-doped Ta2O5 nanotube arrays were grown by self-organizing electrochemical anodization of TaW alloys with different tungsten concentrations and by a suitable high temperature ammonia treatment, fully converted to W:Ta3N5 tubular structures. A main effect found is that W doping can decrease the band gap from 2 eV (bare Ta3N5) down to 1.75 eV. Ta3N5 nanotubes grown on 0.5 at% W alloy and mo…
▽ More
Ordered W-doped Ta2O5 nanotube arrays were grown by self-organizing electrochemical anodization of TaW alloys with different tungsten concentrations and by a suitable high temperature ammonia treatment, fully converted to W:Ta3N5 tubular structures. A main effect found is that W doping can decrease the band gap from 2 eV (bare Ta3N5) down to 1.75 eV. Ta3N5 nanotubes grown on 0.5 at% W alloy and modified with (CoOH)x as co-catalyst show ~33% higher photocurrents in photoelectrochemical (PEC) water splitting than pure Ta3N5.
△ Less
Submitted 14 October, 2016;
originally announced October 2016.
-
Highly controlled coating of a biomimetic polymer in TiO2 nanotubes
Authors:
Gabriel Loget,
Jeung Eun Yoo,
Anca Mazare,
Lei Wang,
Patrik Schmuki
Abstract:
Highly controlled coating of biomimetic polydopamine (PDA) was achieved on titanium dioxide nanotubes (TiO2 NTs) by exposing TiO2 NT arrays to a slightly alkaline dopamine solution. The thin films act as photonic sensitizers (enhancing photocurrents and photodegradation) in the visible light range. The PDA coatings can furthermore be used as a platform for decorating the TiO2 NTs with different co…
▽ More
Highly controlled coating of biomimetic polydopamine (PDA) was achieved on titanium dioxide nanotubes (TiO2 NTs) by exposing TiO2 NT arrays to a slightly alkaline dopamine solution. The thin films act as photonic sensitizers (enhancing photocurrents and photodegradation) in the visible light range. The PDA coatings can furthermore be used as a platform for decorating the TiO2 NTs with different co-catalysts and metal nanoparticles (NPs).
△ Less
Submitted 13 October, 2016;
originally announced October 2016.
