-
LiveHand: Real-time and Photorealistic Neural Hand Rendering
Authors:
Akshay Mundra,
Mallikarjun B R,
Jiayi Wang,
Marc Habermann,
Christian Theobalt,
Mohamed Elgharib
Abstract:
The human hand is the main medium through which we interact with our surroundings, making its digitization an important problem. While there are several works modeling the geometry of hands, little attention has been paid to capturing photo-realistic appearance. Moreover, for applications in extended reality and gaming, real-time rendering is critical. We present the first neural-implicit approach…
▽ More
The human hand is the main medium through which we interact with our surroundings, making its digitization an important problem. While there are several works modeling the geometry of hands, little attention has been paid to capturing photo-realistic appearance. Moreover, for applications in extended reality and gaming, real-time rendering is critical. We present the first neural-implicit approach to photo-realistically render hands in real-time. This is a challenging problem as hands are textured and undergo strong articulations with pose-dependent effects. However, we show that this aim is achievable through our carefully designed method. This includes training on a low-resolution rendering of a neural radiance field, together with a 3D-consistent super-resolution module and mesh-guided sampling and space canonicalization. We demonstrate a novel application of perceptual loss on the image space, which is critical for learning details accurately. We also show a live demo where we photo-realistically render the human hand in real-time for the first time, while also modeling pose- and view-dependent appearance effects. We ablate all our design choices and show that they optimize for rendering speed and quality. Video results and our code can be accessed from https://vcai.mpi-inf.mpg.de/projects/LiveHand/
△ Less
Submitted 20 August, 2023; v1 submitted 15 February, 2023;
originally announced February 2023.
-
Failure Detection and Recovery in Hierarchical Network Using FTN Approach
Authors:
Bhagvan Krishna Gupta,
Ankit Mundra,
Nitin Rakesh
Abstract:
In current scenario several commercial and social organizations are using computer networks for their business and management purposes. In order to meet the business requirements networks are also grow. The growth of network also promotes the handling capability of large networks because it counter raises the possibilities of various faults in the network. A fault in network degrades its performan…
▽ More
In current scenario several commercial and social organizations are using computer networks for their business and management purposes. In order to meet the business requirements networks are also grow. The growth of network also promotes the handling capability of large networks because it counter raises the possibilities of various faults in the network. A fault in network degrades its performance by affecting parameters like throughput, delay, latency, reliability etc. In hierarchical network models any possibility of fault may collapse entire network. If a fault occurrence disables a device in hierarchical network then it may distresses all the devices underneath. Thus it affects entire networks performance. In this paper we propose Fault Tolerable hierarchical Network (FTN) approach as a solution to the problems of hierarchical networks. The proposed approach firstly detects possibilities of fault in the network and accordingly provides specific recovery mechanism. We have evaluated the performance of FTN approach in terms of delay and throughput of network.
△ Less
Submitted 31 January, 2014;
originally announced January 2014.
-
Transport Information System using Query Centric Cyber Physical Systems (QCPS)
Authors:
Ankit Mundra,
Geetanjali Rathee,
Meenu Chawla,
Nitin Rakesh,
Ashsutosh Soni
Abstract:
To incorporate the computation and communication with the physical world, next generation architecture i.e. CPS is viewed as a new technology. To improve the better interaction with the physical world or to perk up the electricity delivery usage, various CPS based approaches have been introduced. Recently several GPS equipped smart phones and sensor based frameworks have been proposed which provid…
▽ More
To incorporate the computation and communication with the physical world, next generation architecture i.e. CPS is viewed as a new technology. To improve the better interaction with the physical world or to perk up the electricity delivery usage, various CPS based approaches have been introduced. Recently several GPS equipped smart phones and sensor based frameworks have been proposed which provide various services i.e. environment estimation, road safety improvement but encounter certain limitations like elevated energy consumption and high computation cost. To meet the high reliability and safety requirements, this paper introduces a novel approach based on QCPS model which provides several users services (discussed in this paper). Further, this paper proposed a Transport Information System (TIS), which provide the communication with lower cost overhead by arranging the similar sensors in the form of grids. Each grid has a coordinator which interacts with cloud to process the user query. In order to evaluate the performance of proposed approach we have implemented a test bed of 16 wireless sensor nodes and have shown the performance in terms of computation and communication cost.
△ Less
Submitted 15 January, 2014;
originally announced January 2014.
-
Query Centric CPS (QCPS) Approach for Multiple Heterogeneous Systems
Authors:
Ankit Mundra,
Nitin Rakesh,
Vipin Tyagi
Abstract:
In modern scenario we need to have mechanisms which can provide better interaction with physical world by an efficient and more effective communication and computation approach for multiple heterogeneous sensor networks. Previous work provides efficient communication approach between sensor nodes and a query centric approach for multiple collaborative heterogeneous sensor networks. Even there is e…
▽ More
In modern scenario we need to have mechanisms which can provide better interaction with physical world by an efficient and more effective communication and computation approach for multiple heterogeneous sensor networks. Previous work provides efficient communication approach between sensor nodes and a query centric approach for multiple collaborative heterogeneous sensor networks. Even there is energy issues involved in wireless sensor network operation. In this paper we have proposed Query centric Cyber Physical System (QCPS)model to implement query centric user request using Cyber Physical System (CPS). CPS takes both communication and computation in parallel to provide better interaction with physical world. This feature of CPS reduces system cost and makes it more energy efficient. This paper provides an efficient query processing approach for multiple heterogeneous sensor networks using cyber physical system.This approach results in reduction of communication and computation cost as sensor network communicates using centroid of respective grids which reduces cost of communication while involvement of CPS reduces the computation cost.
△ Less
Submitted 26 June, 2013;
originally announced June 2013.
-
Validated Real Time Middle Ware For Distributed Cyber Physical Systems Using HMM
Authors:
Ankit Mundra,
Bhagvan K. Gupta,
Geetanjali Rathee,
Meenu Chawla,
Nitin Rakesh,
Vipin Tyagi
Abstract:
Distributed Cyber Physical Systems designed for different scenario must be capable enough to perform in an efficient manner in every situation. Earlier approaches, such as CORBA, has performed but with different time constraints. Therefore, there was the need to design reconfigurable, robust, validated and consistent real time middle ware systems with end-to-end timing. In the DCPS-HMM we have pro…
▽ More
Distributed Cyber Physical Systems designed for different scenario must be capable enough to perform in an efficient manner in every situation. Earlier approaches, such as CORBA, has performed but with different time constraints. Therefore, there was the need to design reconfigurable, robust, validated and consistent real time middle ware systems with end-to-end timing. In the DCPS-HMM we have proposed the processor efficiency and data validation which may proof crucial in implementing various distributed systems such as credit card systems or file transfer through network.
△ Less
Submitted 11 April, 2013;
originally announced April 2013.