-
Mobile Teleoperation: Feasibility of Wireless Wearable Sensing of the Operator's Arm Motion
Authors:
Guanhao Fu,
Ehsan Azimi,
Peter Kazanzides
Abstract:
Teleoperation platforms often require the user to be situated at a fixed location to both visualize and control the movement of the robot and thus do not provide the operator with much mobility. One example is in existing robotic surgery solutions that require the surgeons to be away from the patient, attached to consoles where their heads must be fixed and their arms can only move in a limited sp…
▽ More
Teleoperation platforms often require the user to be situated at a fixed location to both visualize and control the movement of the robot and thus do not provide the operator with much mobility. One example is in existing robotic surgery solutions that require the surgeons to be away from the patient, attached to consoles where their heads must be fixed and their arms can only move in a limited space. This creates a barrier between physicians and patients that does not exist in normal surgery. To address this issue, we propose a mobile telesurgery solution where the surgeons are no longer mechanically limited to control consoles and are able to teleoperate the robots from the patient bedside, using their arms equipped with wireless sensors and viewing the endoscope video via optical see-through head-mounted displays (HMDs). We evaluate the feasibility and efficiency of our user interaction method compared to a standard surgical robotic manipulator via two tasks with different levels of required dexterity. The results indicate that with sufficient training our proposed platform can attain similar efficiency while providing added mobility for the operator.
△ Less
Submitted 11 January, 2022; v1 submitted 14 March, 2021;
originally announced March 2021.
-
Age and Gender Prediction From Face Images Using Attentional Convolutional Network
Authors:
Amirali Abdolrashidi,
Mehdi Minaei,
Elham Azimi,
Shervin Minaee
Abstract:
Automatic prediction of age and gender from face images has drawn a lot of attention recently, due it is wide applications in various facial analysis problems. However, due to the large intra-class variation of face images (such as variation in lighting, pose, scale, occlusion), the existing models are still behind the desired accuracy level, which is necessary for the use of these models in real-…
▽ More
Automatic prediction of age and gender from face images has drawn a lot of attention recently, due it is wide applications in various facial analysis problems. However, due to the large intra-class variation of face images (such as variation in lighting, pose, scale, occlusion), the existing models are still behind the desired accuracy level, which is necessary for the use of these models in real-world applications. In this work, we propose a deep learning framework, based on the ensemble of attentional and residual convolutional networks, to predict gender and age group of facial images with high accuracy rate. Using attention mechanism enables our model to focus on the important and informative parts of the face, which can help it to make a more accurate prediction. We train our model in a multi-task learning fashion, and augment the feature embedding of the age classifier, with the predicted gender, and show that doing so can further increase the accuracy of age prediction. Our model is trained on a popular face age and gender dataset, and achieved promising results. Through visualization of the attention maps of the train model, we show that our model has learned to become sensitive to the right regions of the face.
△ Less
Submitted 7 December, 2020; v1 submitted 8 October, 2020;
originally announced October 2020.
-
FingerNet: Pushing The Limits of Fingerprint Recognition Using Convolutional Neural Network
Authors:
Shervin Minaee,
Elham Azimi,
Amirali Abdolrashidi
Abstract:
Fingerprint recognition has been utilized for cellphone authentication, airport security and beyond. Many different features and algorithms have been proposed to improve fingerprint recognition. In this paper, we propose an end-to-end deep learning framework for fingerprint recognition using convolutional neural networks (CNNs) which can jointly learn the feature representation and perform recogni…
▽ More
Fingerprint recognition has been utilized for cellphone authentication, airport security and beyond. Many different features and algorithms have been proposed to improve fingerprint recognition. In this paper, we propose an end-to-end deep learning framework for fingerprint recognition using convolutional neural networks (CNNs) which can jointly learn the feature representation and perform recognition. We train our model on a large-scale fingerprint recognition dataset, and improve over previous approaches in terms of accuracy. Our proposed model is able to achieve a very high recognition accuracy on a well-known fingerprint dataset. We believe this framework can be widely used for biometrics recognition tasks, making more scalable and accurate systems possible. We have also used a visualization technique to highlight the important areas in an input fingerprint image, that mostly impact the recognition results.
△ Less
Submitted 28 July, 2019;
originally announced July 2019.
-
Deep-Sentiment: Sentiment Analysis Using Ensemble of CNN and Bi-LSTM Models
Authors:
Shervin Minaee,
Elham Azimi,
AmirAli Abdolrashidi
Abstract:
With the popularity of social networks, and e-commerce websites, sentiment analysis has become a more active area of research in the past few years. On a high level, sentiment analysis tries to understand the public opinion about a specific product or topic, or trends from reviews or tweets. Sentiment analysis plays an important role in better understanding customer/user opinion, and also extracti…
▽ More
With the popularity of social networks, and e-commerce websites, sentiment analysis has become a more active area of research in the past few years. On a high level, sentiment analysis tries to understand the public opinion about a specific product or topic, or trends from reviews or tweets. Sentiment analysis plays an important role in better understanding customer/user opinion, and also extracting social/political trends. There has been a lot of previous works for sentiment analysis, some based on hand-engineering relevant textual features, and others based on different neural network architectures. In this work, we present a model based on an ensemble of long-short-term-memory (LSTM), and convolutional neural network (CNN), one to capture the temporal information of the data, and the other one to extract the local structure thereof. Through experimental results, we show that using this ensemble model we can outperform both individual models. We are also able to achieve a very high accuracy rate compared to the previous works.
△ Less
Submitted 8 April, 2019;
originally announced April 2019.
-
Statistical Analysis Of NYC Buildings And Wind Damages
Authors:
Elham Azimi,
Bud Griffis
Abstract:
The objective of this study is to determine the types of existing buildings that are at risk of falling debris based on height, age, construction classification, construction methods and materials and occupancy. This study focuses on elements that could become debris under high wind action and present a hazard to pedestrians, vehicles, and nearby structures. This study evaluated the particular bui…
▽ More
The objective of this study is to determine the types of existing buildings that are at risk of falling debris based on height, age, construction classification, construction methods and materials and occupancy. This study focuses on elements that could become debris under high wind action and present a hazard to pedestrians, vehicles, and nearby structures. This study evaluated the particular building elements that might become Wind Generated Debris (WGD). This was accomplished by inspecting 500 buildings located in Manhattan that experienced wind-related incidents. The results illustrate that the building elements most likely to produce WGD are windows, followed by exterior fixtures, roof elements, stairs/sidewalk shed, and balcony elements, respectively. Consequently, FISP inspectors should pay particular attention to these elements, which have higher probabilities in causing incidents.
△ Less
Submitted 1 January, 2019;
originally announced January 2019.
-
Alignment of the Virtual Scene to the Tracking Space of a Mixed Reality Head-Mounted Display
Authors:
Ehsan Azimi,
Long Qian,
Nassir Navab,
Peter Kazanzides
Abstract:
With the mounting global interest for optical see-through head-mounted displays (OST-HMDs) across medical, industrial and entertainment settings, many systems with different capabilities are rapidly entering the market. Despite such variety, they all require display calibration to create a proper mixed reality environment. With the aid of tracking systems, it is possible to register rendered graph…
▽ More
With the mounting global interest for optical see-through head-mounted displays (OST-HMDs) across medical, industrial and entertainment settings, many systems with different capabilities are rapidly entering the market. Despite such variety, they all require display calibration to create a proper mixed reality environment. With the aid of tracking systems, it is possible to register rendered graphics with tracked objects in the real world. We propose a calibration procedure to properly align the coordinate system of a 3D virtual scene that the user sees with that of the tracker. Our method takes a blackbox approach towards the HMD calibration, where the tracker's data is its input and the 3D coordinates of a virtual object in the observer's eye is the output; the objective is thus to find the 3D projection that aligns the virtual content with its real counterpart. In addition, a faster and more intuitive version of this calibration is introduced in which the user simultaneously aligns multiple points of a single virtual 3D object with its real counterpart; this reduces the number of required repetitions in the alignment from 20 to only 4, which leads to a much easier calibration task for the user. In this paper, both internal (HMD camera) and external tracking systems are studied. We perform experiments with Microsoft HoloLens, taking advantage of its self localization and spatial mapping capabilities to eliminate the requirement for line of sight from the HMD to the object or external tracker. The experimental results indicate an accuracy of up to 4 mm in the average reprojection error based on two separate evaluation methods. We further perform experiments with the internal tracking on the Epson Moverio BT-300 to demonstrate that the method can provide similar results with other HMDs.
△ Less
Submitted 27 March, 2019; v1 submitted 16 March, 2017;
originally announced March 2017.
