-
Tactile Perception of Electroadhesion: Effect of DC versus AC Stimulation and Finger Moisture
Authors:
Easa AliAbbasi,
Muhammad Muzammil,
Omer Sirin,
Philippe Lefèvre,
Ørjan Grøttem Martinsen,
Cagatay Basdogan
Abstract:
Electroadhesion has emerged as a viable technique for displaying tactile feedback on touch surfaces, particularly capacitive touchscreens found in smartphones and tablets. This involves applying a voltage signal to the conductive layer of the touchscreen to generate tactile sensations on the fingerpads of users. In our investigation, we explore the tactile perception of electroadhesion under DC an…
▽ More
Electroadhesion has emerged as a viable technique for displaying tactile feedback on touch surfaces, particularly capacitive touchscreens found in smartphones and tablets. This involves applying a voltage signal to the conductive layer of the touchscreen to generate tactile sensations on the fingerpads of users. In our investigation, we explore the tactile perception of electroadhesion under DC and AC stimulations. Our tactile perception experiments with 10 participants demonstrate a significantly lower voltage detection threshold for AC signals compared to their DC counterparts. This discrepancy is elucidated by the underlying electro-mechanical interactions between the finger and the voltage-induced touchscreen and considering the response of mechanoreceptors in the fingerpad to electrostatic forces generated by electroadhesion. Additionally, our study highlights the impact of moisture on electroadhesive tactile perception. Participants with moist fingers exhibited markedly higher threshold levels. Our electrical impedance measurements show a substantial reduction in impedance magnitude when sweat is present at the finger-touchscreen interface, indicating increased conductivity. These findings not only contribute to our understanding of tactile perception under electroadhesion but also shed light on the underlying physics. In this regard, the results of this study extend beyond mobile devices to encompass other applications of this technology, including robotics, automation, space missions, and textiles.
△ Less
Submitted 25 September, 2024;
originally announced September 2024.
-
Efficient and Safe Contact-rich pHRI via Subtask Detection and Motion Estimation using Deep Learning
Authors:
Pouya P. Niaz,
Engin Erzin,
Cagatay Basdogan
Abstract:
This paper proposes an adaptive admittance controller for improving efficiency and safety in physical human-robot interaction (pHRI) tasks in small-batch manufacturing that involve contact with stiff environments, such as drilling, polishing, cutting, etc. We aim to minimize human effort and task completion time while maximizing precision and stability during the contact of the machine tool attach…
▽ More
This paper proposes an adaptive admittance controller for improving efficiency and safety in physical human-robot interaction (pHRI) tasks in small-batch manufacturing that involve contact with stiff environments, such as drilling, polishing, cutting, etc. We aim to minimize human effort and task completion time while maximizing precision and stability during the contact of the machine tool attached to the robot's end-effector with the workpiece. To this end, a two-layered learning-based human intention recognition mechanism is proposed, utilizing only the kinematic and kinetic data from the robot and two force sensors. A ``subtask detector" recognizes the human intent by estimating which phase of the task is being performed, e.g., \textit{Idle}, \textit{Tool-Attachment}, \textit{Driving}, and \textit{Contact}. Simultaneously, a ``motion estimator" continuously quantifies intent more precisely during the \textit{Driving} to predict when \textit{Contact} will begin. The controller is adapted online according to the subtask while allowing early adaptation before the \textit{Contact} to maximize precision and safety and prevent potential instabilities. Three sets of pHRI experiments were performed with multiple subjects under various conditions. Spring compression experiments were performed in virtual environments to train the data-driven models and validate the proposed adaptive system, and drilling experiments were performed in the physical world to test the proposed methods' efficacy in real-life scenarios. Experimental results show subtask classification accuracy of 84\% and motion estimation R\textsuperscript{2} score of 0.96. Furthermore, 57\% lower human effort was achieved during \textit{Driving} as well as 53\% lower oscillation amplitude at \textit{Contact} as a result of the proposed system.
△ Less
Submitted 19 July, 2024;
originally announced July 2024.
-
Robot-Assisted Drilling on Curved Surfaces with Haptic Guidance under Adaptive Admittance Control
Authors:
Alireza Madani,
Pouya P. Niaz,
Berk Guler,
Yusuf Aydin,
Cagatay Basdogan
Abstract:
Drilling a hole on a curved surface with a desired angle is prone to failure when done manually, due to the difficulties in drill alignment and also inherent instabilities of the task, potentially causing injury and fatigue to the workers. On the other hand, it can be impractical to fully automate such a task in real manufacturing environments because the parts arriving at an assembly line can hav…
▽ More
Drilling a hole on a curved surface with a desired angle is prone to failure when done manually, due to the difficulties in drill alignment and also inherent instabilities of the task, potentially causing injury and fatigue to the workers. On the other hand, it can be impractical to fully automate such a task in real manufacturing environments because the parts arriving at an assembly line can have various complex shapes where drill point locations are not easily accessible, making automated path planning difficult. In this work, an adaptive admittance controller with 6 degrees of freedom is developed and deployed on a KUKA LBR iiwa 7 cobot such that the operator is able to manipulate a drill mounted on the robot with one hand comfortably and open holes on a curved surface with haptic guidance of the cobot and visual guidance provided through an AR interface. Real-time adaptation of the admittance damping provides more transparency when driving the robot in free space while ensuring stability during drilling. After the user brings the drill sufficiently close to the drill target and roughly aligns to the desired drilling angle, the haptic guidance module fine tunes the alignment first and then constrains the user movement to the drilling axis only, after which the operator simply pushes the drill into the workpiece with minimal effort. Two sets of experiments were conducted to investigate the potential benefits of the haptic guidance module quantitatively (Experiment I) and also the practical value of the proposed pHRI system for real manufacturing settings based on the subjective opinion of the participants (Experiment II).
△ Less
Submitted 28 July, 2022;
originally announced July 2022.
-
An adaptive admittance controller for collaborative drilling with a robot based on subtask classification via deep learning
Authors:
Berk Guler,
Pouya P. Niaz,
Alireza Madani,
Yusuf Aydin,
Cagatay Basdogan
Abstract:
In this paper, we propose a supervised learning approach based on an Artificial Neural Network (ANN) model for real-time classification of subtasks in a physical human-robot interaction (pHRI) task involving contact with a stiff environment. In this regard, we consider three subtasks for a given pHRI task: Idle, Driving, and Contact. Based on this classification, the parameters of an admittance co…
▽ More
In this paper, we propose a supervised learning approach based on an Artificial Neural Network (ANN) model for real-time classification of subtasks in a physical human-robot interaction (pHRI) task involving contact with a stiff environment. In this regard, we consider three subtasks for a given pHRI task: Idle, Driving, and Contact. Based on this classification, the parameters of an admittance controller that regulates the interaction between human and robot are adjusted adaptively in real time to make the robot more transparent to the operator (i.e. less resistant) during the Driving phase and more stable during the Contact phase. The Idle phase is primarily used to detect the initiation of task. Experimental results have shown that the ANN model can learn to detect the subtasks under different admittance controller conditions with an accuracy of 98% for 12 participants. Finally, we show that the admittance adaptation based on the proposed subtask classifier leads to 20% lower human effort (i.e. higher transparency) in the Driving phase and 25% lower oscillation amplitude (i.e. higher stability) during drilling in the Contact phase compared to an admittance controller with fixed parameters.
△ Less
Submitted 31 May, 2022; v1 submitted 28 May, 2022;
originally announced May 2022.
-
Exploration Strategies for Tactile Graphics Displayed by Electrovibration on a Touchscreen
Authors:
Bushra Sadia,
Ayberk Sadic,
Mehmet Ayyildiz,
Cagatay Basdogan
Abstract:
Advancements in surface haptics technology have given rise to the development of interactive applications displaying tactile content on touch surfaces such as images, signs, diagrams, plots, charts, graphs, maps, networks, and tables. In those applications, users manually explore the touch surface to interact with the tactile data using some intuitive strategies. The user's exploration strategy, t…
▽ More
Advancements in surface haptics technology have given rise to the development of interactive applications displaying tactile content on touch surfaces such as images, signs, diagrams, plots, charts, graphs, maps, networks, and tables. In those applications, users manually explore the touch surface to interact with the tactile data using some intuitive strategies. The user's exploration strategy, tactile data's complexity, and tactile rendering method all affect the user's haptic perception, which plays a critical role in design and prototyping of those applications. In this study, we conducted experiments with human participants to investigate the recognition rate and time of five tactile shapes rendered by electrovibration on a touchscreen using three different methods and displayed in prototypical orientation and non-prototypical orientations. The results showed that the correct recognition rate of the shapes was higher when the haptically active area was larger. However, as the number of edges increased, the recognition time increased and the recognition rate dropped significantly, arriving to a value slightly higher than the chance rate of 20% for non-prototypical octagon. We also recorded the participants' finger movements on the touchscreen to examine their haptic exploration strategies. Our analyses revealed that the participants first used global scanning to extract the coarse features of the displayed shapes, and then they applied local scanning to identify finer details, but needed another global scan for final confirmation in the case of non-prototypical shapes, possibly due to the current limitations of electrovibration technology in displaying tactile stimuli to a user. We observed that it was highly difficult to follow the edges of shapes and recognize shapes with more than five edges under electrovibration when a single finger was used for exploration.
△ Less
Submitted 26 December, 2021;
originally announced December 2021.
-
Real-time visio-haptic interaction with static soft tissue model shaving geometric and material nonlinearity
Authors:
Igor Peterlik,
Mert Sedef,
Cagatay Basdogan,
Ludek Matyska
Abstract:
We propose a new approach allowing visio-haptic interaction with a FE model of a human liver having both non-linear geometric and material properties. The material properties used in the model are extracted from the experimental data of pig liver to make the simulations more realistic. Our computational approach consists of two main steps: a pre-computation of the configuration space of all possib…
▽ More
We propose a new approach allowing visio-haptic interaction with a FE model of a human liver having both non-linear geometric and material properties. The material properties used in the model are extracted from the experimental data of pig liver to make the simulations more realistic. Our computational approach consists of two main steps: a pre-computation of the configuration space of all possible deformation states of the model, followed by the interpolation of the precomputed data for the calculation of the reaction forces displayed to the user through a haptic device during the real-time interactions. No a priori assumptions or modeling simplifications about the mathematical complexity of the underlying soft tissue model, size and irregularity of the FE mesh are necessary. We show that deformation and force response of the liver in simulations are heavily influenced by the material model, boundary conditions, path of the loading and the type of function used for the interpolation of the pre-computed data.
△ Less
Submitted 9 April, 2021;
originally announced April 2021.
-
Fingerpad Contact Evolution Under Electrovibration
Authors:
Omer Sirin,
Allan Barrea,
Philippe Lefèvre,
Jean-Louis Thonnard,
Cagatay Basdogan
Abstract:
Displaying tactile feedback through a touchscreen via electrovibration has many potential applications in mobile devices, consumer electronics, home appliances, and automotive industry though our knowledge and understanding on the underlying contact mechanics is very limited. An experimental study was conducted to investigate the contact evolution between the human finger and a touchscreen under e…
▽ More
Displaying tactile feedback through a touchscreen via electrovibration has many potential applications in mobile devices, consumer electronics, home appliances, and automotive industry though our knowledge and understanding on the underlying contact mechanics is very limited. An experimental study was conducted to investigate the contact evolution between the human finger and a touchscreen under electrovibration using a robotic set-up and an imaging system. The results show that the effect of electrovibration is only present during full slip but not before slip. Hence, coefficient of friction increases under electrovibration as expected during full slip, but the apparent contact area is significantly smaller during full slip when compared to that of no electrovibration condition. It is suggested that the main cause of the increase in friction during full slip is due to an increase in real contact area and the reduction in apparent area is due to stiffening of the finger skin in tangential direction.
△ Less
Submitted 2 April, 2021;
originally announced April 2021.
-
HaptiStylus: A Novel Stylus Capable of Displaying Movement and Rotational Torque Effects
Authors:
Atakan Arasan,
Cagatay Basdogan,
T. Metin Sezgin
Abstract:
With the emergence of pen-enabled tablets and mobile devices, stylus-based interaction has been receiving increasing attention. Unfortunately, styluses available in the market today are all passive instruments that are primarily used for writing and pointing. In this paper, we describe a novel stylus capable of displaying certain vibro-tactile and inertial haptic effects to the user. Our stylus is…
▽ More
With the emergence of pen-enabled tablets and mobile devices, stylus-based interaction has been receiving increasing attention. Unfortunately, styluses available in the market today are all passive instruments that are primarily used for writing and pointing. In this paper, we describe a novel stylus capable of displaying certain vibro-tactile and inertial haptic effects to the user. Our stylus is equipped with two vibration actuators at the ends, which are used to create a tactile sensation of up and down movement along the stylus. The stylus is also embedded with a DC motor, which is used to create a sense of bidirectional rotational torque about the long axis of the pen. Through two psychophysical experiments, we show that, when driven with carefully selected timing and actuation patterns, our haptic stylus can convey movement and rotational torque information to the user. Results from a further psychophysical experiment provide insight on how the shape of the actuation patterns effects the perception of rotational torque effect. Finally, experimental results from our interactive pen-based game show that our haptic stylus is effective in practical settings
△ Less
Submitted 2 April, 2021;
originally announced April 2021.
-
Data-Driven Vibrotactile Rendering of Digital Buttons on Touchscreens
Authors:
Bushra Sadia,
Senem Ezgi Emgin,
T. Metin Sezgin,
Cagatay Basdogan
Abstract:
Although mobile phones incorporate low-cost vibration motors to enhance touch-based interactions, it is not possible to generate complex tactile effects on their touchscreens. It is also difficult to relate the limited vibrotactile feedback generated by these motors to different types of physical buttons. In this study, we focus on creating vibrotactile feedback on a touchscreen that simulates the…
▽ More
Although mobile phones incorporate low-cost vibration motors to enhance touch-based interactions, it is not possible to generate complex tactile effects on their touchscreens. It is also difficult to relate the limited vibrotactile feedback generated by these motors to different types of physical buttons. In this study, we focus on creating vibrotactile feedback on a touchscreen that simulates the feeling of physical buttons using piezo actuators attached to it. We first recorded and analyzed the force, acceleration, and voltage data from twelve participants interacting with three different physical buttons: latch, toggle, and push buttons. Then, a button-specific vibrotactile stimulus was generated for each button based on the recorded data. Finally, we conducted a threealternative forced choice (3AFC) experiment with twenty participants to explore whether the resultant stimulus is distinct and realistic. In our experiment, participants were able to match the three digital buttons with their physical counterparts with a success rate of 83%. In addition, we harvested seven adjective pairs from the participants expressing their perceptual feeling of pressing the physical buttons. All twenty participants rated the degree of their subjective feelings associated with each adjective for all the physical and digital buttons investigated in this study. Our statistical analysis showed that there exist at least three adjective pairs for which participants have rated two out of three digital buttons similar to their physical counterparts.
△ Less
Submitted 30 March, 2021;
originally announced March 2021.
-
HapTable: An Interactive Tabletop Providing Online Haptic Feedback for Touch Gestures
Authors:
Senem Ezgi Emgin,
Amirreza Aghakhani,
T. Metin Sezgin,
Cagatay Basdogan
Abstract:
We present HapTable; a multimodal interactive tabletop that allows users to interact with digital images and objects through natural touch gestures, and receive visual and haptic feedback accordingly. In our system, hand pose is registered by an infrared camera and hand gestures are classified using a Support Vector Machine (SVM) classifier. To display a rich set of haptic effects for both static…
▽ More
We present HapTable; a multimodal interactive tabletop that allows users to interact with digital images and objects through natural touch gestures, and receive visual and haptic feedback accordingly. In our system, hand pose is registered by an infrared camera and hand gestures are classified using a Support Vector Machine (SVM) classifier. To display a rich set of haptic effects for both static and dynamic gestures, we integrated electromechanical and electrostatic actuation techniques effectively on tabletop surface of HapTable, which is a surface capacitive touch screen. We attached four piezo patches to the edges of tabletop to display vibrotactile feedback for static gestures. For this purpose, the vibration response of the tabletop, in the form of frequency response functions (FRFs), was obtained by a laser Doppler vibrometer for 84 grid points on its surface. Using these FRFs, it is possible to display localized vibrotactile feedback on the surface for static gestures. For dynamic gestures, we utilize the electrostatic actuation technique to modulate the frictional forces between finger skin and tabletop surface by applying voltage to its conductive layer. Here, we present two examples of such applications, one for static and one for dynamic gestures, along with detailed user studies. In the first one, user detects the direction of a virtual flow, such as that of wind or water, by putting their hand on the tabletop surface and feeling a vibrotactile stimulus traveling underneath it. In the second example, user rotates a virtual knob on the tabletop surface to select an item from a menu while feeling the knob's detents and resistance to rotation in the form of frictional haptic feedback.
△ Less
Submitted 30 March, 2021;
originally announced March 2021.
-
Step-Change in Friction under Electrovibration
Authors:
Idil Ozdamar,
M. Reza Alipour,
Benoit P. Delhaye,
Philippe Lef`evre,
Cagatay Basdogan
Abstract:
Rendering tactile effects on a touch screen via electrovibration has many potential applications. However, our knowledge on tactile perception of change in friction and the underlying contact mechanics are both very limited. In this study, we investigate the tactile perception and the contact mechanics for a step change in friction under electrovibration during a relative sliding between finger an…
▽ More
Rendering tactile effects on a touch screen via electrovibration has many potential applications. However, our knowledge on tactile perception of change in friction and the underlying contact mechanics are both very limited. In this study, we investigate the tactile perception and the contact mechanics for a step change in friction under electrovibration during a relative sliding between finger and the surface of a capacitive touchscreen. First, we conduct magnitude estimation experiments to investigate the role of normal force and sliding velocity on the perceived tactile intensity for a step increase and decrease in friction, called as rising friction (RF) and falling friction (FF). To investigate the contact mechanics involved in RF and FF, we then measure the frictional force, the apparent contact area, and the strains acting on the fingerpad during sliding at a constant velocity under three different normal loads using a custom-made experimental set-up. The results show that the participants perceived RF stronger than FF, and both the normal force and sliding velocity significantly influenced their perception. These results are supported by our mechanical measurements; the relative change in friction, the apparent contact area, and the strain in the sliding direction were all higher for RF than those for FF, especially for low normal forces. Taken together, our results suggest that different contact mechanics take place during RF and FF due to the viscoelastic behavior of fingerpad skin, and those differences influence our tactile perception of a step change in friction.
△ Less
Submitted 30 March, 2021;
originally announced March 2021.
-
Towards Collaborative Drilling with a Cobot Using Admittance Controller
Authors:
Yusuf Aydin,
Doganay Sirintuna,
Cagatay Basdogan
Abstract:
In the near future, collaborative robots (cobots) are expected to play a vital role in the manufacturing and automation sectors. It is predicted that workers will work side by side in collaboration with cobots to surpass fully automated factories. In this regard, physical human-robot interaction (pHRI) aims to develop natural communication between the partners to bring speed, flexibility, and ergo…
▽ More
In the near future, collaborative robots (cobots) are expected to play a vital role in the manufacturing and automation sectors. It is predicted that workers will work side by side in collaboration with cobots to surpass fully automated factories. In this regard, physical human-robot interaction (pHRI) aims to develop natural communication between the partners to bring speed, flexibility, and ergonomics to the execution of complex manufacturing tasks. One challenge in pHRI is to design an optimal interaction controller to balance the limitations introduced by the contradicting nature of transparency and stability requirements. In this paper, a general methodology to design an admittance controller for a pHRI system is developed by considering the stability and transparency objectives. In our approach, collaborative robot constrains the movement of human operator to help with a pHRI task while an augmented reality (AR) interface informs the operator about its phases. To this end, dynamical characterization of the collaborative robot (LBR IIWA 7 R800, KUKA Inc.) is presented first. Then, the stability and transparency analyses for our pHRI task involving collaborative drilling with this robot are reported. A range of allowable parameters for the admittance controller is determined by superimposing the stability and transparency graphs. Finally, three different sets of parameters are selected from the allowable range and the effect of admittance controllers utilizing these parameter sets on the task performance is investigated.
△ Less
Submitted 28 July, 2020;
originally announced July 2020.
-
A Computational Multi-Criteria Optimization Approach to Controller Design for Physical Human-Robot Interaction
Authors:
Yusuf Aydin,
Ozan Tokatli,
Volkan Patoglu,
Cagatay Basdogan
Abstract:
Physical human-robot interaction (pHRI) integrates the benefits of human operator and a collaborative robot in tasks involving physical interaction, with the aim of increasing the task performance. However, the design of interaction controllers that achieve safe and transparent operations is challenging, mainly due to the contradicting nature of these objectives. Knowing that attaining perfect tra…
▽ More
Physical human-robot interaction (pHRI) integrates the benefits of human operator and a collaborative robot in tasks involving physical interaction, with the aim of increasing the task performance. However, the design of interaction controllers that achieve safe and transparent operations is challenging, mainly due to the contradicting nature of these objectives. Knowing that attaining perfect transparency is practically unachievable, controllers that allow better compromise between these objectives are desirable. In this paper, we propose a multi-criteria optimization framework, which jointly optimizes the stability robustness and transparency of a closed-loop pHRI system for a given interaction controller. In particular, we propose a Pareto optimization framework that allows the designer to make informed decisions by thoroughly studying the trade-off between stability robustness and transparency. The proposed framework involves a search over the discretized controller parameter space to compute the Pareto front curve and a selection of controller parameters that yield maximum attainable transparency and stability robustness by studying this trade-off curve. The proposed framework not only leads to the design of an optimal controller, but also enables a fair comparison among different interaction controllers. In order to demonstrate the practical use of the proposed approach, integer and fractional order admittance controllers are studied as a case study and compared both analytically and experimentally. The experimental results validate the proposed design framework and show that the achievable transparency under fractional order admittance controller is higher than that of integer order one, when both controllers are designed to ensure the same level of stability robustness.
△ Less
Submitted 19 June, 2020;
originally announced June 2020.
-
Tactile Roughness Perception of Virtual Gratings by Electrovibration
Authors:
Aykut Isleyen,
Yasemin Vardar,
Cagatay Basdogan
Abstract:
Realistic display of tactile textures on touch screens is a big step forward for haptic technology to reach a wide range of consumers utilizing electronic devices on a daily basis. Since the texture topography cannot be rendered explicitly by electrovibration on touch screens, it is important to understand how we perceive the virtual textures displayed by friction modulation via electrovibration.…
▽ More
Realistic display of tactile textures on touch screens is a big step forward for haptic technology to reach a wide range of consumers utilizing electronic devices on a daily basis. Since the texture topography cannot be rendered explicitly by electrovibration on touch screens, it is important to understand how we perceive the virtual textures displayed by friction modulation via electrovibration. We investigated the roughness perception of real gratings made of plexiglass and virtual gratings displayed by electrovibration through a touch screen for comparison. In particular, we conducted two psychophysical experiments with 10 participants to investigate the effect of spatial period and the normal force applied by finger on roughness perception of real and virtual gratings in macro size. We also recorded the contact forces acting on the participants' finger during the experiments. The results showed that the roughness perception of real and virtual gratings are different. We argue that this difference can be explained by the amount of fingerpad penetration into the gratings. For real gratings, penetration increased tangential forces acting on the finger, whereas for virtual ones where skin penetration is absent, tangential forces decreased with spatial period. Supporting our claim, we also found that increasing normal force increases the perceived roughness of real gratings while it causes an opposite effect for the virtual gratings. These results are consistent with the tangential force profiles recorded for both real and virtual gratings. In particular, the rate of change in tangential force ($dF_t/dt$) as a function of spatial period and normal force followed trends similar to those obtained for the roughness estimates of real and virtual gratings, suggesting that it is a better indicator of the perceived roughness than the tangential force magnitude.
△ Less
Submitted 9 June, 2020;
originally announced June 2020.
-
A Review of Surface Haptics:Enabling Tactile Effects on Touch Surfaces
Authors:
Cagatay Basdogan,
Frederic Giraud,
Vincent Levesque,
Seungmoon Choi
Abstract:
We review the current technology underlying surface haptics that converts passive touch surfaces to active ones (machine haptics), our perception of tactile stimuli displayed through active touch surfaces (human haptics), their potential applications (human-machine interaction), and finally the challenges ahead of us in making them available through commercial systems. This review primarily covers…
▽ More
We review the current technology underlying surface haptics that converts passive touch surfaces to active ones (machine haptics), our perception of tactile stimuli displayed through active touch surfaces (human haptics), their potential applications (human-machine interaction), and finally the challenges ahead of us in making them available through commercial systems. This review primarily covers the tactile interactions of human fingers or hands with surface-haptics displays by focusing on the three most popular actuation methods: vibrotactile, electrostatic, and ultrasonic.
△ Less
Submitted 28 April, 2020;
originally announced April 2020.