-
Design and Implementation of a Human-Robot Joint Action Framework using Augmented Reality and Eye Gaze
Authors:
Wesley P. Chan,
Morgan Crouch,
Khoa Hoang,
Charlie Chen,
Nicole Robinson,
Elizabeth Croft
Abstract:
When humans work together to complete a joint task, each person builds an internal model of the situation and how it will evolve. Efficient collaboration is dependent on how these individual models overlap to form a shared mental model among team members, which is important for collaborative processes in human-robot teams. The development and maintenance of an accurate shared mental model requires…
▽ More
When humans work together to complete a joint task, each person builds an internal model of the situation and how it will evolve. Efficient collaboration is dependent on how these individual models overlap to form a shared mental model among team members, which is important for collaborative processes in human-robot teams. The development and maintenance of an accurate shared mental model requires bidirectional communication of individual intent and the ability to interpret the intent of other team members. To enable effective human-robot collaboration, this paper presents a design and implementation of a novel joint action framework in human-robot team collaboration, utilizing augmented reality (AR) technology and user eye gaze to enable bidirectional communication of intent. We tested our new framework through a user study with 37 participants, and found that our system improves task efficiency, trust, as well as task fluency. Therefore, using AR and eye gaze to enable bidirectional communication is a promising mean to improve core components that influence collaboration between humans and robots.
△ Less
Submitted 24 August, 2022;
originally announced August 2022.
-
Natural Typing Recognition via Surface Electromyography
Authors:
Michael S. Crouch,
Mingde Zheng,
Michael S. Eggleston
Abstract:
By using a computer keyboard as a finger recording device, we construct the largest existing dataset for gesture recognition via surface electromyography (sEMG), and use deep learning to achieve over 90% character-level accuracy on reconstructing typed text entirely from measured muscle potentials. We prioritize the temporal structure of the EMG signal instead of the spatial structure of the elect…
▽ More
By using a computer keyboard as a finger recording device, we construct the largest existing dataset for gesture recognition via surface electromyography (sEMG), and use deep learning to achieve over 90% character-level accuracy on reconstructing typed text entirely from measured muscle potentials. We prioritize the temporal structure of the EMG signal instead of the spatial structure of the electrode layout, using network architectures inspired by those used for real-time spoken language transcription. Our architecture recognizes the rapid movements of natural computer typing, which occur at irregular intervals and often overlap in time. The extensive size of our dataset also allows us to study gesture recognition after synthetically downgrading the spatial or temporal resolution, showing the system capabilities necessary for real-time gesture recognition.
△ Less
Submitted 29 September, 2021; v1 submitted 22 September, 2021;
originally announced September 2021.
-
Surface Electromyography as a Natural Human-Machine Interface: A Review
Authors:
Mingde Zheng,
Michael S. Crouch,
Michael S. Eggleston
Abstract:
Surface electromyography (sEMG) is a non-invasive method of measuring neuromuscular potentials generated when the brain instructs the body to perform both fine and coarse locomotion. This technique has seen extensive investigation over the last two decades, with significant advances in both the hardware and signal processing methods used to collect and analyze sEMG signals. While early work focuse…
▽ More
Surface electromyography (sEMG) is a non-invasive method of measuring neuromuscular potentials generated when the brain instructs the body to perform both fine and coarse locomotion. This technique has seen extensive investigation over the last two decades, with significant advances in both the hardware and signal processing methods used to collect and analyze sEMG signals. While early work focused mainly on medical applications, there has been growing interest in utilizing sEMG as a sensing modality to enable next-generation, high-bandwidth, and natural human-machine interfaces. In the first part of this review, we briefly overview the human skeletomuscular physiology that gives rise to sEMG signals followed by a review of developments in sEMG acquisition hardware. Special attention is paid towards the fidelity of these devices as well as form factor, as recent advances have pushed the limits of user comfort and high-bandwidth acquisition. In the second half of the article, we explore work quantifying the information content of natural human gestures and then review the various signal processing and machine learning methods developed to extract information in sEMG signals. Finally, we discuss the future outlook in this field, highlighting the key gaps in current methods to enable seamless natural interactions between humans and machines.
△ Less
Submitted 5 April, 2021; v1 submitted 12 January, 2021;
originally announced January 2021.
-
Demonstrating sub-3 ps temporal resolution in a superconducting nanowire single-photon detector
Authors:
B. A. Korzh,
Q-Y. Zhao,
S. Frasca,
J. P. Allmaras,
T. M. Autry,
E. A. Bersin,
M. Colangelo,
G. M. Crouch,
A. E. Dane,
T. Gerrits,
F. Marsili,
G. Moody,
E. Ramirez,
J. D. Rezac,
M. J. Stevens,
E. E. Wollman,
D. Zhu,
P. D. Hale,
K. L. Silverman,
R. P. Mirin,
S. W. Nam,
M. D. Shaw,
K. K. Berggren
Abstract:
Improving the temporal resolution of single photon detectors has an impact on many applications, such as increased data rates and transmission distances for both classical and quantum optical communication systems, higher spatial resolution in laser ranging and observation of shorter-lived fluorophores in biomedical imaging. In recent years, superconducting nanowire single-photon detectors (SNSPDs…
▽ More
Improving the temporal resolution of single photon detectors has an impact on many applications, such as increased data rates and transmission distances for both classical and quantum optical communication systems, higher spatial resolution in laser ranging and observation of shorter-lived fluorophores in biomedical imaging. In recent years, superconducting nanowire single-photon detectors (SNSPDs) have emerged as the highest efficiency time-resolving single-photon counting detectors available in the near infrared. As the detection mechanism in SNSPDs occurs on picosecond time scales, SNSPDs have been demonstrated with exquisite temporal resolution below 15 ps. We reduce this value to 2.7$\pm$0.2 ps at 400 nm and 4.6$\pm$0.2 ps at 1550 nm, using a specialized niobium nitride (NbN) SNSPD. The observed photon-energy dependence of the temporal resolution and detection latency suggests that intrinsic effects make a significant contribution.
△ Less
Submitted 18 April, 2018;
originally announced April 2018.
-
Machine Layout and Performance
Authors:
D. Angal-Kalinin,
R. Appleby,
G. Arduini,
D. Banfi,
J. Barranco,
N. Biancacci,
D. Brett,
R. Bruce,
O. Bruening,
X. Buffat,
A. Burov,
Y. Cai,
R. Calaga,
A. Chancé,
M. Crouch,
B. Dalena,
H. Day,
R. de Maria,
J. Esteban Muller,
S. Fartoukh,
M. Fitterer,
O. Frasciello,
M. Giovannozzi,
W. Herr,
W. Höfle
, et al. (35 additional authors not shown)
Abstract:
Chapter 2 in High-Luminosity Large Hadron Collider (HL-LHC) : Preliminary Design Report. The Large Hadron Collider (LHC) is one of the largest scientific instruments ever built. Since opening up a new energy frontier for exploration in 2010, it has gathered a global user community of about 7,000 scientists working in fundamental particle physics and the physics of hadronic matter at extreme temper…
▽ More
Chapter 2 in High-Luminosity Large Hadron Collider (HL-LHC) : Preliminary Design Report. The Large Hadron Collider (LHC) is one of the largest scientific instruments ever built. Since opening up a new energy frontier for exploration in 2010, it has gathered a global user community of about 7,000 scientists working in fundamental particle physics and the physics of hadronic matter at extreme temperature and density. To sustain and extend its discovery potential, the LHC will need a major upgrade in the 2020s. This will increase its luminosity (rate of collisions) by a factor of five beyond the original design value and the integrated luminosity (total collisions created) by a factor ten. The LHC is already a highly complex and exquisitely optimised machine so this upgrade must be carefully conceived and will require about ten years to implement. The new configuration, known as High Luminosity LHC (HL-LHC), will rely on a number of key innovations that push accelerator technology beyond its present limits. Among these are cutting-edge 11-12 tesla superconducting magnets, compact superconducting cavities for beam rotation with ultra-precise phase control, new technology and physical processes for beam collimation and 300 metre-long high-power superconducting links with negligible energy dissipation. The present document describes the technologies and components that will be used to realise the project and is intended to serve as the basis for the detailed engineering design of HL-LHC.
△ Less
Submitted 26 May, 2017;
originally announced May 2017.
-
The Morphological Butcher-Oemler effect in the SDSS Cut&Enhance Galaxy Cluster Catalog
Authors:
Tomotsugu Goto,
Sadanori Okamura,
Masafumi Yagi,
Ravi K. Sheth,
Neta A. Bahcall,
Shane A. Zabel,
Michael S. Crouch,
James Annis,
Mariangela Bernardi,
Shang-Shan Chong,
Percy L. Gomez,
Sarah Hansen,
Rita S. J. Kim,
Adam Knudson,
Timothy A. Mckay,
Christopher J. Miller,
Maki Sekiguchi
Abstract:
We investigate the evolution of the fractions of late type cluster galaxies as a function of redshift, using one of the largest, most uniform cluster samples available. The sample consists of 514 clusters of galaxies in the range 0.02<z<0.3 from the Sloan Digital Sky Survey Cut & Enhance galaxy cluster catalog. This catalog was created using a single automated cluster finding algorithm on unifor…
▽ More
We investigate the evolution of the fractions of late type cluster galaxies as a function of redshift, using one of the largest, most uniform cluster samples available. The sample consists of 514 clusters of galaxies in the range 0.02<z<0.3 from the Sloan Digital Sky Survey Cut & Enhance galaxy cluster catalog. This catalog was created using a single automated cluster finding algorithm on uniform data from a single telescope, with accurate CCD photometry, thus, minimizing selection biases. We use four independent methods to analyze the evolution of the late type galaxy fraction. Specifically, we select late type galaxies based on: restframe g-r color, u-r color, galaxy profile fitting and concentration index. The first criterion corresponds to the one used in the classical Butcher-Oemler analyses. The last three criteria are more sensitive to the morphological type of the galaxies. In all four cases, we find an increase in the fraction of late type galaxies with increasing redshift, significant at the 99.9% level. The results confirm that cluster galaxies do change colors with redshift (the Butcher-Oemler effect) and, in addition, they change their morphology to later-type toward higher redshift -- indicating a morphological equivalent of the Butcher-Oemler effect. We also find a tendency of richer clusters to have lower fractions of late type galaxies. The trend is consistent with a ram pressure stripping model, where richer clusters have more effective ram pressure due to their higher temperature.
△ Less
Submitted 11 June, 2003; v1 submitted 15 January, 2003;
originally announced January 2003.
