Showing 1–46 of 46 results for author: Lukin, S

SCOUT: A Situated and Multi-Modal Human-Robot Dialogue Corpus

Authors: Stephanie M. Lukin, Claire Bonial, Matthew Marge, Taylor Hudson, Cory J. Hayes, Kimberly A. Pollard, Anthony Baker, Ashley N. Foots, Ron Artstein, Felix Gervits, Mitchell Abrams, Cassidy Henry, Lucia Donatelli, Anton Leuski, Susan G. Hill, David Traum, Clare R. Voss

Abstract: We introduce the Situated Corpus Of Understanding Transactions (SCOUT), a multi-modal collection of human-robot dialogue in the task domain of collaborative exploration. The corpus was constructed from multiple Wizard-of-Oz experiments where human participants gave verbal instructions to a remotely-located robot to move and gather information about its surroundings. SCOUT contains 89,056 utterance… ▽ More We introduce the Situated Corpus Of Understanding Transactions (SCOUT), a multi-modal collection of human-robot dialogue in the task domain of collaborative exploration. The corpus was constructed from multiple Wizard-of-Oz experiments where human participants gave verbal instructions to a remotely-located robot to move and gather information about its surroundings. SCOUT contains 89,056 utterances and 310,095 words from 278 dialogues averaging 320 utterances per dialogue. The dialogues are aligned with the multi-modal data streams available during the experiments: 5,785 images and 30 maps. The corpus has been annotated with Abstract Meaning Representation and Dialogue-AMR to identify the speaker's intent and meaning within an utterance, and with Transactional Units and Relations to track relationships between utterances to reveal patterns of the Dialogue Structure. We describe how the corpus and its annotations have been used to develop autonomous human-robot systems and enable research in open questions of how humans speak to robots. We release this corpus to accelerate progress in autonomous, situated, human-robot dialogue, especially in the context of navigation tasks where details about the environment need to be discovered. △ Less

Submitted 19 November, 2024; originally announced November 2024.

Comments: 14 pages, 7 figures

ACM Class: I.2.7; I.2.9; I.2.10; H.5.2; J.7

Journal ref: 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) https://aclanthology.org/2024.lrec-main.1259/

Human-Robot Dialogue Annotation for Multi-Modal Common Ground

Authors: Claire Bonial, Stephanie M. Lukin, Mitchell Abrams, Anthony Baker, Lucia Donatelli, Ashley Foots, Cory J. Hayes, Cassidy Henry, Taylor Hudson, Matthew Marge, Kimberly A. Pollard, Ron Artstein, David Traum, Clare R. Voss

Abstract: In this paper, we describe the development of symbolic representations annotated on human-robot dialogue data to make dimensions of meaning accessible to autonomous systems participating in collaborative, natural language dialogue, and to enable common ground with human partners. A particular challenge for establishing common ground arises in remote dialogue (occurring in disaster relief or search… ▽ More In this paper, we describe the development of symbolic representations annotated on human-robot dialogue data to make dimensions of meaning accessible to autonomous systems participating in collaborative, natural language dialogue, and to enable common ground with human partners. A particular challenge for establishing common ground arises in remote dialogue (occurring in disaster relief or search-and-rescue tasks), where a human and robot are engaged in a joint navigation and exploration task of an unfamiliar environment, but where the robot cannot immediately share high quality visual information due to limited communication constraints. Engaging in a dialogue provides an effective way to communicate, while on-demand or lower-quality visual information can be supplemented for establishing common ground. Within this paradigm, we capture propositional semantics and the illocutionary force of a single utterance within the dialogue through our Dialogue-AMR annotation, an augmentation of Abstract Meaning Representation. We then capture patterns in how different utterances within and across speaker floors relate to one another in our development of a multi-floor Dialogue Structure annotation schema. Finally, we begin to annotate and analyze the ways in which the visual modalities provide contextual information to the dialogue for overcoming disparities in the collaborators' understanding of the environment. We conclude by discussing the use-cases, architectures, and systems we have implemented from our annotations that enable physical robots to autonomously engage with humans in bi-directional dialogue and navigation. △ Less

Submitted 19 November, 2024; originally announced November 2024.

Comments: 52 pages, 14 figures

ACM Class: I.2.7; I.2.9; I.2.10; H.5.2; J.7

Journal ref: Language Resources and Evaluation 2024

Mixing, heating and ion-neutral decoupling induced by Rayleigh-Taylor instability in prominence-corona transition regions

Authors: V. S. Lukin, E. Khomenko, B. Popescu Braileanu

Abstract: This study explores non-linear development of the magnetized Rayleigh-Taylor instability (RTI) in a prominence-corona transition region. Using a two-fluid model of a partially ionized plasma, we compare RTI simulations for several different magnetic field configurations. We follow prior descriptions of the numerical prominence model [Popescu Braileanu et al., 2021a,b, 2023] and explore the charged… ▽ More This study explores non-linear development of the magnetized Rayleigh-Taylor instability (RTI) in a prominence-corona transition region. Using a two-fluid model of a partially ionized plasma, we compare RTI simulations for several different magnetic field configurations. We follow prior descriptions of the numerical prominence model [Popescu Braileanu et al., 2021a,b, 2023] and explore the charged-neutral fluid coupling and plasma heating in a two-dimensional mixing layer for different magnetic field configurations. We also investigate how the shear in magnetic field surrounding a prominence may impact the release of the gravitational potential energy of the prominence material. We show that the flow decoupling is strongest in the plane normal to the direction of the magnetic field, where neutral pressure gradients drive ion-neutral drifts and frictional heating is balanced by adiabatic cooling of the expanding prominence material. We also show that magnetic field within the mixing plane can lead to faster non-linear release of the gravitational energy driving the RTI, while more efficiently heating the plasma via viscous dissipation of associated plasma flows. We relate the computational results to potential observables by highlighting how integrating over under-resolved two-fluid sub-structure may lead to misinterpretation of observational data. △ Less

Submitted 27 February, 2024; v1 submitted 6 January, 2024; originally announced January 2024.

Comments: accepted to Philosophical Transactions A

Journal ref: Phil. Trans. R. Soc. A. 382:20230417 (2024)

Navigating to Success in Multi-Modal Human-Robot Collaboration: Analysis and Corpus Release

Authors: Stephanie M. Lukin, Kimberly A. Pollard, Claire Bonial, Taylor Hudson, Ron Arstein, Clare Voss, David Traum

Abstract: Human-guided robotic exploration is a useful approach to gathering information at remote locations, especially those that might be too risky, inhospitable, or inaccessible for humans. Maintaining common ground between the remotely-located partners is a challenge, one that can be facilitated by multi-modal communication. In this paper, we explore how participants utilized multiple modalities to inv… ▽ More Human-guided robotic exploration is a useful approach to gathering information at remote locations, especially those that might be too risky, inhospitable, or inaccessible for humans. Maintaining common ground between the remotely-located partners is a challenge, one that can be facilitated by multi-modal communication. In this paper, we explore how participants utilized multiple modalities to investigate a remote location with the help of a robotic partner. Participants issued spoken natural language instructions and received from the robot: text-based feedback, continuous 2D LIDAR mapping, and upon-request static photographs. We noticed that different strategies were adopted in terms of use of the modalities, and hypothesize that these differences may be correlated with success at several exploration sub-tasks. We found that requesting photos may have improved the identification and counting of some key entities (doorways in particular) and that this strategy did not hinder the amount of overall area exploration. Future work with larger samples may reveal the effects of more nuanced photo and dialogue strategies, which can inform the training of robotic agents. Additionally, we announce the release of our unique multi-modal corpus of human-robot communication in an exploration context: SCOUT, the Situated Corpus on Understanding Transactions. △ Less

Submitted 26 October, 2023; originally announced October 2023.

Comments: 7 pages, 3 figures

Journal ref: Proceedings of the 2023 IEEE Robot and Human Interactive Communication Conference

Envisioning Narrative Intelligence: A Creative Visual Storytelling Anthology

Authors: Brett A. Halperin, Stephanie M. Lukin

Abstract: In this paper, we collect an anthology of 100 visual stories from authors who participated in our systematic creative process of improvised story-building based on image sequences. Following close reading and thematic analysis of our anthology, we present five themes that characterize the variations found in this creative visual storytelling process: (1) Narrating What is in Vision vs. Envisioning… ▽ More In this paper, we collect an anthology of 100 visual stories from authors who participated in our systematic creative process of improvised story-building based on image sequences. Following close reading and thematic analysis of our anthology, we present five themes that characterize the variations found in this creative visual storytelling process: (1) Narrating What is in Vision vs. Envisioning; (2) Dynamically Characterizing Entities/Objects; (3) Sensing Experiential Information About the Scenery; (4) Modulating the Mood; (5) Encoding Narrative Biases. In understanding the varied ways that people derive stories from images, we offer considerations for collecting story-driven training data to inform automatic story generation. In correspondence with each theme, we envision narrative intelligence criteria for computational visual storytelling as: creative, reliable, expressive, grounded, and responsible. From these criteria, we discuss how to foreground creative expression, account for biases, and operate in the bounds of visual storyworlds. △ Less

Submitted 6 October, 2023; originally announced October 2023.

Comments: 21 pages, 11 figures

ACM Class: J.5

Journal ref: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Magnetic field amplification and structure formation by the Rayleigh-Taylor instability

Authors: B. Popescu Braileanu, V. S. Lukin, E. Khomenko

Abstract: We report on results of high resolution two fluid non-linear simulations of the Rayleigh Taylor Instability (RTI) at the interface between a solar prominence and the corona. These follow results reported earlier by Popescu Braileanu et al. (2021a,b) on linear and early non-linear RTI dynamics in this environment. The simulations use a two fluid model that includes collisions between neutrals and c… ▽ More We report on results of high resolution two fluid non-linear simulations of the Rayleigh Taylor Instability (RTI) at the interface between a solar prominence and the corona. These follow results reported earlier by Popescu Braileanu et al. (2021a,b) on linear and early non-linear RTI dynamics in this environment. The simulations use a two fluid model that includes collisions between neutrals and charges, including ionization/recombination, energy and momentum transfer, and frictional heating. High resolution 2.5D magnetized RTI simulations with the magnetic field dominantly normal to and slightly sheared with respect to the prominence plane demonstrate that in a fully developed state of RTI a large fraction of the gravitational energy of a prominence thread can be converted into quasi-turbulent energy of the magnetic field. RTI magnetic energy generation is further accompanied by magnetic and plasma density structure formation, including dynamic formation, break-up, and merging of current sheets and plasmoid sub-structures. The simulations show the role of flow decoupling and ionization/recombination reactions between the neutrals and charges on the structure formation in magnetized RTI. We provide a careful examination of sources and form of numerical dissipation of the evolving magnetic field structures. △ Less

Submitted 22 December, 2022; v1 submitted 24 December, 2021; originally announced December 2021.

Journal ref: A&A 670, A31 (2023)

On application of stochastic differential equations for simulation of nonlinear wave-particle resonant interactions

Authors: A. S. Lukin, A. V. Artemyev, A. A. Petrukovich

Abstract: Long-term simulations of energetic electron fluxes in many space plasma systems require accounting for two groups of processes with well separated time-scales: microphysics of electron resonant scattering by electromagnetic waves and electron adiabatic heating/transport by mesoscale plasma flows. Examples of such systems are Earth's radiation belts and Earth's bow shock, where ion-scale plasma inj… ▽ More Long-term simulations of energetic electron fluxes in many space plasma systems require accounting for two groups of processes with well separated time-scales: microphysics of electron resonant scattering by electromagnetic waves and electron adiabatic heating/transport by mesoscale plasma flows. Examples of such systems are Earth's radiation belts and Earth's bow shock, where ion-scale plasma injections and cross-shock electric fields determine the general electron energization, whereas electron scattering by waves relax anisotropy of electron distributions and produces small populations of high-energy electrons. The applicability of stochastic differential equations is a promising approach for including effects of resonant wave-particle interaction into codes of electron tracing in global models. This study is devoted to test of such equations for systems with nondiffusive wave-particle interactions, i.e. systems with nonlinear effects of phase trapping and bunching. We consider electron resonances with intense electrostatic whistler-mode waves often observed in the Earth's radiation belts. We demonstrate that nonlinear resonant effects can be described by stochastic differential equations with the non-Gaussian probability distribution of random variations of electron energies. △ Less

Submitted 12 May, 2021; originally announced May 2021.

Charged particle scattering in dipolarized magnetotail

Authors: A. S. Lukin, A. V. Artemyev, A. A. Petrukovich, X. -J. Zhang

Abstract: The Earth's magnetotail is characterized by stretched magnetic field lines. Energetic particles are effectively scattered due to the field-line curvature, which then leads to isotropization of energetic particle distributions and particle precipitation to the Earth's atmosphere. Measurements of these precipitation at low-altitude spacecraft are thus often used to remotely probe the magnetotail cur… ▽ More The Earth's magnetotail is characterized by stretched magnetic field lines. Energetic particles are effectively scattered due to the field-line curvature, which then leads to isotropization of energetic particle distributions and particle precipitation to the Earth's atmosphere. Measurements of these precipitation at low-altitude spacecraft are thus often used to remotely probe the magnetotail current sheet configuration. This configuration may include spatially localized maxima of the curvature radius at equator (due to localized humps of the equatorial magnetic field magnitude) that reduce the energetic particle scattering and precipitation. Therefore, the measured precipitation patterns are related to the spatial distribution of the equatorial curvature radius that is determined by the magnetotail current sheet configuration. In this study, we show that, contrary to previous thoughts, the magnetic field line configuration with the localized curvature radius maximum can actually enhance the scattering and subsequent precipitation. The spatially localized magnetic field dipolarization (magnetic field humps) can significantly curve magnetic field lines far from the equator and create off-equatorial minima in the curvature radius. Scattering of energetic particles in these off-equatorial regions alters the scattering (and precipitation) patterns, which has not been studied yet. We discuss our results in the context of remote-sensing the magnetotail current sheet configuration with low-altitude spacecraft measurements. △ Less

Submitted 11 May, 2021; originally announced May 2021.

Two-fluid simulations of Rayleigh-Taylor instability in a magnetized solar prominence thread II. Effects of collisionality

Authors: B. Popescu Braileanu, V. S. Lukin, E. Khomenko, A. de Vicente

Abstract: In this work, we explore the dynamical impacts and observable signatures of two-fluid effects in the parameter regimes when ion-neutral collisions do not fully couple the neutral and charged fluids. The purpose of this study is to deepen our understanding of the RTI and the effects of the partial ionization on the development of RTI using non-linear two-fluid numerical simulations. Our two-fluid m… ▽ More In this work, we explore the dynamical impacts and observable signatures of two-fluid effects in the parameter regimes when ion-neutral collisions do not fully couple the neutral and charged fluids. The purpose of this study is to deepen our understanding of the RTI and the effects of the partial ionization on the development of RTI using non-linear two-fluid numerical simulations. Our two-fluid model takes into account neutral viscosity, thermal conductivity, and collisional interaction between neutrals and charges: ionization/recombination, energy and momentum transfer, and frictional heating. In this paper II, the sensitivity of the RTI dynamics to collisional effects for different magnetic field configurations supporting the prominence thread is explored. This is done by artificially varying, or eliminating, effects of both elastic and inelastic collisions by modifying the model equations. We find that ionization and recombination reactions between ionized and neutral fluids, if in equilibrium prior to the onset of the instability, do not substantially impact the development of the primary RTI. However, such reactions can impact development of secondary structures during mixing of the cold prominence and hotter surrounding coronal material. We find that collisionality within and between ionized and neutral particle populations play an important role in both linear and non-linear development of RTI, with ion-neutral collision frequency as the primary determining factor in development or damping of small scale structures. We also observe that degree and signatures of flow decoupling between ion and neutral fluids can depend both on the inter-particle collisionality and the magnetic field configuration of the prominence thread. △ Less

Submitted 8 April, 2021; v1 submitted 29 January, 2021; originally announced January 2021.

Journal ref: A&A 650, A181 (2021)

Two-fluid simulations of Rayleigh-Taylor instability in a magnetized solar prominence thread. I. Effects of prominence magnetization and mass loading

Authors: B. Popescu Braileanu, V. S. Lukin, E. Khomenko, A. de Vicente

Abstract: Solar prominences are formed by partially ionized plasma with inter-particle collision frequencies generally warranting magnetohydrodynamic treatment. In this work, we explore the dynamical impacts and observable signatures of two-fluid effects in the parameter regimes when ion-neutral collisions do not fully couple the neutral and charged fluids. We perform 2.5D two-fluid (charges - neutrals) sim… ▽ More Solar prominences are formed by partially ionized plasma with inter-particle collision frequencies generally warranting magnetohydrodynamic treatment. In this work, we explore the dynamical impacts and observable signatures of two-fluid effects in the parameter regimes when ion-neutral collisions do not fully couple the neutral and charged fluids. We perform 2.5D two-fluid (charges - neutrals) simulations of the Rayleigh-Taylor instability (RTI) at a smoothly changing interface between a solar prominence thread and the corona. The purpose of this study is to deepen our understanding of the RTI and the effects of the partial ionization on the development of RTI using non-linear two-fluid numerical simulations. Our two-fluid model takes into account viscosity, thermal conductivity, and collisional interaction between neutrals and charges: ionization/recombination, energy and momentum transfer, and frictional heating. In this paper I, the sensitivity of the RTI dynamics to the prominence equilibrium configuration, including the impact of the magnetic field strength and shear supporting the prominence thread, and the amount of prominence mass-loading is explored. We show that, at small scales, a realistically smooth prominence-corona interface leads to qualitatively different linear RTI evolution than that expected for a discontinuous interface, while magnetic field shear has the stabilizing effect of reducing the growth rate or eliminating the instability. In the non-linear phase, we observe that in the presence of field shear the development of the instability leads to formation of coherent and interacting 2.5D magnetic structures, which, in turn, can lead to substantial plasma flow across magnetic field lines and associated decoupling of the fluid velocities of charges and neutrals. △ Less

Submitted 15 December, 2020; v1 submitted 31 July, 2020; originally announced July 2020.

Journal ref: A&A 646, A93 (2021)

A Research Platform for Multi-Robot Dialogue with Humans

Authors: Matthew Marge, Stephen Nogar, Cory J. Hayes, Stephanie M. Lukin, Jesse Bloecker, Eric Holder, Clare Voss

Abstract: This paper presents a research platform that supports spoken dialogue interaction with multiple robots. The demonstration showcases our crafted MultiBot testing scenario in which users can verbally issue search, navigate, and follow instructions to two robotic teammates: a simulated ground robot and an aerial robot. This flexible language and robotic platform takes advantage of existing tools for… ▽ More This paper presents a research platform that supports spoken dialogue interaction with multiple robots. The demonstration showcases our crafted MultiBot testing scenario in which users can verbally issue search, navigate, and follow instructions to two robotic teammates: a simulated ground robot and an aerial robot. This flexible language and robotic platform takes advantage of existing tools for speech recognition and dialogue management that are compatible with new domains, and implements an inter-agent communication protocol (tactical behavior specification), where verbal instructions are encoded for tasks assigned to the appropriate robot. △ Less

Submitted 12 October, 2019; originally announced October 2019.

Comments: Accepted for publication at NAACL 2019; also presented at AI-HRI 2019 (arXiv:1909.04812)

Report number: AI-HRI/2019/05

Two-fluid simulations of waves in the solar chromosphere II. Propagation and damping of fast magneto-acoustic waves and shocks

Authors: B. Popescu Braileanu, V. S. Lukin, E. Khomenko, A. de Vicente

Abstract: Waves and shocks traveling through the solar chromospheric plasma are influenced by its partial ionization and weak collisional coupling, and may become susceptible to multi-fluid effects, similar to interstellar shock waves. In this study, we consider fast magneto-acoustic shock wave formation and propagation in a stratified medium, that is permeated by a horizontal magnetic field, with propertie… ▽ More Waves and shocks traveling through the solar chromospheric plasma are influenced by its partial ionization and weak collisional coupling, and may become susceptible to multi-fluid effects, similar to interstellar shock waves. In this study, we consider fast magneto-acoustic shock wave formation and propagation in a stratified medium, that is permeated by a horizontal magnetic field, with properties similar to that of the solar chromosphere. The evolution of plasma and neutrals is modeled using a two-fluid code that evolves a set of coupled equations for two separate fluids. We observed that waves in neutrals and plasma, initially coupled at the upper photosphere, become uncoupled at higher heights in the chromosphere. This decoupling can be a consequence of either the characteristic spatial scale at the shock front, that becomes similar to the collisional scale, or the change in the relation between the wave frequency, ion cyclotron frequency, and the collisional frequency with height. The decoupling height is a sensitive function of the wave frequency, wave amplitude, and the magnetic field strength. We observed that decoupling causes damping of waves and an increase in the background temperature due to the frictional heating. The comparison between analytical and numerical results allows us to separate the role of the nonlinear effects from the linear ones on the decoupling and damping of waves. △ Less

Submitted 14 August, 2019; originally announced August 2019.

Journal ref: A&A 630, A79 (2019)

Visual Understanding and Narration: A Deeper Understanding and Explanation of Visual Scenes

Authors: Stephanie M. Lukin, Claire Bonial, Clare R. Voss

Abstract: We describe the task of Visual Understanding and Narration, in which a robot (or agent) generates text for the images that it collects when navigating its environment, by answering open-ended questions, such as 'what happens, or might have happened, here?' We describe the task of Visual Understanding and Narration, in which a robot (or agent) generates text for the images that it collects when navigating its environment, by answering open-ended questions, such as 'what happens, or might have happened, here?' △ Less

Submitted 23 September, 2019; v1 submitted 31 May, 2019; originally announced June 2019.

Comments: 2-page extended abstract, presented at the Workshop on Shortcomings in Vision and Language (SiVL), 2019, at the North American Association for Computational Linguistics (NAACL)

Two-fluid simulations of waves in the solar chromosphere I: numerical code verification

Authors: B. Popescu Braileanu, V. S. Lukin, E. Khomenko, A. de Vicente

Abstract: Solar chromosphere consists of a partially ionized plasma, which makes modeling the solar chromosphere a particularly challenging numerical task. Here we numerically model chromospheric waves using a two-fluid approach with a newly developed numerical code. The code solves two-fluid equations of conservation of mass, momentum and energy, together with the induction equation, for the case of the pu… ▽ More Solar chromosphere consists of a partially ionized plasma, which makes modeling the solar chromosphere a particularly challenging numerical task. Here we numerically model chromospheric waves using a two-fluid approach with a newly developed numerical code. The code solves two-fluid equations of conservation of mass, momentum and energy, together with the induction equation, for the case of the purely hydrogen plasma with collisional coupling between the charged and neutral fluid components. The implementation of a semi-implicit algorithm allows us to overcome the numerical stability constraints due to the stiff collisional terms. We test the code against analytical solutions of acoustic and Alfvén wave propagation in uniform medium in several regimes of collisional coupling.The results of our simulations are consistent with the analytical estimates, and with other results described in the literature. In the limit of a large collisional frequency, the waves propagate with a common speed of a single fluid. In the other limit of a vanishingly small collisional frequency, the Alfvén waves propagate with an Alfvén speed of the charged fluid only, while the perturbation in neutral fluid is very small. The acoustic waves in these limits propagate with the sound speed corresponding to either the charges or the neutrals, while the perturbation in the other fluid component is very small. Otherwise, when the collision frequency is similar to the real part of the wave frequency, the interaction between charges and neutrals through momentum transfer collisions cause alterations of the waves frequencies and damping of the wave amplitudes. △ Less

Submitted 9 May, 2019; originally announced May 2019.

Journal ref: A&A 627, A25 (2019)

Onset of secondary instabilities and plasma heating during magnetic reconnection in strongly magnetized regions of the low solar atmosphere

Authors: Lei Ni, Vyacheslav S. Lukin

Abstract: We numerically study magnetic reconnection on different spatial scales and at different heights in the weakly ionized plasma of the low solar atmosphere (around $300-800$~km above the solar surface) within a reactive 2.5 D multi-fluid plasma-neutral model. We consider a strongly magnetized plasma ($β\sim 6\% $) evolving from a force-free magnetic configuration and perturbed to initialize formation… ▽ More We numerically study magnetic reconnection on different spatial scales and at different heights in the weakly ionized plasma of the low solar atmosphere (around $300-800$~km above the solar surface) within a reactive 2.5 D multi-fluid plasma-neutral model. We consider a strongly magnetized plasma ($β\sim 6\% $) evolving from a force-free magnetic configuration and perturbed to initialize formation of a reconnection current sheet. On large scales, the resulting current sheets are observed to undergo a secondary 'plasmoid' instability. A series of simulations at different scales demonstrate a cascading current sheet formation process that terminates for current sheets with width of ~2m and length of $\sim100$~m, corresponding to the critical current sheet aspect ratio of $\sim50$. We also observe that the plasmoid instability is the primary physical mechanism accelerating the magnetic reconnection in this plasma parameter regime. After plasmoid instabilities appear, the reconnection rate sharply increases to a value of $\sim$ 0.035, observed to be independent of the Lundquist number. These characteristics are very similar to magnetic reconnection in fully ionized plasmas. In this low $β$ guide field reconnection regime, both the recombination and collisionless effects are observed to have a small contribution to the reconnection rate. The simulations show that it is difficult to heat the dense weakly ionized photospheric plasmas to above $2\times10^4$~K during the magnetic reconnection process. However, the plasmas in the low solar chromosphere can be heated above $3\times10^4$~K with reconnection magnetic fields of $500$~G or stronger. △ Less

Submitted 25 October, 2018; v1 submitted 23 October, 2018; originally announced October 2018.

Balancing Efficiency and Coverage in Human-Robot Dialogue Collection

Authors: Matthew Marge, Claire Bonial, Stephanie Lukin, Cory Hayes, Ashley Foots, Ron Artstein, Cassidy Henry, Kimberly Pollard, Carla Gordon, Felix Gervits, Anton Leuski, Susan Hill, Clare Voss, David Traum

Abstract: We describe a multi-phased Wizard-of-Oz approach to collecting human-robot dialogue in a collaborative search and navigation task. The data is being used to train an initial automated robot dialogue system to support collaborative exploration tasks. In the first phase, a wizard freely typed robot utterances to human participants. For the second phase, this data was used to design a GUI that includ… ▽ More We describe a multi-phased Wizard-of-Oz approach to collecting human-robot dialogue in a collaborative search and navigation task. The data is being used to train an initial automated robot dialogue system to support collaborative exploration tasks. In the first phase, a wizard freely typed robot utterances to human participants. For the second phase, this data was used to design a GUI that includes buttons for the most common communications, and templates for communications with varying parameters. Comparison of the data gathered in these phases show that the GUI enabled a faster pace of dialogue while still maintaining high coverage of suitable responses, enabling more efficient targeted data collection, and improvements in natural language understanding using GUI-collected data. As a promising first step towards interactive learning, this work shows that our approach enables the collection of useful training data for navigation-based HRI tasks. △ Less

Submitted 7 October, 2018; v1 submitted 3 October, 2018; originally announced October 2018.

Comments: Presented at AI-HRI AAAI-FSS, 2018 (arXiv:1809.06606)

Report number: AI-HRI/2018/01

A Pipeline for Creative Visual Storytelling

Authors: Stephanie M. Lukin, Reginald Hobbs, Clare R. Voss

Abstract: Computational visual storytelling produces a textual description of events and interpretations depicted in a sequence of images. These texts are made possible by advances and cross-disciplinary approaches in natural language processing, generation, and computer vision. We define a computational creative visual storytelling as one with the ability to alter the telling of a story along three aspects… ▽ More Computational visual storytelling produces a textual description of events and interpretations depicted in a sequence of images. These texts are made possible by advances and cross-disciplinary approaches in natural language processing, generation, and computer vision. We define a computational creative visual storytelling as one with the ability to alter the telling of a story along three aspects: to speak about different environments, to produce variations based on narrative goals, and to adapt the narrative to the audience. These aspects of creative storytelling and their effect on the narrative have yet to be explored in visual storytelling. This paper presents a pipeline of task-modules, Object Identification, Single-Image Inferencing, and Multi-Image Narration, that serve as a preliminary design for building a creative visual storyteller. We have piloted this design for a sequence of images in an annotation task. We present and analyze the collected corpus and describe plans towards automation. △ Less

Submitted 20 July, 2018; originally announced July 2018.

Comments: Originally published in the Proceedings of the First Workshop on Storytelling (StoryNLP), 2018, at the North American Association for Computational Linguistics (NAACL)

Consequences and Factors of Stylistic Differences in Human-Robot Dialogue

Authors: Stephanie M. Lukin, Kimberly A. Pollard, Claire Bonial, Matthew Marge, Cassidy Henry, Ron Arstein, David Traum, Clare R. Voss

Abstract: This paper identifies stylistic differences in instruction-giving observed in a corpus of human-robot dialogue. Differences in verbosity and structure (i.e., single-intent vs. multi-intent instructions) arose naturally without restrictions or prior guidance on how users should speak with the robot. Different styles were found to produce different rates of miscommunication, and correlations were fo… ▽ More This paper identifies stylistic differences in instruction-giving observed in a corpus of human-robot dialogue. Differences in verbosity and structure (i.e., single-intent vs. multi-intent instructions) arose naturally without restrictions or prior guidance on how users should speak with the robot. Different styles were found to produce different rates of miscommunication, and correlations were found between style differences and individual user variation, trust, and interaction experience with the robot. Understanding potential consequences and factors that influence style can inform design of dialogue systems that are robust to natural variation from human users. △ Less

Submitted 20 July, 2018; originally announced July 2018.

Comments: Originally published in the Proceedings of the 19th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), 2018

ScoutBot: A Dialogue System for Collaborative Navigation

Authors: Stephanie M. Lukin, Felix Gervits, Cory J. Hayes, Anton Leuski, Pooja Moolchandani, John G. Rogers III, Carlos Sanchez Amaro, Matthew Marge, Clare R. Voss, David Traum

Abstract: ScoutBot is a dialogue interface to physical and simulated robots that supports collaborative exploration of environments. The demonstration will allow users to issue unconstrained spoken language commands to ScoutBot. ScoutBot will prompt for clarification if the user's instruction needs additional input. It is trained on human-robot dialogue collected from Wizard-of-Oz experiments, where robot r… ▽ More ScoutBot is a dialogue interface to physical and simulated robots that supports collaborative exploration of environments. The demonstration will allow users to issue unconstrained spoken language commands to ScoutBot. ScoutBot will prompt for clarification if the user's instruction needs additional input. It is trained on human-robot dialogue collected from Wizard-of-Oz experiments, where robot responses were initiated by a human wizard in previous interactions. The demonstration will show a simulated ground robot (Clearpath Jackal) in a simulated environment supported by ROS (Robot Operating System). △ Less

Submitted 20 July, 2018; originally announced July 2018.

Comments: Originally published in the Proceedings of the Association for Computational Linguistics (ACL) 2018, System Demonstrations, 93-98

Controlling Personality-Based Stylistic Variation with Neural Natural Language Generators

Authors: Shereen Oraby, Lena Reed, Shubhangi Tandon, T. S. Sharath, Stephanie Lukin, Marilyn Walker

Abstract: Natural language generators for task-oriented dialogue must effectively realize system dialogue actions and their associated semantics. In many applications, it is also desirable for generators to control the style of an utterance. To date, work on task-oriented neural generation has primarily focused on semantic fidelity rather than achieving stylistic goals, while work on style has been done in… ▽ More Natural language generators for task-oriented dialogue must effectively realize system dialogue actions and their associated semantics. In many applications, it is also desirable for generators to control the style of an utterance. To date, work on task-oriented neural generation has primarily focused on semantic fidelity rather than achieving stylistic goals, while work on style has been done in contexts where it is difficult to measure content preservation. Here we present three different sequence-to-sequence models and carefully test how well they disentangle content and style. We use a statistical generator, Personage, to synthesize a new corpus of over 88,000 restaurant domain utterances whose style varies according to models of personality, giving us total control over both the semantic content and the stylistic variation in the training data. We then vary the amount of explicit stylistic supervision given to the three models. We show that our most explicit model can simultaneously achieve high fidelity to both semantic and stylistic goals: this model adds a context vector of 36 stylistic parameters as input to the hidden state of the encoder at each time step, showing the benefits of explicit stylistic supervision, even when the amount of training data is large. △ Less

Submitted 21 May, 2018; originally announced May 2018.

Comments: To appear at SIGDIAL 2018

Magnetic reconnection in the low solar chromosphere with a more realistic radiative cooling model

Authors: Lei Ni, Vyacheslav S. Lukin, Nicholas A. Murphy, Jun Lin

Abstract: Magnetic reconnection is the most likely mechanism responsible for the high temperature events that are observed in strongly magnetized locations around the temperature minimum in the low solar chromosphere. This work improves upon our previous work ["Magnetic Reconnection in Strongly Magnetized Regions of the Low Solar Chromosphere", The Astrophysical Journal 852, 95 (2018) ] by using a more real… ▽ More Magnetic reconnection is the most likely mechanism responsible for the high temperature events that are observed in strongly magnetized locations around the temperature minimum in the low solar chromosphere. This work improves upon our previous work ["Magnetic Reconnection in Strongly Magnetized Regions of the Low Solar Chromosphere", The Astrophysical Journal 852, 95 (2018) ] by using a more realistic radiative cooling model computed from the OPACITY project and the CHIANTI database. We find that the rate of ionization of the neutral component of the plasma is still faster than recombination within the current sheet region. For low $β$ plasmas, the ionized and neutral fluid flows are well-coupled throughout the reconnection region resembling the single-fluid Sweet-Parker model dynamics. Decoupling of the ion and neutral inflows appears in the higher $β$ case with $β_0=1.46$, which leads to a reconnection rate about three times faster than the rate predicted by the Sweet-Parker model. In all cases, the plasma temperature increases with time inside the current sheet, and the maximum value is above $2\times10^4$~K when the reconnection magnetic field strength is greater than $500$~G. While the more realistic radiative cooling model does not result in qualitative changes of the characteristics of magnetic reconnection, it is necessary for studying the variations of the plasma temperature and ionization fraction inside current sheets in strongly magnetized regions of the low solar atmosphere. It is also important for studying energy conversion during the magnetic reconnection process when the hydrogen-dominated plasma approaches full ionization. △ Less

Submitted 25 October, 2018; v1 submitted 16 April, 2018; originally announced April 2018.

Reflection of fast magnetosonic waves near magnetic reconnection region

Authors: Elena Provornikova, J. Martin Laming, Vyacheslav S. Lukin

Abstract: Magnetic reconnection in the solar corona is thought to be unstable to the formation of multiple interacting plasmoids, and previous studies have shown that plasmoid dynamics can trigger MHD waves of different modes propagating outward from the reconnection site. However, variations in plasma parameters and magnetic field strength in the vicinity of a coronal reconnection site may lead to wave ref… ▽ More Magnetic reconnection in the solar corona is thought to be unstable to the formation of multiple interacting plasmoids, and previous studies have shown that plasmoid dynamics can trigger MHD waves of different modes propagating outward from the reconnection site. However, variations in plasma parameters and magnetic field strength in the vicinity of a coronal reconnection site may lead to wave reflection and mode conversion. In this paper we investigate the reflection and refraction of fast magnetoacoustic waves near a reconnection site. Under a justified assumption of an analytically specified Alfvén speed profile, we derive and solve analytically the full wave equation governing propagation of fast mode waves in a non-uniform background plasma without recourse to the small-wavelength approximation. We show that the waves undergo reflection near the reconnection current sheet due to the Alfvén speed gradient and that the reflection efficiently depends on the plasma-$β$ parameter as well as on the wave frequency. In particular, we find that waves are reflected more efficiently near reconnection sites in a low-$β$ plasma which is typical for the solar coronal conditions. Also, the reflection is larger for lower frequency waves while high frequency waves propagate outward from the reconnection region almost without the reflection. We discuss the implications of efficient wave reflection near magnetic reconnection sites in strongly magnetized coronal plasma for particle acceleration, and also the effect this might have on First Ionization Potential (FIP) fractionation by the ponderomotive force of these waves in the chromosphere. △ Less

Submitted 29 March, 2018; originally announced March 2018.

Comments: 28 pages, 10 figures, submitted to the Astrophysical Journal

Journal ref: E Provornikova et al 2018 ApJ 860 138

Magnetic reconnection in strongly magnetized regions of the low solar chromosphere

Authors: Lei Ni, Vyacheslav S. Lukin, Nicholas A. Murphy, Jun Lin

Abstract: Magnetic reconnection in strongly magnetized regions around the temperature minimum region of the low solar atmosphere is studied by employing MHD-based simulations of a partially ionized plasma within a reactive 2.5D multi-fluid model. It is shown that in the absence of magnetic nulls in a low $β$ plasma the ionized and neutral fluid flows are well-coupled throughout the reconnection region. Howe… ▽ More Magnetic reconnection in strongly magnetized regions around the temperature minimum region of the low solar atmosphere is studied by employing MHD-based simulations of a partially ionized plasma within a reactive 2.5D multi-fluid model. It is shown that in the absence of magnetic nulls in a low $β$ plasma the ionized and neutral fluid flows are well-coupled throughout the reconnection region. However, non-equilibrium ionization-recombination dynamics play a critical role in determining the structure of the reconnection region, lead to much lower temperature increases and a faster magnetic reconnection rate as compared to simulations that assume plasma to be in ionization-recombination equilibrium. The rate of ionization of the neutral component of the plasma is always faster than recombination within the current sheet region even when the initial plasma $β$ is as high as $β_0=1.46$. When the reconnecting magnetic field is in excess of a kilogauss and the plasma $β$ is lower than 0.0145, the initially weakly ionized plasmas can become fully ionized within the reconnection region and the current sheet can be strongly heated to above $2.5\times10^4$~K, even as most of the collisionally dissipated magnetic energy is radiated away. The Hall effect increases the reconnection rate slightly, but in the absence of magnetic nulls it does not result in significant asymmetries or change the characteristics of the reconnection current sheet down to meter scales. △ Less

Submitted 22 December, 2017; v1 submitted 2 December, 2017; originally announced December 2017.

Journal ref: Lei Ni et al 2018 ApJ 852 95

Laying Down the Yellow Brick Road: Development of a Wizard-of-Oz Interface for Collecting Human-Robot Dialogue

Authors: Claire Bonial, Matthew Marge, Ron artstein, Ashley Foots, Felix Gervits, Cory J. Hayes, Cassidy Henry, Susan G. Hill, Anton Leuski, Stephanie M. Lukin, Pooja Moolchandani, Kimberly A. Pollard, David Traum, Clare R. Voss

Abstract: We describe the adaptation and refinement of a graphical user interface designed to facilitate a Wizard-of-Oz (WoZ) approach to collecting human-robot dialogue data. The data collected will be used to develop a dialogue system for robot navigation. Building on an interface previously used in the development of dialogue systems for virtual agents and video playback, we add templates with open param… ▽ More We describe the adaptation and refinement of a graphical user interface designed to facilitate a Wizard-of-Oz (WoZ) approach to collecting human-robot dialogue data. The data collected will be used to develop a dialogue system for robot navigation. Building on an interface previously used in the development of dialogue systems for virtual agents and video playback, we add templates with open parameters which allow the wizard to quickly produce a wide variety of utterances. Our research demonstrates that this approach to data collection is viable as an intermediate step in developing a dialogue system for physical robots in remote locations from their users - a domain in which the human and robot need to regularly verify and update a shared understanding of the physical environment. We show that our WoZ interface and the fixed set of utterances and templates therein provide for a natural pace of dialogue with good coverage of the navigation domain. △ Less

Submitted 17 October, 2017; originally announced October 2017.

Comments: 7 pages, 2 figures, accepted for oral presentation at the Symposium on Natural Communication for Human-Robot Collaboration, AAAI Fall Symposium Series, November 9-11, 2017, https://www.aaai.org/ocs/index.php/FSS/FSS17

Data-Driven Dialogue Systems for Social Agents

Authors: Kevin K. Bowden, Shereen Oraby, Amita Misra, Jiaqi Wu, Stephanie Lukin

Abstract: In order to build dialogue systems to tackle the ambitious task of holding social conversations, we argue that we need a data driven approach that includes insight into human conversational chit chat, and which incorporates different natural language processing modules. Our strategy is to analyze and index large corpora of social media data, including Twitter conversations, online debates, dialogu… ▽ More In order to build dialogue systems to tackle the ambitious task of holding social conversations, we argue that we need a data driven approach that includes insight into human conversational chit chat, and which incorporates different natural language processing modules. Our strategy is to analyze and index large corpora of social media data, including Twitter conversations, online debates, dialogues between friends, and blog posts, and then to couple this data retrieval with modules that perform tasks such as sentiment and style analysis, topic modeling, and summarization. We aim for personal assistants that can learn more nuanced human language, and to grow from task-oriented agents to more personable social bots. △ Less

Submitted 10 September, 2017; originally announced September 2017.

Comments: IWSDS 2017

Getting Reliable Annotations for Sarcasm in Online Dialogues

Authors: Reid Swanson, Stephanie Lukin, Luke Eisenberg, Thomas Chase Corcoran, Marilyn A. Walker

Abstract: The language used in online forums differs in many ways from that of traditional language resources such as news. One difference is the use and frequency of nonliteral, subjective dialogue acts such as sarcasm. Whether the aim is to develop a theory of sarcasm in dialogue, or engineer automatic methods for reliably detecting sarcasm, a major challenge is simply the difficulty of getting enough rel… ▽ More The language used in online forums differs in many ways from that of traditional language resources such as news. One difference is the use and frequency of nonliteral, subjective dialogue acts such as sarcasm. Whether the aim is to develop a theory of sarcasm in dialogue, or engineer automatic methods for reliably detecting sarcasm, a major challenge is simply the difficulty of getting enough reliably labelled examples. In this paper we describe our work on methods for achieving highly reliable sarcasm annotations from untrained annotators on Mechanical Turk. We explore the use of a number of common statistical reliability measures, such as Kappa, Karger's, Majority Class, and EM. We show that more sophisticated measures do not appear to yield better results for our data than simple measures such as assuming that the correct label is the one that a majority of Turkers apply. △ Less

Submitted 4 September, 2017; originally announced September 2017.

Comments: International Conference on Language Resources and Evaluation (LREC 2014)

Automating Direct Speech Variations in Stories and Games

Authors: Stephanie M. Lukin, James O. Ryan, Marilyn A. Walker

Abstract: Dialogue authoring in large games requires not only content creation but the subtlety of its delivery, which can vary from character to character. Manually authoring this dialogue can be tedious, time-consuming, or even altogether infeasible. This paper utilizes a rich narrative representation for modeling dialogue and an expressive natural language generation engine for realizing it, and expands… ▽ More Dialogue authoring in large games requires not only content creation but the subtlety of its delivery, which can vary from character to character. Manually authoring this dialogue can be tedious, time-consuming, or even altogether infeasible. This paper utilizes a rich narrative representation for modeling dialogue and an expressive natural language generation engine for realizing it, and expands upon a translation tool that bridges the two. We add functionality to the translator to allow direct speech to be modeled by the narrative representation, whereas the original translator supports only narratives told by a third person narrator. We show that we can perform character substitution in dialogues. We implement and evaluate a potential application to dialogue implementation: generating dialogue for games with big, dynamic, or procedurally-generated open worlds. We present a pilot study on human perceptions of the personalities of characters using direct speech, assuming unknown personality types at the time of authoring. △ Less

Submitted 29 August, 2017; originally announced August 2017.

Comments: 3rd Workshop on Games and NLP (GAMNLP 2014)

Argument Strength is in the Eye of the Beholder: Audience Effects in Persuasion

Authors: Stephanie M. Lukin, Pranav Anand, Marilyn Walker, Steve Whittaker

Abstract: Americans spend about a third of their time online, with many participating in online conversations on social and political issues. We hypothesize that social media arguments on such issues may be more engaging and persuasive than traditional media summaries, and that particular types of people may be more or less convinced by particular styles of argument, e.g. emotional arguments may resonate wi… ▽ More Americans spend about a third of their time online, with many participating in online conversations on social and political issues. We hypothesize that social media arguments on such issues may be more engaging and persuasive than traditional media summaries, and that particular types of people may be more or less convinced by particular styles of argument, e.g. emotional arguments may resonate with some personalities while factual arguments resonate with others. We report a set of experiments testing at large scale how audience variables interact with argument style to affect the persuasiveness of an argument, an under-researched topic within natural language processing. We show that belief change is affected by personality factors, with conscientious, open and agreeable people being more convinced by emotional arguments. △ Less

Submitted 29 August, 2017; originally announced August 2017.

Comments: European Chapter of the Association for Computational Linguistics (EACL 2017)

PersonaBank: A Corpus of Personal Narratives and Their Story Intention Graphs

Authors: Stephanie M. Lukin, Kevin Bowden, Casey Barackman, Marilyn A. Walker

Abstract: We present a new corpus, PersonaBank, consisting of 108 personal stories from weblogs that have been annotated with their Story Intention Graphs, a deep representation of the fabula of a story. We describe the topics of the stories and the basis of the Story Intention Graph representation, as well as the process of annotating the stories to produce the Story Intention Graphs and the challenges of… ▽ More We present a new corpus, PersonaBank, consisting of 108 personal stories from weblogs that have been annotated with their Story Intention Graphs, a deep representation of the fabula of a story. We describe the topics of the stories and the basis of the Story Intention Graph representation, as well as the process of annotating the stories to produce the Story Intention Graphs and the challenges of adapting the tool to this new personal narrative domain We also discuss how the corpus can be used in applications that retell the story using different styles of tellings, co-tellings, or as a content planner. △ Less

Submitted 29 August, 2017; originally announced August 2017.

Comments: International Conference on Language Resources and Evaluation (LREC 2016)

Narrative Variations in a Virtual Storyteller

Authors: Stephanie M. Lukin, Marilyn A. Walker

Abstract: Research on storytelling over the last 100 years has distinguished at least two levels of narrative representation (1) story, or fabula; and (2) discourse, or sujhet. We use this distinction to create Fabula Tales, a computational framework for a virtual storyteller that can tell the same story in different ways through the implementation of general narratological variations, such as varying direc… ▽ More Research on storytelling over the last 100 years has distinguished at least two levels of narrative representation (1) story, or fabula; and (2) discourse, or sujhet. We use this distinction to create Fabula Tales, a computational framework for a virtual storyteller that can tell the same story in different ways through the implementation of general narratological variations, such as varying direct vs. indirect speech, character voice (style), point of view, and focalization. A strength of our computational framework is that it is based on very general methods for re-using existing story content, either from fables or from personal narratives collected from blogs. We first explain how a simple annotation tool allows naive annotators to easily create a deep representation of fabula called a story intention graph, and show how we use this representation to generate story tellings automatically. Then we present results of two studies testing our narratological parameters, and showing that different tellings affect the reader's perception of the story and characters. △ Less

Submitted 28 August, 2017; originally announced August 2017.

Comments: Intelligent Virtual Agents (IVA 2015)

Generating Sentence Planning Variations for Story Telling

Authors: Stephanie M. Lukin, Lena I. Reed, Marilyn A. Walker

Abstract: There has been a recent explosion in applications for dialogue interaction ranging from direction-giving and tourist information to interactive story systems. Yet the natural language generation (NLG) component for many of these systems remains largely handcrafted. This limitation greatly restricts the range of applications; it also means that it is impossible to take advantage of recent work in e… ▽ More There has been a recent explosion in applications for dialogue interaction ranging from direction-giving and tourist information to interactive story systems. Yet the natural language generation (NLG) component for many of these systems remains largely handcrafted. This limitation greatly restricts the range of applications; it also means that it is impossible to take advantage of recent work in expressive and statistical language generation that can dynamically and automatically produce a large number of variations of given content. We propose that a solution to this problem lies in new methods for developing language generation resources. We describe the ES-Translator, a computational language generator that has previously been applied only to fables, and quantitatively evaluate the domain independence of the EST by applying it to personal narratives from weblogs. We then take advantage of recent work on language generation to create a parameterized sentence planner for story generation that provides aggregation operations, variations in discourse and in point of view. Finally, we present a user evaluation of different personal narrative retellings. △ Less

Submitted 28 August, 2017; originally announced August 2017.

Comments: SIGdial Meeting on Discourse and Dialogue (SIGDIAL 2015)

Identifying Subjective and Figurative Language in Online Dialogue

Authors: Stephanie M. Lukin, Luke Eisenberg, Thomas Corcoran, Marilyn A. Walker

Abstract: More and more of the information on the web is dialogic, from Facebook newsfeeds, to forum conversations, to comment threads on news articles. In contrast to traditional, monologic resources such as news, highly social dialogue is very frequent in social media. We aim to automatically identify sarcastic and nasty utterances in unannotated online dialogue, extending a bootstrapping method previousl… ▽ More More and more of the information on the web is dialogic, from Facebook newsfeeds, to forum conversations, to comment threads on news articles. In contrast to traditional, monologic resources such as news, highly social dialogue is very frequent in social media. We aim to automatically identify sarcastic and nasty utterances in unannotated online dialogue, extending a bootstrapping method previously applied to the classification of monologic subjective sentences in Riloff and Weibe 2003. We have adapted the method to fit the sarcastic and nasty dialogic domain. Our method is as follows: 1) Explore methods for identifying sarcastic and nasty cue words and phrases in dialogues; 2) Use the learned cues to train a sarcastic (nasty) Cue-Based Classifier; 3) Learn general syntactic extraction patterns from the sarcastic (nasty) utterances and define fine-tuned sarcastic patterns to create a Pattern-Based Classifier; 4) Combine both Cue-Based and fine-tuned Pattern-Based Classifiers to maximize precision at the expense of recall and test on unannotated utterances. △ Less

Submitted 28 August, 2017; originally announced August 2017.

Comments: Pacific Northwest Natural Language Processing Workshop (NWNLP 2014)

Generating Different Story Tellings from Semantic Representations of Narrative

Authors: Elena Rishes, Stephanie M. Lukin, David K. Elson, Marilyn A. Walker

Abstract: In order to tell stories in different voices for different audiences, interactive story systems require: (1) a semantic representation of story structure, and (2) the ability to automatically generate story and dialogue from this semantic representation using some form of Natural Language Generation (NLG). However, there has been limited research on methods for linking story structures to narrativ… ▽ More In order to tell stories in different voices for different audiences, interactive story systems require: (1) a semantic representation of story structure, and (2) the ability to automatically generate story and dialogue from this semantic representation using some form of Natural Language Generation (NLG). However, there has been limited research on methods for linking story structures to narrative descriptions of scenes and story events. In this paper we present an automatic method for converting from Scheherazade's story intention graph, a semantic representation, to the input required by the Personage NLG engine. Using 36 Aesop Fables distributed in DramaBank, a collection of story encodings, we train translation rules on one story and then test these rules by generating text for the remaining 35. The results are measured in terms of the string similarity metrics Levenshtein Distance and BLEU score. The results show that we can generate the 35 stories with correct content: the test set stories on average are close to the output of the Scheherazade realizer, which was customized to this semantic representation. We provide some examples of story variations generated by personage. In future work, we will experiment with measuring the quality of the same stories generated in different voices, and with techniques for making storytelling interactive. △ Less

Submitted 28 August, 2017; originally announced August 2017.

Comments: International Conference on Interactive Digital Storytelling (ICIDS 2013)

Really? Well. Apparently Bootstrapping Improves the Performance of Sarcasm and Nastiness Classifiers for Online Dialogue

Authors: Stephanie Lukin, Marilyn Walker

Abstract: More and more of the information on the web is dialogic, from Facebook newsfeeds, to forum conversations, to comment threads on news articles. In contrast to traditional, monologic Natural Language Processing resources such as news, highly social dialogue is frequent in social media, making it a challenging context for NLP. This paper tests a bootstrapping method, originally proposed in a monologi… ▽ More More and more of the information on the web is dialogic, from Facebook newsfeeds, to forum conversations, to comment threads on news articles. In contrast to traditional, monologic Natural Language Processing resources such as news, highly social dialogue is frequent in social media, making it a challenging context for NLP. This paper tests a bootstrapping method, originally proposed in a monologic domain, to train classifiers to identify two different types of subjective language in dialogue: sarcasm and nastiness. We explore two methods of developing linguistic indicators to be used in a first level classifier aimed at maximizing precision at the expense of recall. The best performing classifier for the first phase achieves 54% precision and 38% recall for sarcastic utterances. We then use general syntactic patterns from previous work to create more general sarcasm indicators, improving precision to 62% and recall to 52%. To further test the generality of the method, we then apply it to bootstrapping a classifier for nastiness dialogic acts. Our first phase, using crowdsourced nasty indicators, achieves 58% precision and 49% recall, which increases to 75% precision and 62% recall when we bootstrap over the first level with generalized syntactic patterns. △ Less

Submitted 28 August, 2017; originally announced August 2017.

Comments: Workshop on Language Analysis in Social Media (LASM 2013), at the North American Chapter of the Association for Computational Linguistics (NAACL 2013)

Overview of HiFi -- implicit spectral element code framework for multi-fluid plasma applications

Authors: Vyacheslav S. Lukin, Alan H. Glasser, Weston Lowrie, Eric T. Meier

Abstract: An overview of the algorithm and a sampling of plasma applications of the implicit, adaptive high order finite (spectral) element modeling framework, HiFi, is presented. The distinguishing capabilities of the HiFi code include adaptive spectral element spatial representation with flexible geometry, highly parallelizable implicit time advance, and general flux-source form of the partial differentia… ▽ More An overview of the algorithm and a sampling of plasma applications of the implicit, adaptive high order finite (spectral) element modeling framework, HiFi, is presented. The distinguishing capabilities of the HiFi code include adaptive spectral element spatial representation with flexible geometry, highly parallelizable implicit time advance, and general flux-source form of the partial differential equations and boundary conditions that can be implemented in its framework. Early algorithm development and extensive verification studies of the two-dimensional version of the code, known as SEL, have been previously described [A.H. Glasser & X.Z. Tang, Comp. Phys. Comm., 164 (2004); V.S. Lukin, Ph.D. thesis, Princeton University (2008)]. Here, substantial algorithmic improvements and extensions are presented together with examples of two- and three- dimensional applications of the HiFi framework. These include a Cartesian two-dimensional incompressible magnetohydrodynamic simulation of low dissipation magnetic reconnection in a large system, a two-dimensional axisymmetric simulation of self-similar compression of a magnetic plasma confinement configuration, and a three-dimensional Hall MHD simulation of spheromak tilting and relaxation. Some planned efforts to further improve and expand the capabilities of the HiFi modeling framework are discussed. △ Less

Submitted 21 August, 2016; originally announced August 2016.

Comments: manuscript, previously unpublished, prepared in 2009 with minor edits since

Plasma compression in magnetic reconnection regions in the solar corona

Authors: Elena Provornikova, John Martin Laming, Vyacheslav S. Lukin

Abstract: It has been proposed that particles bouncing between magnetized flows converging in a reconnection region can be accelerated by the first order Fermi mechanism. Analytical considerations of this mechanism have shown that the spectral index of accelerated particles is related to the total plasma compression within the reconnection region similarly to the case of diffusive shock acceleration mechani… ▽ More It has been proposed that particles bouncing between magnetized flows converging in a reconnection region can be accelerated by the first order Fermi mechanism. Analytical considerations of this mechanism have shown that the spectral index of accelerated particles is related to the total plasma compression within the reconnection region similarly to the case of diffusive shock acceleration mechanism. As a first step to investigate the efficiency of Fermi acceleration in reconnection regions in producing hard energy spectra of particles in the solar corona, we explore the degree of plasma compression that can be achieved at reconnection sites. In particular, we aim to determine the conditions for the strong compressions to form. Using a two-dimensional resistive MHD numerical model we consider a set of magnetic field configurations where magnetic reconnection can occur including a Harris current sheet, a force-free current sheet, and two merging flux ropes. Plasma parameters are taken to be characteristic of the solar corona. Numerical simulations show that strong plasma compressions ($\geq 4$) in the reconnection regions can form when the plasma heating due to reconnection is efficiently removed by fast thermal conduction or radiative cooling process. The radiative cooling process which is negligible in the typical 1 MK corona can play an important role in the low corona/transition region. It is found that plasma compression is expected to be strongest in low-beta plasma $β\sim 0.01-0.07$ at reconnection magnetic nulls. △ Less

Submitted 28 April, 2016; v1 submitted 25 April, 2016; originally announced April 2016.

Comments: Accepted for publication in the Astrophysical Journal, 36 pages, 11 figures, 1 table

A Two-Fluid Study of Oblique Tearing Modes in a Force-Free Current Sheet

Authors: Cihan Akcay, William Daughton, Vyacheslav S. Lukin, Yi-Hsin Liu

Abstract: Kinetic simulations have demonstrated that three-dimensional reconnection in collisionless regimes proceeds through the formation and interaction of magnetic flux ropes, which are generated due to the growth of tearing instabilities at multiple resonance surfaces. Since kinetic simulations are intrinsically expensive, it is desirable to explore the feasibility of reduced two-fluid models to captur… ▽ More Kinetic simulations have demonstrated that three-dimensional reconnection in collisionless regimes proceeds through the formation and interaction of magnetic flux ropes, which are generated due to the growth of tearing instabilities at multiple resonance surfaces. Since kinetic simulations are intrinsically expensive, it is desirable to explore the feasibility of reduced two-fluid models to capture this complex evolution, particularly, in the strong guide field regime, where two-fluid models are better justified. With this goal in mind, this paper compares the evolution of the collisionless tearing instability in a force-free current sheet with a two-fluid model and fully kinetic simulations. Our results indicate that the most unstable modes are oblique for guide fields larger than the reconnecting field, in agreement with the kinetic results. The standard two-fluid tearing theory is extended to address the tearing instability at oblique angles. The resulting theory yields a flat oblique spectrum and underestimates the growth of oblique modes in a similar manner to kinetic theory relative to kinetic simulations. △ Less

Submitted 26 January, 2016; originally announced January 2016.

Comments: accepted for publication in Physics of plasmas (February or March 2016 issue)

Two-fluid and magnetohydrodynamic modelling of magnetic reconnection in the MAST spherical tokamak and the solar corona

Authors: P. K. Browning, S. Cardnell, M. Evans, F. Arese Lucini, V. S. Lukin, K. G. McClements, A. Stanier

Abstract: Twisted magnetic flux ropes are ubiquitous in space and laboratory plasmas, and the merging of such flux ropes through magnetic reconnection is an important mechanism for restructuring magnetic fields and releasing free magnetic energy. The merging-compression scenario is one possible start up scheme for spherical tokamaks, which has been used on the Mega Amp Spherical Tokamak MAST. Two current-ca… ▽ More Twisted magnetic flux ropes are ubiquitous in space and laboratory plasmas, and the merging of such flux ropes through magnetic reconnection is an important mechanism for restructuring magnetic fields and releasing free magnetic energy. The merging-compression scenario is one possible start up scheme for spherical tokamaks, which has been used on the Mega Amp Spherical Tokamak MAST. Two current-carrying plasma rings, or flux ropes, approach each other through the mutual attraction of their like currents, and merge, through magnetic reconnection, into a single plasma torus, with substantial plasma heating. 2D resistive MHD and Hall MHD simulations of this process are reported, and new results for the temperature distribution of ions and electrons are presented. A model of the based on relaxation theory is also described, which is now extended to tight aspect ratio geometry. This model allows prediction of the final merged state and the heating. The implications of the relaxation model for heating of the solar corona are also discussed, and a model of the merger of two or more twisted coronal flux ropes is presented, allowing for different senses of twist. △ Less

Submitted 27 July, 2015; originally announced July 2015.

Asymmetric Magnetic Reconnection in Weakly Ionized Chromospheric Plasmas

Authors: Nicholas A. Murphy, Vyacheslav S. Lukin

Abstract: Realistic models of magnetic reconnection in the solar chromosphere must take into account that the plasma is partially ionized and that plasma conditions within any two magnetic flux bundles undergoing reconnection may not be the same. Asymmetric reconnection in the chromosphere may occur when newly emerged flux interacts with pre-existing, overlying flux. We present 2.5D simulations of asymmetri… ▽ More Realistic models of magnetic reconnection in the solar chromosphere must take into account that the plasma is partially ionized and that plasma conditions within any two magnetic flux bundles undergoing reconnection may not be the same. Asymmetric reconnection in the chromosphere may occur when newly emerged flux interacts with pre-existing, overlying flux. We present 2.5D simulations of asymmetric reconnection in weakly ionized, reacting plasmas where the magnetic field strengths, ion and neutral densities, and temperatures are different in each upstream region. The plasma and neutral components are evolved separately to allow non-equilibrium ionization. As in previous simulations of chromospheric reconnection, the current sheet thins to the scale of the neutral-ion mean free path and the ion and neutral outflows are strongly coupled. However, the ion and neutral inflows are asymmetrically decoupled. In cases with magnetic asymmetry, a net flow of neutrals through the current sheet from the weak field (high density) upstream region into the strong field upstream region results from a neutral pressure gradient. Consequently, neutrals dragged along with the outflow are more likely to originate from the weak field region. The Hall effect leads to the development of a characteristic quadrupole magnetic field modified by asymmetry, but the X-point geometry expected during Hall reconnection does not occur. All simulations show the development of plasmoids after an initial laminar phase. △ Less

Submitted 6 April, 2015; originally announced April 2015.

Comments: Accepted for publication in the Astrophysical Journal

Temporal and Spatial Turbulent Spectra of MHD Plasma and an Observation of Variance Anisotropy

Authors: D. A. Schaffner, M. R. Brown, V. S. Lukin

Abstract: The nature of MHD turbulence is analyzed through both temporal and spatial magnetic fluctuation spectra. A magnetically turbulent plasma is produced in the MHD wind-tunnel configuration of the Swarthmore Spheromak Experiment (SSX). The power of magnetic fluctuations is projected into directions perpendicular and parallel to a local mean field; the ratio of these quantities shows the presence of va… ▽ More The nature of MHD turbulence is analyzed through both temporal and spatial magnetic fluctuation spectra. A magnetically turbulent plasma is produced in the MHD wind-tunnel configuration of the Swarthmore Spheromak Experiment (SSX). The power of magnetic fluctuations is projected into directions perpendicular and parallel to a local mean field; the ratio of these quantities shows the presence of variance anisotropy which varies as a function of frequency. Comparison amongst magnetic, velocity, and density spectra are also made, demonstrating that the energy of the turbulence observed is primarily seeded by magnetic fields created during plasma production. Direct spatial spectra are constructed using multi-channel diagnostics and are used to compare to frequency spectra converted to spatial scales using the Taylor Hypothesis. Evidence for the observation of dissipation due to ion inertial length scale physics is also discussed as well as the role laboratory experiment can play in understanding turbulence typically studied in space settings such as the solar wind. Finally, all turbulence results are shown to compare fairly well to a Hall-MHD simulation of the experiment. △ Less

Submitted 12 April, 2014; originally announced April 2014.

Comments: 17 pages, 17 figures, Submitted to Astrophysical Journal

Journal ref: ApJ 790, 126 (2014)

On Flux Rope Stability and Atmospheric Stratification in Models of Coronal Mass Ejections Triggered by Flux Emergence

Authors: E. Lee, V. S. Lukin, M. G. Linton

Abstract: Flux emergence is widely recognized to play an important role in the initiation of coronal mass ejections. The Chen-Shibata (2000) model, which addresses the connection between emerging flux and flux rope eruptions, can be implemented numerically to study how emerging flux through the photosphere can impact the eruption of a pre-existing coronal flux rope. The model's sensitivity to the initial co… ▽ More Flux emergence is widely recognized to play an important role in the initiation of coronal mass ejections. The Chen-Shibata (2000) model, which addresses the connection between emerging flux and flux rope eruptions, can be implemented numerically to study how emerging flux through the photosphere can impact the eruption of a pre-existing coronal flux rope. The model's sensitivity to the initial conditions and reconnection micro-physics is investigated with a parameter study. In particular, we aim to understand the stability of the coronal flux rope in the context of X-point collapse and the effects of boundary driving in both unstratified and stratified atmospheres. In the absence of driving, we assess the behavior of waves in the vicinity of the X-point. With boundary driving applied, we study the effects of reconnection micro-physics and atmospheric stratification on the eruption. We find that the Chen-Shibata equilibrium can be unstable to an X-point collapse even in the absence of driving due to wave accumulation at the X-point. However, the equilibrium can be stabilized by reducing the compressibility of the plasma, which allows small-amplitude waves to pass through the X-point without accumulation. Simulations with the photospheric boundary driving evaluate the impact of reconnection micro-physics and atmospheric stratification on the resulting dynamics: we show the evolution of the system to be determined primarily by the structure of the global magnetic fields with little sensitivity to the micro-physics of magnetic reconnection; and in a stratified atmosphere, we identify a novel mechanism for producing quasi-periodic behavior at the reconnection site behind a rising flux rope as a possible explanation of similar phenomena observed in solar and stellar flares. △ Less

Submitted 14 August, 2014; v1 submitted 2 March, 2014; originally announced March 2014.

Comments: Submitted Feb 28, 2014 to, accepted Aug 14, 2014 by Astronomy & Astrophysics. 13 pages, 10 figures, 2 tables

Journal ref: A&A 569, A94 (2014)

Turbulence analysis of an experimental flux rope plasma

Authors: D. A. Schaffner, V. S. Lukin, A. Wan, M. R. Brown

Abstract: We have previously generated elongated Taylor double-helix flux rope plasmas in the SSX MHD wind tunnel. These plasmas are remarkable in their rapid relaxation (about one Alfvén time) and their description by simple analytical Taylor force-free theory despite their high plasma beta and high internal flow speeds. We report on the turbulent features observed in these plasmas including frequency spec… ▽ More We have previously generated elongated Taylor double-helix flux rope plasmas in the SSX MHD wind tunnel. These plasmas are remarkable in their rapid relaxation (about one Alfvén time) and their description by simple analytical Taylor force-free theory despite their high plasma beta and high internal flow speeds. We report on the turbulent features observed in these plasmas including frequency spectra, autocorrelation function, and probability distribution functions of increments. We discuss here the possibility that the turbulence facilitating access to the final state supports coherent structures and intermittency revealed by non-Gaussian signatures in the statistics. Comparisons to a Hall-MHD simulation of the SSX MHD wind tunnel show similarity in several statistical measures. △ Less

Submitted 8 October, 2013; originally announced October 2013.

Comments: 20 pages, 9 figures, submitted to Plasma Physics Controlled Fusion for Special Issue on Flux Ropes

Journal ref: Plasma Phys. Control. Fusion 56, 064003 (2014)

Ionized Plasma and Neutral Gas Coupling in the Sun's Chromosphere and Earth's Ionosphere/Thermosphere

Authors: J. E. Leake, C. R. DeVore, J. P. Thayer, A. G. Burns, G. Crowley, H. R. Gilbert, J. D Huba, J. Krall, M. G. Linton, V. S. Lukin, W. Wang

Abstract: We review our understanding of ionized plasma and neutral gas coupling in the weakly ionized, stratified, electromagnetically-permeated regions of the Sun's chromosphere and Earth's ionosphere/thermosphere. Using representative models for each environment we derive fundamental descriptions of the coupling of the constituent parts to each other and to the electric and magnetic fields, and we examin… ▽ More We review our understanding of ionized plasma and neutral gas coupling in the weakly ionized, stratified, electromagnetically-permeated regions of the Sun's chromosphere and Earth's ionosphere/thermosphere. Using representative models for each environment we derive fundamental descriptions of the coupling of the constituent parts to each other and to the electric and magnetic fields, and we examine the variation in magnetization of the ionized component. Using these descriptions we compare related phenomena in the two environments, and discuss electric currents, energy transfer and dissipation. We present a coupled theoretical and numerical study of plasma instabilities in the two environments that serves as an example of how the chromospheric and ionospheric communities can further collaborate. We also suggest future collaborative studies that will help improve our understanding of these two different atmospheres which share many similarities, but have large disparities in key quantities. △ Less

Submitted 29 August, 2016; v1 submitted 1 October, 2013; originally announced October 2013.

Two-fluid simulations of driven reconnection in the Mega-Ampere Spherical Tokamak

Authors: A. Stanier, P. Browning, M. Gordovskyy, K. G. McClements, M. P. Gryaznevich, V. S. Lukin

Abstract: In the merging-compression method of plasma start-up, two flux-ropes with parallel toroidal current are formed around in-vessel poloidal field coils, before merging to form a spherical tokamak plasma. This start-up method, used in the Mega-Ampere Spherical Tokamak (MAST), is studied as a high Lundquist number and low plasma-beta magnetic reconnection experiment. In this paper, 2D fluid simulatio… ▽ More In the merging-compression method of plasma start-up, two flux-ropes with parallel toroidal current are formed around in-vessel poloidal field coils, before merging to form a spherical tokamak plasma. This start-up method, used in the Mega-Ampere Spherical Tokamak (MAST), is studied as a high Lundquist number and low plasma-beta magnetic reconnection experiment. In this paper, 2D fluid simulations are presented of this merging process in order to understand the underlying physics, and better interpret the experimental data. These simulations examine the individual and combined effects of tight-aspect ratio geometry and two-fluid physics on the merging. The ideal self-driven flux-rope dynamics are coupled to the diffusion layer physics, resulting in a large range of phenomena. For resistive MHD simulations, the flux-ropes enter the sloshing regime for normalised resistivity eta < 1E-5. In Hall-MHD three regimes are found for the qualitative behaviour of the current sheet, depending on the ratio of the current sheet width to the ion-sound radius. These are a stable collisional regime, an open X-point regime, and an intermediate regime that is highly unstable to tearing-type instabilities. In toroidal axisymmetric geometry, the final state after merging is a MAST-like spherical tokamak with nested flux-surfaces. It is also shown that the evolution of simulated 1D radial density profiles closely resembles the Thomson scattering electron density measurements in MAST. An intuitive explanation for the origin of the measured density structures is proposed, based upon the results of the toroidal Hall-MHD simulations. △ Less

Submitted 13 August, 2013; originally announced August 2013.

Comments: 12 pages, 12 figures. The following article has been submitted to Physics of Plasmas. After it is published, it will be found at pop.aip.org

Journal ref: Phys. Plasmas 20, 122302 (2013)

Magnetic Reconnection in a Weakly Ionized Plasma

Authors: James E Leake, Vyacheslav S Lukin, Mark G Linton

Abstract: Magnetic reconnection in partially ionized plasmas is a ubiquitous phenomenon spanning the range from laboratory to intergalactic scales, yet it remains poorly understood and relatively little studied. Here, we present results from a self-consistent multi-fluid simulation of magnetic reconnection in a weakly ionized reacting plasma with a particular focus on the parameter regime of the solar chrom… ▽ More Magnetic reconnection in partially ionized plasmas is a ubiquitous phenomenon spanning the range from laboratory to intergalactic scales, yet it remains poorly understood and relatively little studied. Here, we present results from a self-consistent multi-fluid simulation of magnetic reconnection in a weakly ionized reacting plasma with a particular focus on the parameter regime of the solar chromosphere. The numerical model includes collisional transport, interaction and reactions between the species, and optically thin radiative losses. This model improves upon our previous work in Leake et al. 2012 \cite{Leake2012} by considering realistic chromospheric transport coefficients, and by solving a generalized Ohm's law that accounts for finite ion-inertia and electron-neutral drag. We find that during the two dimensional reconnection of a Harris current sheet with an initial width larger than the neutral-ion collisional coupling scale, the current sheet thins until its width becomes less than this coupling scale, and the neutral and ion fluids decouple upstream from the reconnection site. During this process of decoupling, we observe reconnection faster than the single-fluid Sweet-Parker prediction, with recombination and plasma outflow both playing a role in determining the reconnection rate. As the current sheet thins further and elongates it becomes unstable to the secondary tearing instability, and plasmoids are seen. The reconnection rate, outflows and plasmoids observed in this simulation provide evidence that magnetic reconnection in the chromosphere could be responsible for jet-like transient phenomena such as spicules and chromospheric jets. △ Less

Submitted 13 February, 2013; originally announced February 2013.

Comments: 11 Figures

Journal ref: Phys. Plasmas 20, 061202 (2013)

Multi-fluid simulations of chromospheric magnetic reconnection in a weakly ionized reacting plasma

Authors: James E. Leake, Vyacheslav S. Lukin, Mark G. Linton, Eric T. Meier

Abstract: We present results from the first self-consistent multi-fluid simulations of chromospheric magnetic reconnection in a weakly ionized reacting plasma. We simulate two dimensional magnetic reconnection in a Harris current sheet with a numerical model which includes ion-neutral scattering collisions, ionization, recombination, optically thin radiative loss, collisional heating, and thermal conduction… ▽ More We present results from the first self-consistent multi-fluid simulations of chromospheric magnetic reconnection in a weakly ionized reacting plasma. We simulate two dimensional magnetic reconnection in a Harris current sheet with a numerical model which includes ion-neutral scattering collisions, ionization, recombination, optically thin radiative loss, collisional heating, and thermal conduction. In the resulting tearing mode reconnection the neutral and ion fluids become decoupled upstream from the reconnection site, creating an excess of ions in the reconnection region and therefore an ionization imbalance. Ion recombination in the reconnection region, combined with Alfvénic outflows, quickly removes ions from the reconnection site, leading to a fast reconnection rate independent of Lundquist number. In addition to allowing fast reconnection, we find that these non-equilibria partial ionization effects lead to the onset of the nonlinear secondary tearing instability at lower values of the Lundquist number than has been found in fully ionized plasmas.These simulations provide evidence that magnetic reconnection in the chromosphere could be responsible for jet-like transient phenomena such as spicules and chromospheric jets. △ Less

Submitted 5 October, 2012; originally announced October 2012.

Comments: 8 Figures, 32 pages total

Journal ref: ApJ 760, 109 (2012)