-
Self-Evaluated Expertise in experimental physics: a measure of students' physics self-recognition
Authors:
Michael F. J. Fox,
Taylor O. Pomfret
Abstract:
We introduce and theoretically justify a new measure of the self-recognition component of student physics identity called Self-Evaluated Expertise (SEE). This measure is constructed such that it can be extracted from existing responses to the E-CLASS. In this work, we compare scores from SEE with the traditional measure calculated from the E-CLASS, which probes student views about experimental phy…
▽ More
We introduce and theoretically justify a new measure of the self-recognition component of student physics identity called Self-Evaluated Expertise (SEE). This measure is constructed such that it can be extracted from existing responses to the E-CLASS. In this work, we compare scores from SEE with the traditional measure calculated from the E-CLASS, which probes student views about experimental physics, to show that the SEE score is a quantitatively different measure. Consequently, we show that student self-recognition decreases from pre-instruction administration of the E-CLASS to the post-instruction administration when averaged across data from 494 courses having taken place between 2016--2019.
△ Less
Submitted 10 April, 2025;
originally announced April 2025.
-
Comparing large language models for supervised analysis of students' lab notes
Authors:
Rebeckah K. Fussell,
Megan Flynn,
Anil Damle,
Michael F. J. Fox,
N. G. Holmes
Abstract:
Recent advancements in large language models (LLMs) hold significant promise in improving physics education research that uses machine learning. In this study, we compare the application of various models to perform large-scale analysis of written text grounded in a physics education research classification problem: identifying skills in students' typed lab notes through sentence-level labeling. S…
▽ More
Recent advancements in large language models (LLMs) hold significant promise in improving physics education research that uses machine learning. In this study, we compare the application of various models to perform large-scale analysis of written text grounded in a physics education research classification problem: identifying skills in students' typed lab notes through sentence-level labeling. Specifically, we use training data to fine-tune two different LLMs, BERT and LLaMA, and compare the performance of these models to both a traditional bag of words approach and a few-shot LLM (without fine-tuning).} We evaluate the models based on their resource use, performance metrics, and research outcomes when identifying skills in lab notes. We find that higher-resource models often, but not necessarily, perform better than lower-resource models. We also find that all models estimate similar trends in research outcomes, although the absolute values of the estimated measurements are not always within uncertainties of each other. We use the results to discuss relevant considerations for education researchers seeking to select a model type to use as a classifier.
△ Less
Submitted 24 February, 2025; v1 submitted 13 December, 2024;
originally announced December 2024.
-
Development of a global landscape of undergraduate physics laboratory courses
Authors:
Gayle Geschwind,
Micol Alemani,
Michael F. J. Fox,
P. S. W. M. Logman,
Eugenio Tufino,
H. J. Lewandowski
Abstract:
Physics Education Research (PER) is a global endeavour, with a wealth of work performed at a variety of institutions worldwide. However, results from research into undergraduate physics laboratory courses is often difficult to compare due to the broad variations in courses. We have created a survey to help classify these courses to compare and contrast them, which will be useful in two key endeavo…
▽ More
Physics Education Research (PER) is a global endeavour, with a wealth of work performed at a variety of institutions worldwide. However, results from research into undergraduate physics laboratory courses is often difficult to compare due to the broad variations in courses. We have created a survey to help classify these courses to compare and contrast them, which will be useful in two key endeavours: comparisons between PER studies and providing useful data for individual instructors hoping to improve their courses, thus providing information relevant to both researchers and instructors. While we are still in the process of collecting sufficient data to create a full taxonomy of laboratory courses, we present here details of the survey creation itself, as well as a first look at the data collected, which includes a broad landscape of lab courses in 41 countries. We used both quantitative and qualitative methods in analyzing the data collected. Some of these results include similarities between courses, such as students often using pre-constructed apparatuses and that instructors hope for students to learn technical skills. We also find differences in courses, such as in the number and types of goals of the course, as well as the activities students participate in.
△ Less
Submitted 12 July, 2024;
originally announced July 2024.
-
Listening to the magnetosphere: How best to make ULF waves audible
Authors:
Martin O. Archer,
Marek Cottingham,
Michael D. Hartinger,
Xueling Shi,
Shane Coyle,
Ethan "Duke" Hill,
Michael F. J. Fox,
Emmanuel V. Masongsong
Abstract:
Observations across the heliosphere typically rely on in situ spacecraft observations producing time-series data. While often this data is analysed visually, it lends itself more naturally to our sense of sound. The simplest method of converting oscillatory data into audible sound is audification -- a one-to-one mapping of data samples to audio samples -- which has the benefit that no information…
▽ More
Observations across the heliosphere typically rely on in situ spacecraft observations producing time-series data. While often this data is analysed visually, it lends itself more naturally to our sense of sound. The simplest method of converting oscillatory data into audible sound is audification -- a one-to-one mapping of data samples to audio samples -- which has the benefit that no information is lost, thus is a true representation of the original data. However, audification can make some magnetospheric ULF waves observations pass by too quickly for someone to realistically be able to listen to effectively. For this reason, we detail various existing audio time scale modification techniques developed for music, applying these to ULF wave observations by spacecraft and exploring how they affect the properties of the resulting audio. Through a public dialogue we arrive at recommendations for ULF wave researchers on rendering these waves audible and discuss the scientific and educational possibilities of these new methods.
△ Less
Submitted 9 June, 2022;
originally announced June 2022.
-
Rapid Transition to Remote Instruction of Physics Labs During Spring 2020: Instructor Perspectives
Authors:
Alexandra Werth,
Jessica R. Hoehn,
Kristin Oliver,
Michael F. J. Fox,
H. J. Lewandowski
Abstract:
Laboratory courses are an important part of the undergraduate physics curriculum. During physics labs, students can engage in authentic, hands-on experimental practices, which can prepare them for graduate school, research laboratories, and jobs in industry. Due to the COVID-19 pandemic in spring 2020, colleges and universities across the world rapidly transitioned to teaching labs remotely. In th…
▽ More
Laboratory courses are an important part of the undergraduate physics curriculum. During physics labs, students can engage in authentic, hands-on experimental practices, which can prepare them for graduate school, research laboratories, and jobs in industry. Due to the COVID-19 pandemic in spring 2020, colleges and universities across the world rapidly transitioned to teaching labs remotely. In this work, we report results from a survey of physics lab instructors on how they adapted their courses in the transition to emergency remote teaching. We found that the instructors who responded to the survey faced numerous challenges when transitioning their classes to remote instruction, particularly in providing students with a similar experience to the in-person labs. In addition, we identified common themes in the instructors' responses including changing learning goals of the courses to be more concept-focused, reducing group work due to equity and technological concerns, and using a variety simulation tools, as well as report on factors that the instructors hoped to continue once they have returned to in-person instruction.
△ Less
Submitted 22 December, 2021;
originally announced December 2021.
-
Building a Quantum Engineering Undergraduate Program
Authors:
Abraham Asfaw,
Alexandre Blais,
Kenneth R. Brown,
Jonathan Candelaria,
Christopher Cantwell,
Lincoln D. Carr,
Joshua Combes,
Dripto M. Debroy,
John M. Donohue,
Sophia E. Economou,
Emily Edwards,
Michael F. J. Fox,
Steven M. Girvin,
Alan Ho,
Hilary M. Hurst,
Zubin Jacob,
Blake R. Johnson,
Ezekiel Johnston-Halperin,
Robert Joynt,
Eliot Kapit,
Judith Klein-Seetharaman,
Martin Laforest,
H. J. Lewandowski,
Theresa W. Lynn,
Corey Rae H. McRae
, et al. (12 additional authors not shown)
Abstract:
The rapidly growing quantum information science and engineering (QISE) industry will require both quantum-aware and quantum-proficient engineers at the bachelor's level. We provide a roadmap for building a quantum engineering education program to satisfy this need. For quantum-aware engineers, we describe how to design a first quantum engineering course accessible to all STEM students. For the edu…
▽ More
The rapidly growing quantum information science and engineering (QISE) industry will require both quantum-aware and quantum-proficient engineers at the bachelor's level. We provide a roadmap for building a quantum engineering education program to satisfy this need. For quantum-aware engineers, we describe how to design a first quantum engineering course accessible to all STEM students. For the education and training of quantum-proficient engineers, we detail both a quantum engineering minor accessible to all STEM majors, and a quantum track directly integrated into individual engineering majors. We propose that such programs typically require only three or four newly developed courses that complement existing engineering and science classes available on most larger campuses. We describe a conceptual quantum information science course for implementation at any post-secondary institution, including community colleges and military schools. QISE presents extraordinary opportunities to work towards rectifying issues of inclusivity and equity that continue to be pervasive within engineering. We present a plan to do so and describe how quantum engineering education presents an excellent set of education research opportunities. Finally, we outline a hands-on training plan on quantum hardware, a key component of any quantum engineering program, with a variety of technologies including optics, atoms and ions, cryogenic and solid-state technologies, nanofabrication, and control and readout electronics. Our recommendations provide a flexible framework that can be tailored for academic institutions ranging from teaching and undergraduate-focused two- and four-year colleges to research-intensive universities.
△ Less
Submitted 3 August, 2021;
originally announced August 2021.
-
Achieving a quantum smart workforce
Authors:
Clarice D. Aiello,
D. D. Awschalom,
Hannes Bernien,
Tina Brower-Thomas,
Kenneth R. Brown,
Todd A. Brun,
Justin R. Caram,
Eric Chitambar,
Rosa Di Felice,
Michael F. J. Fox,
Stephan Haas,
Alexander W. Holleitner,
Eric R. Hudson,
Jeffrey H. Hunt,
Robert Joynt,
Scott Koziol,
H. J. Lewandowski,
Douglas T. McClure,
Jens Palsberg,
Gina Passante,
Kristen L. Pudenz,
Christopher J. K. Richardson,
Jessica L. Rosenberg,
R. S. Ross,
Mark Saffman
, et al. (7 additional authors not shown)
Abstract:
Interest in building dedicated Quantum Information Science and Engineering (QISE) education programs has greatly expanded in recent years. These programs are inherently convergent, complex, often resource intensive and likely require collaboration with a broad variety of stakeholders. In order to address this combination of challenges, we have captured ideas from many members in the community. Thi…
▽ More
Interest in building dedicated Quantum Information Science and Engineering (QISE) education programs has greatly expanded in recent years. These programs are inherently convergent, complex, often resource intensive and likely require collaboration with a broad variety of stakeholders. In order to address this combination of challenges, we have captured ideas from many members in the community. This manuscript not only addresses policy makers and funding agencies (both public and private and from the regional to the international level) but also contains needs identified by industry leaders and discusses the difficulties inherent in creating an inclusive QISE curriculum. We report on the status of eighteen post-secondary education programs in QISE and provide guidance for building new programs. Lastly, we encourage the development of a comprehensive strategic plan for quantum education and workforce development as a means to make the most of the ongoing substantial investments being made in QISE.
△ Less
Submitted 23 October, 2020;
originally announced October 2020.
-
Teaching labs during a pandemic: Lessons from Spring 2020 and an outlook for the future
Authors:
Michael F. J. Fox,
Alexandra Werth,
Jessica R. Hoehn,
H. J. Lewandowski
Abstract:
We report results from a survey of lab instructors on how they adapted their courses in the transition to emergency remote teaching due to the COVID-19 pandemic. The purpose of this report is to share the experiences of instructors in order to prepare for future remote teaching of labs. We include summaries of responses to help illustrate the types of lab activities that were done, learning goals…
▽ More
We report results from a survey of lab instructors on how they adapted their courses in the transition to emergency remote teaching due to the COVID-19 pandemic. The purpose of this report is to share the experiences of instructors in order to prepare for future remote teaching of labs. We include summaries of responses to help illustrate the types of lab activities that were done, learning goals for the remote labs, motivations for instructors' choices, challenges instructors faced, and ways in which instructors and students communicated. This is a first step in a larger project as part of an NSF RAPID grant to understand what happened during the switch to remote labs and how it impacted teaching methods and student learning.
△ Less
Submitted 2 July, 2020;
originally announced July 2020.
-
Preparing for the quantum revolution -- what is the role of higher education?
Authors:
Michael F. J. Fox,
Benjamin M. Zwickl,
H. J. Lewandowski
Abstract:
Quantum sensing, quantum networking and communication, and quantum computing have attracted significant attention recently, as these quantum technologies offer significant advantages over existing technologies. In order to accelerate the commercialization of these quantum technologies the workforce must be equipped with the necessary skills. Through a qualitative study of the quantum industry, in…
▽ More
Quantum sensing, quantum networking and communication, and quantum computing have attracted significant attention recently, as these quantum technologies offer significant advantages over existing technologies. In order to accelerate the commercialization of these quantum technologies the workforce must be equipped with the necessary skills. Through a qualitative study of the quantum industry, in a series of interviews with 21 U.S. companies carried out in Fall 2019, we describe the types of activities being carried out in the quantum industry, profile the types of jobs that exist, and describe the skills valued across the quantum industry, as well as in each type of job. The current routes into the quantum industry are detailed, providing a picture of the current role of higher education in training the quantum workforce. Finally, we present the training and hiring challenges the quantum industry is facing and how higher education may optimize the important role it is currently playing.
△ Less
Submitted 22 September, 2020; v1 submitted 29 June, 2020;
originally announced June 2020.
-
Experimental determination of the correlation properties of plasma turbulence using 2D BES systems
Authors:
M. F. J. Fox,
A. R. Field,
F. van Wyk,
Y. -c. Ghim,
A. A. Schekochihin,
the MAST Team
Abstract:
A procedure is presented to map from the spatial correlation parameters of a turbulent density field (the radial and binormal correlation lengths and wavenumbers, and the fluctuation amplitude) to correlation parameters that would be measured by a Beam Emission Spectroscopy (BES) diagnostic. The inverse mapping is also derived, which results in resolution criteria for recovering correct correlatio…
▽ More
A procedure is presented to map from the spatial correlation parameters of a turbulent density field (the radial and binormal correlation lengths and wavenumbers, and the fluctuation amplitude) to correlation parameters that would be measured by a Beam Emission Spectroscopy (BES) diagnostic. The inverse mapping is also derived, which results in resolution criteria for recovering correct correlation parameters, depending on the spatial response of the instrument quantified in terms of Point-Spread Functions (PSFs). Thus, a procedure is presented that allows for a systematic comparison between theoretical predictions and experimental observations. This procedure is illustrated using the MAST BES system and the validity of the underlying assumptions is tested on fluctuating density fields generated by direct numerical simulations using the gyrokinetic code GS2. The measurement of the correlation time, by means of the cross-correlation time-delay (CCTD) method, is also investigated and is shown to be sensitive to the fluctuating radial component of velocity, as well as to small variations in the spatial properties of the PSFs.
△ Less
Submitted 29 September, 2016;
originally announced September 2016.
-
Symmetry breaking in MAST plasma turbulence due to toroidal flow shear
Authors:
M. F. J. Fox,
F. van Wyk,
A. R. Field,
Y. -c. Ghim,
F. I. Parra,
A. A. Schekochihin
Abstract:
The flow shear associated with the differential toroidal rotation of tokamak plasmas breaks an underlying symmetry of the turbulent fluctuations imposed by the up-down symmetry of the magnetic equilibrium. Using experimental Beam-Emission-Spectroscopy (BES) measurements and gyrokinetic simulations, this symmetry breaking in ion-scale turbulence in MAST is shown to manifest itself as a tilt of the…
▽ More
The flow shear associated with the differential toroidal rotation of tokamak plasmas breaks an underlying symmetry of the turbulent fluctuations imposed by the up-down symmetry of the magnetic equilibrium. Using experimental Beam-Emission-Spectroscopy (BES) measurements and gyrokinetic simulations, this symmetry breaking in ion-scale turbulence in MAST is shown to manifest itself as a tilt of the spatial correlation function and a finite skew in the distribution of the fluctuating density field. The tilt is a statistical expression of the "shearing" of the turbulent structures by the mean flow. The skewness of the distribution is related to the emergence of long-lived density structures in sheared, near-marginal plasma turbulence. The extent to which these effects are pronounced is argued (with the aid of the simulations) to depend on the distance from the nonlinear stability threshold. Away from the threshold, the symmetry is effectively restored.
△ Less
Submitted 13 October, 2016; v1 submitted 28 September, 2016;
originally announced September 2016.
-
Conditions for generating synthetic data to investigate characteristics of fluctuating quantities
Authors:
Jaewook Kim,
M. F. J. Fox,
A. R. Field,
Y. U. Nam,
Y. -c. Ghim
Abstract:
Synthetic data describing coherent random fluctuations have widely been used to validate numerical sim- ulations against experimental observations or to examine the reliability of extracting statistical properties of plasma turbulence via correlation functions. Estimating correlation time or lengths based on correlation functions implicitly assumes that the observed data are stationary and homogen…
▽ More
Synthetic data describing coherent random fluctuations have widely been used to validate numerical sim- ulations against experimental observations or to examine the reliability of extracting statistical properties of plasma turbulence via correlation functions. Estimating correlation time or lengths based on correlation functions implicitly assumes that the observed data are stationary and homogeneous. It is, therefore, impor- tant that synthetic data also satisfy the stationary process and homogeneous state. Based on the synthetic data with randomly generated moving Gaussian shaped fluctuations both in time and space, the correlation function depending on the size of averaging time window is analytically derived. Then, the smallest possible spatial window size of synthetic data satisfying the stationary process and homogeneous state is proposed, thereby reducing the computation time to generate proper synthetic data and providing a constraint on the minimum size of simulation domains when using synthetic diagnostics to compare with experiment. This window size is also numerically confirmed with 1D synthetic data with various parameter scans.
△ Less
Submitted 21 December, 2015; v1 submitted 26 October, 2015;
originally announced October 2015.
-
Neoclassical and gyrokinetic analysis of time-dependent helium transport experiments on MAST
Authors:
S. S. Henderson,
L. Garzotti,
F. J. Casson,
D. Dickinson,
M. F. J. Fox,
M. O'Mullane,
A. Patel,
C. M. Roach,
H. P. Summers,
M. Valovic,
the MAST team
Abstract:
Time-dependent helium gas puff experiments have been performed on the Mega Ampere Spherical Tokamak (MAST) during a two point plasma current scan in L-mode and a confinement scan at 900 kA. An evaluation of the He II spectrum line induced by charge exchange suggests anomalous rates of diffusion and inward convection in the outer regions of both L-mode plasmas. Similar rates of diffusion are found…
▽ More
Time-dependent helium gas puff experiments have been performed on the Mega Ampere Spherical Tokamak (MAST) during a two point plasma current scan in L-mode and a confinement scan at 900 kA. An evaluation of the He II spectrum line induced by charge exchange suggests anomalous rates of diffusion and inward convection in the outer regions of both L-mode plasmas. Similar rates of diffusion are found in the H-mode plasma, however these rates are consistent with neoclassical predictions. The anomalous inward pinch found in the core of L-mode plasmas is also not apparent in the H-mode core. Linear gyrokinetic simulations of one flux surface in L-mode using the gs2 and gkw codes find that equilibrium flow shear is sufficient to stabilise ITG modes, consistent with BES observations, and suggest that collisionless TEMs may dominate the anomalous helium particle transport. A quasilinear estimate of the dimensionless peaking factor associated with TEMs is in good agreement with experiment. Collisionless TEMs are more stable in H-mode because the electron density gradient is flatter. The steepness of this gradient is therefore pivotal in determining the inward neoclassical particle pinch and the particle flux associated with TEM turbulence.
△ Less
Submitted 3 September, 2014;
originally announced September 2014.