-
Assessing physics quantitative literacy development in algebra-based physics
Authors:
Charlotte Zimmerman,
Alexis Olsho,
Trevor I. Smith,
Philip Eaton,
Suzanne White Brahmia
Abstract:
Quantitative reasoning is an essential learning objective of physics instruction. The Physics Inventory for Quantitative Literacy (PIQL) is an assessment tool that has been developed for calculus-based physics courses to help instructors evaluate whether their students learn to reason this way (White Brahmia, et al., 2019). However, the PIQL is not appropriate for the large population of students…
▽ More
Quantitative reasoning is an essential learning objective of physics instruction. The Physics Inventory for Quantitative Literacy (PIQL) is an assessment tool that has been developed for calculus-based physics courses to help instructors evaluate whether their students learn to reason this way (White Brahmia, et al., 2019). However, the PIQL is not appropriate for the large population of students taking physics who are not enrolled in, or have not completed, calculus. To address this need, we have developed the General Equation-based Reasoning inventory of QuaNtity (GERQN). The GERQN is an algebra-based version of the PIQL and is appropriate for most physics students; the only requirement is that students have taken algebra so they are familiar with the use of variable, negative quantities, and linear functions. In this paper we present the development and validation of the GERQN, and a short discussion on how the GERQN can be used by instructors to help their students learn.
△ Less
Submitted 20 April, 2025;
originally announced April 2025.
-
A framework for characterizing covariational reasoning in physics
Authors:
Alexis Olsho,
Charlotte Zimmerman,
Suzanne White Brahmia
Abstract:
Covariational reasoning--considering how changes in one quantity affect another, related quantity--is a foundation of quantitative modeling in physics. Understanding quantitative models is a learning objective of introductory physics instruction at the college level. Prior work suggests that covariational reasoning in physics contexts differs in important ways from reasoning about functions and gr…
▽ More
Covariational reasoning--considering how changes in one quantity affect another, related quantity--is a foundation of quantitative modeling in physics. Understanding quantitative models is a learning objective of introductory physics instruction at the college level. Prior work suggests that covariational reasoning in physics contexts differs in important ways from reasoning about functions and graphs in purely mathematical contexts; this reasoning is effortful in physics even for mathematically well-prepared students. In order to help students learn to reason covariationally in physics contexts, we need to characterize what we mean by physics covariational reasoning. To this end, we present a framework of covariational reasoning in physics contexts, to describe the ways that covariational reasoning is used in physics modeling. The framework can be used as a tool by which instructors can recognize physics covariational reasoning patterns and researchers can analyze student reasoning. The framework can also help inform the development of effective instructional materials and methods.
△ Less
Submitted 10 October, 2023;
originally announced October 2023.
-
Empirical evidence of the inseparability of mathematics and physics in expert reasoning about novel graphing tasks
Authors:
Charlotte Zimmerman,
Alexis Olsho,
Michael Loverude,
Suzanne White Brahmia
Abstract:
Pre-college mathematics modeling instruction often frames mathematics as being separated from reasoning about the real world -- and commonly treats reasoning mathematically and reasoning about the real-world context as separate stages of a modeling cycle. In this paper, we present evidence that helps characterize how experts use mathematics in physics contexts while developing graphical models. An…
▽ More
Pre-college mathematics modeling instruction often frames mathematics as being separated from reasoning about the real world -- and commonly treats reasoning mathematically and reasoning about the real-world context as separate stages of a modeling cycle. In this paper, we present evidence that helps characterize how experts use mathematics in physics contexts while developing graphical models. An important finding is that there was essentially no evidence of experts reasoning in a context-free way with these tasks, but instead they used physical reasoning -- either grounded in the context of the task or from abstract physical models -- to guide their mathematics. The difference in approach of physics instructors and students may lead to a mismatch in expectations, and frustration, for both parties. This work contributes to the body of knowledge about how mathematical reasoning appears in physics, and can help researchers and instructors recognize the connections to the physical world in expert mathematical reasoning. This can help instructors and researchers be better equipped to develop materials and methods that can help students start building those connections as well.
△ Less
Submitted 2 August, 2023;
originally announced August 2023.
-
Expert covariational reasoning resources in physics graphing tasks
Authors:
Charlotte Zimmerman,
Alexis Olsho,
Michael Loverude,
Suzanne White Brahmia
Abstract:
Developing and making sense of quantitative models is a core practice of physics. Covariational reasoning -- considering how the changes in one quantity affect changes in another, related quantity -- is an essential part of modeling quantitatively. Covariational reasoning has been studied widely in mathematics education research, but has only begun to be used in physics education research. We pres…
▽ More
Developing and making sense of quantitative models is a core practice of physics. Covariational reasoning -- considering how the changes in one quantity affect changes in another, related quantity -- is an essential part of modeling quantitatively. Covariational reasoning has been studied widely in mathematics education research, but has only begun to be used in physics education research. We present evidence from three studies of 25 individual interviews with physics experts, in which the experts were asked to reason out loud while generating graphical models. We analyze the studies through the lens of covariational reasoning frameworks from mathematics education research, and determine that the frameworks are useful but do not completely describe the covariational reasoning of the physics experts we interviewed. From our data, we identified reasoning patterns that are not described in the mathematics education research that, together with the mathematics covariational reasoning frameworks, begin to characterize physics covariational reasoning.
△ Less
Submitted 19 December, 2024; v1 submitted 1 June, 2023;
originally announced June 2023.
-
Online test administration results in students selecting more responses to multiple-choice-multiple-response items
Authors:
Alexis Olsho,
Trevor Smith,
Suzanne White Brahmia,
Philip Eaton,
Charlotte Zimmerman,
Andrew Boudreaux
Abstract:
Multiple-choice multiple-response (MCMR) items (i.e., multiple-choice questions for which more than one response may be selected) can be a valuable tool for assessment. Like traditional multiple-choice single-response questions, they are easy to score, but MCMR items can provide more information about student thinking by probing multiple reasoning facets in a single problem context. In this paper,…
▽ More
Multiple-choice multiple-response (MCMR) items (i.e., multiple-choice questions for which more than one response may be selected) can be a valuable tool for assessment. Like traditional multiple-choice single-response questions, they are easy to score, but MCMR items can provide more information about student thinking by probing multiple reasoning facets in a single problem context. In this paper, we discuss differences in performance on MCMR items that result from differences in administration method (paper vs. online). In particular, we find a tendency for ``clickiness'' in online administration: students choose more responses to MCMR items when taking the electronic version of the assessment. Based on these findings, we recommend that online administration be compared only to other online administrations and not to paper administrations when comparing student results on MCMR items. These results also suggest that MCMR items provide a unique opportunity to probe differences in online and on-paper administration of low-stakes assessments.
△ Less
Submitted 19 August, 2022; v1 submitted 3 June, 2021;
originally announced June 2021.
-
The Physics Inventory of Quantitative Literacy: A tool for assessing mathematical reasoning in introductory physics
Authors:
Suzanne White Brahmia,
Alexis Olsho,
Trevor I. Smith,
Andrew Boudreaux,
Philip Eaton,
Charlotte Zimmerman
Abstract:
One desired outcome of introductory physics instruction is that students will develop facility with reasoning quantitatively about physical phenomena. Little research has been done regarding how students develop the algebraic concepts and skills involved in reasoning productively about physics quantities, which is different from either understanding of physics concepts or problem-solving abilities…
▽ More
One desired outcome of introductory physics instruction is that students will develop facility with reasoning quantitatively about physical phenomena. Little research has been done regarding how students develop the algebraic concepts and skills involved in reasoning productively about physics quantities, which is different from either understanding of physics concepts or problem-solving abilities. We introduce the Physics Inventory of Quantitative Literacy (PIQL) as a tool for measuring quantitative literacy, a foundation of mathematical reasoning, in the context of introductory physics. We present the development of the PIQL and evidence of its validity for use in calculus-based introductory physics courses. Unlike concept inventories, the PIQL is a reasoning inventory, and can be used to assess reasoning over the span of students' instruction in introductory physics. Although mathematical reasoning associated with the PIQL is taught in prior mathematics courses, pre/post test scores reveal that this reasoning isn't readily used by most students in physics, nor does it develop as part of physics instruction--even in courses that use high-quality, research-based curricular materials. As has been the case with many inventories in physics education, we expect use of the PIQL to support the development of instructional strategies and materials--in this case, designed to meet the course objective that all students become quantitatively literate in introductory physics.
△ Less
Submitted 9 June, 2021; v1 submitted 22 September, 2020;
originally announced September 2020.
-
Exploring student facility with "goes like'' reasoning in introductory physics
Authors:
Charlotte Zimmerman,
Alexis Olsho,
Andrew Boudreaux,
Trevor Smith,
Philip Eaton,
Suzanne White Brahmia
Abstract:
Covariational reasoning -- reasoning about how changes in one quantity relate to changes in another quantity -- has been examined extensively in mathematics education research. Little research has been done, however, on covariational reasoning in introductory physics contexts. We explore one aspect of covariational reasoning: ``goes like'' reasoning. ``Goes like'' reasoning refers to ways physicis…
▽ More
Covariational reasoning -- reasoning about how changes in one quantity relate to changes in another quantity -- has been examined extensively in mathematics education research. Little research has been done, however, on covariational reasoning in introductory physics contexts. We explore one aspect of covariational reasoning: ``goes like'' reasoning. ``Goes like'' reasoning refers to ways physicists relate two quantities through a simplified function. For example, physicists often say that ``the electric field goes like one over r squared.'' While this reasoning mode is used regularly by physicists and physics instructors, how students make sense of and use it remains unclear. We present evidence from reasoning inventory items which indicate that many students are sense making with tools from prior math instruction, that could be developed into expert ``goes like'' thinking with direct instruction. Recommendations for further work in characterizing student sense making as a foundation for future development of instruction are made.
△ Less
Submitted 20 July, 2020;
originally announced July 2020.
-
When negative is not "less than zero": Electric charge as a signed quantity
Authors:
Alexis Olsho,
Suzanne White Brahmia,
Andrew Boudreaux,
Trevor Smith
Abstract:
Electromagnetism (E&M) is often challenging for students enrolled in introductory college-level physics courses. Compared to mechanics, the mathematics of E&M is more sophisticated and the representations are more abstract. Furthermore, students may lack productive intuitions they had with force and motion. In this article, we explore the mathematization of electric charge. Specifically, we explor…
▽ More
Electromagnetism (E&M) is often challenging for students enrolled in introductory college-level physics courses. Compared to mechanics, the mathematics of E&M is more sophisticated and the representations are more abstract. Furthermore, students may lack productive intuitions they had with force and motion. In this article, we explore the mathematization of electric charge. Specifically, we explore how difficulties with positive and negative signs can arise for learners who approach integers primarily as positions on a number line.
△ Less
Submitted 16 July, 2020;
originally announced July 2020.
-
Online administration of a reasoning inventory in development
Authors:
Alexis Olsho,
Suzanne White Brahmia,
Trevor Smith,
Charlotte Zimmerman,
Andrew Boudreaux,
Philip Eaton
Abstract:
We are developing a new research based assessment (RBA) focused on quantitative reasoning -- rather than conceptual understanding -- in physics contexts. We rapidly moved administration of the RBA online in Spring 2020 due to the COVID-19 pandemic. We present our experiences with online, unproctored administration of an RBA in development to students enrolled in a large-enrollment, calculus-based,…
▽ More
We are developing a new research based assessment (RBA) focused on quantitative reasoning -- rather than conceptual understanding -- in physics contexts. We rapidly moved administration of the RBA online in Spring 2020 due to the COVID-19 pandemic. We present our experiences with online, unproctored administration of an RBA in development to students enrolled in a large-enrollment, calculus-based, introductory physics course. We describe our attempts to adhere to best practices on a limited time frame, and present a preliminary analysis of the results, comparing results from the online administration to earlier results from in-person, proctored administration. We include discussion of online administration of multiple-choice/multiple-response (MCMR) items, which we use on the instrument as a way to probe multiple facets of student reasoning. Our initial comparison indicates little difference between online and paper administrations of the RBA, consistent with previous work by other researchers.
△ Less
Submitted 16 July, 2020;
originally announced July 2020.
-
Toward a valid instrument for measuring physics quantitative literacy
Authors:
Trevor I. Smith,
Philip Eaton,
Suzanne White Brahmia,
Alexis Olsho,
Andrew Boudreaux,
Charlotte Zimmerman
Abstract:
We have developed the Physics Inventory of Quantitative Literacy (PIQL) as a tool to measure students' quantitative literacy in the context of introductory physics topics. We present the results from various quantitative analyses used to establish the validity of both the individual items and the PIQL as a whole. We show how examining the results from classical test theory analyses, factor analysi…
▽ More
We have developed the Physics Inventory of Quantitative Literacy (PIQL) as a tool to measure students' quantitative literacy in the context of introductory physics topics. We present the results from various quantitative analyses used to establish the validity of both the individual items and the PIQL as a whole. We show how examining the results from classical test theory analyses, factor analysis, and item response curves informed decisions regarding the inclusion, removal, or modification of items. We also discuss how the choice to include multiple-choice/multiple-response items has informed both our choices for analyses and the interpretations of their results. We are confident that the most recent version of the PIQL is a valid and reliable instrument for measuring students' physics quantitative literacy in calculus-based introductory physics courses at our primary research site. More data are needed to establish its validity for use at other institutions and in other courses.
△ Less
Submitted 16 July, 2020;
originally announced July 2020.
-
Identifying Covariational Reasoning Behaviors in Expert Physicists in Graphing Tasks
Authors:
Charlotte Zimmerman,
Alexis Olsho,
Michael Loverude,
Suzanne White Brahmia
Abstract:
Covariational reasoning -- how one thinks about the way changes in one quantity affect another quantity -- is essential to calculus and physics instruction alike. As physics is often centered on understanding and predicting changes in quantities, it is an excellent discipline to develop covariational reasoning. However, while significant work has been done on covariational reasoning in mathematics…
▽ More
Covariational reasoning -- how one thinks about the way changes in one quantity affect another quantity -- is essential to calculus and physics instruction alike. As physics is often centered on understanding and predicting changes in quantities, it is an excellent discipline to develop covariational reasoning. However, while significant work has been done on covariational reasoning in mathematics education research, it is only beginning to be studied in physics contexts. This work presents preliminary results from an investigation into expert physicists' covariational reasoning in a replication study of Hobson and Moore's 2017 investigation of covariational reasoning modes in mathematics graduate students. Additionally, we expand on this work to include results from a study that uses slightly more complex physics-context questions. Two behavioral modes were identified across contexts that appear distinct from those articulated in the Hobson and Moore study: the use of compiled relationships and neighborhood analysis.
△ Less
Submitted 18 November, 2019; v1 submitted 5 November, 2019;
originally announced November 2019.
-
Towards understanding and characterizing expert covariational reasoning in physics
Authors:
Charlotte Zimmerman,
Alexis Olsho,
Michael Loverude,
Andrew Boudreaux,
Trevor Smith,
Suzanne White Brahmia
Abstract:
Relating two quantities to describe a physical system or process is at the heart of "doing physics" for novices and experts alike. In this paper, we explore the ways in which experts use covariational reasoning when solving introductory physics graphing problems. Here, graduate students are considered experts for the introductory level material, as they often take the role of instructor at large r…
▽ More
Relating two quantities to describe a physical system or process is at the heart of "doing physics" for novices and experts alike. In this paper, we explore the ways in which experts use covariational reasoning when solving introductory physics graphing problems. Here, graduate students are considered experts for the introductory level material, as they often take the role of instructor at large research universities. Drawing on work from Research in Undergraduate Mathematics Education (RUME), we replicated a study of mathematics experts' covariational reasoning done by Hobson and Moore with physics experts [N. L. F. Hobson and K. C. Moore, in RUME Conference Proceedings, pp. 664-672 (2017)]. We conducted think-aloud interviews with 10 physics graduate students using tasks minimally adapted from the mathematics study. Adaptations were made solely for the purpose of participant understanding of the question, and validated by preliminary interviews. Preliminary findings suggest physics experts approach covariational reasoning problems significantly differently than mathematics experts. In particular, two behaviors are identified in the reasoning of expert physicists that were not seen in the mathematics study. We introduce these two behaviors, which we call Using Compiled Relationships and Neighborhood Analysis, and articulate their differences from the behaviors articulated by Hobson and Moore. Finally, we share implications for instruction and questions for further research.
△ Less
Submitted 4 November, 2019;
originally announced November 2019.
-
A Conceptual Blend Analysis of Physics Quantitative Literacy Reasoning Inventory Items
Authors:
Suzanne White Brahmia,
Alexis Olsho,
Andrew Boudreaux,
Trevor Smith,
Charlotte Zimmerman
Abstract:
Mathematical reasoning flexibility across physics contexts is a desirable learning outcome of introductory physics, where the math world and physical world meet. Physics Quantitative Literacy (PQL) is a set of interconnected skills and habits of mind that support quantitative reasoning about the physical world. The Physics Inventory of Quantitative Literacy (PIQL), which we are currently refining…
▽ More
Mathematical reasoning flexibility across physics contexts is a desirable learning outcome of introductory physics, where the math world and physical world meet. Physics Quantitative Literacy (PQL) is a set of interconnected skills and habits of mind that support quantitative reasoning about the physical world. The Physics Inventory of Quantitative Literacy (PIQL), which we are currently refining and validating, assesses students proportional reasoning, covariational reasoning, and reasoning with signed quantities in physics contexts. In this paper, we apply a Conceptual Blending Theory analysis of two exemplar PIQL items to demonstrate how we are using this theory to help develop an instrument that represents the kind of blended reasoning that characterizes expertise in physics. A Conceptual Blending Theory analysis allows for assessment of hierarchical partially correct reasoning patterns, and thereby holds potential to map the emergence of mathematical reasoning flexibility throughout the introductory physics sequence.
△ Less
Submitted 4 November, 2019;
originally announced November 2019.
-
Using psychometric tools as a window into students' quantitative reasoning in introductory physics
Authors:
Trevor I. Smith,
Philip Eaton,
Suzanne White Brahmia,
Alexis Olsho,
Andrew Boudreaux,
Chris DePalma,
Victor LaSasso,
Scott Straguzzi,
Christopher Whitener
Abstract:
The Physics Inventory of Quantitative Literacy (PIQL), a reasoning inventory under development, aims to assess students' physics quantitative literacy at the introductory level. The PIQL's design presents the challenge of isolating types of mathematical reasoning that are independent of each other in physics questions. In its current form, the PIQL spans three principle reasoning subdomains previo…
▽ More
The Physics Inventory of Quantitative Literacy (PIQL), a reasoning inventory under development, aims to assess students' physics quantitative literacy at the introductory level. The PIQL's design presents the challenge of isolating types of mathematical reasoning that are independent of each other in physics questions. In its current form, the PIQL spans three principle reasoning subdomains previously identified in mathematics and physics education research: ratios and proportions, covariation, and signed (negative) quantities. An important psychometric objective is to test the orthogonality of these three reasoning subdomains. We present results from exploratory factor analysis, confirmatory factor analysis, and module analysis that inform interpretations of the underlying structure of the PIQL from a student viewpoint, emphasizing ways in which these results agree and disagree with expert categorization. In addition to informing the development of existing and new PIQL assessment items, these results are also providing exciting insights into students' quantitative reasoning at the introductory level.
△ Less
Submitted 1 October, 2019; v1 submitted 11 July, 2019;
originally announced July 2019.
-
A framework for the natures of negativity in introductory physics
Authors:
Suzanne White Brahmia,
Alexis Olsho,
Trevor I. Smith,
Andrew Boudreaux
Abstract:
Mathematical reasoning skills are a desired outcome of many introductory physics courses, particularly calculus-based physics courses. Positive and negative quantities are ubiquitous in physics, and the sign carries important and varied meanings. Novices can struggle to understand the many roles signed numbers play in physics contexts, and recent evidence shows that unresolved struggle can carry o…
▽ More
Mathematical reasoning skills are a desired outcome of many introductory physics courses, particularly calculus-based physics courses. Positive and negative quantities are ubiquitous in physics, and the sign carries important and varied meanings. Novices can struggle to understand the many roles signed numbers play in physics contexts, and recent evidence shows that unresolved struggle can carry over to subsequent physics courses. The mathematics education research literature documents the cognitive challenge of conceptualizing negative numbers as mathematical objects--both for experts, historically, and for novices as they learn. We contribute to the small but growing body of research in physics contexts that examines student reasoning about signed quantities and reasoning about the use and interpretation of signs in mathematical models. In this paper we present a framework for categorizing various meanings and interpretations of the negative sign in physics contexts, inspired by established work in algebra contexts from the mathematics education research community. Such a framework can support innovation that can catalyze deeper mathematical conceptualizations of signed quantities in the introductory courses and beyond.
△ Less
Submitted 9 March, 2019;
originally announced March 2019.
-
Developing a reasoning inventory for measuring physics quantitative literacy
Authors:
Trevor I. Smith,
Suzanne W. Brahmia,
Alexis Olsho,
Andrew Boudreaux,
Philip Eaton,
Paul J. Kelly,
Kyle J. Louis,
Mitchell A. Nussenbaum,
Louis J. Remy
Abstract:
In an effort to improve the quality of citizen engagement in workplace, politics, and other domains in which quantitative reasoning plays an important role, Quantitative Literacy (QL) has become the focus of considerable research and development efforts in mathematics education. QL is characterized by sophisticated reasoning with elementary mathematics. In this project, we extend the notions of QL…
▽ More
In an effort to improve the quality of citizen engagement in workplace, politics, and other domains in which quantitative reasoning plays an important role, Quantitative Literacy (QL) has become the focus of considerable research and development efforts in mathematics education. QL is characterized by sophisticated reasoning with elementary mathematics. In this project, we extend the notions of QL to include the physics domain and call it Physics Quantitative Literacy (PQL). We report on early stage development from a collaboration that focuses on reasoning inventory design and data analysis methodology for measuring the development of PQL across the introductory physics sequence. We have piloted a prototype assessment designed to measure students' PQL in introductory physics: Physics Inventory of Quantitative Literacy (PIQL). This prototype PIQL focuses on two components of PQL: proportional reasoning, and reasoning with negative quantities. We present preliminary results from approximately 1,000 undergraduate and 20 graduate students.
△ Less
Submitted 10 January, 2019;
originally announced January 2019.