-
Emerging STEM education researchers' positioning and perception of discipline-based education research
Authors:
Shams El-Adawy,
Cydney Alexis,
Eleanor C. Sayre
Abstract:
Various motivations bring researchers to discipline-based education research (DBER), but there is little research on their conceptualization of and navigation into this new-to-them area of research. We use phenomenography to analyze interview data collected from twenty-eight emerging STEM education researchers to gain a better understanding of how they perceive themselves within DBER and what they…
▽ More
Various motivations bring researchers to discipline-based education research (DBER), but there is little research on their conceptualization of and navigation into this new-to-them area of research. We use phenomenography to analyze interview data collected from twenty-eight emerging STEM education researchers to gain a better understanding of how they perceive themselves within DBER and what they perceive it to be. Grounded in the figured worlds theoretical framework, we identify the spectrum of ways emerging STEM education researchers identify or project themselves into this new space: to improve their teaching, to make it their new primary research field, and/or to negotiate how it will fit with their primary one. We also highlight salient negotiations that emerge because of the close ties between DBER and disciplinary science, which provides us with a better understanding of emerging researchers' perceptions. This work generates insight into the kinds of professional development opportunities that would support emerging education researchers within STEM departments and the broader DBER community.
△ Less
Submitted 8 August, 2023;
originally announced August 2023.
-
Emerging Physics Education Researchers' Growth in Professional Agency: Case Study
Authors:
Shams El-Adawy,
Scott V. Franklin,
Eleanor C. Sayre
Abstract:
Improving the physics enterprise to broaden participation in physics is one of the main goals of the physics education research community. Many classically trained physics faculty transition during their faculty career into engaging in research investigating the teaching and learning of their discipline. There is scarce research on the support and needs of these faculty as they engage in their fir…
▽ More
Improving the physics enterprise to broaden participation in physics is one of the main goals of the physics education research community. Many classically trained physics faculty transition during their faculty career into engaging in research investigating the teaching and learning of their discipline. There is scarce research on the support and needs of these faculty as they engage in their first projects in this new research field for them. We investigate agency growth of two emerging physics education researchers and one emerging mathematics education researcher as they participate in a professional development program. We ground our case study analysis of interview data in a theoretical framework on agency. We identify the elements of the professional development program that were transformative in our case study participants' trajectory in education research. Receiving get-started information, building mechanisms to sustain research projects and engaging with a supportive community help participants transform general interests to specific questions, articulate concrete next-steps and increase their sense of self-efficacy. During this professional development program all three case study participants gain agency in this new area of research for them. These identified program elements that affect agency growth can inform professional development opportunities for faculty transitioning into discipline-based education research, which expands our understanding of how to build capacity in the field.
△ Less
Submitted 12 July, 2023;
originally announced July 2023.
-
Motivation and needs of informal physics practitioners
Authors:
Shams El-Adawy,
Alexandra C. Lau,
Eleanor C. Sayre,
Claudia Fracchiolla
Abstract:
Physicists engage with the public to varying degrees at different stages of their careers. However, their public engagement covers many activities, events, and audiences, making their motivations and professional development needs not well understood. As part of ongoing efforts to build and support community in the informal physics space, we conducted interviews with physicists with a range of dif…
▽ More
Physicists engage with the public to varying degrees at different stages of their careers. However, their public engagement covers many activities, events, and audiences, making their motivations and professional development needs not well understood. As part of ongoing efforts to build and support community in the informal physics space, we conducted interviews with physicists with a range of different experiences in public engagement. We use personas methodology and self-determination theory to articulate their public engagement motivation, challenges, and needs. We present our set of three personas: the physicist who engages in informal physics for self-reflection, the physicist who wants to spark interest and understanding in physics, and the physicist who wants to provide diverse role models to younger students and inspire them to pursue a STEM career. Needs covered a range of resources including science communication training, community building among informal physics practitioners, and mechanisms to recognize, elevate and value informal physics. By bringing user-centered design methodology to a new topical area of physics education research, we expand our understanding of motivations and needs of practitioners in physics public engagement. Therefore, departments, organizations and institutions could draw upon the personas developed to consider the ways to better support physicists in their respective environment.
△ Less
Submitted 30 May, 2023;
originally announced May 2023.
-
Case Study: Context Interactions & Physics Faculty's Professional Development
Authors:
Shams El-Adawy,
Tra Huynh,
Mary Bridget Kustusch,
Eleanor C. Sayre
Abstract:
This paper investigates the interactions between context and professional development of physics instructors in a case study of two physics faculty. A phenomenological-case study approach was used to analyze two physics faculty at different institutions over a year and a half using three semi-structured interviews each. The data enabled the identification of relevant context elements; and the impa…
▽ More
This paper investigates the interactions between context and professional development of physics instructors in a case study of two physics faculty. A phenomenological-case study approach was used to analyze two physics faculty at different institutions over a year and a half using three semi-structured interviews each. The data enabled the identification of relevant context elements; and the impact of these elements on physics faculty was explored by adapting a framework that examines instructors' professional development. The analysis shows that both case study subjects used their physics expertise and growing understanding of their context to develop their physics teaching. However, this growth was enacted differently given the nature of their context, highlighting instructors' strengths in navigating their local context to improve their physics teaching. The results show the subtleties of how context has a salient, complex, and evolving role in moderating faculty's professional development. By taking a faculty-centric approach, this paper broadens the community's awareness of the ways physics instructors develop their physics teaching. This work contributes to a relatively new lens by which the physics community views, discusses, and supports the professional development of physics faculty.
△ Less
Submitted 26 June, 2022; v1 submitted 16 May, 2021;
originally announced May 2021.
-
What do equitable physics lab groups look like in light of inchargeness?
Authors:
Sophia M. Jeon,
Eleanor C. Sayre,
N. G. Holmes
Abstract:
In physics labs, students experience a wide range of equitable and inequitable interactions. We developed a methodology to characterize different lab groups in terms of their bid exchanges and inchargeness. An equitable group is one in which every student's bids are heard and acknowledged. Our analysis of equitable and inequitable groups raises questions about how inchargeness and gender interact…
▽ More
In physics labs, students experience a wide range of equitable and inequitable interactions. We developed a methodology to characterize different lab groups in terms of their bid exchanges and inchargeness. An equitable group is one in which every student's bids are heard and acknowledged. Our analysis of equitable and inequitable groups raises questions about how inchargeness and gender interact to affect the functionality of a lab group.
△ Less
Submitted 25 July, 2020;
originally announced July 2020.
-
Positioning in groups: The roles of expertise and being in charge
Authors:
Tra Huynh,
Amali Priyanka Jambuge,
Hien Khong,
James T. Laverty,
Eleanor C. Sayre
Abstract:
Inchargeness is associated with one's authority in driving the activity in collaboration. We study how inchargeness changes within a collaborative group when its members have differing expertise. We present a case study of a group of three students working in an upper division undergraduate physics laboratory. One of them has less on-task expertise than her peers due to missing a day, which reduce…
▽ More
Inchargeness is associated with one's authority in driving the activity in collaboration. We study how inchargeness changes within a collaborative group when its members have differing expertise. We present a case study of a group of three students working in an upper division undergraduate physics laboratory. One of them has less on-task expertise than her peers due to missing a day, which reduces her relative inchargeness across two storylines: "catching up" and "moving forward".
△ Less
Submitted 29 February, 2020;
originally announced March 2020.
-
Undergraduate Researcher Personas
Authors:
Tra Huynh,
Adrian M Madsen,
Eleanor C Sayre
Abstract:
Personalized undergraduate research programs can help increase undergraduate students' participation in research. Personas of undergraduate researchers are a powerful means of encapsulating the richness of students' various goals, motivations, and experiences in research. Student personas can support the design of research programs with student-centered approaches that better engage undergraduate…
▽ More
Personalized undergraduate research programs can help increase undergraduate students' participation in research. Personas of undergraduate researchers are a powerful means of encapsulating the richness of students' various goals, motivations, and experiences in research. Student personas can support the design of research programs with student-centered approaches that better engage undergraduate students across multiple disciplines. We used interview data and drew on Self-Determination Theory to identify students' various goals and motivations in order to build three undergraduate researcher personas in physics.
△ Less
Submitted 29 February, 2020;
originally announced March 2020.
-
Teacher Noticing and Shifting of Student Epistemic Framing
Authors:
Christopher A. F. Hass,
Qing X. Ryan,
Eleanor C Sayre
Abstract:
Through a case study, we demonstrate that teachers can tacitly notice student epistemic framing, and that this noticing can prompt instructor action which tips student framing. Our study is based on video data taken during tutorial sections and oral exams in an upper-division, undergraduate physics course. We analyze one interaction between a student and the course instructor through the lenses of…
▽ More
Through a case study, we demonstrate that teachers can tacitly notice student epistemic framing, and that this noticing can prompt instructor action which tips student framing. Our study is based on video data taken during tutorial sections and oral exams in an upper-division, undergraduate physics course. We analyze one interaction between a student and the course instructor through the lenses of teacher noticing and epistemic framing.
△ Less
Submitted 28 February, 2020;
originally announced February 2020.
-
Beyond teaching methods: highlighting physics faculty's strengths and agency
Authors:
Linda E. Strubbe,
Adrian M. Madsen,
Sarah B. McKagan,
Eleanor C. Sayre
Abstract:
Much work in physics education research (PER) characterizes faculty teaching practice in terms of whether faculty use specific named PER-based teaching methods, either with fidelity or with adaptation; we call this research paradigm the "teaching-method-centered paradigm." However, most faculty do not frame their teaching in terms of which particular named methods they use, but rather in terms of…
▽ More
Much work in physics education research (PER) characterizes faculty teaching practice in terms of whether faculty use specific named PER-based teaching methods, either with fidelity or with adaptation; we call this research paradigm the "teaching-method-centered paradigm." However, most faculty do not frame their teaching in terms of which particular named methods they use, but rather in terms of their own ideas and values, suggesting that the teaching-method-centered paradigm misses key features of faculty teaching. These key features include the productive ideas that faculty have about student learning and faculty agency around teaching. We present three case studies of faculty talking about their teaching, and analyze them in terms of two theoretical frameworks: a framework of teaching principles (How Learning Works) and a framework of faculty agency (Self-Determination Theory). We show that these frameworks well characterize key features of faculty teaching practices and agency, and can be combined in a new paradigm for modeling faculty teaching which we call an "asset-based agentic paradigm." We therefore encourage physics education researchers to move beyond the teaching-method-centered paradigm and think about faculty teaching using an asset-based agentic paradigm.
△ Less
Submitted 28 April, 2020; v1 submitted 19 December, 2019;
originally announced December 2019.
-
Blending of Conceptual Physics and Mathematical Signs
Authors:
Tra Huynh,
Eleanor C Sayre
Abstract:
Mathematics is the language of science. Fluent and productive use of mathematics requires one to understand the meaning embodied in mathematical symbols, operators, syntax, etc., which can be a difficult task. For instance, in algebraic symbolization, the negative and positive signs carry multiple meanings depending on contexts. In the context of electromagnetism, we use conceptual blending theory…
▽ More
Mathematics is the language of science. Fluent and productive use of mathematics requires one to understand the meaning embodied in mathematical symbols, operators, syntax, etc., which can be a difficult task. For instance, in algebraic symbolization, the negative and positive signs carry multiple meanings depending on contexts. In the context of electromagnetism, we use conceptual blending theory to demonstrate that different physical meanings, such as directionality and location, could associate to the positive and negative signs. With these blends, we analyze the struggles of upper-division students as they work with an introductory level problem where the students must employ multiple signs with different meanings in one mathematical expression. We attribute their struggles to the complexity of choosing blends with an appropriate meaning for each sign, which gives us insight into students' algebraic thinking and reasoning.
△ Less
Submitted 25 September, 2019;
originally announced September 2019.
-
Investigating students seriousness during selected conceptual inventory surveys
Authors:
David P Waters,
Dragos Amarie,
Rebecca A Booth,
Christopher Conover,
Eleanor C Sayre
Abstract:
Conceptual inventory surveys are routinely used in education research to identify student learning needs and assess instructional practices. Students might not fully engage with these instruments because of the low stakes attached to them. This paper explores tests that can be used to estimate the percentage of students in a population who might not have taken such surveys seriously. These three s…
▽ More
Conceptual inventory surveys are routinely used in education research to identify student learning needs and assess instructional practices. Students might not fully engage with these instruments because of the low stakes attached to them. This paper explores tests that can be used to estimate the percentage of students in a population who might not have taken such surveys seriously. These three seriousness tests are the pattern recognition test, the easy questions test, and the uncommon answers test. These three tests are applied to sets of students who were assessed either by the Force Concept Inventory, the Conceptual Survey of Electricity and Magnetism, or the Brief Electricity and Magnetism Assessment. The results of our investigation are compared to computer simulated populations of random answers.
△ Less
Submitted 12 July, 2019; v1 submitted 14 May, 2019;
originally announced May 2019.
-
PhysPort use and growth: Supporting physics teaching with research-based resources since 2011
Authors:
Sarah B. McKagan,
Linda E. Strubbe,
Lyle J. Barbato,
Adrian M. Madsen,
Eleanor C. Sayre,
Bruce A. Mason
Abstract:
PhysPort (www.physport.org) has become the go-to place for physics faculty to learn to apply research-based teaching and assessment in their classrooms. Usage has doubled every two years since the site was released in 2011, and 20% of all U.S. physics faculty are now verified educators on PhysPort. The lead author conceived of PhysPort in 2007 after meeting many physics faculty interested in incor…
▽ More
PhysPort (www.physport.org) has become the go-to place for physics faculty to learn to apply research-based teaching and assessment in their classrooms. Usage has doubled every two years since the site was released in 2011, and 20% of all U.S. physics faculty are now verified educators on PhysPort. The lead author conceived of PhysPort in 2007 after meeting many physics faculty interested in incorporating results of physics education research (PER) in their classrooms but with no idea where to start. At the time, most PER results were buried in research journals not accessible to ordinary physics educators, and there was no central place to learn about results and implications for classroom practice. Throughout its development, PhysPort has been based on user research: we interview physics faculty about their needs, design the site based on those needs, and conduct usability testing to see how we meet those needs. PhysPort is a joint product of the American Association of Physics Teachers (AAPT) and Kansas State University (K-State), with contributions from many universities, funded by the National Science Foundation (NSF), and a library within the ComPADRE.org digital library. The site (originally called the PER User's Guide) was first funded by an NSF grant in 2009 and released in November 2011. This article presents an overview of resources on PhysPort, discussion of research and development of the site, and data on the continuing growth of site usage.
△ Less
Submitted 11 June, 2020; v1 submitted 9 May, 2019;
originally announced May 2019.
-
Best Practices for Administering Attitude and Beliefs Surveys
Authors:
Adrian Madsen,
Sarah B McKagan,
Eleanor C Sayre
Abstract:
Physics faculty care about their students learning physics content. In addition, they usually hope that their students will learn some deeper lessons about thinking critically and scientifically. They hope that as a result of taking a physics class, students will come to appreciate physics as a coherent and logical method of understanding the world, and recognize that they can use reason and exper…
▽ More
Physics faculty care about their students learning physics content. In addition, they usually hope that their students will learn some deeper lessons about thinking critically and scientifically. They hope that as a result of taking a physics class, students will come to appreciate physics as a coherent and logical method of understanding the world, and recognize that they can use reason and experimentation to figure things out about the world. Physics education researchers have created several surveys to assess one important aspect of thinking like a physicist: what students believe that learning physics is all about. In this article, we introduce attitudes and beliefs surveys; and give advice on how to choose, administer, and score them in your classes. This article is a companion to Best Practices for Administering Concept Inventories (The Physics Teacher, 2017), which introduces and answers common questions around concept inventories, which are research-based assessments of physics content topics.
△ Less
Submitted 7 February, 2019;
originally announced February 2019.
-
Resource Letter RBAI-2: Research-based assessment instruments: Beyond physics topics
Authors:
Adrian Madsen,
Sarah B. McKagan,
Eleanor C Sayre,
Cassandra A Paul
Abstract:
This Resource Letter provides a guide to research-based assessment instruments (RBAIs) for physics and astronomy classes, but goes beyond physics and astronomy topics to include: attitudes and beliefs about physics, epistemologies and expectations, the nature of physics, problem solving, self-efficacy, reasoning skills and lab skills. We also discuss RBAIs in physics and astronomy cognate fields s…
▽ More
This Resource Letter provides a guide to research-based assessment instruments (RBAIs) for physics and astronomy classes, but goes beyond physics and astronomy topics to include: attitudes and beliefs about physics, epistemologies and expectations, the nature of physics, problem solving, self-efficacy, reasoning skills and lab skills. We also discuss RBAIs in physics and astronomy cognate fields such as mathematics and observation protocols for standardized observation of teaching. In this Resource Letter, we present an overview of these assessments and surveys including research validation, instructional level, format, and themes, to help faculty find the assessment that most closely matches their goals. This Resource Letter is a companion to RBAI-1: Research-based Assessment Instruments in Physics and Astronomy, which explicitly dealt with physics and astronomy topics. More details about each RBAI discussed in this paper are available at PhysPort: physport.org/assessments.
△ Less
Submitted 7 November, 2018;
originally announced November 2018.
-
Studying community development: a network analytical approach
Authors:
C. A. Hass,
Florian Genz,
Mary Bridget Kustusch,
Pierre-P. A. Ouimet,
Katarzyna Pomian,
Eleanor C. Sayre,
Justyna P. Zwolak
Abstract:
Research shows that community plays a central role in learning, and strong community engages students and aids in student persistence. Thus, understanding the function and structure of communities in learning environments is essential to education. We use social network analysis to explore the community dynamics of students in a pre-matriculation, two-week summer program. Unlike previous network a…
▽ More
Research shows that community plays a central role in learning, and strong community engages students and aids in student persistence. Thus, understanding the function and structure of communities in learning environments is essential to education. We use social network analysis to explore the community dynamics of students in a pre-matriculation, two-week summer program. Unlike previous network analysis studies in PER, we build our networks from classroom video that has been coded for student interactions using labeled, directed ties. We define 3 types of interaction: on task interactions (regarding the assigned task), on topic interactions (having to do with science, technology, engineering, and mathematics (STEM)), and off topic interactions (unrelated to the assignment or STEM). To study the development of community in this program, we analyze the shift in conversation topicality over the course of the program. Conversations are more on-task toward the end of the program and we propose that this conversational shift represents a change in student membership within their forming community.
△ Less
Submitted 12 October, 2018; v1 submitted 24 August, 2018;
originally announced August 2018.
-
Case Study: Coordinating Among Multiple Semiotic Resources to Solve Complex Physics Problems
Authors:
Nandana Weliweriya,
Eleanor C Sayre,
Dean A Zollman
Abstract:
This work examines student meaning-making in undergraduate physics problem-solving. We use a social semiotic perspective to sketch a theoretical framework. The social semiotic approach focuses on all types of meaning-making practices that are accomplished through different semiotic modes that include visual, verbal (or aural), written and gestural modes and language, text, algebra, diagrams, sketc…
▽ More
This work examines student meaning-making in undergraduate physics problem-solving. We use a social semiotic perspective to sketch a theoretical framework. The social semiotic approach focuses on all types of meaning-making practices that are accomplished through different semiotic modes that include visual, verbal (or aural), written and gestural modes and language, text, algebra, diagrams, sketches, graphs, body movements, signs, and gestures are examples for semiotic resources. We use the developed theoretical framework to investigate how semiotic resources might be combined to solve physics problems. Data for this study are drawn from an upper-division Electromagnetism I course and a student ("Larry") who is engaged in an individual oral exam. We identify the semiotic and conceptual resources that Larry uses. We use a resource graph representation to show Larry's coordination of resources in his problem solving activity. Larry's case exemplifies coordination between multiple semiotic resources with different disciplinary affordances to build up compound representations. Our analysis of this case illustrates a novel way of thinking about what it means to solve physics problems using semiotic resources.
△ Less
Submitted 16 October, 2018; v1 submitted 8 August, 2018;
originally announced August 2018.
-
How Physics Textbooks Embed Meaning in the Equals Sign
Authors:
Dina Zohrabi Alaee,
Eleanor C. Sayre,
Kellianne Kornick,
Scott V Franklin
Abstract:
Physics as a discipline embeds conceptual meaning about the physical world in mathematical formalism. The meaning associated with mathematical symbols depends on context, and physicists can shift conceptual meaning by manipulating those symbols. We present an analysis of the different physical meanings associated with the equal sign "=" that can be inferred from introductory and upper--level physi…
▽ More
Physics as a discipline embeds conceptual meaning about the physical world in mathematical formalism. The meaning associated with mathematical symbols depends on context, and physicists can shift conceptual meaning by manipulating those symbols. We present an analysis of the different physical meanings associated with the equal sign "=" that can be inferred from introductory and upper--level physics textbooks. Five distinct meanings/categories are identified: causality, balancing, definitional, assignment, and calculation, each with operational definitions that help identify their presence. The different uses can be seen to link mathematical equations to intuitive conceptual ideas, and significant differences in the frequency with which these are used exist between textbooks of different levels.
△ Less
Submitted 19 June, 2020; v1 submitted 14 March, 2018;
originally announced March 2018.
-
Qualitative Measures of Equity in Small Groups
Authors:
Ben Archibeque,
Mary-Bridget Kustusch,
Florian Genz,
Scott Franklin,
Eleanor C Sayre
Abstract:
We investigate the utility of two qualitative measures of equity. Our data are videos of groups of first-generation and Deaf or hard-of-hearing students in a pre-matriculation university program designed to help them persist in STEM fields by developing their metacognitive practices. We analyze video data of students in small groups trying to accomplish various tasks. We analyze how groups engage…
▽ More
We investigate the utility of two qualitative measures of equity. Our data are videos of groups of first-generation and Deaf or hard-of-hearing students in a pre-matriculation university program designed to help them persist in STEM fields by developing their metacognitive practices. We analyze video data of students in small groups trying to accomplish various tasks. We analyze how groups engage with proposed ideas (inchargeness) and create a space of open sharing (civility). By capturing different aspects of each group, these measures combine to help our understanding of what an equitable group could look like.
△ Less
Submitted 4 March, 2018;
originally announced March 2018.
-
Blending Mathematical and Physical Negative-ness
Authors:
Tra Huynh,
Eleanor C Sayre
Abstract:
Expressing physics problems in the form of a mathematical model is one of the most important stages in the problem-solving process. Particularly in algebraic symbolization, understanding the meanings of signs and being able to manipulate them becomes a challenging task for students, especially when more than two elements in the mathematical expression could carry a negative sign. We use Conceptual…
▽ More
Expressing physics problems in the form of a mathematical model is one of the most important stages in the problem-solving process. Particularly in algebraic symbolization, understanding the meanings of signs and being able to manipulate them becomes a challenging task for students, especially when more than two elements in the mathematical expression could carry a negative sign. We use Conceptual Blending theory to investigate how students attribute emergent meaning to the signs and how they articulate different signs in their algebraic symbolization. The data for this research is drawn from oral exams of students enrolled in upper-division physics. The results shed light on students' understanding of algebraic symbols and their competence in formulating and manipulating them.
△ Less
Submitted 4 March, 2018;
originally announced March 2018.
-
Quantitative Measures of Equity in Small Groups
Authors:
Benjamin Archibeque,
Florian Genz,
Maxwell Franklin,
Scott V Franklin,
Eleanor C Sayre
Abstract:
This project investigates how to quantitatively measure equity in small student groups. We follow several student groups to operationalize how discourse may be equitable or inequitable. The groups came from a two week, pre-college program that prepares first generation and deaf/hard-of-hearing students to major in a STEM field. In the program, students focus on improving their metacognitive skills…
▽ More
This project investigates how to quantitatively measure equity in small student groups. We follow several student groups to operationalize how discourse may be equitable or inequitable. The groups came from a two week, pre-college program that prepares first generation and deaf/hard-of-hearing students to major in a STEM field. In the program, students focus on improving their metacognitive skills and cultural preparation for college life within a context of model building. We use three methods to measure equity. First, we look at speaking time: who talks, when, and to whom. Second, we look to segment student discourse by analyzing consistency of group speaking time. Third, we analyze group equality over time changes. We analyze these methods to see how effective they are at capturing equity in group discourse.
△ Less
Submitted 31 October, 2017;
originally announced November 2017.
-
Using Social Network Analysis on classroom video data
Authors:
Katarzyna E. Pomian,
Justyna P. Zwolak,
Eleanor C. Sayre,
Scott V. Franklin,
Mary Bridget Kustusch
Abstract:
We propose a novel application of Social Network Analysis (SNA) using classroom video data as a means of quantitatively and visually exploring the collaborations between students. The context for our study was a summer program that works with first generation students and deaf/hard-of-hearing students to engage in authentic science practice and develop a supportive community. We applied SNA to dat…
▽ More
We propose a novel application of Social Network Analysis (SNA) using classroom video data as a means of quantitatively and visually exploring the collaborations between students. The context for our study was a summer program that works with first generation students and deaf/hard-of-hearing students to engage in authentic science practice and develop a supportive community. We applied SNA to data from one activity during the two-week program to test our approach and as a means to begin to assess whether the goals of the program are being met. We used SNA to identify groups that were interacting in unexpected ways and then to highlight how individuals were contributing to the overall group behavior. We plan to expand our new use of SNA to video data on a larger scale.
△ Less
Submitted 30 October, 2017;
originally announced October 2017.
-
Standing fast: Translation among durable representations using evanescent representations in upper-division problem solving
Authors:
Nandana Weliweriya,
Tra Huynh,
Eleanor C Sayre
Abstract:
Mastering problem solving requires students to not only understand and apply physics concepts but also employ mathematics and mathematical representations (sketches, diagrams, graphs, gestures, equations and spoken language) skillfully. As part of a larger project to investigate problem solving processes among upper division physics students, we investigate how students coordinate among multiple r…
▽ More
Mastering problem solving requires students to not only understand and apply physics concepts but also employ mathematics and mathematical representations (sketches, diagrams, graphs, gestures, equations and spoken language) skillfully. As part of a larger project to investigate problem solving processes among upper division physics students, we investigate how students coordinate among multiple representations while solving problems. Data for this study is drawn from an upper-division Electromagnetism I course, where students engage in individual oral exams. We do moment-by-moment analysis of students' problem solving to see how they translate between durable representations (diagrams, written mathematical equations) with the help of evanescent representations (gestures, words); and how they build up durable representations where they can "stand fast" later. In this paper, we present the case of Larry as an exemplary case for problem solving. Larry starts from a durable representation (diagram) and builds up from there using evanescent representations (gestures and words), standing fast on the diagram. He later translates to a different kind of durable representation (mathematics), where he reasons and answers the original problem.
△ Less
Submitted 12 October, 2017;
originally announced October 2017.
-
Framing Difficulties in Quantum Mechanics
Authors:
Bahar Modir,
John D Thompson,
Eleanor C Sayre
Abstract:
Students' difficulties in quantum mechanics may be the result of unproductive framing rather than a fundamental inability to solve the problems or misconceptions about physics content. Using the theoretical lens of epistemological framing, we applied previously developed frames to seek an underlying structure to the long lists of published difficulties that span many topics in quantum mechanics. M…
▽ More
Students' difficulties in quantum mechanics may be the result of unproductive framing rather than a fundamental inability to solve the problems or misconceptions about physics content. Using the theoretical lens of epistemological framing, we applied previously developed frames to seek an underlying structure to the long lists of published difficulties that span many topics in quantum mechanics. Mapping descriptions of published difficulties into errors in epistemological framing and resource use, we analyzed descriptions of students' problem solving to find their frames, and compared students' framing to the framing (and frame shifting) required by problem statements. We found three categories of error: mismatches between students' framing and problem statement framing; inappropriate or absent shifting between frames; and insufficient resource activation within an appropriate frame.
△ Less
Submitted 25 September, 2019; v1 submitted 14 June, 2017;
originally announced June 2017.
-
Student and instructor framing in upper-division physics
Authors:
Deepa N Chari,
Hai D Nguyen,
Dean A Zollman,
Eleanor C Sayre
Abstract:
Upper-division physics students spend much of their time solving problems. In addition to their basic skills and background, their epistemic framing can form an important part of their ability to learn physics from these problems. Encouraging students to move toward productive framing may help them solve problems. Thus, an instructor should understand the specifics of how student have framed a pro…
▽ More
Upper-division physics students spend much of their time solving problems. In addition to their basic skills and background, their epistemic framing can form an important part of their ability to learn physics from these problems. Encouraging students to move toward productive framing may help them solve problems. Thus, an instructor should understand the specifics of how student have framed a problem and understand how her interaction with the students will impact that framing. In this study we investigate epistemic framing of students in problem solving situations where math is applied to physics. To analyze the frames and changes in frames, we develop and use a two-axis framework involving conceptual and algorithmic physics and math. We examine student and instructor framing and the interactions of these frames over a range of problems in an upper-division electromagnetic fields course. Within interactions, students and instructors generally follow each others' leads in framing.
△ Less
Submitted 21 May, 2019; v1 submitted 17 April, 2017;
originally announced April 2017.
-
The effectiveness of 'pencasts' in physics courses
Authors:
Nandana Weliweriya,
Eleanor C Sayre,
Dean A Zollman
Abstract:
Pencasts are videos of problem solving with narration by the problem solver. Pedagogically, students can create pencasts to illustrate their own problem solving to the instructor or to their peers. Pencasts have implications for teaching at multiple levels from elementary grades through university courses. In this article, we describe the use of pencasts in a university level upperdivision Electro…
▽ More
Pencasts are videos of problem solving with narration by the problem solver. Pedagogically, students can create pencasts to illustrate their own problem solving to the instructor or to their peers. Pencasts have implications for teaching at multiple levels from elementary grades through university courses. In this article, we describe the use of pencasts in a university level upperdivision Electromagnetic Fields course usually taken by junior and senior physics majors. For each homework assignment, students created and submitted pencasts of ordinary problems several days before the problem set was due. We compare students' performance in the class (grades for pencast submission excluded) with the pencast submission rate. Students who submitted more pencasts tend to do better in the course. We conclude with some practical suggestions for implementing pencasts in other courses.
△ Less
Submitted 27 March, 2017;
originally announced March 2017.
-
Varied reasoning schema in students' written solutions
Authors:
Nandana Weliweriya,
Justyna P. Zwolak,
Eleanor C. Sayre,
Dean Zollman
Abstract:
The Mathematization project investigates students' use of mathematical tools across the undergraduate physics curriculum. As a part of this project, we look at intermediate mechanics students' written homework solutions to understand how they use these tools in approaching traditional mechanics problems. We use a modified version of the ACER (Activation-Construction-Execution-Reflection) framework…
▽ More
The Mathematization project investigates students' use of mathematical tools across the undergraduate physics curriculum. As a part of this project, we look at intermediate mechanics students' written homework solutions to understand how they use these tools in approaching traditional mechanics problems. We use a modified version of the ACER (Activation-Construction-Execution-Reflection) framework to analyze students' solutions and to identify patterns of mathematical skills used on traditional problems. We apply techniques borrowed from network analysis and the Resources Framework to build a "fingerprint" of students' mathematical tool use. In this paper, we present preliminary findings on patterns that we identified in students' problem solving.
△ Less
Submitted 15 June, 2017; v1 submitted 7 November, 2016;
originally announced November 2016.
-
Linking Behavior in the PER Coauthorship Network
Authors:
Katharine A Anderson,
Matthew Crespi,
Eleanor C Sayre
Abstract:
There is considerable long-term interest in understanding the dynamics of collaboration networks, and how these networks form and evolve over time. Most of the work done on the dynamics of social networks focuses on well-established communities. Work examining emerging social networks is rarer, simply because data is difficult to obtain in real time. In this paper, we use thirty years of data from…
▽ More
There is considerable long-term interest in understanding the dynamics of collaboration networks, and how these networks form and evolve over time. Most of the work done on the dynamics of social networks focuses on well-established communities. Work examining emerging social networks is rarer, simply because data is difficult to obtain in real time. In this paper, we use thirty years of data from an emerging scientific community to look at that crucial early stage in the development of a social network. We show that when the field was very young, islands of individual researchers labored in relative isolation, and the coauthorship network was disconnected. Thirty years later, rather than a cluster of individuals, we find a true collaborative community, bound together by a robust collaboration network. However, this change did not take place gradually\textemdash the network remained a loose assortment of isolated individuals until the mid-2000s, when those smaller parts suddenly knit themselves together into a single whole. In the rest of this paper, we consider the role of three factors in these observed structural changes: growth, changes in social norms, and the introduction of institutions such as field-specific conferences and journals. We have data from the very earliest years of the field, a period which includes the introduction of two different institutions: the first field-specific conference, and the first field-specific journals. We also identify two relevant behavioral shifts: a discrete increase in coauthorship coincident with the first conference, and a shift among established authors away from collaborating with outsiders, towards collaborating with each other. The interaction of these factors gives us insight into the formation of collaboration networks more broadly.
△ Less
Submitted 30 March, 2017; v1 submitted 28 September, 2016;
originally announced September 2016.
-
"Pulling out" as a procedural resource when solving partial differential equations
Authors:
Bahar Modir,
Eleanor C Sayre
Abstract:
We investigate how students solve partial differential equations and partial derivatives in the context of quantum mechanics. We use the resources framework to investigate students' discussion in a group problem-solving environment to investigate the fine-grain elements of their problem solving. We analyze an example of students' use of separation of variables to solve a partial differential equat…
▽ More
We investigate how students solve partial differential equations and partial derivatives in the context of quantum mechanics. We use the resources framework to investigate students' discussion in a group problem-solving environment to investigate the fine-grain elements of their problem solving. We analyze an example of students' use of separation of variables to solve a partial differential equation for a free particle problem. We identify a mathematical action called "pulling out" as a procedural resource to help students with separating the time part from the space part of the wave function in the course of solving the time-dependent Schrodinger equation. We discuss how students use "pulling out" as a procedural step in solving partial differential equations and sense-making.
△ Less
Submitted 25 July, 2016;
originally announced July 2016.
-
Student understanding of electric and magnetic fields in materials
Authors:
Savannah L. Mitchem,
Dina Zohrabi Alaee,
Eleanor C. Sayre
Abstract:
We discuss the clusters of resources that emerge when upper-division students write about electromagnetic fields in linear materials. The data analyzed for this paper comes from students' written tests in an upper-division electricity and magnetism course. We examine how these clusters change with time and context. The evidence shows that students benefit from activating resources related to the i…
▽ More
We discuss the clusters of resources that emerge when upper-division students write about electromagnetic fields in linear materials. The data analyzed for this paper comes from students' written tests in an upper-division electricity and magnetism course. We examine how these clusters change with time and context. The evidence shows that students benefit from activating resources related to the internal structure of the atom when thinking about electric fields and their effect on materials. We argue that facilitating activation of certain resources by the instructor in the classroom can affect the plasticity of those resources in the student, making them more solid and easily activated. We find that the wording of the questions posed to students affects which resources are activated, and that students often fill in resources to link known phenomena to phenomena described by the question when lacking detailed mental models.
△ Less
Submitted 17 March, 2017; v1 submitted 15 July, 2016;
originally announced July 2016.
-
Dynamics of students' epistemological framing in group problem solving
Authors:
Hai D Nguyen,
Deepa N Chari,
Eleanor C Sayre
Abstract:
Many studies have investigated students' epistemological framing when solving physics problems. Framing supports students' problem solving as they decide what knowledge to employ and the necessary steps to solve the problem. Students may frame the same problem differently and take alternate paths to a correct solution. When students work in group settings, they share and discuss their framing to d…
▽ More
Many studies have investigated students' epistemological framing when solving physics problems. Framing supports students' problem solving as they decide what knowledge to employ and the necessary steps to solve the problem. Students may frame the same problem differently and take alternate paths to a correct solution. When students work in group settings, they share and discuss their framing to decide how to proceed in problem solving as a whole group. In this study, we investigate how groups of students negotiate their framing and frame shifts in group problem solving.
△ Less
Submitted 11 July, 2016;
originally announced July 2016.
-
Students' epistemological framing in quantum mechanics problem solving
Authors:
Bahar Modir,
John D. Thompson,
Eleanor C Sayre
Abstract:
Students' difficulties in quantum mechanics may be the result of unproductive framing and not a fundamental inability to solve the problems or misconceptions about physics content. We observed groups of students solving quantum mechanics problems in an upper-division physics course. Using the lens of epistemological framing, we investigated four frames in our observational data: algorithmic math,…
▽ More
Students' difficulties in quantum mechanics may be the result of unproductive framing and not a fundamental inability to solve the problems or misconceptions about physics content. We observed groups of students solving quantum mechanics problems in an upper-division physics course. Using the lens of epistemological framing, we investigated four frames in our observational data: algorithmic math, conceptual math, algorithmic physics, and conceptual physics. We discuss the characteristics of each frame as well as causes for transitions between different frames, arguing that productive problem solving may occur in any frame as long as students' transition appropriately between frames. Our work extends epistemological framing theory on how students frame discussions in upper-division physics courses.
△ Less
Submitted 14 June, 2017; v1 submitted 27 May, 2016;
originally announced May 2016.
-
iPad Screencasts as Evidence of Accountable Disciplinary Knowledge
Authors:
Eleanor C Sayre,
Claudia Fracchiolla,
Ben Van Dusen
Abstract:
We define knowledge as facts, information, and skills acquired by a person through experience or education. In turn, Disciplinary Knowledge is the knowledge related to a specific field or discipline, such as physics. Accountable Disciplinary Knowledge (ADK) is "what counts" as important to a community or discipline: the kinds of activities that participants engage in, the problems they value and s…
▽ More
We define knowledge as facts, information, and skills acquired by a person through experience or education. In turn, Disciplinary Knowledge is the knowledge related to a specific field or discipline, such as physics. Accountable Disciplinary Knowledge (ADK) is "what counts" as important to a community or discipline: the kinds of activities that participants engage in, the problems they value and solve, and methods for solving those problems. Because ADK is determined on a community basis, the details of "what counts" will vary with the norms and expectations of the community. In this paper, we use the ADK framework to investigate "what counts" as solving problems well in a high school physics classroom from the perspective of the students.
△ Less
Submitted 25 May, 2016;
originally announced May 2016.
-
Resource Letter: RBAI-1: Research-based Assessment Instruments in Physics and Astronomy
Authors:
Adrian Madsen,
Sam McKagan,
Eleanor C Sayre
Abstract:
This resource letter provides a guide to research-based assessment instruments (RBAIs) of physics and astronomy content. These are standardized assessments that were rigorously developed and revised using student ideas and interviews, expert input, and statistical analyses. RBAIs have had a major impact on physics and astronomy education reform by providing a universal and convincing measure of st…
▽ More
This resource letter provides a guide to research-based assessment instruments (RBAIs) of physics and astronomy content. These are standardized assessments that were rigorously developed and revised using student ideas and interviews, expert input, and statistical analyses. RBAIs have had a major impact on physics and astronomy education reform by providing a universal and convincing measure of student understanding that instructors can use to assess and improve the effectiveness of their teaching. In this resource letter, we present an overview of all content RBAIs in physics and astronomy by topic, research validation, instructional level, format, and themes, to help faculty find the best assessment for their course.
△ Less
Submitted 16 June, 2016; v1 submitted 9 May, 2016;
originally announced May 2016.
-
Secondary Analysis of Teaching Methods in Introductory Physics: a 50k-Student Study
Authors:
Joshua Von Korff,
Benjamin Archibeque,
K. Alison Gomez,
Tyrel Heckendorf,
Sarah B. McKagan,
Eleanor C. Sayre,
Edward W. Schenk,
Chase Shepherd,
Lane Sorell
Abstract:
Physics education researchers have developed many evidence-based instructional strategies to enhance physics students' conceptual learning. These strategies have historically been tested using assessments such as the Force Concept Inventory (FCI) and Force and Motion Conceptual Evaluation (FMCE). We have performed a review and analysis of FCI and FMCE data published between 1995 and 2014. We confi…
▽ More
Physics education researchers have developed many evidence-based instructional strategies to enhance physics students' conceptual learning. These strategies have historically been tested using assessments such as the Force Concept Inventory (FCI) and Force and Motion Conceptual Evaluation (FMCE). We have performed a review and analysis of FCI and FMCE data published between 1995 and 2014. We confirm previous findings that interactive engagement teaching techniques are significantly more likely to produce high student learning gains than traditional lecture-based instruction. We also establish that interactive engagement instruction works in many settings, including for students with a high and low level of prior knowledge, for liberal arts and research universities, and for small and large class sizes.
△ Less
Submitted 7 October, 2016; v1 submitted 1 March, 2016;
originally announced March 2016.
-
Identity statuses in upper-division physics students
Authors:
Paul W. Irving,
Eleanor C. Sayre
Abstract:
We use the theories of identity statuses and communities of practice to describe three different case studies of students finding their paths through undergraduate physics and developing a physics subject-specific identity. Each case study demonstrates a unique path that reinforces the link between the theories of communities of practice and identity statuses. The case studies also illustrate how…
▽ More
We use the theories of identity statuses and communities of practice to describe three different case studies of students finding their paths through undergraduate physics and developing a physics subject-specific identity. Each case study demonstrates a unique path that reinforces the link between the theories of communities of practice and identity statuses. The case studies also illustrate how students progress and regress in their commitment to their subject-specific identities and their professional identities. The progression/regression is dependent on their willingness to explore different aspects of a physics professional identity and their availability to carry out such exploration. Identity status and future identity crises can manifest in students' behavior in the classroom. Allowing students to engage in more legitimate practices of the physics community, especially in the form of undergraduate research, helps students to explore their opportunities and inform the level of commitment they wish to make to physics.
△ Less
Submitted 28 May, 2015;
originally announced May 2015.
-
Research-based assessment affordances and constraints: Perceptions of physics faculty
Authors:
Adrian Madsen,
Sarah B. McKagan,
Mathew "Sandy" Martinuk,
Alexander Bell,
Eleanor C. Sayre
Abstract:
To help faculty use research-based materials in a more significant way, we learn about their perceived needs and desires and use this information to suggest ways for the Physics Education Research community to address these needs. When research-based resources are well aligned with the perceived needs of faculty, faculty members will more readily take them up. We used phenomenographic interviews o…
▽ More
To help faculty use research-based materials in a more significant way, we learn about their perceived needs and desires and use this information to suggest ways for the Physics Education Research community to address these needs. When research-based resources are well aligned with the perceived needs of faculty, faculty members will more readily take them up. We used phenomenographic interviews of ordinary physics faculty and department chairs to identify four families of issues that faculty have around research-based assessments (RBA). First, many faculty are interested in using RBAs but have practical needs around how to do so: how to find them, which ones there are, and how to administer them. They want help addressing these needs. Second, at the same time, many faculty think that RBAs are limited and don't measure many of the things they care about, or aren't applicable in their classes. They want assessments to measure skills, perceptions, and specific concepts. Third, many faculty want to turn to communities of other faculty and experts to help them interpret their assessment results and suggest other ways to do assessment. They want to norm their assessment results by comparing to others and interacting with faculty from other schools to learn about how they do assessment. Fourth, many faculty consider their courses in the broader contexts of accountability and their departments. They want help with assessment in these broader contexts. We also discuss how faculty members role in their department and type of institution influence their perceived wants and needs around assessment.
△ Less
Submitted 6 January, 2015;
originally announced January 2015.
-
Becoming a Physicist: The Roles of Research, Mindsets, and Milestones in upper-division student perceptions
Authors:
Paul W. Irving,
Eleanor C. Sayre
Abstract:
As part of a longitudinal study into identity development in upper-level physics students, a phenomenographic research method was used to examine students' perceptions of what it means to be a physicist. The results revealed four different categories of perception of what it means to be a physicist, with a clear distinction in the level of exclusivity students associate with being a physicist and…
▽ More
As part of a longitudinal study into identity development in upper-level physics students, a phenomenographic research method was used to examine students' perceptions of what it means to be a physicist. The results revealed four different categories of perception of what it means to be a physicist, with a clear distinction in the level of exclusivity students associate with being a physicist and differences of importance of research and its association with being a physicist. We find a relationship between students' perceptions of physicists and students' goal orientation. The paper highlights a need for faculty to not just emphasize the importance of research to students' academic development but also to further demonstrate and explain what research entails and the role it plays in a physicist's identity.
△ Less
Submitted 28 May, 2015; v1 submitted 29 September, 2014;
originally announced September 2014.
-
Brief, embedded, spontaneous metacognitive talk indicates thinking like a physicist
Authors:
Eleanor C. Sayre,
Paul W. Irving
Abstract:
Instructors and researchers think "thinking like a physicist" is important for students' professional development. However, precise definitions and observational markers remain elusive. We reinterpret popular beliefs inventories in physics to indicate what physicists think "thinking like a physicist" entails. Through discourse analysis of upper-division students' speech in natural settings, we sho…
▽ More
Instructors and researchers think "thinking like a physicist" is important for students' professional development. However, precise definitions and observational markers remain elusive. We reinterpret popular beliefs inventories in physics to indicate what physicists think "thinking like a physicist" entails. Through discourse analysis of upper-division students' speech in natural settings, we show that students may appropriate or resist these elements. We identify a new element in the physicist speech genre: brief, embedded, spontaneous metacognitive talk (BESM talk). BESM talk communicates students' in-the-moment enacted expectations about physics as a technical field and a cultural endeavor. Students use BESM talk to position themselves as physicists or non-physicists. Students also use BESM talk to communicate their expectations in four ways: understanding, confusion, spotting inconsistencies, and generalized expectations.
△ Less
Submitted 28 May, 2015; v1 submitted 26 September, 2014;
originally announced September 2014.
-
Upper-Level Physics Students' Perceptions of Physicists
Authors:
Paul W. Irving,
Eleanor C. Sayre
Abstract:
As part of a longitudinal study into identity development in upper-level physics students, we used a phenomenographic research method to examine students' perceptions of what it means to be a physicist. The results revealed four different categories. We find a clear distinction in the exclusivity students associate with being a physicist and the differences in the importance of research and its as…
▽ More
As part of a longitudinal study into identity development in upper-level physics students, we used a phenomenographic research method to examine students' perceptions of what it means to be a physicist. The results revealed four different categories. We find a clear distinction in the exclusivity students associate with being a physicist and the differences in the importance of research and its association with being a physicist. A relationship between perceptions of physicists and goal orientation is indicated.
△ Less
Submitted 3 September, 2014;
originally announced September 2014.
-
Personas as a Powerful Methodology to Design Targeted Professional Development Resources
Authors:
Adrian Madsen,
Sarah B. McKagan,
Eleanor C. Sayre,
Mathew "Sandy" Martinuk,
Alexander Bell
Abstract:
Scaling and sustaining educational innovations is a common problem in the learning sciences. Professional development resources around educational innovations that are personalized to appeal to the needs and motivations of different types of faculty offer a possible solution. The method of developing personas to represent key types of users is commonly employed in user-interface design and can be…
▽ More
Scaling and sustaining educational innovations is a common problem in the learning sciences. Professional development resources around educational innovations that are personalized to appeal to the needs and motivations of different types of faculty offer a possible solution. The method of developing personas to represent key types of users is commonly employed in user-interface design and can be used to produce personalized resources. Personas are fictional named archetypes of users encompassing generalizations of their key characteristics and goals that emerge from interviews. This method is especially powerful because personas succinctly package information into the form of a person, who is easily understood and reasoned about. Herein we describe the creation of a set of personas focusing on the needs and motivations of physics faculty around assessment and teaching. We present the personas, a discussion of how they inform our design and how the method can be used more broadly.
△ Less
Submitted 23 February, 2017; v1 submitted 5 August, 2014;
originally announced August 2014.
-
Learning about the Energy of a Hurricane System through an Estimation Epistemic Game
Authors:
Bahar Modir,
Paul W. Irving,
Steven F. Wolf,
Eleanor C. Sayre
Abstract:
As part of a study into students' problem solving behaviors, we asked upper-division physics students to solve estimation problems in clinical interviews. We use the Resources Framework and epistemic games to describe students' problem solving moves. We present a new epistemic game, the "estimation epistemic game". In the estimation epistemic game, students break the larger problem into a series o…
▽ More
As part of a study into students' problem solving behaviors, we asked upper-division physics students to solve estimation problems in clinical interviews. We use the Resources Framework and epistemic games to describe students' problem solving moves. We present a new epistemic game, the "estimation epistemic game". In the estimation epistemic game, students break the larger problem into a series of smaller, tractable problems. Within each sub-problem, they try to remember a method for solving the problem, and use estimation and reasoning abilities to justify their answers. We demonstrate how a single case study student plays the game to estimate the total energy in a hurricane. Finally, we discuss the implications of epistemic game analysis for other estimation problems.
△ Less
Submitted 11 July, 2014;
originally announced July 2014.
-
Just Math: A new epistemic frame
Authors:
Steven F. Wolf,
Leanne Doughty,
Paul W. Irving,
Eleanor C. Sayre,
Marcos D. Caballero
Abstract:
A goal of PER is to understand how students use math in physics contexts. To investigate how students use math, we need to identify transitions between conceptual sense-making about physical systems and using mathematics to describe and to make predictions about those systems. We reviewed video of students solving a variety of physics problems in small groups through the lens of epistemic frames (…
▽ More
A goal of PER is to understand how students use math in physics contexts. To investigate how students use math, we need to identify transitions between conceptual sense-making about physical systems and using mathematics to describe and to make predictions about those systems. We reviewed video of students solving a variety of physics problems in small groups through the lens of epistemic frames (e-frames). In this paper, we present a new e-frame, which we are calling "Just Math", that is similar to the Worksheet e-frame, but is characterized by brief, low-level, math-focused utterances between students. Future work will focus on analyzing the transitions into and out of this e-frame so that we may develop a more coherent understanding of students' use of math in physics.
△ Less
Submitted 17 December, 2014; v1 submitted 10 July, 2014;
originally announced July 2014.
-
Best Practices for Administering Concept Inventories
Authors:
Adrian Madsen,
Sarah B. McKagan,
Eleanor C. Sayre
Abstract:
There are a plethora of concept inventories in physics available for faculty to use, but it is not always clear exactly why you would use these tests, or how you should administer them and interpret the results. These multiple-choice research-based tests about physics concepts are valuable because they allow for standardized comparisons among institutions, instructors, or over time. In order for t…
▽ More
There are a plethora of concept inventories in physics available for faculty to use, but it is not always clear exactly why you would use these tests, or how you should administer them and interpret the results. These multiple-choice research-based tests about physics concepts are valuable because they allow for standardized comparisons among institutions, instructors, or over time. In order for these comparisons to be meaningful, you should use best practices for administering the tests. Here we discuss best practices for administering concept inventories including background on these types of tests and specifics of how to give them online or in-class. We also discuss advantages and disadvantages of different incentives you could give your students, interpretation of scores and common concerns you may have about using concept inventories.
△ Less
Submitted 20 October, 2016; v1 submitted 25 April, 2014;
originally announced April 2014.
-
How physics instruction impacts students' beliefs about learning physics: A meta-analysis of 24 studies
Authors:
Adrian Madsen,
Sarah B. McKagan,
Eleanor C. Sayre
Abstract:
In this meta-analysis, we synthesize the results of 24 studies using the Colorado Learning Attitudes about Science Survey (CLASS) and the Maryland Physics Expectations Survey (MPEX) to answer several questions: (1) How does physics instruction impact students' beliefs? (2) When do physics majors develop expert-like beliefs? and (3) How do students' beliefs impact their learning of physics? We repo…
▽ More
In this meta-analysis, we synthesize the results of 24 studies using the Colorado Learning Attitudes about Science Survey (CLASS) and the Maryland Physics Expectations Survey (MPEX) to answer several questions: (1) How does physics instruction impact students' beliefs? (2) When do physics majors develop expert-like beliefs? and (3) How do students' beliefs impact their learning of physics? We report that in typical physics classes, students' beliefs deteriorate or at best stay the same. There are a few types of interventions, including an explicit focus on model-building and/or developing expert- like beliefs that lead to significant improvements in beliefs. Further, small courses and those for elementary education and non-science majors also result in improved beliefs. However, because the available data oversamples certain types of classes, it is unclear whether these improvements are actually due to the interventions, or due to the small class size, or student population typical of the kinds of classes in which these interventions are most often used. Physics majors tend to enter their undergraduate education with more expert-like beliefs than non-majors and these beliefs remain relatively stable throughout their undergraduate careers. Thus, typical physics courses appear to be selecting students who already have strong beliefs, rather than supporting students in developing strong beliefs. There is a small correlation between students' incoming beliefs about physics and their gains on conceptual mechanics surveys. This suggests that students with more expert-like incoming beliefs may learn more in their physics courses, but this finding should be further explored and replicated. Some unanswered questions remain. To answer these questions, we advocate several specific types of future studies.
△ Less
Submitted 28 May, 2015; v1 submitted 25 March, 2014;
originally announced March 2014.
-
Conditions for building a community of practice in an advanced physics laboratory
Authors:
Paul W. Irving,
Eleanor C. Sayre
Abstract:
In this paper we explore the theory of communities of practice in the context of a physics college course and in particular the classroom environment of an advanced laboratory. We introduce the idea of elements of a classroom community being able to provide students with the opportunity to have an accelerated trajectory towards being a more central participant of the community of practice of physi…
▽ More
In this paper we explore the theory of communities of practice in the context of a physics college course and in particular the classroom environment of an advanced laboratory. We introduce the idea of elements of a classroom community being able to provide students with the opportunity to have an accelerated trajectory towards being a more central participant of the community of practice of physicists. This opportunity is a result of structural features of the course and a primary instructional choice which result in the development of a learning community with several elements that encourage students to engage in more authentic practices of a physicist. A jump in accountable disciplinary knowledge is also explored as a motivation for enculturation into the community of practice of physicists. In the advanced laboratory what students are being assessed on as counting as physics is significantly different and so they need to assimilate in order to succeed.
△ Less
Submitted 6 December, 2013;
originally announced December 2013.
-
Gender gap on concept inventories in physics: what is consistent, what is inconsistent, and what factors influence the gap?
Authors:
Adrian Madsen,
Sarah B. McKagan,
Eleanor C. Sayre
Abstract:
We review the literature on the gender gap on concept inventories in physics. Across studies of the most commonly used mechanics concept inventories, the Force Concept Inventory (FCI) and Force and Motion Conceptual Evaluation (FMCE), mens average pretest scores are always higher than womens, and in most cases mens posttest scores are higher as well. The weighted average gender difference on these…
▽ More
We review the literature on the gender gap on concept inventories in physics. Across studies of the most commonly used mechanics concept inventories, the Force Concept Inventory (FCI) and Force and Motion Conceptual Evaluation (FMCE), mens average pretest scores are always higher than womens, and in most cases mens posttest scores are higher as well. The weighted average gender difference on these tests is 13% for pretest scores, 12% for posttest scores, and 6% for normalized gain. This difference is much smaller than the average difference in normalized gain between traditional lecture and interactive engagement (25%), but it is large enough that it could impact the results of studies comparing the effectiveness of different teaching methods. There is sometimes a gender gap on commonly used electromagnetism concept inventories, but it is usually much smaller and sometimes is zero or favors women. The weighted average gender difference on these tests is 3.7% for pretest scores, 8.5% for posttest scores, and 6% for normalized gain. Based on our analysis of 26 published articles, no single factor is sufficient to explain the gap. Several high-profile studies that have claimed to account for or reduce the gender gap have failed to be replicated in subsequent studies, suggesting that isolated claims of explanations of the gender gap should be interpreted with caution. Other factors, such as gender differences in background preparation, scores on different kinds of assessment, and splits between how students respond to test questions when answering for themselves or for a scientist do contribute to a difference between male and female responses, but the size of these differences is smaller than the size of the overall gender gap, suggesting that the gender gap is most likely due to the combination of many small factors rather than any one factor that can easily be modified.
△ Less
Submitted 25 March, 2014; v1 submitted 3 July, 2013;
originally announced July 2013.
-
Fluctuations in Student Understanding of Newton's 3rd Law
Authors:
Jessica W. Clark,
Eleanor C. Sayre,
Scott V. Franklin
Abstract:
We present data from a between-student study on student response to questions on Newton's Third Law given throughout the academic year. The study, conducted at Rochester Institute of Technology, involved students from the first and third of a three-quarter sequence. Construction of a response curve reveals subtle dynamics in student learning not captured by simple pre/post testing. We find a a sig…
▽ More
We present data from a between-student study on student response to questions on Newton's Third Law given throughout the academic year. The study, conducted at Rochester Institute of Technology, involved students from the first and third of a three-quarter sequence. Construction of a response curve reveals subtle dynamics in student learning not captured by simple pre/post testing. We find a a significant positive effect from direct instruction, peaking at the end of instruction on forces, that diminishes by the end of the quarter. Two quarters later, in physics III, a significant dip in correct response occurs when instruction changes from the vector quantities of electric forces and fields to the scalar quantity of electric potential. Student response rebounds to its initial values, however, once instruction returns to the vector-based topics involving magnetic fields.
△ Less
Submitted 1 September, 2010;
originally announced September 2010.
-
Students' Responses To Different Representations Of A Vector Addition Question
Authors:
Jeffrey M. Hawkins,
John R. Thompson,
Michael C. Wittmann,
Eleanor C. Sayre,
Brian W. Frank
Abstract:
We investigate if the visual representation of vectors can affect which methods students use to add them. We gave students one of four questions with different graphical representations, asking students to add the same two vectors. For students in an algebra-based class the arrangement of the vectors had a statistically significant effect on the vector addition method chosen while the addition or…
▽ More
We investigate if the visual representation of vectors can affect which methods students use to add them. We gave students one of four questions with different graphical representations, asking students to add the same two vectors. For students in an algebra-based class the arrangement of the vectors had a statistically significant effect on the vector addition method chosen while the addition or removal of a grid did not.
△ Less
Submitted 26 August, 2010; v1 submitted 4 August, 2010;
originally announced August 2010.