-
Sthymuli: a Static Educational Robot. Leveraging the Thymio II Platform
Authors:
Manuel Bernal-Lecina,
Alejandrina Hernández,
Adrien Pannatier,
Léa Pereyre,
Francesco Mondada
Abstract:
The use of robots in education represents a challenge for teachers and a fixed vision of what robots can do for students. This paper presents the development of Sthymuli, a static educational robot designed to explore new classroom interactions between robots, students and teachers. We propose the use of the Thymio II educational platform as a base, ensuring a robust benchmark for a fair compariso…
▽ More
The use of robots in education represents a challenge for teachers and a fixed vision of what robots can do for students. This paper presents the development of Sthymuli, a static educational robot designed to explore new classroom interactions between robots, students and teachers. We propose the use of the Thymio II educational platform as a base, ensuring a robust benchmark for a fair comparison of the commonly available wheeled robots and our exploratory approach with Sthymuli. This paper outlines the constraints and requirements for developing such a robot, the current state of development and future work.
△ Less
Submitted 12 January, 2025;
originally announced January 2025.
-
The CTSkills App -- Measuring Problem Decomposition Skills of Students in Computational Thinking
Authors:
Dorit Assaf,
Giorgia Adorni,
Elia Lutz,
Lucio Negrini,
Alberto Piatti,
Francesco Mondada,
Francesca Mangili,
Luca Maria Gambardella
Abstract:
This paper addresses the incorporation of problem decomposition skills as an important component of computational thinking (CT) in K-12 computer science (CS) education. Despite the growing integration of CS in schools, there is a lack of consensus on the precise definition of CT in general and decomposition in particular. While decomposition is commonly referred to as the starting point of (comput…
▽ More
This paper addresses the incorporation of problem decomposition skills as an important component of computational thinking (CT) in K-12 computer science (CS) education. Despite the growing integration of CS in schools, there is a lack of consensus on the precise definition of CT in general and decomposition in particular. While decomposition is commonly referred to as the starting point of (computational) problem-solving, algorithmic solution formulation often receives more attention in the classroom, while decomposition remains rather unexplored. This study presents "CTSKills", a web-based skill assessment tool developed to measure students' problem decomposition skills. With the data collected from 75 students in grades 4-9, this research aims to contribute to a baseline of students' decomposition proficiency in compulsory education. Furthermore, a thorough understanding of a given problem is becoming increasingly important with the advancement of generative artificial intelligence (AI) tools that can effectively support the process of formulating algorithms. This study highlights the importance of problem decomposition as a key skill in K-12 CS education to foster more adept problem solvers.
△ Less
Submitted 22 November, 2024;
originally announced November 2024.
-
FADE-CTP: A Framework for the Analysis and Design of Educational Computational Thinking Problems
Authors:
Giorgia Adorni,
Alberto Piatti,
Engin Bumbacher,
Lucio Negrini,
Francesco Mondada,
Dorit Assaf,
Francesca Mangili,
Luca Gambardella
Abstract:
In recent years, the emphasis on computational thinking (CT) has intensified as an effect of accelerated digitalisation. While most researchers are concentrating on defining CT and developing tools for its instruction and assessment, we focus on the characteristics of computational thinking problems (CTPs) - activities requiring CT to be solved - and how they influence the skills students can deve…
▽ More
In recent years, the emphasis on computational thinking (CT) has intensified as an effect of accelerated digitalisation. While most researchers are concentrating on defining CT and developing tools for its instruction and assessment, we focus on the characteristics of computational thinking problems (CTPs) - activities requiring CT to be solved - and how they influence the skills students can develop. In this paper, we present a comprehensive framework for systematically profiling CTPs by identifying specific components and characteristics, while establishing a link between these attributes and a structured catalogue of CT competencies. The purposes of this framework are (i) facilitating the analysis of existing CTPs to identify which abilities can be developed or measured based on their inherent characteristics, and (ii) guiding the design of new CTPs targeted at specific skills by outlining the necessary characteristics required for CT activation. To illustrate the framework functionalities, we begin by analysing prototypical activities in the literature, a process that leads to the definition of a taxonomy of CTPs across various domains, and we conclude with a case study on the design of a different version of one of these activities, the Cross Array Task (CAT), set in different cognitive environments. This approach allows an understanding of how CTPs in different contexts display unique and recurring characteristics that promote the development of distinct skills. In conclusion, this framework can inform the development of assessment tools, improve teacher training, and facilitate the analysis and comparison of existing CT activities, contributing to a deeper understanding of competency activation and guiding curriculum design in CT education.
△ Less
Submitted 19 March, 2025; v1 submitted 28 March, 2024;
originally announced March 2024.
-
Quantifying the biomimicry gap in biohybrid robot-fish pairs
Authors:
Vaios Papaspyros,
Guy Theraulaz,
Clément Sire,
Francesco Mondada
Abstract:
Biohybrid systems in which robotic lures interact with animals have become compelling tools for probing and identifying the mechanisms underlying collective animal behavior. One key challenge lies in the transfer of social interaction models from simulations to reality, using robotics to validate the modeling hypotheses. This challenge arises in bridging what we term the "biomimicry gap", which is…
▽ More
Biohybrid systems in which robotic lures interact with animals have become compelling tools for probing and identifying the mechanisms underlying collective animal behavior. One key challenge lies in the transfer of social interaction models from simulations to reality, using robotics to validate the modeling hypotheses. This challenge arises in bridging what we term the "biomimicry gap", which is caused by imperfect robotic replicas, communication cues and physics constraints not incorporated in the simulations, that may elicit unrealistic behavioral responses in animals. In this work, we used a biomimetic lure of a rummy-nose tetra fish (Hemigrammus rhodostomus) and a neural network (NN) model for generating biomimetic social interactions. Through experiments with a biohybrid pair comprising a fish and the robotic lure, a pair of real fish, and simulations of pairs of fish, we demonstrate that our biohybrid system generates social interactions mirroring those of genuine fish pairs. Our analyses highlight that: 1) the lure and NN maintain minimal deviation in real-world interactions compared to simulations and fish-only experiments, 2) our NN controls the robot efficiently in real-time, and 3) a comprehensive validation is crucial to bridge the biomimicry gap, ensuring realistic biohybrid systems.
△ Less
Submitted 17 March, 2024; v1 submitted 17 August, 2023;
originally announced August 2023.
-
An Adapted Cascade Model to Scale Primary School Digital Education Curricular Reforms and Teacher Professional Development Programs
Authors:
Laila El-Hamamsy,
Emilie-Charlotte Monnier,
Sunny Avry,
Frédérique Chessel-Lazzarotto,
Grégory Liégeois,
Barbara Bruno,
Jessica Dehler Zufferey,
Francesco Mondada
Abstract:
Many countries struggle to effectively introduce Digital Education (DE) to all K-12 students as they lack adequately trained teachers. While cascade models of in-service teacher-professional development (PD) can rapidly deploy PD-programs through multiple levels of trainers to reach all teachers, they suffer from many limitations and are often ineffective. We therefore propose an adapted cascade m…
▽ More
Many countries struggle to effectively introduce Digital Education (DE) to all K-12 students as they lack adequately trained teachers. While cascade models of in-service teacher-professional development (PD) can rapidly deploy PD-programs through multiple levels of trainers to reach all teachers, they suffer from many limitations and are often ineffective. We therefore propose an adapted cascade model to deploy a primary school DE teacher-PD program throughout an administrative region. The model relies on teacher-trainers who (i) are active teachers in the region, (ii) have a prolonged trainer-PD with experts who piloted the teacher-PD program to acquire adult-trainer and DE-related competences, and (iii) are supported by the experts throughout the deployment. To validate the deployment model we used data from 14 teacher-trainers, the 700 teachers they trained, and 350 teachers trained by experts. The teacher-trainer findings demonstrate that the adapted cascade model effectively addresses most cascade models' limitations. The teacher-related findings further validate the adapted cascade model in terms of perception, motivation and adoption which are at least equivalent to those obtained with the experts. To conclude, the adapted cascade model is an effective means of spreading primary school DE PD-programs at a large scale and can be used in other DE reforms.
△ Less
Submitted 5 June, 2023;
originally announced June 2023.
-
How are Primary School Computer Science Curricular Reforms Contributing to Equity? Impact on Student Learning, Perception of the Discipline, and Gender Gaps
Authors:
Laila El-Hamamsy,
Barbara Bruno,
Catherine Audrin,
Morgane Chevalier,
Sunny Avry,
Jessica Dehler Zufferey,
Francesco Mondada
Abstract:
Early exposure to Computer Science (CS) for all is critical to broaden participation and promote equity in the field. But how does introducting CS into primary school curricula impact learning, perception, and gaps between groups of students? We investigate a CS-curricular reform and teacher Professional Development (PD) program from an equity standpoint by applying hierarchical regression and str…
▽ More
Early exposure to Computer Science (CS) for all is critical to broaden participation and promote equity in the field. But how does introducting CS into primary school curricula impact learning, perception, and gaps between groups of students? We investigate a CS-curricular reform and teacher Professional Development (PD) program from an equity standpoint by applying hierarchical regression and structural equation modelling on student learning and perception data from three studies with respectively 1384, 2433 & 1644 grade 3-6 students (ages 7-11) and their 83, 142 & 95 teachers. Regarding learning, exposure to CS instruction appears to contribute to closing the performance gap between low-achieving and high-achieving students, as well as pre-existing gender gaps. Despite a lack of direct influence of what was taught on student learning, there is no impact of teachers' demographics or motivation on student learning, with teachers' perception of the CS-PD positively influencing learning. Regarding perception, students perceive CS and its teaching tools (robotics, tablets) positively, and even more so when they perceive a role model close to them as doing CS. Nonetheless gender differences exist all around with boys perceiving CS more positively than girls despite access to CS education. However, access to CS-education affects boys and girls differently: larger gender gaps are closing (namely those related to robotics), while smaller gaps are increasing (namely those related to CS and tablets). To conclude, our findings highlight how a CS curricular reform impacts learning, perception, and equity and supports the importance of i) early introductions to CS for all, ii) preparing teachers to teach CS all the while removing the influence of teacher demographics and motivation on student outcomes, and iii) having developmentally appropriate activities that signal to all groups of students.
△ Less
Submitted 1 June, 2023;
originally announced June 2023.
-
The competent Computational Thinking test (cCTt): a valid, reliable and gender-fair test for longitudinal CT studies in grades 3-6
Authors:
Laila El-Hamamsy,
María Zapata-Cáceres,
Estefanía Martín-Barroso,
Francesco Mondada,
Jessica Dehler Zufferey,
Barbara Bruno,
Marcos Román-González
Abstract:
The introduction of computing education into curricula worldwide requires multi-year assessments to evaluate the long-term impact on learning. However, no single Computational Thinking (CT) assessment spans primary school, and no group of CT assessments provides a means of transitioning between instruments. This study therefore investigated whether the competent CT test (cCTt) could evaluate learn…
▽ More
The introduction of computing education into curricula worldwide requires multi-year assessments to evaluate the long-term impact on learning. However, no single Computational Thinking (CT) assessment spans primary school, and no group of CT assessments provides a means of transitioning between instruments. This study therefore investigated whether the competent CT test (cCTt) could evaluate learning reliably from grades 3 to 6 (ages 7-11) using data from 2709 students. The psychometric analysis employed Classical Test Theory, Item Response Theory, Measurement Invariance analyses which include Differential Item Functioning, normalised z-scoring, and PISA's methodology to establish proficiency levels. The findings indicate that the cCTt is valid, reliable and gender-fair for grades 3-6, although more complex items would be beneficial for grades 5-6. Grade-specific proficiency levels are provided to help tailor interventions, with a normalised scoring system to compare students across and between grades, and help establish transitions between instruments. To improve the utility of CT assessments among researchers, educators and practitioners, the findings emphasise the importance of i) developing and validating gender-fair, grade-specific, instruments aligned with students' cognitive maturation, and providing ii) proficiency levels, and iii) equivalency scales to transition between assessments. To conclude, the study provides insight into the design of longitudinal developmentally appropriate assessments and interventions.
△ Less
Submitted 5 August, 2024; v1 submitted 30 May, 2023;
originally announced May 2023.
-
Predicting the long-term collective behaviour of fish pairs with deep learning
Authors:
Vaios Papaspyros,
Ramón Escobedo,
Alexandre Alahi,
Guy Theraulaz,
Clément Sire,
Francesco Mondada
Abstract:
Modern computing has enhanced our understanding of how social interactions shape collective behaviour in animal societies. Although analytical models dominate in studying collective behaviour, this study introduces a deep learning model to assess social interactions in the fish species Hemigrammus rhodostomus. We compare the results of our deep learning approach to experiments and to the results o…
▽ More
Modern computing has enhanced our understanding of how social interactions shape collective behaviour in animal societies. Although analytical models dominate in studying collective behaviour, this study introduces a deep learning model to assess social interactions in the fish species Hemigrammus rhodostomus. We compare the results of our deep learning approach to experiments and to the results of a state-of-the-art analytical model. To that end, we propose a systematic methodology to assess the faithfulness of a collective motion model, exploiting a set of stringent individual and collective spatio-temporal observables. We demonstrate that machine learning models of social interactions can directly compete with their analytical counterparts in reproducing subtle experimental observables. Moreover, this work emphasises the need for consistent validation across different timescales, and identifies key design aspects that enable our deep learning approach to capture both short- and long-term dynamics. We also show that our approach can be extended to larger groups without any retraining, and to other fish species, while retaining the same architecture of the deep learning network. Finally, we discuss the added value of machine learning in the context of the study of collective motion in animal groups and its potential as a complementary approach to analytical models.
△ Less
Submitted 17 March, 2024; v1 submitted 14 February, 2023;
originally announced February 2023.
-
The competent Computational Thinking test (cCTt): Development and validation of an unplugged Computational Thinking test for upper primary school
Authors:
Laila El-Hamamsy,
María Zapata-Cáceres,
Estefanía Martín Barroso,
Francesco Mondada,
Jessica Dehler Zufferey,
Barbara Bruno
Abstract:
With the increasing importance of Computational Thinking (CT) at all levels of education, it is essential to have valid and reliable assessments. Currently, there is a lack of such assessments in upper primary school. That is why we present the development and validation of the competent CT test (cCTt), an unplugged CT test targeting 7-9 year-old students. In the first phase, 37 experts evaluated…
▽ More
With the increasing importance of Computational Thinking (CT) at all levels of education, it is essential to have valid and reliable assessments. Currently, there is a lack of such assessments in upper primary school. That is why we present the development and validation of the competent CT test (cCTt), an unplugged CT test targeting 7-9 year-old students. In the first phase, 37 experts evaluated the validity of the cCTt through a survey and focus group. In the second phase, the test was administered to 1519 students. We employed Classical Test Theory, Item Response Theory, and Confirmatory Factor Analysis to assess the instruments' psychometric properties. The expert evaluation indicates that the cCTt shows good face, construct, and content validity. Furthermore, the psychometric analysis of the student data demonstrates adequate reliability, difficulty, and discriminability for the target age groups. Finally, shortened variants of the test are established through Confirmatory Factor Analysis. To conclude, the proposed cCTt is a valid and reliable instrument, for use by researchers and educators alike, which expands the portfolio of validated CT assessments across compulsory education. Future assessments looking at capturing CT in a more exhaustive manner might consider combining the cCTt with other forms of assessments.
△ Less
Submitted 4 May, 2022; v1 submitted 11 March, 2022;
originally announced March 2022.
-
Investigating the role of educational robotics in formal mathematics education: the case of geometry for 15-year-old students
Authors:
Jérôme Brender,
Laila El-Hamamsy,
Barbara Bruno,
Frédérique Chessel-Lazzarotto,
Jessica Dehler Zufferey,
Francesco Mondada
Abstract:
Research has shown that Educational Robotics (ER) enhances student performance, interest, engagement and collaboration. However, until now, the adoption of robotics in formal education has remained relatively scarce. Among other causes, this is due to the difficulty of determining the alignment of educational robotic learning activities with the learning outcomes envisioned by the curriculum, as w…
▽ More
Research has shown that Educational Robotics (ER) enhances student performance, interest, engagement and collaboration. However, until now, the adoption of robotics in formal education has remained relatively scarce. Among other causes, this is due to the difficulty of determining the alignment of educational robotic learning activities with the learning outcomes envisioned by the curriculum, as well as their integration with traditional, non-robotics learning activities that are well established in teachers' practices. This work investigates the integration of ER into formal mathematics education, through a quasi-experimental study employing the Thymio robot and Scratch programming to teach geometry to two classes of 15-year-old students, for a total of 26 participants. Three research questions were addressed: (1) Should an ER-based theoretical lecture precede, succeed or replace a traditional theoretical lecture? (2) What is the students' perception of and engagement in the ER-based lecture and exercises? (3) Do the findings differ according to students' prior appreciation of mathematics? The results suggest that ER activities are as valid as traditional ones in helping students grasp the relevant theoretical concepts. Robotics activities seem particularly beneficial during exercise sessions: students freely chose to do exercises that included the robot, rated them as significantly more interesting and useful than their traditional counterparts, and expressed their interest in introducing ER in other mathematics lectures. Finally, results were generally consistent between the students that like and did not like mathematics, suggesting the use of robotics as a means to broaden the number of students engaged in the discipline.
△ Less
Submitted 21 June, 2021;
originally announced June 2021.
-
Teachers' perspective on fostering computational thinking through educational robotics
Authors:
Morgane Chevalier,
Laila El-Hamamsy,
Christian Giang,
Barbara Bruno,
Francesco Mondada
Abstract:
With the introduction of educational robotics (ER) and computational thinking (CT) in classrooms, there is a rising need for operational models that help ensure that CT skills are adequately developed. One such model is the Creative Computational Problem Solving Model (CCPS) which can be employed to improve the design of ER learning activities. Following the first validation with students, the obj…
▽ More
With the introduction of educational robotics (ER) and computational thinking (CT) in classrooms, there is a rising need for operational models that help ensure that CT skills are adequately developed. One such model is the Creative Computational Problem Solving Model (CCPS) which can be employed to improve the design of ER learning activities. Following the first validation with students, the objective of the present study is to validate the model with teachers, specifically considering how they may employ the model in their own practices. The Utility, Usability and Acceptability framework was leveraged for the evaluation through a survey analysis with 334 teachers. Teachers found the CCPS model useful to foster transversal skills but could not recognise the impact of specific intervention methods on CT-related cognitive processes. Similarly, teachers perceived the model to be usable for activity design and intervention, although felt unsure about how to use it to assess student learning and adapt their teaching accordingly. Finally, the teachers accepted the model, as shown by their intent to replicate the activity in their classrooms, but were less willing to modify it or create their own activities, suggesting that they need time to appropriate the model and underlying tenets.
△ Less
Submitted 3 July, 2021; v1 submitted 11 May, 2021;
originally announced May 2021.
-
Exploring a Handwriting Programming Language for Educational Robots
Authors:
Laila El-Hamamsy,
Vaios Papaspyros,
Taavet Kangur,
Laura Mathex,
Christian Giang,
Melissa Skweres,
Barbara Bruno,
Francesco Mondada
Abstract:
Recently, introducing computer science and educational robots in compulsory education has received increasing attention. However, the use of screens in classrooms is often met with resistance, especially in primary school. To address this issue, this study presents the development of a handwriting-based programming language for educational robots. Aiming to align better with existing classroom pra…
▽ More
Recently, introducing computer science and educational robots in compulsory education has received increasing attention. However, the use of screens in classrooms is often met with resistance, especially in primary school. To address this issue, this study presents the development of a handwriting-based programming language for educational robots. Aiming to align better with existing classroom practices, it allows students to program a robot by drawing symbols with ordinary pens and paper. Regular smartphones are leveraged to process the hand-drawn instructions using computer vision and machine learning algorithms, and send the commands to the robot for execution. To align with the local computer science curriculum, an appropriate playground and scaffolded learning tasks were designed. The system was evaluated in a preliminary test with eight teachers, developers and educational researchers. While the participants pointed out that some technical aspects could be improved, they also acknowledged the potential of the approach to make computer science education in primary school more accessible.
△ Less
Submitted 3 July, 2021; v1 submitted 11 May, 2021;
originally announced May 2021.
-
How to Blend a Robot within a Group of Zebrafish: Achieving Social Acceptance through Real-time Calibration of a Multi-level Behavioural Model
Authors:
Leo Cazenille,
Yohann Chemtob,
Frank Bonnet,
Alexey Gribovskiy,
Francesco Mondada,
Nicolas Bredeche,
Jose Halloy
Abstract:
We have previously shown how to socially integrate a fish robot into a group of zebrafish thanks to biomimetic behavioural models. The models have to be calibrated on experimental data to present correct behavioural features. This calibration is essential to enhance the social integration of the robot into the group. When calibrated, the behavioural model of fish behaviour is implemented to drive…
▽ More
We have previously shown how to socially integrate a fish robot into a group of zebrafish thanks to biomimetic behavioural models. The models have to be calibrated on experimental data to present correct behavioural features. This calibration is essential to enhance the social integration of the robot into the group. When calibrated, the behavioural model of fish behaviour is implemented to drive a robot with closed-loop control of social interactions into a group of zebrafish. This approach can be useful to form mixed-groups, and study animal individual and collective behaviour by using biomimetic autonomous robots capable of responding to the animals in long-standing experiments. Here, we show a methodology for continuous real-time calibration and refinement of multi-level behavioural model. The real-time calibration, by an evolutionary algorithm, is based on simulation of the model to correspond to the observed fish behaviour in real-time. The calibrated model is updated on the robot and tested during the experiments. This method allows to cope with changes of dynamics in fish behaviour. Moreover, each fish presents individual behavioural differences. Thus, each trial is done with naive fish groups that display behavioural variability. This real-time calibration methodology can optimise the robot behaviours during the experiments. Our implementation of this methodology runs on three different computers that perform individual tracking, data-analysis, multi-objective evolutionary algorithms, simulation of the fish robot and adaptation of the robot behavioural models, all in real-time.
△ Less
Submitted 29 May, 2018;
originally announced May 2018.
-
Automated Analysis of Behavioural Variability and Filial Imprinting of Chicks (G. gallus), using Autonomous Robots
Authors:
A. Gribovskiy,
F. Mondada,
J. L. Deneubourg,
L. Cazenille,
N. Bredeche,
J. Halloy
Abstract:
Inter-individual variability has various impacts in animal social behaviour. This implies that not only collective behaviours have to be studied but also the behavioural variability of each member composing the groups. To understand those effects on group behaviour, we develop a quantitative methodology based on automated ethograms and autonomous robots to study the inter-individual variability am…
▽ More
Inter-individual variability has various impacts in animal social behaviour. This implies that not only collective behaviours have to be studied but also the behavioural variability of each member composing the groups. To understand those effects on group behaviour, we develop a quantitative methodology based on automated ethograms and autonomous robots to study the inter-individual variability among social animals. We choose chicks of \textit{Gallus gallus domesticus} as a classic social animal model system for their suitability in laboratory and controlled experimentation. Moreover, even domesticated chicken present social structures implying forms or leadership and filial imprinting. We develop an imprinting methodology on autonomous robots to study individual and social behaviour of free moving animals. This allows to quantify the behaviours of large number of animals. We develop an automated experimental methodology that allows to make relatively fast controlled experiments and efficient data analysis. Our analysis are based on high-throughput data allowing a fine quantification of individual behavioural traits. We quantify the efficiency of various state-of-the-art algorithms to automate data analysis and produce automated ethograms. We show that the use of robots allows to provide controlled and quantified stimuli to the animals in absence of human intervention. We quantify the individual behaviour of 205 chicks obtained from hatching after synchronized fecundation. Our results show a high variability of individual behaviours and of imprinting quality and success. Three classes of chicks are observed with various level of imprinting. Our study shows that the concomitant use of autonomous robots and automated ethograms allows detailed and quantitative analysis of behavioural patterns of animals in controlled laboratory experiments.
△ Less
Submitted 7 September, 2015;
originally announced September 2015.