-
Using Vision Language Models for Safety Hazard Identification in Construction
Authors:
Muhammad Adil,
Gaang Lee,
Vicente A. Gonzalez,
Qipei Mei
Abstract:
Safety hazard identification and prevention are the key elements of proactive safety management. Previous research has extensively explored the applications of computer vision to automatically identify hazards from image clips collected from construction sites. However, these methods struggle to identify context-specific hazards, as they focus on detecting predefined individual entities without un…
▽ More
Safety hazard identification and prevention are the key elements of proactive safety management. Previous research has extensively explored the applications of computer vision to automatically identify hazards from image clips collected from construction sites. However, these methods struggle to identify context-specific hazards, as they focus on detecting predefined individual entities without understanding their spatial relationships and interactions. Furthermore, their limited adaptability to varying construction site guidelines and conditions hinders their generalization across different projects. These limitations reduce their ability to assess hazards in complex construction environments and adaptability to unseen risks, leading to potential safety gaps. To address these challenges, we proposed and experimentally validated a Vision Language Model (VLM)-based framework for the identification of construction hazards. The framework incorporates a prompt engineering module that structures safety guidelines into contextual queries, allowing VLM to process visual information and generate hazard assessments aligned with the regulation guide. Within this framework, we evaluated state-of-the-art VLMs, including GPT-4o, Gemini, Llama 3.2, and InternVL2, using a custom dataset of 1100 construction site images. Experimental results show that GPT-4o and Gemini 1.5 Pro outperformed alternatives and displayed promising BERTScore of 0.906 and 0.888 respectively, highlighting their ability to identify both general and context-specific hazards. However, processing times remain a significant challenge, impacting real-time feasibility. These findings offer insights into the practical deployment of VLMs for construction site hazard detection, thereby contributing to the enhancement of proactive safety management.
△ Less
Submitted 12 April, 2025;
originally announced April 2025.
-
Understanding and Assessment of Mission-Centric Key Cyber Terrains for joint Military Operations
Authors:
Álvaro Luis Martínez,
Jorge Maestre Vidal,
Victor A. Villagrá González
Abstract:
Since the cyberspace consolidated as fifth warfare dimension, the different actors of the defense sector began an arms race toward achieving cyber superiority, on which research, academic and industrial stakeholders contribute from a dual vision, mostly linked to a large and heterogeneous heritage of developments and adoption of civilian cybersecurity capabilities. In this context, augmenting the…
▽ More
Since the cyberspace consolidated as fifth warfare dimension, the different actors of the defense sector began an arms race toward achieving cyber superiority, on which research, academic and industrial stakeholders contribute from a dual vision, mostly linked to a large and heterogeneous heritage of developments and adoption of civilian cybersecurity capabilities. In this context, augmenting the conscious of the context and warfare environment, risks and impacts of cyber threats on kinetic actuations became a critical rule-changer that military decision-makers are considering. A major challenge on acquiring mission-centric Cyber Situational Awareness (CSA) is the dynamic inference and assessment of the vertical propagations from situations that occurred at the mission supportive Information and Communications Technologies (ICT), up to their relevance at military tactical, operational and strategical views. In order to contribute on acquiring CSA, this paper addresses a major gap in the cyber defence state-of-the-art: the dynamic identification of Key Cyber Terrains (KCT) on a mission-centric context. Accordingly, the proposed KCT identification approach explores the dependency degrees among tasks and assets defined by commanders as part of the assessment criteria. These are correlated with the discoveries on the operational network and the asset vulnerabilities identified thorough the supported mission development. The proposal is presented as a reference model that reveals key aspects for mission-centric KCT analysis and supports its enforcement and further enforcement by including an illustrative application case.
△ Less
Submitted 12 November, 2021;
originally announced November 2021.
-
Non-linearity identification for construction workers' personality-safety behaviour predictive relationship using neural network and linear regression modelling
Authors:
Yifan Gao,
Vicente A. Gonzalez,
Tak Wing Yiu,
Guillermo Cabrera-Guerrerod
Abstract:
The prediction of workers' safety behaviour can help identify vulnerable workers who intend to undertake unsafe behaviours and be useful in the design of management practices to minimise the occurrence of accidents. The latest literature has evidenced that there is within-population diversity that leads people's intended safety behaviours in the workplace, which are found to vary among individuals…
▽ More
The prediction of workers' safety behaviour can help identify vulnerable workers who intend to undertake unsafe behaviours and be useful in the design of management practices to minimise the occurrence of accidents. The latest literature has evidenced that there is within-population diversity that leads people's intended safety behaviours in the workplace, which are found to vary among individuals as a function of their personality traits. In this study, an innovative forecasting model, which employs neural network algorithms, is developed to numerically simulate the predictive relationship between construction workers' personality traits and their intended safety behaviour. The data-driven nature of neural network enabled a reliable estimate of the relationship, which allowed this research to find that a nonlinear effect exists in the relationship. This research has practical implications. The neural network developed is shown to have highly satisfactory prediction accuracy and is thereby potentially useful for assisting project decision-makers to assess how prone workers are to carry out unsafe behaviours in the workplace.
△ Less
Submitted 26 August, 2020; v1 submitted 11 December, 2019;
originally announced December 2019.
-
An Immersive Virtual Reality Serious Game to Enhance Earthquake Behavioral Responses and Post-earthquake Evacuation Preparedness in Buildings
Authors:
Zhenan Feng,
Vicente A. González,
Robert Amor,
Michael Spearpoint,
Jared Thomas,
Rafael Sacks,
Ruggiero Lovreglio,
Guillermo Cabrera-Guerrero
Abstract:
Enhancing the earthquake behavioral responses and post-earthquake evacuation preparedness of building occupants is beneficial to increasing their chances of survival and reducing casualties after the main shock of an earthquake. Traditionally, training approaches such as seminars, posters, videos or drills are applied to enhance preparedness. However, they are not highly engaging and have limited…
▽ More
Enhancing the earthquake behavioral responses and post-earthquake evacuation preparedness of building occupants is beneficial to increasing their chances of survival and reducing casualties after the main shock of an earthquake. Traditionally, training approaches such as seminars, posters, videos or drills are applied to enhance preparedness. However, they are not highly engaging and have limited sensory capabilities to mimic life-threatening scenarios for the purpose of training potential participants. Immersive Virtual Reality (IVR) and Serious Games (SG) as innovative digital technologies can be used to create training tools to overcome these limitations. In this study, we propose an IVR SG-based training system to improve earthquake behavioral responses and post-earthquake evacuation preparedness. Auckland City Hospital was chosen as a case study to test our IVR SG training system. A set of learning outcomes based on best evacuation practice has been identified and embedded into several training scenarios of the IVR SG. Hospital staff (healthcare and administrative professionals) and visitors were recruited as participants to be exposed to these training scenarios. Participants' preparedness has been measured along two dimensions: 1) Knowledge about best evacuation practice; 2) Self-efficacy in dealing with earthquake emergencies. Assessment results showed that there was a significant knowledge and self-efficacy increase after the training. And participants acknowledged that it was easy and engaging to learn best evacuation practice knowledge through the IVR SG training system.
△ Less
Submitted 27 May, 2019;
originally announced May 2019.
-
Rapid 3D Reconstruction of Indoor Environments to Generate Virtual Reality Serious Games Scenarios
Authors:
Zhenan Feng,
Vicente A. González,
Ling Ma,
Mustafa M. A. Al-Adhami,
Claudio Mourgues
Abstract:
Virtual Reality (VR) for Serious Games (SGs) is attracting increasing attention for training applications due to its potential to provide significantly enhanced learning to users. Some examples of the application of VR for SGs are complex training evacuation problems such as indoor earthquake evacuation or fire evacuation. The indoor 3D geometry of existing buildings can largely influence evacuees…
▽ More
Virtual Reality (VR) for Serious Games (SGs) is attracting increasing attention for training applications due to its potential to provide significantly enhanced learning to users. Some examples of the application of VR for SGs are complex training evacuation problems such as indoor earthquake evacuation or fire evacuation. The indoor 3D geometry of existing buildings can largely influence evacuees' behaviour, being instrumental in the design of VR SGs storylines and simulation scenarios. The VR scenarios of existing buildings can be generated from drawings and models. However, these data may not reflect the 'as-is' state of the indoor environment and may not be suitable to reflect dynamic changes of the system (e.g. Earthquakes), resulting in excessive development efforts to design credible and meaningful user experience. This paper explores several workflows for the rapid and effective reconstruction of 3D indoor environments of existing buildings that are suitable for earthquake simulations. These workflows start from Building Information Modelling (BIM), laser scanning and 360-degree panoramas. We evaluated the feasibility and efficiency of different approaches by using an earthquake-based case study developed for VR SGs.
△ Less
Submitted 4 December, 2018;
originally announced December 2018.
-
Immersive Virtual Reality Serious Games for Evacuation Training and Research: A Systematic Literature Review
Authors:
Zhenan Feng,
Vicente A. González,
Robert Amor,
Ruggiero Lovreglio,
Guillermo Cabrera
Abstract:
An appropriate and safe behavior for exiting a facility is key to reducing injuries and increasing survival when facing an emergency evacuation in a building. Knowledge on the best evacuation practice is commonly delivered by traditional training approaches such as videos, posters, or evacuation drills, but they may become ineffective in terms of knowledge acquisition and retention. Serious games…
▽ More
An appropriate and safe behavior for exiting a facility is key to reducing injuries and increasing survival when facing an emergency evacuation in a building. Knowledge on the best evacuation practice is commonly delivered by traditional training approaches such as videos, posters, or evacuation drills, but they may become ineffective in terms of knowledge acquisition and retention. Serious games (SGs) are an innovative approach devoted to training and educating people in a gaming environment. Recently, increasing attention has been paid to immersive virtual reality (IVR)-based SGs for evacuation knowledge delivery and behavior assessment because they are highly engaging and promote greater cognitive learning.
This paper aims to understand the development and implementation of IVR SGs in the context of building evacuation training and research, applied to various indoor emergencies such as fire and earthquake. Thus, a conceptual framework for effective design and implementation through the systematic literature review method was developed. As a result, this framework integrates critical aspects and provides connections between them, including pedagogical and behavioral impacts, gaming environment development, and outcome and participation experience measures.
△ Less
Submitted 13 September, 2018; v1 submitted 14 May, 2018;
originally announced May 2018.
