-
Real-Time Indoor Object Detection based on hybrid CNN-Transformer Approach
Authors:
Salah Eddine Laidoudi,
Madjid Maidi,
Samir Otmane
Abstract:
Real-time object detection in indoor settings is a challenging area of computer vision, faced with unique obstacles such as variable lighting and complex backgrounds. This field holds significant potential to revolutionize applications like augmented and mixed realities by enabling more seamless interactions between digital content and the physical world. However, the scarcity of research specific…
▽ More
Real-time object detection in indoor settings is a challenging area of computer vision, faced with unique obstacles such as variable lighting and complex backgrounds. This field holds significant potential to revolutionize applications like augmented and mixed realities by enabling more seamless interactions between digital content and the physical world. However, the scarcity of research specifically fitted to the intricacies of indoor environments has highlighted a clear gap in the literature. To address this, our study delves into the evaluation of existing datasets and computational models, leading to the creation of a refined dataset. This new dataset is derived from OpenImages v7, focusing exclusively on 32 indoor categories selected for their relevance to real-world applications. Alongside this, we present an adaptation of a CNN detection model, incorporating an attention mechanism to enhance the model's ability to discern and prioritize critical features within cluttered indoor scenes. Our findings demonstrate that this approach is not just competitive with existing state-of-the-art models in accuracy and speed but also opens new avenues for research and application in the field of real-time indoor object detection.
△ Less
Submitted 3 September, 2024;
originally announced September 2024.
-
Low-cost VR Collaborative System equipped with Haptic Feedback
Authors:
Samir Benbelkacem,
Abdelkader Bellarbi,
Nadia Zenati-Henda,
Ahmed Bentaleb,
Ahmed Bellabaci,
Samir Otmane
Abstract:
In this paper, we present a low-cost virtual reality (VR) collaborative system equipped with a haptic feedback sensation system. This system is composed of a Kinect sensor for bodies and gestures detection, a microcontroller and vibrators to simulate outside interactions, and smartphone powered cardboard, all of this are put into a network implemented with Unity 3D game engine. CCS CONCEPTS…
▽ More
In this paper, we present a low-cost virtual reality (VR) collaborative system equipped with a haptic feedback sensation system. This system is composed of a Kinect sensor for bodies and gestures detection, a microcontroller and vibrators to simulate outside interactions, and smartphone powered cardboard, all of this are put into a network implemented with Unity 3D game engine. CCS CONCEPTS $\bullet$ Interaction paradigms $\rightarrow$ Virtual reality; Collaborative interaction; $\bullet$ Hardware $\rightarrow$ Sensors and actuators; Wireless devices; KEYWORDS collaborative virtual reality, haptic feedback system.
△ Less
Submitted 1 March, 2019;
originally announced March 2019.
-
MVC-3D: Adaptive Design Pattern for Virtual and Augmented Reality Systems
Authors:
Samir Benbelkacem,
Djamel Aouam,
Nadia Zenati-Henda,
Abdelkader Bellarbi,
Ahmed Bouhena,
Samir Otmane
Abstract:
In this paper, we present MVC-3D design pattern to develop virtual and augmented (or mixed) reality interfaces that use new types of sensors, modalities and implement specific algorithms and simulation models. The proposed pattern represents the extension of classic MVC pattern by enriching the View component (interactive View) and adding a specific component (Library). The results obtained on the…
▽ More
In this paper, we present MVC-3D design pattern to develop virtual and augmented (or mixed) reality interfaces that use new types of sensors, modalities and implement specific algorithms and simulation models. The proposed pattern represents the extension of classic MVC pattern by enriching the View component (interactive View) and adding a specific component (Library). The results obtained on the development of augmented reality interfaces showed that the complexity of M, iV and C components is reduced. The complexity increases only on the Library component (L). This helps the programmers to well structure their models even if the interface complexity increases. The proposed design pattern is also used in a design process called MVC-3D in the loop that enables a seamless evolution from initial prototype to the final system.
△ Less
Submitted 1 March, 2019;
originally announced March 2019.
-
Vision-based Pose Estimation for Augmented Reality : A Comparison Study
Authors:
Hayet Belghit,
Abdelkader Bellarbi,
Nadia Zenati,
Samir Otmane
Abstract:
Augmented reality aims to enrich our real world by inserting 3D virtual objects. In order to accomplish this goal, it is important that virtual elements are rendered and aligned in the real scene in an accurate and visually acceptable way. The solution of this problem can be related to a pose estimation and 3D camera localization. This paper presents a survey on different approaches of 3D pose est…
▽ More
Augmented reality aims to enrich our real world by inserting 3D virtual objects. In order to accomplish this goal, it is important that virtual elements are rendered and aligned in the real scene in an accurate and visually acceptable way. The solution of this problem can be related to a pose estimation and 3D camera localization. This paper presents a survey on different approaches of 3D pose estimation in augmented reality and gives classification of key-points-based techniques. The study given in this paper may help both developers and researchers in the field of augmented reality.
△ Less
Submitted 25 June, 2018;
originally announced June 2018.
-
A Distributed Software Architecture for Collaborative Teleoperation based on a VR Platform and Web Application Interoperability
Authors:
Christophe Domingues,
Samir Otmane,
Frédéric Davesne,
Malik Mallem
Abstract:
Augmented Reality and Virtual Reality can provide to a Human Operator (HO) a real help to complete complex tasks, such as robot teleoperation and cooperative teleassistance. Using appropriate augmentations, the HO can interact faster, safer and easier with the remote real world. In this paper, we present an extension of an existing distributed software and network architecture for collaborative…
▽ More
Augmented Reality and Virtual Reality can provide to a Human Operator (HO) a real help to complete complex tasks, such as robot teleoperation and cooperative teleassistance. Using appropriate augmentations, the HO can interact faster, safer and easier with the remote real world. In this paper, we present an extension of an existing distributed software and network architecture for collaborative teleoperation based on networked human-scaled mixed reality and mobile platform. The first teleoperation system was composed by a VR application and a Web application. However the 2 systems cannot be used together and it is impossible to control a distant robot simultaneously. Our goal is to update the teleoperation system to permit a heterogeneous collaborative teleoperation between the 2 platforms. An important feature of this interface is based on different Mobile platforms to control one or many robots.
△ Less
Submitted 14 April, 2009;
originally announced April 2009.
