Skip to main content

Showing 1–22 of 22 results for author: Mercelis, S

Searching in archive cs. Search in all archives.
.
  1. arXiv:2505.03776  [pdf

    cs.LG

    PAPN: Proximity Attention Encoder and Pointer Network Decoder for Parcel Pickup Route Prediction

    Authors: Hansi Denis, Siegfried Mercelis, Ngoc-Quang Luong

    Abstract: Optimization of the last-mile delivery and first-mile pickup of parcels is an integral part of the broader logistics optimization pipeline as it entails both cost and resource efficiency as well as a heightened service quality. Such optimization requires accurate route and time prediction systems to adapt to different scenarios in advance. This work tackles the first building block, namely route p… ▽ More

    Submitted 30 April, 2025; originally announced May 2025.

    Comments: 9 pages, 2 figures, 2 tables

    ACM Class: I.2.8; F.2.2

  2. arXiv:2412.01461  [pdf, other

    cs.CV

    A comprehensive review of datasets and deep learning techniques for vision in Unmanned Surface Vehicles

    Authors: Linh Trinh, Siegfried Mercelis, Ali Anwar

    Abstract: Unmanned Surface Vehicles (USVs) have emerged as a major platform in maritime operations, capable of supporting a wide range of applications. USVs can help reduce labor costs, increase safety, save energy, and allow for difficult unmanned tasks in harsh maritime environments. With the rapid development of USVs, many vision tasks such as detection and segmentation become increasingly important. Dat… ▽ More

    Submitted 2 December, 2024; originally announced December 2024.

  3. arXiv:2412.01420  [pdf, other

    cs.LG

    Task Adaptation of Reinforcement Learning-based NAS Agents through Transfer Learning

    Authors: Amber Cassimon, Siegfried Mercelis, Kevin Mets

    Abstract: Recently, a novel paradigm has been proposed for reinforcement learning-based NAS agents, that revolves around the incremental improvement of a given architecture. We assess the abilities of such reinforcement learning agents to transfer between different tasks. We perform our evaluation using the Trans-NASBench-101 benchmark, and consider the efficacy of the transferred agents, as well as how qui… ▽ More

    Submitted 19 December, 2024; v1 submitted 2 December, 2024; originally announced December 2024.

    Comments: 15 Pages, 13 Figures, Corrected data in Figure 5

  4. arXiv:2411.04915  [pdf, other

    cs.LG cs.AI

    Evaluating Robustness of Reinforcement Learning Algorithms for Autonomous Shipping

    Authors: Bavo Lesy, Ali Anwar, Siegfried Mercelis

    Abstract: Recently, there has been growing interest in autonomous shipping due to its potential to improve maritime efficiency and safety. The use of advanced technologies, such as artificial intelligence, can address the current navigational and operational challenges in autonomous shipping. In particular, inland waterway transport (IWT) presents a unique set of challenges, such as crowded waterways and va… ▽ More

    Submitted 7 November, 2024; originally announced November 2024.

    Comments: 5 pages, 4 figures. Will be presented at IEEE RAAI 2024

  5. arXiv:2410.05425  [pdf, other

    cs.LG

    Designing a Classifier for Active Fire Detection from Multispectral Satellite Imagery Using Neural Architecture Search

    Authors: Amber Cassimon, Phil Reiter, Siegfried Mercelis, Kevin Mets

    Abstract: This paper showcases the use of a reinforcement learning-based Neural Architecture Search (NAS) agent to design a small neural network to perform active fire detection on multispectral satellite imagery. Specifically, we aim to design a neural network that can determine if a single multispectral pixel is a part of a fire, and do so within the constraints of a Low Earth Orbit (LEO) nanosatellite wi… ▽ More

    Submitted 11 October, 2024; v1 submitted 7 October, 2024; originally announced October 2024.

    Comments: Added IEEE Submission Notice

  6. Scalable Reinforcement Learning-based Neural Architecture Search

    Authors: Amber Cassimon, Siegfried Mercelis, Kevin Mets

    Abstract: In this publication, we assess the ability of a novel Reinforcement Learning-based solution to the problem of Neural Architecture Search, where a Reinforcement Learning (RL) agent learns to search for good architectures, rather than to return a single optimal architecture. We consider both the NAS-Bench-101 and NAS- Bench-301 settings, and compare against various known strong baselines, such as lo… ▽ More

    Submitted 2 October, 2024; originally announced October 2024.

    Comments: 33 Pages, 19 Figures

  7. arXiv:2407.14418  [pdf, other

    cs.CV

    Improving classification of road surface conditions via road area extraction and contrastive learning

    Authors: Linh Trinh, Ali Anwar, Siegfried Mercelis

    Abstract: Maintaining roads is crucial to economic growth and citizen well-being because roads are a vital means of transportation. In various countries, the inspection of road surfaces is still done manually, however, to automate it, research interest is now focused on detecting the road surface defects via the visual data. While, previous research has been focused on deep learning methods which tend to pr… ▽ More

    Submitted 19 July, 2024; originally announced July 2024.

    Comments: 7 pages

  8. arXiv:2407.12065  [pdf, other

    cs.LG cs.AI

    Data selection method for assessment of autonomous vehicles

    Authors: Linh Trinh, Ali Anwar, Siegfried Mercelis

    Abstract: As the popularity of autonomous vehicles has grown, many standards and regulators, such as ISO, NHTSA, and Euro NCAP, require safety validation to ensure a sufficient level of safety before deploying them in the real world. Manufacturers gather a large amount of public road data for this purpose. However, the majority of these validation activities are done manually by humans. Furthermore, the dat… ▽ More

    Submitted 28 October, 2024; v1 submitted 16 July, 2024; originally announced July 2024.

    Comments: 7 pages

    Journal ref: 27th IEEE International Conference on Intelligent Transportation Systems 2024

  9. arXiv:2407.10197  [pdf, other

    cs.CV

    Multiple data sources and domain generalization learning method for road surface defect classification

    Authors: Linh Trinh, Ali Anwar, Siegfried Mercelis

    Abstract: Roads are an essential mode of transportation, and maintaining them is critical to economic growth and citizen well-being. With the continued advancement of AI, road surface inspection based on camera images has recently been extensively researched and can be performed automatically. However, because almost all of the deep learning methods for detecting road surface defects were optimized for a sp… ▽ More

    Submitted 14 July, 2024; originally announced July 2024.

    Comments: 6 pages

  10. arXiv:2406.09976  [pdf, other

    cs.LG cs.AI

    Robust Model-Based Reinforcement Learning with an Adversarial Auxiliary Model

    Authors: Siemen Herremans, Ali Anwar, Siegfried Mercelis

    Abstract: Reinforcement learning has demonstrated impressive performance in various challenging problems such as robotics, board games, and classical arcade games. However, its real-world applications can be hindered by the absence of robustness and safety in the learned policies. More specifically, an RL agent that trains in a certain Markov decision process (MDP) often struggles to perform well in nearly… ▽ More

    Submitted 1 July, 2024; v1 submitted 14 June, 2024; originally announced June 2024.

    Comments: Will be presented at the RL Safety Workshop at RLC 2024

  11. Autonomous Port Navigation With Ranging Sensors Using Model-Based Reinforcement Learning

    Authors: Siemen Herremans, Ali Anwar, Arne Troch, Ian Ravijts, Maarten Vangeneugden, Siegfried Mercelis, Peter Hellinckx

    Abstract: Autonomous shipping has recently gained much interest in the research community. However, little research focuses on inland - and port navigation, even though this is identified by countries such as Belgium and the Netherlands as an essential step towards a sustainable future. These environments pose unique challenges, since they can contain dynamic obstacles that do not broadcast their location,… ▽ More

    Submitted 17 November, 2023; originally announced December 2023.

    Comments: Presented at 42nd International Conference on Ocean, Offshore & Arctic Engineering. June 11 - 16, 2023. Melbourne, Australia

    Journal ref: Proceedings of the ASME 2023 42nd International Conference on Ocean, Offshore and Arctic Engineering. Volume 5: Ocean Engineering. Melbourne, Australia. June 11-16, 2023. V005T06A072. ASME

  12. arXiv:2311.11580  [pdf, other

    cs.CV

    SeaDSC: A video-based unsupervised method for dynamic scene change detection in unmanned surface vehicles

    Authors: Linh Trinh, Ali Anwar, Siegfried Mercelis

    Abstract: Recently, there has been an upsurge in the research on maritime vision, where a lot of works are influenced by the application of computer vision for Unmanned Surface Vehicles (USVs). Various sensor modalities such as camera, radar, and lidar have been used to perform tasks such as object detection, segmentation, object tracking, and motion planning. A large subset of this research is focused on t… ▽ More

    Submitted 20 November, 2023; originally announced November 2023.

    Comments: WACV 2024 conference

  13. Safety Aware Autonomous Path Planning Using Model Predictive Reinforcement Learning for Inland Waterways

    Authors: Astrid Vanneste, Simon Vanneste, Olivier Vasseur, Robin Janssens, Mattias Billast, Ali Anwar, Kevin Mets, Tom De Schepper, Siegfried Mercelis, Peter Hellinckx

    Abstract: In recent years, interest in autonomous shipping in urban waterways has increased significantly due to the trend of keeping cars and trucks out of city centers. Classical approaches such as Frenet frame based planning and potential field navigation often require tuning of many configuration parameters and sometimes even require a different configuration depending on the situation. In this paper, w… ▽ More

    Submitted 16 November, 2023; originally announced November 2023.

    Comments: \c{opyright} 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

  14. arXiv:2308.04938  [pdf, other

    cs.LG cs.AI cs.MA

    An In-Depth Analysis of Discretization Methods for Communication Learning using Backpropagation with Multi-Agent Reinforcement Learning

    Authors: Astrid Vanneste, Simon Vanneste, Kevin Mets, Tom De Schepper, Siegfried Mercelis, Peter Hellinckx

    Abstract: Communication is crucial in multi-agent reinforcement learning when agents are not able to observe the full state of the environment. The most common approach to allow learned communication between agents is the use of a differentiable communication channel that allows gradients to flow between agents as a form of feedback. However, this is challenging when we want to use discrete messages to redu… ▽ More

    Submitted 9 August, 2023; originally announced August 2023.

    Comments: arXiv admin note: substantial text overlap with arXiv:2204.05669

  15. arXiv:2308.04844  [pdf, other

    cs.LG cs.AI cs.MA

    Scalability of Message Encoding Techniques for Continuous Communication Learned with Multi-Agent Reinforcement Learning

    Authors: Astrid Vanneste, Thomas Somers, Simon Vanneste, Kevin Mets, Tom De Schepper, Siegfried Mercelis, Peter Hellinckx

    Abstract: Many multi-agent systems require inter-agent communication to properly achieve their goal. By learning the communication protocol alongside the action protocol using multi-agent reinforcement learning techniques, the agents gain the flexibility to determine which information should be shared. However, when the number of agents increases we need to create an encoding of the information contained in… ▽ More

    Submitted 9 August, 2023; originally announced August 2023.

    Comments: Paper accepted to the BNAIC/BeNeLearn 2022 conference

  16. arXiv:2305.02061  [pdf, other

    cs.MA cs.AI

    Attention Based Feature Fusion For Multi-Agent Collaborative Perception

    Authors: Ahmed N. Ahmed, Siegfried Mercelis, Ali Anwar

    Abstract: In the domain of intelligent transportation systems (ITS), collaborative perception has emerged as a promising approach to overcome the limitations of individual perception by enabling multiple agents to exchange information, thus enhancing their situational awareness. Collaborative perception overcomes the limitations of individual sensors, allowing connected agents to perceive environments beyon… ▽ More

    Submitted 3 May, 2023; originally announced May 2023.

  17. arXiv:2304.07051  [pdf, other

    cs.CV cs.AI

    The Second Monocular Depth Estimation Challenge

    Authors: Jaime Spencer, C. Stella Qian, Michaela Trescakova, Chris Russell, Simon Hadfield, Erich W. Graf, Wendy J. Adams, Andrew J. Schofield, James Elder, Richard Bowden, Ali Anwar, Hao Chen, Xiaozhi Chen, Kai Cheng, Yuchao Dai, Huynh Thai Hoa, Sadat Hossain, Jianmian Huang, Mohan Jing, Bo Li, Chao Li, Baojun Li, Zhiwen Liu, Stefano Mattoccia, Siegfried Mercelis , et al. (18 additional authors not shown)

    Abstract: This paper discusses the results for the second edition of the Monocular Depth Estimation Challenge (MDEC). This edition was open to methods using any form of supervision, including fully-supervised, self-supervised, multi-task or proxy depth. The challenge was based around the SYNS-Patches dataset, which features a wide diversity of environments with high-quality dense ground-truth. This includes… ▽ More

    Submitted 26 April, 2023; v1 submitted 14 April, 2023; originally announced April 2023.

    Comments: Published at CVPRW2023

  18. arXiv:2204.05669  [pdf, other

    cs.LG cs.MA

    An Analysis of Discretization Methods for Communication Learning with Multi-Agent Reinforcement Learning

    Authors: Astrid Vanneste, Simon Vanneste, Kevin Mets, Tom De Schepper, Siegfried Mercelis, Steven Latré, Peter Hellinckx

    Abstract: Communication is crucial in multi-agent reinforcement learning when agents are not able to observe the full state of the environment. The most common approach to allow learned communication between agents is the use of a differentiable communication channel that allows gradients to flow between agents as a form of feedback. However, this is challenging when we want to use discrete messages to redu… ▽ More

    Submitted 12 April, 2022; originally announced April 2022.

    Comments: Accepted at Adaptive and Learning Agents Workshop (ALA 2022) https://ala2022.github.io/

  19. Learning to Communicate with Reinforcement Learning for an Adaptive Traffic Control System

    Authors: Simon Vanneste, Gauthier de Borrekens, Stig Bosmans, Astrid Vanneste, Kevin Mets, Siegfried Mercelis, Steven Latré, Peter Hellinckx

    Abstract: Recent work in multi-agent reinforcement learning has investigated inter agent communication which is learned simultaneously with the action policy in order to improve the team reward. In this paper, we investigate independent Q-learning (IQL) without communication and differentiable inter-agent learning (DIAL) with learned communication on an adaptive traffic control system (ATCS). In real world… ▽ More

    Submitted 29 October, 2021; originally announced October 2021.

  20. Mixed Cooperative-Competitive Communication Using Multi-Agent Reinforcement Learning

    Authors: Astrid Vanneste, Wesley Van Wijnsberghe, Simon Vanneste, Kevin Mets, Siegfried Mercelis, Steven Latré, Peter Hellinckx

    Abstract: By using communication between multiple agents in multi-agent environments, one can reduce the effects of partial observability by combining one agent's observation with that of others in the same dynamic environment. While a lot of successful research has been done towards communication learning in cooperative settings, communication learning in mixed cooperative-competitive settings is also impo… ▽ More

    Submitted 29 October, 2021; originally announced October 2021.

  21. arXiv:2110.06742  [pdf, other

    cs.LG

    A Review of the Deep Sea Treasure problem as a Multi-Objective Reinforcement Learning Benchmark

    Authors: Amber Cassimon, Reinout Eyckerman, Siegfried Mercelis, Steven Latré, Peter Hellinckx

    Abstract: In this paper, the authors investigate the Deep Sea Treasure (DST) problem as proposed by Vamplew et al. Through a number of proofs, the authors show the original DST problem to be quite basic, and not always representative of practical Multi-Objective Optimization problems. In an attempt to bring theory closer to practice, the authors propose an alternative, improved version of the DST problem, a… ▽ More

    Submitted 21 May, 2024; v1 submitted 13 October, 2021; originally announced October 2021.

    Comments: 10 pages, 4 figures; Fixed Supplementary Materials PDF

  22. arXiv:2006.07200  [pdf, other

    cs.LG cs.MA stat.ML

    Learning to Communicate Using Counterfactual Reasoning

    Authors: Simon Vanneste, Astrid Vanneste, Kevin Mets, Tom De Schepper, Ali Anwar, Siegfried Mercelis, Steven Latré, Peter Hellinckx

    Abstract: Learning to communicate in order to share state information is an active problem in the area of multi-agent reinforcement learning (MARL). The credit assignment problem, the non-stationarity of the communication environment and the creation of influenceable agents are major challenges within this research field which need to be overcome in order to learn a valid communication protocol. This paper… ▽ More

    Submitted 26 April, 2022; v1 submitted 12 June, 2020; originally announced June 2020.

    Comments: Accepted at Adaptive and Learning Agents Workshop (ALA 2022) https://ala2022.github.io/