-
Reinforcement Learning Agent Design and Optimization with Bandwidth Allocation Model
Authors:
Rafael F. Reale,
Joberto S. B. Martins
Abstract:
Reinforcement learning (RL) is currently used in various real-life applications. RL-based solutions have the potential to generically address problems, including the ones that are difficult to solve with heuristics and meta-heuristics and, in addition, the set of problems and issues where some intelligent or cognitive approach is required. However, reinforcement learning agents require a not strai…
▽ More
Reinforcement learning (RL) is currently used in various real-life applications. RL-based solutions have the potential to generically address problems, including the ones that are difficult to solve with heuristics and meta-heuristics and, in addition, the set of problems and issues where some intelligent or cognitive approach is required. However, reinforcement learning agents require a not straightforward design and have important design issues. RL agent design issues include the target problem modeling, state-space explosion, the training process, and agent efficiency. Research currently addresses these issues aiming to foster RL dissemination. A BAM model, in summary, allocates and shares resources with users. There are three basic BAM models and several hybrids that differ in how they allocate and share resources among users. This paper addresses the issue of an RL agent design and efficiency. The RL agent's objective is to allocate and share resources among users. The paper investigates how a BAM model can contribute to the RL agent design and efficiency. The AllocTC-Sharing (ATCS) model is analytically described and simulated to evaluate how it mimics the RL agent operation and how the ATCS can offload computational tasks from the RL agent. The essential argument researched is whether algorithms integrated with the RL agent design and operation have the potential to facilitate agent design and optimize its execution. The ATCS analytical model and simulation presented demonstrate that a BAM model offloads agent tasks and assists the agent's design and optimization.
△ Less
Submitted 23 November, 2022;
originally announced November 2022.
-
Modeling and Accomplishing the BEREC Network Neutrality Policy
Authors:
David S. Barreto,
Rafael F. Reale,
Joberto S. B. Martins
Abstract:
Network neutrality (NN) is a principle of equal treatment of data in network infrastructures with fairness and universality being the primary outcomes of the NN management practice. For networks, the accomplishment of NN management practice is essential to deal with heterogeneous user requirements and the ever-increasing data traffic. Current tools and methods address the NN problem by detecting n…
▽ More
Network neutrality (NN) is a principle of equal treatment of data in network infrastructures with fairness and universality being the primary outcomes of the NN management practice. For networks, the accomplishment of NN management practice is essential to deal with heterogeneous user requirements and the ever-increasing data traffic. Current tools and methods address the NN problem by detecting network neutrality violations and detecting traffic differentiation. This paper proposes the NN-PCM (Network Neutrality Policy Conformance Module) that deploys the BEREC network neutrality policy using a bandwidth allocation model (BAM). The NN-PCM new approach allocates bandwidth to network users and accomplishes the BEREC NN policy concomitantly. Network neutrality is achieved by grouping users with similar traffic requirements in classes and leveraging the bandwidth allocation model's characteristics. The conceptual analysis and simulation results indicate that NN-PCM allocates bandwidth to users and accomplishes BEREC network neutrality conformance by design with transparent, non-discriminatory, exceptional, and proportional management practices.
△ Less
Submitted 16 June, 2021;
originally announced June 2021.
-
A SDN/OpenFlow Framework for Dynamic Resource Allocation based on Bandwidth Allocation Model
Authors:
Eliseu Silva Torres,
Rafael F. Reale,
Leobino N. Sampaio,
Joberto S. B. Martins
Abstract:
The communication network context in actual systems like 5G, cloud and IoT (Internet of Things), presents an ever-increasing number of users, applications, and services that are highly distributed with distinct and heterogeneous communications requirements. Resource allocation in this context requires dynamic, efficient, and customized solutions and Bandwidth Allocation Models (BAMs) are an altern…
▽ More
The communication network context in actual systems like 5G, cloud and IoT (Internet of Things), presents an ever-increasing number of users, applications, and services that are highly distributed with distinct and heterogeneous communications requirements. Resource allocation in this context requires dynamic, efficient, and customized solutions and Bandwidth Allocation Models (BAMs) are an alternative to support this new trend. This paper proposes the BAMSDN (Bandwidth Allocation Model through Software-Defined Networking) framework that dynamically allocates resources (bandwidth) for a MPLS (MultiProtocol Label Switching) network using a SDN (Software-Defined Networking)/OpenFlow strategy with BAM. The framework adopts an innovative implementation approach for BAM systems by controlling the MPLS network using SDN with OpenFlow. Experimental results suggest that using SDN/OpenFlow with BAM for bandwidth allocation does have effective advantages for MPLS networks requiring flexible resource sharing among applications and facilitates the migration path to a SDN/OpenFlow network.
△ Less
Submitted 31 January, 2021;
originally announced February 2021.
-
BAMSim Simulator
Authors:
Rafael F. Reale,
Walter P. neto,
Joberto S. B. Martins
Abstract:
Resource allocation is an essential design aspect for current systems and bandwidth allocation is an essential design aspect in multi-protocol label switched and OpenFlow/SDN network infrastructures. The bandwidth allocation models (BAMs) are an alternative to allocate and share bandwidth among network users. BAMs have an extensive number of parameters that need to be defined and tuned to achieve…
▽ More
Resource allocation is an essential design aspect for current systems and bandwidth allocation is an essential design aspect in multi-protocol label switched and OpenFlow/SDN network infrastructures. The bandwidth allocation models (BAMs) are an alternative to allocate and share bandwidth among network users. BAMs have an extensive number of parameters that need to be defined and tuned to achieve an expected network performance. This paper presents the BAMSim simulator to support the network manager decision process in choosing a set of BAM configuration parameters for network design or during network operation.
△ Less
Submitted 30 January, 2021;
originally announced February 2021.
-
A Methodological Approach to Model CBR-based Systems
Authors:
Eliseu M. Oliveira,
Rafael F. Reale,
Joberto S. B. Martins
Abstract:
Artificial intelligence (AI) has been used in various areas to support system optimization and find solutions where the complexity makes it challenging to use algorithmic and heuristics. Case-based Reasoning (CBR) is an AI technique intensively exploited in domains like management, medicine, design, construction, retail and smart grid. CBR is a technique for problem-solving and captures new knowle…
▽ More
Artificial intelligence (AI) has been used in various areas to support system optimization and find solutions where the complexity makes it challenging to use algorithmic and heuristics. Case-based Reasoning (CBR) is an AI technique intensively exploited in domains like management, medicine, design, construction, retail and smart grid. CBR is a technique for problem-solving and captures new knowledge by using past experiences. One of the main CBR deployment challenges is the target system modeling process. This paper presents a straightforward methodological approach to model CBR-based applications using the concepts of abstract and concrete models. Splitting the modeling process with two models facilitates the allocation of expertise between the application domain and the CBR technology. The methodological approach intends to facilitate the CBR modeling process and to foster CBR use in various areas outside computer science.
△ Less
Submitted 9 September, 2020;
originally announced September 2020.
-
Evaluating the Applicability of Bandwidth Allocation Models for EON Slot Allocation
Authors:
Rafael F. Reale,
Romildo M. S. Bezerra,
Gilvan Duraes,
Alexandre C. Fontinele,
Andre C. B. Soares,
Joberto S. B. Martins
Abstract:
Bandwidth Allocation Models (BAMs) configure and handle resource allocation (bandwidth, LSPs, fiber, slots) in networks in general (IP/MPLS/DS-TE, optical domain, other). In this paper, BAMs are considered for elastic optical networks slot allocation targeting an improvement in resource utilization. The paper focuses initially on proposing a BAM basic configuration parameter mapping suitable for e…
▽ More
Bandwidth Allocation Models (BAMs) configure and handle resource allocation (bandwidth, LSPs, fiber, slots) in networks in general (IP/MPLS/DS-TE, optical domain, other). In this paper, BAMs are considered for elastic optical networks slot allocation targeting an improvement in resource utilization. The paper focuses initially on proposing a BAM basic configuration parameter mapping suitable for elastic optical circuits. Following that, MAM, RDM and ATCS BAMs are applied for elastic optical networks resource allocation and the overall network resource utilization is evaluated. A set of simulation results and BAM behaviors are presented as a proof of concept to evaluate BAM applicability for elastic optical network slot allocation. Authors argue that a slot allocation model for EON based on BAMs may improve utilization by dynamically managing the aggregated traffic profile.
△ Less
Submitted 16 April, 2019;
originally announced April 2019.
-
AllocTC-Sharing: A New Bandwidth Allocation Model for DS-TE Networks
Authors:
Rafael F. Reale,
Walter da C. P. neto,
Joberto S. B. Martins
Abstract:
DiffServ-aware MPLS-TE (DS-TE) allows bandwidth reservation for Traffic Classes (TCs) in MPLS-based engineered networks and, as such, improves the basic MPLS-TE model. In DS-TE networks, per-Class quality of service guarantees are provided while being possible to achieve improved network utilization. DS-TE requires the use of a Bandwidth Allocation Model (BAM) that establishes the amount of bandwi…
▽ More
DiffServ-aware MPLS-TE (DS-TE) allows bandwidth reservation for Traffic Classes (TCs) in MPLS-based engineered networks and, as such, improves the basic MPLS-TE model. In DS-TE networks, per-Class quality of service guarantees are provided while being possible to achieve improved network utilization. DS-TE requires the use of a Bandwidth Allocation Model (BAM) that establishes the amount of bandwidth per-Class and any eventual sharing among them. This paper proposes a new bandwidth allocation model (AllocTC-Sharing) in which the higher priority traffic classes are allowed to use non allocated resources of lower priority traffic classes and vice versa. By adopting this dual sense allocation strategy for dynamic bandwidth allocation, it is shown that AllocTC-Sharing model preserves bandwidth constraints for traffic classes and improves overall link utilization.
△ Less
Submitted 16 April, 2019;
originally announced April 2019.
-
Cognitive Management of Bandwidth Allocation Models with Case-Based Reasoning -- Evidences Towards Dynamic BAM Reconfiguration
Authors:
Eliseu M. Oliveira,
Rafael Freitas Reale,
Joberto S. B. Martins
Abstract:
Management is a complex task in today's heterogeneous and large scale networks like Cloud, IoT, vehicular and MPLS networks. Likewise, researchers and developers envision the use of artificial intelligence techniques to create cognitive and autonomic management tools that aim better assist and enhance the management process cycle. Bandwidth allocation models (BAMs) are a resource allocation soluti…
▽ More
Management is a complex task in today's heterogeneous and large scale networks like Cloud, IoT, vehicular and MPLS networks. Likewise, researchers and developers envision the use of artificial intelligence techniques to create cognitive and autonomic management tools that aim better assist and enhance the management process cycle. Bandwidth allocation models (BAMs) are a resource allocation solution for networks that need to share and optimize limited resources like bandwidth, fiber or optical slots in a flexible and dynamic way. This paper proposes and evaluates the use of Case-Based Reasoning (CBR) for the cognitive management of BAM reconfiguration in MPLS networks. The results suggest that CBR learns about bandwidth request profiles (LSPs requests) associated with the current network state and is able to dynamically define or assist in BAM reconfiguration. The BAM reconfiguration approach adopted is based on switching among available BAM implementations (MAM, RDM and ATCS). The cognitive management proposed allows BAMs self-configuration and results in optimizing the utilization of network resources.
△ Less
Submitted 1 April, 2019;
originally announced April 2019.
-
G-BAM: A Generalized Bandwidth Allocation Model for IP/MPLS/DS-TE Networks
Authors:
Rafael Freitas Reale,
Romildo Martins da S. Bezerra,
Joberto S. B. Martins
Abstract:
Bandwidth Allocation Models (BAMs) configure and handle resource allocation (bandwidth, LSPs, fiber) in networks in general (IP/MPLS/DS-TE, optical domain, other). BAMs currently available for IP/MPLS/DS-TE networks (MAM, RDM, G-RDM and AllocTC-Sharing) basically define resource restrictions (bandwidth) by class (traffic class, application class, user class or other grouping criteria) and allocate…
▽ More
Bandwidth Allocation Models (BAMs) configure and handle resource allocation (bandwidth, LSPs, fiber) in networks in general (IP/MPLS/DS-TE, optical domain, other). BAMs currently available for IP/MPLS/DS-TE networks (MAM, RDM, G-RDM and AllocTC-Sharing) basically define resource restrictions (bandwidth) by class (traffic class, application class, user class or other grouping criteria) and allocate on demand this resource. There is a BAM allocation policy inherent for each existing model which behaves differently under distinct network state, such as heavy traffic loads and dynamic traffic and/or application scenarios. A generalized Bandwidth Allocation Model (G-BAM) is proposed in this paper. G-BAM, firstly, incorporates the inherent behavior of currently used BAMs such as MAM, RDM, G-RDM and AllocTC-Sharing in IP/MPLS/DS-TE context. G-BAM, secondly, proposes a new policy/ behavior allocation in addition to existing ones in which additional private resources are incorporated. G-BAM, thirdly, allows a smoother BAM policy transition among existing policy alternatives resulting from MAM, RDM and AllocTC-Sharing adoption independently. The paper focuses on the first characteristics of G-BAM which is to reproduce MAM, RDM and AllocTC-Sharing behaviors. As such, the required configuration to achieve MAM, RDM and AllocTC-Sharing behaviors is presented followed by a proof of concept. Authors argue that the G-BAM reproducibility characteristics may improve overall network resource utilization under distinct traffic profiles.
△ Less
Submitted 19 June, 2018;
originally announced June 2018.
-
Applying Autonomy with Bandwidth Allocation Models
Authors:
Rafael Freitas Reale,
Romildo Martins da S. Bezerra,
Joberto S. B. Martins
Abstract:
Bandwidth Allocation Models (BAMs) are resource allocation methods used for networks in general. BAMs are currently applied for handling resources such as bandwidth allocation in MPLS DS-TE networks (LSP setup). In general, BAMs defines resource restrictions by class and allocate the available resources on demand. This is frequently necessary to manage large and complex systems like routing networ…
▽ More
Bandwidth Allocation Models (BAMs) are resource allocation methods used for networks in general. BAMs are currently applied for handling resources such as bandwidth allocation in MPLS DS-TE networks (LSP setup). In general, BAMs defines resource restrictions by class and allocate the available resources on demand. This is frequently necessary to manage large and complex systems like routing networks. GBAM is a new generalized BAM that, by configuration, incorporates the behavior of existing BAMs (MAM, RDM, G-RDM and AllocTC-Sharing). In effect, any current available BAM behavior is reproduced by G-BAM by simply adjusting its configuration parameters. This paper focuses on investigating the applicability of using autonomy together with Bandwidth Allocation Models (BAMs) for improve performance and facilitating the management of MPLS DS-TE networks. It is investigated the applicability of BAM switching using a framework with autonomic characteristics. In brief, it is investigated the switching among BAM behaviors and BAM reconfiguration with distinct network traffic scenarios by using GBAM. Simulation results suggest that the autonomic switching of BAM behaviors based on high-level management rules (SLAs, QoS or other police) may result in improving overall network management and operational parameters such as link utilization and preemption.
△ Less
Submitted 16 June, 2018;
originally announced June 2018.
