-
Improving Multi-Domain Task-Oriented Dialogue System with Offline Reinforcement Learning
Authors:
Dharmendra Prajapat,
Durga Toshniwal
Abstract:
Task-oriented dialogue (TOD) system is designed to accomplish user-defined tasks through dialogues. The TOD system has progressed towards end-to-end modeling by leveraging pre-trained large language models. Fine-tuning the pre-trained language models using only supervised learning leads to the exposure bias and token loss problem and it deviates the models from completing the user's task. To addre…
▽ More
Task-oriented dialogue (TOD) system is designed to accomplish user-defined tasks through dialogues. The TOD system has progressed towards end-to-end modeling by leveraging pre-trained large language models. Fine-tuning the pre-trained language models using only supervised learning leads to the exposure bias and token loss problem and it deviates the models from completing the user's task. To address these issues, we propose a TOD system that leverages a unified pre-trained language model, GPT2, as a base model. It is optimized using supervised learning and reinforcement learning (RL). The issues in the TOD system are mitigated using a non-differentiable reward function. The reward is calculated using the weighted sum of the success rate and BLEU evaluation metrics. The success rate and BLEU metrics in reward calculation guide the language model for user task completion while ensuring a coherent and fluent response. Our model is acquired by fine-tuning a pre-trained model on the dialogue-session level which comprises user utterance, belief state, system act, and system response. Experimental results on MultiWOZ2.1 demonstrate that our model increases the inform rate by 1.60% and the success rate by 3.17% compared to the baseline.
△ Less
Submitted 8 November, 2024;
originally announced November 2024.
-
TEMPUS, a Timepix4-based system for event-based X-rays detection
Authors:
Jonathan Correa,
Alexandr Ignatenko,
David Pennicard,
Sabine Lange,
Sergei Fridman,
Sebastian Karl,
Leon Lohse,
Bjoern Senfftleben,
Ilya Sergeev,
Sven Velten,
Deepak Prajapat,
Lars Bocklage,
Hubertus Bromberger,
Andrey Samartsev,
Aleksandr Chumakov,
Rudolf Rueffer,
Joachim von Zanthier,
Ralf Roehlsberger,
Heinz Graafsma
Abstract:
A readout system based on the Timepix4 ASIC, is being developed for photon science. The TEMPUS detector can be operated in two distinct modes: a photon counting mode, which allows for conventional full-frame readout at rates up to 40 kfps; and an event-driven time-stamping mode, which allows excellent time resolution in the nanosecond regime in measurements with moderate X-ray flux. In this paper,…
▽ More
A readout system based on the Timepix4 ASIC, is being developed for photon science. The TEMPUS detector can be operated in two distinct modes: a photon counting mode, which allows for conventional full-frame readout at rates up to 40 kfps; and an event-driven time-stamping mode, which allows excellent time resolution in the nanosecond regime in measurements with moderate X-ray flux. In this paper, we introduce the initial prototype, a single-chip system, and present the first results obtained at PETRA III and ESRF.
△ Less
Submitted 10 April, 2024;
originally announced April 2024.
-
Magnetism in four-layered Aurivillius Bi$_5$FeTi$_3$O$_{15}$ at high pressures : A nuclear forward scattering study
Authors:
Deepak Prajapat,
Akash Surampalli,
Anjali Panchwanee,
Carlo Meneghini,
Ilya Sergeev,
Olaf Leubold,
Srihari Velaga,
Marco Merlini,
Konstantin Glazyrin,
René Steinbrügge,
Atefeh Jafari,
Himashu Kumar Poswal,
V. G. Sathe,
V. Raghavendra Reddy
Abstract:
We report the structural and magnetic properties of four-layer Aurivillius compound Bi$_5$FeTi$_3$O$_{15}$ (BFTO) at high hydrostatic pressure conditions. The high-pressure XRD data does not explicitly show structural phase transitions with hydrostatic pressure, however the observed changes in lattice parameters indicate structural modifications at different pressure values. In the initial pressur…
▽ More
We report the structural and magnetic properties of four-layer Aurivillius compound Bi$_5$FeTi$_3$O$_{15}$ (BFTO) at high hydrostatic pressure conditions. The high-pressure XRD data does not explicitly show structural phase transitions with hydrostatic pressure, however the observed changes in lattice parameters indicate structural modifications at different pressure values. In the initial pressure region values, the lattice parameters $\textit{a}$- and $\textit{b}$- are nearly equal implying a quasi-tetragonal structure, however as the pressure increases $\textit{a}$- and $\textit{b}$- diverges apart and exhibits complete orthorhombic phase at pressure values of about $\geq$8 GPa. Principal component analysis of high pressure Raman measurements point out an evident change in the local structure at about 5.5 GPa indicating that the evolution of the local structure under applied pressure seems to not follow crystallographic changes (long range order). Nuclear forward scattering (NFS) measurement reveal the development of magnetic ordering in BFTO at 5K with high pressures. A progressive increase in magnetic order is observed with increase in pressure at 5K. Further, NFS measurements carried out at constant pressure (6.4GPa) and different temperatures indicate that the developed magnetism disappears at higher temperatures (20K). It is attempted to explain these observations in terms of the observed structural parameter variation with pressure.
△ Less
Submitted 10 March, 2022;
originally announced March 2022.
-
Re-entrant phenomenon in diffuse ferroelectric, $BaSn_{0.15}Ti_{0.85}O_{3}$ : Local structural insights and FORC study
Authors:
Akash Surampalli,
Ramon Egli,
Deepak Prajapat,
Carlo Meneghini,
V. Raghavendra Reddy
Abstract:
From the phase diagram as proposed by Lei et.al., [J. App. Phys 101, 084105 (2007)] a $BaSn_{0.15}Ti_{0.85}O_{3}$ is chosen showing a diffuse phase transition between cubic to rhombohedral (C-R) near room temperature. Dielectric analysis confirms a phase transition near room temperature ($T_{C}$ $\approx$ 290 K) and also frequency dispersion in dielectric constant is observed towards low temperatu…
▽ More
From the phase diagram as proposed by Lei et.al., [J. App. Phys 101, 084105 (2007)] a $BaSn_{0.15}Ti_{0.85}O_{3}$ is chosen showing a diffuse phase transition between cubic to rhombohedral (C-R) near room temperature. Dielectric analysis confirms a phase transition near room temperature ($T_{C}$ $\approx$ 290 K) and also frequency dispersion in dielectric constant is observed towards low temperature. Polarization and first-order reversal curves (FORC) suggest that the system is in re-entrant phase at low temperatures. Put together, all these electrical characterization results points toward the relaxor behavior in the re-entrant phase. Local probe techniques such as x-ray absorption near edge spectroscopy, Raman and Mossbauer spectroscopy are employed to investigate the local environment changes around this region of low temperature dielectric anomaly. A simple ferroelectric exchange model explaining the low temperature re-entrant behavior is presented from these results.
△ Less
Submitted 24 July, 2021; v1 submitted 17 July, 2021;
originally announced July 2021.
