Architecture of the data aggregation and streaming system for the European Spallation Source neutron instrument suite
Authors:
A. H. C. Mukai,
M. J. Clarke,
M. J. Christensen,
J. M. C. Nilsson,
M. G. Shetty,
M. Brambilla,
D. Werder,
M. Könnecke,
J. Harper,
M. D. Jones,
F. A. Akeroyd,
C. Reis,
G. Kourousias,
T. S. Richter
Abstract:
The European Spallation Source (ESS) will provide long neutron pulses for experiments on a suite of different instruments. Most of these will perform neutron data acquisition in event mode, i.e. each detected neutron will be characterised by one absolute timestamp and pixel identifier pair. Slow controls metadata from EPICS, such as sample environment measurements and motor positions, will also be…
▽ More
The European Spallation Source (ESS) will provide long neutron pulses for experiments on a suite of different instruments. Most of these will perform neutron data acquisition in event mode, i.e. each detected neutron will be characterised by one absolute timestamp and pixel identifier pair. Slow controls metadata from EPICS, such as sample environment measurements and motor positions, will also be timestamped at their source, so that all data and metadata are streamed as a list of events instead of histograms. A flexible data aggregation and streaming system is being developed combining both open source third-party software and in-house development. This is to be used at ESS and other neutron scattering facilities like ISIS and SINQ, replacing legacy solutions by a shared software collection maintained by a cross-facility effort. The architecture of the Apache Kafka-based system, its metadata forwarding and NeXus file writing components are presented, along with test results demonstrating their integration and the scalability in terms of performance.
△ Less
Submitted 30 August, 2018; v1 submitted 26 July, 2018;
originally announced July 2018.
Hardware Aspects, Modularity and Integration of an Event Mode Data Acquisition and Instrument Control for the European Spallation Source (ESS)
Authors:
Thomas Gahl,
Mark Hagen,
Richard Hall-Wilton,
Scott Kolya,
Mark Koennecke,
Miha Rescic,
Thomas H. Rod,
Iain Sutton,
Garry Trahern,
Oliver Kirstein
Abstract:
The European Spallation Source (ESS) in Lund, Sweden is just entering the construction phase with 3 neutron instruments having started in its design concept phase in 2014. As a collaboration of 17 European countries the majority of hardware devices for neutron instrumentation will be provided in-kind. This presents numerous technical and organisational challenges for the construction and the integ…
▽ More
The European Spallation Source (ESS) in Lund, Sweden is just entering the construction phase with 3 neutron instruments having started in its design concept phase in 2014. As a collaboration of 17 European countries the majority of hardware devices for neutron instrumentation will be provided in-kind. This presents numerous technical and organisational challenges for the construction and the integration of the instruments into the facility wide infrastructure; notably the EPICS control network with standardised hardware interfaces and the facilities absolute timing system. Additionally the new generation of pulsed source requires a new complexity and flexibility of instrumentation to fully exploit its opportunities. In this contribution we present a strategy for the modularity of the instrument hardware with well-defined standardized functionality and control & data interfaces integrating into EPICS and the facilities timing system. It allows for in-kind contribution of dedicated modules for each instrument (horizontal approach) as well as of whole instruments (vertical approach). Key point of the strategy is the time stamping of all readings from the instruments control electronics extending the event mode data acquisition from neutron events to all metadata. This gives the control software the flexibility necessary to adapt the functionality of the instruments to the demands of each single experiment. We present the advantages of that approach for operation and diagnostics and discuss additional hardware requirements necessary.
△ Less
Submitted 7 July, 2015;
originally announced July 2015.
NeXus Software Status
Authors:
Mark Koennecke,
Uwe Filges
Abstract:
NeXus is a joint effort of both the synchrotron and neutron scattering community to devlop a common data exchange format based on HDF. In order to simplify access to NeXus-files a NeXus-API is provided. This NeXus-API has been redesigned and expanded to cover both HDF versions 4 and 5. Only small changes to the API were necessary in order to accomplish. A new NeXus-API for IDL based on IDL C int…
▽ More
NeXus is a joint effort of both the synchrotron and neutron scattering community to devlop a common data exchange format based on HDF. In order to simplify access to NeXus-files a NeXus-API is provided. This NeXus-API has been redesigned and expanded to cover both HDF versions 4 and 5. Only small changes to the API were necessary in order to accomplish. A new NeXus-API for IDL based on IDL C interface has been implemented.
△ Less
Submitted 18 October, 2002;
originally announced October 2002.
