Author: Mol, J.J.D.
Paper Title Page
THMBCMO01 New Developements on HDB++, the High-performance Data Archiving for Tango Controls 1190
 
  • D. Lacoste, R. Bourtembourg
    ESRF, Grenoble, France
  • J. Forsberg
    MAX IV Laboratory, Lund University, Lund, Sweden
  • T. Juerges
    SKAO, Macclesfield, United Kingdom
  • J.J.D. Mol
    ASTRON, Dwingeloo, The Netherlands
  • L. Pivetta, G. Scalamera
    Elettra-Sincrotrone Trieste S.C.p.A., Basovizza, Italy
  • S. Rubio-Manrique
    ALBA-CELLS, Cerdanyola del Vallès, Spain
 
  The Tango HDB++ project is a high performance event-driven archiving system which stores data with micro-second resolution timestamps. HDB++ supports many different backends, including MySQL/MariaDB, TimeScaleDB (a time-series PostgreSQL extension), and soon SQLite. Building on its flexible design, latest developments made supporting new backends even easier. HDB++ keeps improving with new features such as batch insertion and by becoming easier to install or setup in a testing environment, using ready to use docker images and striving to simplify all the steps of deployment. The HDB++ project is not only a data storage installation, but a full ecosystem to manage data, query it, and get the information needed. In this effort a lot of tools were developed to put a powerful backend to its proper use and be able to get the best out of the stored data. In this paper we will present as well the latest developments in data extraction, from low level libraries to web viewer integration such as grafana. Pointing out strategies in use in terms of data decimation, compression and others to help deliver data as fast as possible.  
slides icon Slides THMBCMO01 [0.926 MB]  
poster icon Poster THMBCMO01 [0.726 MB]  
DOI • reference for this paper ※ doi:10.18429/JACoW-ICALEPCS2023-THMBCMO01  
About • Received ※ 05 October 2023 — Revised ※ 24 October 2023 — Accepted ※ 08 December 2023 — Issued ※ 16 December 2023
Cite • reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)