ICALEPCS2023 - List of Authors (Minotti, C.)

Paper	Title	Page
THMBCMO02	Enhancing Data Management with SciCat: A Comprehensive Overview of a Metadata Catalogue for Research Infrastructures	1195
	C. Minotti, A. Ashton, S.E. Bliven, S. Egli PSI, Villigen PSI, Switzerland F.B. Bolmsten, M. Novelli, T.S. Richter ESS, Lund, Sweden M. Leorato MAX IV Laboratory, Lund University, Lund, Sweden D. McReynolds LBNL, Berkeley, California, USA L.A. Shemilt RFI, Didcot, United Kingdom
	As the volume and quantity of data continue to increase, the role of data management becomes even more crucial. It is essential to have tools that facilitate the management of data in order to manage the ever-growing amount of data. SciCat is a metadata catalogue that utilizes a NoSQL database, enabling it to accept heterogeneous data and customize it to meet the unique needs of scientists and facilities. With its API-centric architecture, SciCat simplifies the integration process with existing infrastructures, allowing for easy access to its capabilities and seamless integration into workflows, including cloud-based systems. The session aims to provide a comprehensive introduction of SciCat, a metadata catalogue started as a collaboration between PSI, ESS, and MAXIV, which has been adopted by numerous Research Infrastructures (RIs) worldwide. The presentation will delve into the guiding principles that underpin this project and the challenges that it endeavours to address. Moreover, it will showcase the features that have been implemented, starting from the ingestion of data to its eventual publication. Given the growing importance of the FAIR (Findable, Accessible, Interoperable, and Reusable) principles, the presentation will touch upon how their uptake is facilitated and will also provide an overview of the work carried out under the Horizon 2020 EU grant for FAIR.
	Slides THMBCMO02 [5.158 MB]
DOI •	reference for this paper ※ doi:10.18429/JACoW-ICALEPCS2023-THMBCMO02
About •	Received ※ 05 October 2023 — Revised ※ 09 October 2023 — Accepted ※ 14 December 2023 — Issued ※ 20 December 2023
Cite •	reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

THPDP073	Scilog: A Flexible Logbook System for Experiment Data Management	1512
	K. Wakonig, A. Ashton, C. Minotti PSI, Villigen PSI, Switzerland
	Capturing both raw and metadata during an experiment is of the utmost importance, as it provides valuable context for the decisions made during the experiment and the acquisition strategy. However, logbooks often lack seamless integration with facility-specific services such as authentication and data acquisition systems and can prove to be a burden, particularly in high-pressure situations during experiments. To address these challenges, SciLog has been developed as a logbook system utilizing MongoDB, Loopback, and Angular. Its primary objective is to provide a flexible and extensible environment, as well as a user-friendly interface. SciLog relies on atomic entries in a NoSQL database that can be easily queried, sorted, and displayed according to the user’s requirements. The integration with facility-specific authorization systems and the automatic import of new experiment proposals enable a user experience that is specifically tailored for the challenging environment of experiments conducted at large research facilities. The system is currently in use during beam time at the Paul Scherrer Institut, where it is collecting valuable feedback from scientists to enhance its capabilities.
DOI •	reference for this paper ※ doi:10.18429/JACoW-ICALEPCS2023-THPDP073
About •	Received ※ 05 October 2023 — Revised ※ 10 October 2023 — Accepted ※ 08 December 2023 — Issued ※ 11 December 2023
Cite •	reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

Paper

Title

Page

Enhancing Data Management with SciCat: A Comprehensive Overview of a Metadata Catalogue for Research Infrastructures

1195

C. Minotti, A. Ashton, S.E. Bliven, S. Egli
PSI, Villigen PSI, Switzerland
F.B. Bolmsten, M. Novelli, T.S. Richter
ESS, Lund, Sweden
M. Leorato
MAX IV Laboratory, Lund University, Lund, Sweden
D. McReynolds
LBNL, Berkeley, California, USA
L.A. Shemilt
RFI, Didcot, United Kingdom

As the volume and quantity of data continue to increase, the role of data management becomes even more crucial. It is essential to have tools that facilitate the management of data in order to manage the ever-growing amount of data. SciCat is a metadata catalogue that utilizes a NoSQL database, enabling it to accept heterogeneous data and customize it to meet the unique needs of scientists and facilities. With its API-centric architecture, SciCat simplifies the integration process with existing infrastructures, allowing for easy access to its capabilities and seamless integration into workflows, including cloud-based systems. The session aims to provide a comprehensive introduction of SciCat, a metadata catalogue started as a collaboration between PSI, ESS, and MAXIV, which has been adopted by numerous Research Infrastructures (RIs) worldwide. The presentation will delve into the guiding principles that underpin this project and the challenges that it endeavours to address. Moreover, it will showcase the features that have been implemented, starting from the ingestion of data to its eventual publication. Given the growing importance of the FAIR (Findable, Accessible, Interoperable, and Reusable) principles, the presentation will touch upon how their uptake is facilitated and will also provide an overview of the work carried out under the Horizon 2020 EU grant for FAIR.

Slides THMBCMO02 [5.158 MB]

DOI •

reference for this paper ※ doi:10.18429/JACoW-ICALEPCS2023-THMBCMO02

About •

Received ※ 05 October 2023 — Revised ※ 09 October 2023 — Accepted ※ 14 December 2023 — Issued ※ 20 December 2023

Cite •

reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

THPDP073

Scilog: A Flexible Logbook System for Experiment Data Management

1512

K. Wakonig, A. Ashton, C. Minotti
PSI, Villigen PSI, Switzerland

Capturing both raw and metadata during an experiment is of the utmost importance, as it provides valuable context for the decisions made during the experiment and the acquisition strategy. However, logbooks often lack seamless integration with facility-specific services such as authentication and data acquisition systems and can prove to be a burden, particularly in high-pressure situations during experiments. To address these challenges, SciLog has been developed as a logbook system utilizing MongoDB, Loopback, and Angular. Its primary objective is to provide a flexible and extensible environment, as well as a user-friendly interface. SciLog relies on atomic entries in a NoSQL database that can be easily queried, sorted, and displayed according to the user’s requirements. The integration with facility-specific authorization systems and the automatic import of new experiment proposals enable a user experience that is specifically tailored for the challenging environment of experiments conducted at large research facilities. The system is currently in use during beam time at the Paul Scherrer Institut, where it is collecting valuable feedback from scientists to enhance its capabilities.

DOI •

reference for this paper ※ doi:10.18429/JACoW-ICALEPCS2023-THPDP073

About •

Received ※ 05 October 2023 — Revised ※ 10 October 2023 — Accepted ※ 08 December 2023 — Issued ※ 11 December 2023

Cite •

reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)