JACoW is a publisher in Geneva, Switzerland that publishes the proceedings of accelerator conferences held around the world by an international collaboration of editors.
TY - UNPB AU - Lauer, K.R. ED - Schaa, Volker RW ED - Götz, Andy ED - Venter, Johan ED - White, Karen ED - Robichon, Marie ED - Rowland, Vivienne TI - Centralized Logging and Alerts for EPICS-based Control Systems with Logstash and Grafana J2 - Proc. of ICALEPCS2023, Cape Town, South Africa, 09-13 October 2023 CY - Cape Town, South Africa T2 - International Conference on Accelerator and Large Experimental Physics Control Systems T3 - 19 LA - english AB - Controls-focused centralized logging on the experimental side of the LCLS aims to bring together logging information from a variety of disparate sources into a single database for easy correlation and alerting. Our application of EPICS covers thousands of IOCs, dozens of Channel Access gateways, hundreds of PLCs and other physical devices, and numerous user-facing applications all running simultaneously. Each of these elements has its own idiosyncrasies in terms of how log messages are generated, where they are stored (if at all), and what information is contained. Our centralized logging implementation routes messages from our most common sources to a logstash instance which is configured to interpret each message and store the parsed information into a database. This system includes support for caput logs, Channel Access gateway put logs, messages generated from TwinCAT PLCs, user-facing Python applications, and the EPICS error logging facility. Aggregated logs can then be readily queried alongside EPICS Process Variable data in Grafana. Alerts can be easily configured by end-users to notify users of situations by way of Slack message and e-mail. PB - JACoW Publishing CP - Geneva, Switzerland ER -