EPSCI SRO Meeting May. 13 2024

From epsciwiki
Jump to navigation Jump to search


Connection Info:

You can connect using https://jlab-org.zoomgov.com/j/1617825253 (Meeting ID: 1160 855 6097). (Click "Expand" to the right for details -->):

One tap mobile: US: +16692545252,,1618740469# or +16468287666,,1618740469#
Meeting URL: https://jlab-org.zoomgov.com/j/1617825253?pwd=bTQ2enh3QlBnb2JEd1JUK3BRSjFJdz09&from=addon&from=addon
Meeting ID: 161 782 5253
Passcode: 923910

Join by Telephone
For higher quality, dial a number based on your current location.
Dial:
US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free)
Meeting ID: 161 782 5253

International numbers
Join from an H.323/SIP room system
H.323: 161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 161 782 5253
Passcode: 923910
SIP: 1608556097@sip.zoomgov.com
Passcode: 923910


Agenda:

  • Announcements
  • RTDP UI
    • Vardan is working on a project to develop a user interface that allows designing, deploying, and configuring complete data-stream processing pipelines. This includes streaming readout and data acquisition capabilities, data transport and distribution, and data-stream processing and visualization. The RTDP UI project will be a desktop application built using JAVA SWING, incorporating some design elements and programming solutions from the CODA JCEdit project. Additionally, we plan to develop a specialized RTDP ontology language based on RDFS, which will be used for the serialization, communication, and archiving of configuration data.
  • Large-scale Deployment and Scaling Test of the CLAS12 Data-Stream Processing Application at NERSC through EJFAT LB at ESnet
    • Discussion on the outcomes from the recent 25-node horizontal scaling test.
    • Challenges encountered in requesting additional resources due to the resource limits set for the EJFAT project.
    • Jeng submitted a special resource reservation to reserve 40 nodes for 3 hours on May 20th at 10 AM. The submission was accepted this morning with the flag reservation=100g.
  • Ongoing Work to Debug and Commission the Return Path for Processed Events through the Second LB Back to JLAB
    • Readiness for local tests of the return path using two load balancer instances on the JLAB EJFAT testbed.
    • Query on whether it is possible to request two local load balancers on the EJFAT testbed that are consistent with the latest LB upgrades and API.
    • Procedure for releasing LB with the open end date ( -until 1970-01-01T00:00:00t00:00).
  • Developing a Demo for a Full Streaming Pipeline:
    • Progress on developing a demo for a full streaming pipeline, starting from streaming readout of the FADC250 through the VTP, passing VTP aggregated time windows to CODA PAGG (primary aggregator) that will create two data stream connections: one for the critical path to ER (socket-based fast connection), and the second to the ET system that plays the role of the FIFO, presented data stream for ERSAP data-processing pipeline pulling data off the ET FIFO, identifying FADC hits, applying a simple trigger algorithm and visualizing triggered data in real-time.
    • Request to update EMU to be able to accept multiple output channels with user-programmable prescale factors for two output channels, one critical channel that outputs all the stream events, while the second output channel outputs some percentage of the stream simultaneously.
    • The current mechanism of the EMU provides multiple output channels, where each channel gets a stream unit in a round-robin fashion. Seeking an elegant solution to avoid the stream unit copying required by the previous request.
  • RTDP report
  • Updates on the EJFAT project
  • Preparations for the abstract for CHEP24.
  • AOT

Useful References

Minutes:

Retrieved from "https://wiki.jlab.org/epsciwiki/index.php?title=EPSCI_SRO_Meeting_May._13_2024&oldid=4992"