View source for EPSCI SRO Meeting May. 13 2024



=== Connection Info: ===
<div class="toccolours mw-collapsible mw-collapsed">
You can connect using [https://jlab-org.zoomgov.com/j/1617825253 https://jlab-org.zoomgov.com/j/1617825253] (Meeting ID: 1160 855 6097). <font size="-3">(Click "Expand" to the right for details -->):</font>

<div class="mw-collapsible-content">

<p>
One tap mobile:	US: +16692545252,,1618740469# or +16468287666,,1618740469#<br>
Meeting URL:	 https://jlab-org.zoomgov.com/j/1617825253?pwd=bTQ2enh3QlBnb2JEd1JUK3BRSjFJdz09&from=addon&from=addon<br>
Meeting ID:	161 782 5253<br>
Passcode:	923910<br>
</p>
<p>
Join by Telephone<br>
For higher quality, dial a number based on your current location.<br>
Dial:	<br>
US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free)<br>
Meeting ID: 161 782 5253<br>
</p>
<p>
International numbers<br>
Join from an H.323/SIP room system<br>
H.323:	161.199.138.10 (US West)<br>
161.199.136.10 (US East)<br>
Meeting ID:	161 782 5253<br>
Passcode:	923910 <br>
SIP:		1608556097@sip.zoomgov.com<br>
Passcode:	923910 <br>
</p>
</div>
</div>

<!-------------------------------------------------------------------------------------------------->

=== Agenda: ===
* Announcements
** [https://indico.cern.ch/event/1338689/ CHEP2024]
** 24th IEEE Real-Time [https://indico.cern.ch/event/940112/ Conference]
* RTDP UI
** Vardan is working on a project to develop a user interface that allows designing, deploying, and configuring complete data-stream processing pipelines. This includes streaming readout and data acquisition capabilities, data transport and distribution, and data-stream processing and visualization. The RTDP UI project will be a desktop application built using JAVA SWING, incorporating some design elements and programming solutions from the CODA JCEdit project. Additionally, we plan to develop a specialized RTDP ontology language based on RDFS, which will be used for the serialization, communication, and archiving of configuration data.
* Large-scale Deployment and Scaling Test of the CLAS12 Data-Stream Processing Application at NERSC through EJFAT LB at ESnet
** Discussion on the outcomes from the recent 25-node horizontal scaling test.
** Challenges encountered in requesting additional resources due to the resource limits set for the EJFAT project.
** Jeng submitted a special resource reservation to reserve 40 nodes for 3 hours on May 20th at 10 AM. The submission was accepted this morning with the flag reservation=100g.
* Ongoing Work to Debug and Commission the Return Path for Processed Events through the Second LB Back to JLAB
** Readiness for local tests of the return path using two load balancer instances on the JLAB EJFAT testbed.
** Query on whether it is possible to request two local load balancers on the EJFAT testbed that are consistent with the latest LB upgrades and API.
** Procedure for releasing LB with the open end date ( -until 1970-01-01T00:00:00t00:00).
* Developing a Demo for a Full Streaming Pipeline:
** Progress on developing a demo for a full streaming pipeline, starting from streaming readout of the FADC250 through the VTP, passing CTP aggregated time windows to CODA PAGG (primary aggregator) that will create two data stream connections: one for the critical path to ER (socket-based fast connection), and the second to the ET system that plays the role of the FIFO, presented data stream for ERSAP data-processing pipeline pulling data off the ET FIFO, identifying FADC hits, applying a simple trigger algorithm and visualizing triggered data in real-time.
** Request to update EMU to be able to accept multiple output channels with user-programmable prescale factors for two output channels, one critical channel that outputs all the stream events, while the second output channel outputs some percentage of the stream simultaneously.
** The current mechanism of the EMU provides multiple output channels, where each channel gets a stream unit in a round-robin fashion. Seeking an elegant solution to avoid the stream unit copying required by the previous request.
* RTDP report 
* Updates on the EJFAT project
* Preparations for the abstract for CHEP24.
* AOT

==== Useful References ====
<small>
* [[SRO Meetings]]
* [https://clasweb.jlab.org/wiki/index.php/Streaming_Read-out_Wiki_page CLAS12 SRO page]
* [https://jeffersonlab.sharepoint.com/:w:/s/SciComp/EQxPpI6h8VRFtlSKLHeLWusBYCOQUySVpEBKCIlR09u5wA?email=davidl%40jlab.org&e=NCC22f ERSAP Document]
* [https://jeffersonlab.sharepoint.com/:w:/r/sites/SciComp/Shared%20Documents/EPSCI/SRO/Streaming/Development/WMS.docx?d=w286e2f0b5d174426a0ddd06a0766e57d&csf=1&e=8wGGZR Vardan's WMS draft]
* [https://jeffersonlab.sharepoint.com/:b:/r/sites/SciComp/Shared%20Documents/EPSCI/SRO/Streaming/20191217%20Streaming%20Paper/20200302%20JLab%20Streaming%20Readout.pdf?csf=1&e=kDX7yr Graham's Paper describing SRO]
* [[Media:20200609_data_format.pdf |Dave Abbott's slides on data format]]
</small>

<hr>

=== Minutes: ===