Difference between revisions of "EPSCI SRO Meeting Mov. 13 2023"
(Created page with " === Connection Info: === <div class="toccolours mw-collapsible mw-collapsed"> You can connect using [https://jlab-org.zoomgov.com/j/1608556097 https://jlab-org.zoomgov.com/j...") |
|||
Line 37: | Line 37: | ||
=== Agenda: === | === Agenda: === | ||
# Announcements | # Announcements | ||
− | # Critical milestone is achieved! | + | ## Critical milestone is achieved! |
− | ## The ERSAP stream processing data pipeline has successfully reconstructed CLAS12 data originating from a stream at JLAB. | + | ### The ERSAP stream processing data pipeline has successfully reconstructed CLAS12 data originating from a stream at JLAB. |
− | ### This marks the first demonstration of remote data-stream processing utilizing ERSAP. | + | #### This marks the first demonstration of remote data-stream processing utilizing ERSAP. |
− | ## This marks the inaugural data stream transportation and intelligent load balancing, guided by the EJFAT. | + | ### This marks the inaugural data stream transportation and intelligent load balancing, guided by the EJFAT. |
# ERSAP recent developments | # ERSAP recent developments | ||
## MonitorOrchestrator | ## MonitorOrchestrator |
Latest revision as of 14:34, 13 November 2023
Connection Info:
You can connect using https://jlab-org.zoomgov.com/j/1608556097 (Meeting ID: 1160 855 6097). (Click "Expand" to the right for details -->):
One tap mobile: US: +16692545252,,1618740469# or +16468287666,,1618740469#
Meeting URL: https://jlab-org.zoomgov.com/j/1608556097?pwd=S1Fzbk9ubnZsOW5pRStqWW5MVTZLZz09&from=addon
Meeting ID: 160 855 6097
Passcode: 923910
Join by Telephone
For higher quality, dial a number based on your current location.
Dial:
US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free)
Meeting ID: 160 855 6097
International numbers
Join from an H.323/SIP room system
H.323: 161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 160 855 6097
Passcode: 923910
SIP: 1608556097@sip.zoomgov.com
Passcode: 923910
Agenda:
- Announcements
- Critical milestone is achieved!
- The ERSAP stream processing data pipeline has successfully reconstructed CLAS12 data originating from a stream at JLAB.
- This marks the first demonstration of remote data-stream processing utilizing ERSAP.
- This marks the inaugural data stream transportation and intelligent load balancing, guided by the EJFAT.
- The ERSAP stream processing data pipeline has successfully reconstructed CLAS12 data originating from a stream at JLAB.
- Critical milestone is achieved!
- ERSAP recent developments
- MonitorOrchestrator
- DataRing of monitored data
- PrometheusExpoeter and InfluxDBReporter as clients
- DataRing of monitored data
- GenericOrchestrator
- Prometheus exporter based on io.prometheus.client.Gauge
- It now tracks the average event processing time, total processed events, and cumulative processing duration, all accessible via an HTTP server on localhost.
- Prometheus exporter based on io.prometheus.client.Gauge
- MonitorOrchestrator
- Indra Lab streaming readout
- SAMPA SRO and processing is operational.
- The ERSAP SAMPA decoder and analyzer engines have been upgraded.
- We've revised the Wiki instructions and conducted practical sessions with the CNU group and Holley.
- SAMPA SRO and processing is operational.
- JIRAF-EJFAT-EsNet-NERSC integration test.
- Preparing for the extensive scalability test at NERSC with JIRIAF.
- Developing the stream source actor to transmit reconstructed events to JLAB.
- VTP stream hit identification algorithm
- Adaptive Crawling Window Event Clustering (ACWEC) algorithm
- Collaborating with Ben to code the algorithm onto the VTP FPGA.
- Adaptive Crawling Window Event Clustering (ACWEC) algorithm
- Writing data from Kafka into DAOS and streaming data from DAOS to Kafka.
- Awaiting the readiness of a test bed.
- AOT
Useful References
- SRO Meetings
- CLAS12 SRO page
- ERSAP Document
- Vardan's WMS draft
- Graham's Paper describing SRO
- Dave Abbott's slides on data format