EPSCI SRO Meeting Nov. 28 2022

Connection Info:

You can connect using https://jlab-org.zoomgov.com/j/1608556097 (Meeting ID: 1160 855 6097). (Click "Expand" to the right for details -->):

One tap mobile: US: +16692545252,,1618740469# or +16468287666,,1618740469#
Meeting URL: https://jlab-org.zoomgov.com/j/1608556097?pwd=S1Fzbk9ubnZsOW5pRStqWW5MVTZLZz09&from=addon
Meeting ID: 160 855 6097
Passcode: 923910

Join by Telephone
For higher quality, dial a number based on your current location.
Dial:
US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free)
Meeting ID: 160 855 6097

International numbers
Join from an H.323/SIP room system
H.323: 161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 160 855 6097
Passcode: 923910
SIP: 1608556097@sip.zoomgov.com
Passcode: 923910

Agenda:

1. Announcements
   1. CHEP 2023
      1. Submitted "Streaming Readout and Data-Stream Processing With ERSAP"
         1. DESY beam test
         2. GEM detector studies at Indra Lab.
2. ERSAP planning
   1. Development efforts
      1. Monitoring
         1. Support for InfluxDB (done)
         2. Support for Prometheus (active)
            1. Prometheus ERSAP Exporter (active)
      2. Tiered data storage
         1. Redis as a source actor
         2. Data-lake as a source actor
            1. Developed EjfatReaderEngine that includes a large ring buffer. (completed)
      3. Data stream transport
         1. Implementing Kafka as internal transport (research)
         2. Support for P2P (client-server) communication (on hold)
      4. Transient data format
         1. Use EVIO-6 as default
         2. Evaluate Apache Arrow as a transient data format (active)
         3. EvioArrow, ArrowEvio convertor engines (designing)
      5. Application graphical designer (research)
         1. Extend COOL to describe data-stream processing pipelines
            1. Considering using Spring Boot for web interface and object persistency (research)
         2. Engine provisioning and deployment improvements (on hold)
      6. CLI improvements
      7. New language bindings (on hold)
      8. General-purpose data-stream processing engines (on hold)
      9. Benchmarking and testing (active)
   2. Commissioning and field studies
      1. EIC prototype detector components data stream readout and processing
         1. Upcoming beam tests at the JLAB
            1. TriDAS
            2. Streaming CODA
      2. Prototype GEM detector readout
         1. instructions at SAMPA-SRO
         2. DSPDecoder engine (on hold)
         3. Extending to 10 stream aggregation (designing)
         4. Formatting output data in EVIO-6 (in progress)
         5. ML-based anomaly detection: Adaptive sliding window (ADWIN) algorithm-based actor development (completed, testing)
         6. GEM detector failure. Installing replacement GEM
            1. 512 v.s. 768 strips
            2. Designing and fabricating a new transition board
            3. Transition board maps 480 (fits in 3 FE cards) of the 512 strips
         7. Paper at the CHEP23 (target)
      3. Integration with the streaming CODA data acquisition system.
         1. JCEdit-5.0: CODA COOL streaming front-end
         2. New CODA types: PAAG and SAAG (completed)
         3. AFECS updates to support new CODA types (completed)
         4. CODA connection mechanism to a data-processing pipeline
      4. EJFAT
         1. Port CLAS12 CLARA services into ERSAP (completed)
         2. EJFAT reassemble - ERSAP BE interface (completed)
         3. Successfully run CLAS12 reconstruction application on ejfat-1, streaming data from ejfat-5 through LB on EJFAT-3
            1. Detected missing events.( solved)
            2. Introducing data lake as a stream-source actor (completed)
3. AOT

Useful References

• SRO Meetings
• CLAS12 SRO page
• ERSAP Document
• Vardan's WMS draft
• Graham's Paper describing SRO
• Dave Abbott's slides on data format

---