EPSCI SRO Meeting Nov. 14 2022

From epsciwiki
Jump to navigation Jump to search


Connection Info:

You can connect using https://jlab-org.zoomgov.com/j/1608556097 (Meeting ID: 1160 855 6097). (Click "Expand" to the right for details -->):

One tap mobile: US: +16692545252,,1618740469# or +16468287666,,1618740469#
Meeting URL: https://jlab-org.zoomgov.com/j/1608556097?pwd=S1Fzbk9ubnZsOW5pRStqWW5MVTZLZz09&from=addon
Meeting ID: 160 855 6097
Passcode: 923910

Join by Telephone
For higher quality, dial a number based on your current location.
Dial:
US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free)
Meeting ID: 160 855 6097

International numbers
Join from an H.323/SIP room system
H.323: 161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 160 855 6097
Passcode: 923910
SIP: 1608556097@sip.zoomgov.com
Passcode: 923910


Agenda:

  1. Announcements
    1. CHEP 2023
  2. ERSAP planning
    1. Development efforts
      1. Tiered data storage
        1. Redis as a source actor
        2. Data-lake as a source actor
      2. Data stream transport
        1. Implementing Kafka as internal transport
        2. Support for P2P (client-server) communication
      3. Transient data format
        1. Use EVIO-6 as default
        2. Evaluate Apache Arrow as a transient data format
      4. Application graphical designer (on hold)
        1. Extend COOL to describe data-stream processing pipelines
        2. Engine provisioning and deployment improvements
      5. CLI improvements
      6. New language bindings (on hold)
      7. General-purpose data-stream processing engines
      8. Benchmarking and testing
    2. Commissioning and field studies
      1. EIC prototype detector components data stream readout and processing
        1. Upcoming beam tests at the JLAB
          1. TriDAS
          2. Streaming CODA
      2. Prototype GEM detector readout
        1. instructions at SAMPA-SRO
        2. DSPDecoder engine (on hold)
        3. Extending to 10 stream aggregation (designing)
        4. Formatting output data in EVIO-6 (in progress)
        5. ML-based anomaly detection: Adaptive sliding window (ADWIN) algorithm-based actor development (completed, testing)
        6. GEM detector failure. Installing replacement GEM
          1. 512 v.s. 768 strips
          2. Designing and fabricating a new transition board
          3. Transition board maps 480 (fits in 3 FE cards) of the 512 strips
        7. Paper at the CHEP23 (target)
      3. Integration with the streaming CODA data acquisition system.
        1. JCEdit-5.0: CODA COOL streaming front-end
        2. New CODA types: PAAG and SAAG (completed)
        3. AFECS updates to support new CODA types (completed)
        4. CODA connection mechanism to a data-processing pipeline
      4. EJFAT
        1. Port CLAS12 CLARA services into ERSAP (completed)
        2. EJFAT reassemble - ERSAP BE interface (completed)
        3. Successfully run CLAS12 reconstruction application on ejfat-1, streaming data from ejfat-5
          1. Detected missing events.
          2. Introducing data lake as a stream-source actor
  3. AOT

Useful References

Minutes:

Retrieved from "https://wiki.jlab.org/epsciwiki/index.php?title=EPSCI_SRO_Meeting_Nov._14_2022&oldid=2632"