EPSCI SRO Meeting Dec. 12 2022

From epsciwiki
Jump to navigation Jump to search


Connection Info:

You can connect using https://jlab-org.zoomgov.com/j/1608556097 (Meeting ID: 1160 855 6097). (Click "Expand" to the right for details -->):


Agenda:

  1. Announcements
    1. Last meeting of the 2022
  2. ERSAP planning
    1. Development efforts
      1. Monitoring
        1. Support for InfluxDB (done)
        2. Support for Prometheus (active)
          1. Prometheus ERSAP Exporter (active)
      2. Tiered data storage
        1. Redis as a source actor (on hold)
        2. Data-lake as a source actor
          1. Developed EjfatReaderEngine that includes a large ring buffer. (Testing)
          2. Develop EjfatReaderEngine that talks to ET (designing)
      3. Data stream transport
        1. Implementing Kafka as internal transport (research)
        2. Support for P2P (client-server) communication (on hold)
      4. Transient data format
        1. Use EVIO-6 as default
        2. Evaluate Apache Arrow as a transient data format (active)
        3. EvioArrow, ArrowEvio convertor engines (designing)
      5. Application graphical designer (research)
        1. Extend COOL to describe data-stream processing pipelines
          1. Considering using Spring Boot for web interface and object persistency (research)
        2. Engine provisioning and deployment improvements (on hold)
      6. CLI improvements
      7. New language bindings (on hold)
      8. General-purpose data-stream processing engines (on hold)
      9. Benchmarking and testing (active)
    2. Commissioning and field studies
      1. EIC prototype detector components data stream readout and processing
        1. Upcoming beam tests at the JLAB
          1. TriDAS
          2. Streaming CODA
      2. Prototype GEM detector readout
        1. instructions at SAMPA-SRO
        2. DSPDecoder engine (on hold)
        3. Extending to 10 stream aggregation (designing)
        4. Formatting output data in EVIO-6 (in progress)
        5. ML-based anomaly detection: Adaptive sliding window (ADWIN) algorithm-based actor development (completed, testing)
        6. GEM detector failure. Installing replacement GEM
          1. 512 v.s. 768 strips
          2. Designing and fabricating a new transition board
          3. Transition board maps 480 (fits in 3 FE cards) of the 512 strips
        7. Paper at the CHEP23 (target)
      3. Integration with the streaming CODA data acquisition system.
        1. JCEdit-5.0: CODA COOL streaming front-end
        2. New CODA types: PAAG and SAAG (testing)
        3. AFECS updates to support new CODA types (testing)
        4. CODA connection mechanism to a data-processing pipeline
          1. Most likely ET
      4. EJFAT
        1. Port CLAS12 CLARA services into ERSAP (completed)
        2. EJFAT reassemble - ERSAP BE interface (completed)
        3. Successfully run CLAS12 reconstruction application on ejfat-1, streaming data from ejfat-5 through LB on ejfat-1
          1. Corrupted reassembled events
          2. Introducing data lake as a stream-source actor (testing)
          3. PID loop in the BE receiver actor (completed)
  3. AOT

Useful References

Minutes:

Retrieved from "https://wiki.jlab.org/epsciwiki/index.php?title=EPSCI_SRO_Meeting_Dec._12_2022&oldid=2735"