Difference between revisions of "EPSCI SRO Meeting Jan. 9 2023"

From epsciwiki
Jump to navigation Jump to search
(Created page with " === Connection Info: === <div class="toccolours mw-collapsible mw-collapsed"> You can connect using [https://jlab-org.zoomgov.com/j/1608556097 https://jlab-org.zoomgov.com/j...")
 
 
Line 53: Line 53:
 
## Formatting output data in EVIO-6 (in progress)
 
## Formatting output data in EVIO-6 (in progress)
 
## ML-based anomaly detection: Adaptive sliding window (ADWIN) algorithm-based actor development (completed, testing)
 
## ML-based anomaly detection: Adaptive sliding window (ADWIN) algorithm-based actor development (completed, testing)
 +
## Cluster finding in a stream of data
 
## New GEM detector installation
 
## New GEM detector installation
 
## Integration with the streaming CODA data acquisition system.
 
## Integration with the streaming CODA data acquisition system.

Latest revision as of 18:54, 9 January 2023


Connection Info:

You can connect using https://jlab-org.zoomgov.com/j/1608556097 (Meeting ID: 1160 855 6097). (Click "Expand" to the right for details -->):

One tap mobile: US: +16692545252,,1618740469# or +16468287666,,1618740469#
Meeting URL: https://jlab-org.zoomgov.com/j/1608556097?pwd=S1Fzbk9ubnZsOW5pRStqWW5MVTZLZz09&from=addon
Meeting ID: 160 855 6097
Passcode: 923910

Join by Telephone
For higher quality, dial a number based on your current location.
Dial:
US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free)
Meeting ID: 160 855 6097

International numbers
Join from an H.323/SIP room system
H.323: 161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 160 855 6097
Passcode: 923910
SIP: 1608556097@sip.zoomgov.com
Passcode: 923910


Agenda:

  1. Announcements
  1. Streaming CODA
    1. CODA PAAG and SAAG components
    2. JCEdit-5.0: CODA COOL streaming front-end
      1. New CODA types: PAAG and SAAG
    3. AFECS updates to support new CODA types
    4. CODA connection mechanism to a data-processing pipeline
      1. Remote ET FIFO
    5. CODA EPICS interface
      1. ActiveMQ
  1. Prototype GEM detector readout
    1. instructions at SAMPA-SRO
    2. DSPDecoder engine (on hold)
    3. Formatting output data in EVIO-6 (in progress)
    4. ML-based anomaly detection: Adaptive sliding window (ADWIN) algorithm-based actor development (completed, testing)
    5. Cluster finding in a stream of data
    6. New GEM detector installation
    7. Integration with the streaming CODA data acquisition system.
  1. EJFAT
    1. Port CLAS12 CLARA services into ERSAP (completed)
    2. EJFAT reassemble - ERSAP BE interface (completed)
    3. Successfully run CLAS12 reconstruction application on ejfat-1, streaming data from ejfat-5 through LB on ejfat-1
    4. Corrupted reassembled events
    5. Introducing data lake as a stream-source actor (testing)
    6. PID loop in the BE receiver actor (completed)
  1. TriDAS
  1. ERSAP planning
    1. Development efforts
      1. Monitoring
        1. Support for InfluxDB (done)
        2. Support for Prometheus (active)
          1. Prometheus ERSAP Exporter (active)
      2. Tiered data storage
        1. Redis as a source actor (on hold)
        2. Data-lake as a source actor
          1. Developed EjfatReaderEngine that includes a large ring buffer. (Testing)
          2. Develop EjfatReaderEngine that talks to ET (designing)
      3. Data stream transport
        1. Implementing Kafka as internal transport (research)
        2. Support for P2P (client-server) communication (on hold)
      4. Transient data format
        1. Use EVIO-6 as default
        2. Evaluate Apache Arrow as a transient data format (active)
        3. EvioArrow, ArrowEvio convertor engines (designing)
      5. Application graphical designer (research)
        1. Extend COOL to describe data-stream processing pipelines
          1. Considering using Spring Boot for web interface and object persistency (research)
        2. Engine provisioning and deployment improvements (on hold)
      6. CLI improvements
      7. New language bindings (on hold)
      8. General-purpose data-stream processing engines (on hold)
      9. Benchmarking and testing (active)
    2. Commissioning and field studies
      1. EIC prototype detector components data stream readout and processing
        1. Upcoming beam tests at the JLAB
  2. AOT

Useful References


Minutes: