Difference between revisions of "EPSCI SRO Meeting Nov. 14 2022"

From epsciwiki
Jump to navigation Jump to search
(Created page with " === Connection Info: === <div class="toccolours mw-collapsible mw-collapsed"> You can connect using [https://jlab-org.zoomgov.com/j/1608556097 https://jlab-org.zoomgov.com/j...")
 
 
(2 intermediate revisions by the same user not shown)
Line 68: Line 68:
 
#### ML-based anomaly detection: Adaptive sliding window (ADWIN) algorithm-based actor development (completed, testing)
 
#### ML-based anomaly detection: Adaptive sliding window (ADWIN) algorithm-based actor development (completed, testing)
 
#### GEM detector failure. Installing replacement GEM
 
#### GEM detector failure. Installing replacement GEM
 +
##### 512 v.s. 768 strips
 
##### Designing and fabricating a new transition board
 
##### Designing and fabricating a new transition board
 +
##### Transition board maps 480 (fits in 3 FE cards) of the 512 strips
 
#### Paper at the CHEP23 (target)
 
#### Paper at the CHEP23 (target)
 
### Integration with the streaming CODA data acquisition system.
 
### Integration with the streaming CODA data acquisition system.
Line 78: Line 80:
 
#### Port CLAS12 CLARA services into ERSAP (completed)
 
#### Port CLAS12 CLARA services into ERSAP (completed)
 
#### EJFAT reassemble - ERSAP BE interface (completed)
 
#### EJFAT reassemble - ERSAP BE interface (completed)
#### Successfully run CLAS12 reconstruction application on ejfat-1, streami ng data from ejfat-5
+
#### Successfully run CLAS12 reconstruction application on ejfat-1, streaming data from ejfat-5
 
##### Detected missing events.  
 
##### Detected missing events.  
 +
##### Introducing data lake as a stream-source actor
 
# AOT
 
# AOT
  

Latest revision as of 12:26, 14 November 2022


Connection Info:

You can connect using https://jlab-org.zoomgov.com/j/1608556097 (Meeting ID: 1160 855 6097). (Click "Expand" to the right for details -->):

One tap mobile: US: +16692545252,,1618740469# or +16468287666,,1618740469#
Meeting URL: https://jlab-org.zoomgov.com/j/1608556097?pwd=S1Fzbk9ubnZsOW5pRStqWW5MVTZLZz09&from=addon
Meeting ID: 160 855 6097
Passcode: 923910

Join by Telephone
For higher quality, dial a number based on your current location.
Dial:
US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free)
Meeting ID: 160 855 6097

International numbers
Join from an H.323/SIP room system
H.323: 161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 160 855 6097
Passcode: 923910
SIP: 1608556097@sip.zoomgov.com
Passcode: 923910


Agenda:

  1. Announcements
    1. CHEP 2023
  2. ERSAP planning
    1. Development efforts
      1. Tiered data storage
        1. Redis as a source actor
        2. Data-lake as a source actor
      2. Data stream transport
        1. Implementing Kafka as internal transport
        2. Support for P2P (client-server) communication
      3. Transient data format
        1. Use EVIO-6 as default
        2. Evaluate Apache Arrow as a transient data format
      4. Application graphical designer (on hold)
        1. Extend COOL to describe data-stream processing pipelines
        2. Engine provisioning and deployment improvements
      5. CLI improvements
      6. New language bindings (on hold)
      7. General-purpose data-stream processing engines
      8. Benchmarking and testing
    2. Commissioning and field studies
      1. EIC prototype detector components data stream readout and processing
        1. Upcoming beam tests at the JLAB
          1. TriDAS
          2. Streaming CODA
      2. Prototype GEM detector readout
        1. instructions at SAMPA-SRO
        2. DSPDecoder engine (on hold)
        3. Extending to 10 stream aggregation (designing)
        4. Formatting output data in EVIO-6 (in progress)
        5. ML-based anomaly detection: Adaptive sliding window (ADWIN) algorithm-based actor development (completed, testing)
        6. GEM detector failure. Installing replacement GEM
          1. 512 v.s. 768 strips
          2. Designing and fabricating a new transition board
          3. Transition board maps 480 (fits in 3 FE cards) of the 512 strips
        7. Paper at the CHEP23 (target)
      3. Integration with the streaming CODA data acquisition system.
        1. JCEdit-5.0: CODA COOL streaming front-end
        2. New CODA types: PAAG and SAAG (completed)
        3. AFECS updates to support new CODA types (completed)
        4. CODA connection mechanism to a data-processing pipeline
      4. EJFAT
        1. Port CLAS12 CLARA services into ERSAP (completed)
        2. EJFAT reassemble - ERSAP BE interface (completed)
        3. Successfully run CLAS12 reconstruction application on ejfat-1, streaming data from ejfat-5
          1. Detected missing events.
          2. Introducing data lake as a stream-source actor
  3. AOT

Useful References


Minutes: