SRO RTDP Feb. 26, 2024

The current weekly meeting time is every other Monday at 10:00 US/Eastern

Connection Info:

You can connect using ZOOM Video conferencing (ID: 160 248 4178). (Click "Expand" to the right for details -->):

One tap mobile: US: +16692545252,,1602484178# or +16468287666,,1602484178#

Meeting URL: https://jlab-org.zoomgov.com/j/1602484178?pwd=UFViZUpyODYrZmsxdkVNbWZTMUR1Zz09&from=addon
Meeting ID: 160 248 4178
Passcode: 104412

Join by Telephone
For higher quality, dial a number based on your current location.
Dial: +1 669 254 5252 US (San Jose)
+1 646 828 7666 US (New York)
+1 646 964 1167 US (US Spanish Line)
+1 551 285 1373 US (New Jersey)
+1 669 216 1590 US (San Jose)
+1 415 449 4000 US (US Spanish Line)
833 568 8864 US Toll-free
Meeting ID: 160 248 4178
International numbers
Join from an H.323/SIP room system
H.323: 161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 160 248 4178
Passcode: 104412

SIP: 1602484178@sip.zoomgov.com
Passcode: 104412

One tap mobile: US: +16692545252,,1601987443# or +16468287666,,1601987443#

Meeting URL: https://jlab-org.zoomgov.com/j/1601987443?pwd=bUVPV3puTHJPU0Fub2Q2Z1dsV0JjQT09&from=addon
Meeting ID: 160 198 7443
Passcode: 607906

Agenda:

1. Previous Meeting

2. Announcements:

3. R&D Projects
   • BDX Experiment
   • Visualization
   • Configuration
     • JCedit
     • rtdp YAML

4. Data Capture and Processing
   • CLAS12 Data Capture exercise
     • Aggregation program
     • CLAS12 Reconstruction (ERSAP)
   • INDRA Data Capture
     • Network enabled readout code
     • 100Gbps connection to EJFAT
     • Reconstruction

5. Milestone Progress: (Github Project)
   • FY24Q1

   • M01: Create prototype ERSAP configurations for INDRA and CLAS12 test systems (Ayan)

   • M02: Identify or capture SRO formatted data from CLAS12 and INDRA test systems with data tag/filtering capability (output data ready for further offline processing) (Discussion w/ Sergey)

   • M03: Evaluate existing solutions for configuring and launching remote distributed processes (Jeng, Cissie)

   • M04: Establish code repository(s), project site, and method of documentation (Jeng, Ayan)

   • FY24Q2

   • M05: Create stream splitter program for EVIO or HIPO data formatted files

   • M06: Create stream splitter program for simulated data in PODIO for ePIC

   • M07: Create VTP emulator using files produced by stream splitter

   • M08: Create controller program to synchronize multiple VTP emulators

6. AOT

---

Minutes

Attendees: David L., Vardan G., Cissie M., Ayan R., Fabio R., Jeng T., Marco B.

• Marco: Met last week with people from Univ. of Tokyo (SPADI alliance)
  • Possible involvement in BDX
  • Patrick Achenbach was in Japan and spoke with Taku(sp?)
  • Marco will invite reps from SPADI to join our bi-weekly meetings

• Fabio: SRO w/ Raspberry Pi slides
  • Compared various batch sizes on Rpi, CPU, GPU
  • Batch of 1k waveforms on GPU is not better than 1k batch on CPU
  • Interested in moving to FPGA for increased speed
  • Gets a compression ration ~4 (n.b. autoencoder is lossy method)

• Vardan: JCedit
  • Success last week on generalizing code for non-CODA applications (e.g. RTDP)
  • BPMN
  • Should have demo ready for next time
  • Looking at understanding process control
  • Configuration will likely end up as XML and not YAML
  • Monitoring still expected to be based on Grafana work Cissie is doing

• Ayan: RTDP system
  • YAML configuration prototype
  • Initial version for process launching now in repository (uses pssh)
  • Integrated into rtdp application

• CLAS12 Captured Data:
  • Ayan has been testing Carl's aggregation code and feeding issues back to him
    • Issues with multiple clients
    • Java version on EJFAT not compatible with version Carl developed under. Needs upgrade

• INDRA

• Cissie reported running speed tests on EJFAT machines, but only seeing about half the rates Carl reported on his wiki page here