SRO RTDP Jul. 15, 2024

The current weekly meeting time is every other Monday at 10:00 US/Eastern

Connection Info:

You can connect using ZOOM Video conferencing (ID: 160 248 4178). (Click "Expand" to the right for details -->):

One tap mobile: US: +16692545252,,1602484178# or +16468287666,,1602484178#

Meeting URL: https://jlab-org.zoomgov.com/j/1602484178?pwd=UFViZUpyODYrZmsxdkVNbWZTMUR1Zz09&from=addon
Meeting ID: 160 248 4178
Passcode: 104412

Join by Telephone
For higher quality, dial a number based on your current location.
Dial: +1 669 254 5252 US (San Jose)
+1 646 828 7666 US (New York)
+1 646 964 1167 US (US Spanish Line)
+1 551 285 1373 US (New Jersey)
+1 669 216 1590 US (San Jose)
+1 415 449 4000 US (US Spanish Line)
833 568 8864 US Toll-free
Meeting ID: 160 248 4178
International numbers
Join from an H.323/SIP room system
H.323: 161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 160 248 4178
Passcode: 104412

SIP: 1602484178@sip.zoomgov.com
Passcode: 104412

One tap mobile: US: +16692545252,,1601987443# or +16468287666,,1601987443#

Meeting URL: https://jlab-org.zoomgov.com/j/1601987443?pwd=bUVPV3puTHJPU0Fub2Q2Z1dsV0JjQT09&from=addon
Meeting ID: 160 198 7443
Passcode: 607906

Agenda:

1. Previous Meeting

2. Announcements:

   • Renewal Proposal Submitted
   • No meeting July 29th (David OoO)

3. R&D Projects
   • BDX Experiment
   • Configuration
     • DPPUI

4. Data Capture and Processing
   • Aggregation/Streaming
     • GlueX
     • CLAS12
     • ePIC

5. Milestone Progress: (Github Project)
   • FY24Q2

   • M05: Create stream splitter program for EVIO or HIPO data formatted files

   • M06: Create stream splitter program for simulated data in PODIO for ePIC

   • M07: Create VTP emulator using files produced by stream splitter

   • M08: Create controller program to synchronize multiple VTP emulators
   • FY24Q3

   • M09: Determine appropriate schema for all aspects of monitoring system

   • M10: Establish databases for monitoring system using existing JLab servers.

   • M11: Integrate Hydra as monitoring component.

6. AOT

---

Minutes

Attendees: David L., Ayan R., Vardan G., Fabio R., Jeng T., Cissie M.

• Fabio
  • Made is safely back to Italy (after some weather delays)
  • Spoke with Sergey Furletov about FPGA streaming. He confirmed that Alveo was not a good choice for SRO DAQ as PCIe transfers would dominate much of the rate.
    • Need board with dedicated network connections (Sergey suggested a few boards)
  • One crate with a flash ADC exists in Hall-B as a shared resource for testing
  • Fabio will use over the coming weeks/months to become familiar with the electronics
  • Fabio spoke with Ben about FADC250 streaming readout and limitations on reading windows. It will be some time before window readout is supported for SRO.

• Vardan
  • No direct progress to report on DPPUI (Data Processing Pipeline User Interface)
  • Some low-level work being done on DPOL (Data Processing Ontology Language) which required some redesign to address performance issues.

• Jeng
  • Looking to deploy JIRIAF using FABRIC
  • Spoke some with Srinivas from HPDF to get started

• Cissie
  • Able to capture podman process status using the fabric python module
    • Fabric is not to be confused with FABRIC
    • Tool allows launching over ssh and monitoring process by retrieving JSON records.

• Ayan
  • Quarterly report for LDRD largely completed.
    • Figures and status table are done but need to replace Q2 text with Q3 text
  • ACAT2024 paper almost done
    • Would like to include more description of figures in the text as opposed to just what is in the captions.
    • Will communicate with David offline to resolve remaining questions about figures.

• Discussion
  • David noted we now have 3 variations on stream processing representing 3 experiments:
    1. CLAS12
    2. GlueX
    3. ePIC/PODIO
  • Some discussion on how the JLab -> NERSC exercise Jeng did for ePIC/PODIO worked
    • Jeng explained the system worked via two connected ssh tunnels with the NERSC login node as the intermediate point between the JIRIAF node at JLab and the slurm-allocated Perlmutter node.
  • David suggested Jeng and Ayan work together to document the three examples so any of us could run them
    • EJFAT would likely be needed for high bandwidth communication, but will require some coding to make the GlueX and epic/PODIO systems use it.
  • Our next goal is to generalize these examples so RTDP could configure and run each of them.