SRO RTDP Apr. 22, 2024

The current weekly meeting time is every other Monday at 10:00 US/Eastern

Connection Info:

You can connect using ZOOM Video conferencing (ID: 160 248 4178). (Click "Expand" to the right for details -->):

One tap mobile: US: +16692545252,,1602484178# or +16468287666,,1602484178#

Meeting URL: https://jlab-org.zoomgov.com/j/1602484178?pwd=UFViZUpyODYrZmsxdkVNbWZTMUR1Zz09&from=addon
Meeting ID: 160 248 4178
Passcode: 104412

Join by Telephone
For higher quality, dial a number based on your current location.
Dial: +1 669 254 5252 US (San Jose)
+1 646 828 7666 US (New York)
+1 646 964 1167 US (US Spanish Line)
+1 551 285 1373 US (New Jersey)
+1 669 216 1590 US (San Jose)
+1 415 449 4000 US (US Spanish Line)
833 568 8864 US Toll-free
Meeting ID: 160 248 4178
International numbers
Join from an H.323/SIP room system
H.323: 161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 160 248 4178
Passcode: 104412

SIP: 1602484178@sip.zoomgov.com
Passcode: 104412

One tap mobile: US: +16692545252,,1601987443# or +16468287666,,1601987443#

Meeting URL: https://jlab-org.zoomgov.com/j/1601987443?pwd=bUVPV3puTHJPU0Fub2Q2Z1dsV0JjQT09&from=addon
Meeting ID: 160 198 7443
Passcode: 607906

Agenda:

1. Previous Meeting

2. Announcements:

   • Slides for RTDP update at JLab EIC meeting in mid-April (date TBD)

   • LDRD PI meeting

3. R&D Projects
   • BDX Experiment
   • Configuration
     • JCedit
     • rtdp YAML

4. Data Capture and Processing
   • Aggregation
     • GlueX
     • CLAS12

5. ePIC
   • PODIO Streaming
   • Visualization
6. INDRA:100Gbps connection to EJFAT#** Reconstruction

7. Milestone Progress: (Github Project)
   • FY24Q1

   • M01: Create prototype ERSAP configurations for INDRA and CLAS12 test systems (Ayan)

   • M02: Identify or capture SRO formatted data from CLAS12 and INDRA test systems with data tag/filtering capability (output data ready for further offline processing) (Discussion w/ Sergey)

   • M03: Evaluate existing solutions for configuring and launching remote distributed processes (Jeng, Cissie)

   • M04: Establish code repository(s), project site, and method of documentation (Jeng, Ayan)

   • FY24Q2

   • M05: Create stream splitter program for EVIO or HIPO data formatted files

   • M06: Create stream splitter program for simulated data in PODIO for ePIC

   • M07: Create VTP emulator using files produced by stream splitter

   • M08: Create controller program to synchronize multiple VTP emulators

8. AOT

---

Minutes

Attendees: David L., Ayan R., Vardan G., Fabio R., Jeng T.

• Fabio reported he has been tied up with FPGA issues on a setup he is working on.
  • He may come in June to JLab for a meeting on the BDX setup. We'll take the opportunity to meet in person with him then.

• Vardan
  • Lots of progress on JCedit
    • Currently implementing process control mechanism (very close to being done)
  • Some discussion on how to present a demo and get others involved as users
    • Suggested Cissie learn and test the system and then give the demo
    • Vardan will generate some documentation first for her to work from

Ayan

• Still working on getting a working stream aggregator system
  • Original provided by Carl made specifically for SRO format data
    • Some issues with using it with packet captured data. This, Carl's limited availability at the time, and the desire to move towards a system to be used with Hydra for the next set of milestones caused a switch to GlueX raw data
  • EVIO split files from GlueX generated using an old program containing only info from a single ROC. These turned out to be missing trigger info banks and EVIO block headers making their use limited with standard tools.
  • An attempt was made to use the CDAQ aggregator by Sergey Furletov with the split files.
    • Some issues with getting the stream exactly right started leading down a rabbit hole
  • Carl produced another aggregator that could be used with triggered data. The incomplete format of the split files prevented this from working
  • Ayan, Carl, and David will need to have a meeting to figure out the details on how to proceed

• The PODIO streaming prototype for ePIC was successfully tested by Jeng
  • Some discussion on how this might be coupled to EJFAT. Best course of action is to wait for library API Ilya and Carl are working on to be ready and then use that.
  • Suggestion that Jeng look at running this at NERSC using JIRIAF. This will be an R&D test for both JIRIAF and RTDP so should be charged 50/50 between those projects.

Action Items

1. Generate documentation on new Configuration tool (Vardan)
2. Schedule meeting with Ayan, Carl, and David on aggregator (Carl)
3. PODIO + NERSC + JIRIAF test (Jeng)