SRO RTDP Sep. 23, 2024
The current weekly meeting time is every other Monday at 10:00 US/Eastern
Connection Info:
You can connect using ZOOM Video conferencing (ID: 160 248 4178). (Click "Expand" to the right for details -->):
One tap mobile: US: +16692545252,,1602484178# or +16468287666,,1602484178#
Meeting URL: https://jlab-org.zoomgov.com/j/1602484178?pwd=UFViZUpyODYrZmsxdkVNbWZTMUR1Zz09&from=addon
Meeting ID: 160 248 4178
Passcode: 104412
Join by Telephone
For higher quality, dial a number based on your current location.
Dial: +1 669 254 5252 US (San Jose)
+1 646 828 7666 US (New York)
+1 646 964 1167 US (US Spanish Line)
+1 551 285 1373 US (New Jersey)
+1 669 216 1590 US (San Jose)
+1 415 449 4000 US (US Spanish Line)
833 568 8864 US Toll-free
Meeting ID: 160 248 4178
International numbers
Join from an H.323/SIP room system
H.323: 161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 160 248 4178
Passcode: 104412
SIP: 1602484178@sip.zoomgov.com
Passcode: 104412
One tap mobile: US: +16692545252,,1601987443# or +16468287666,,1601987443#
Meeting URL: https://jlab-org.zoomgov.com/j/1601987443?pwd=bUVPV3puTHJPU0Fub2Q2Z1dsV0JjQT09&from=addon
Meeting ID: 160 198 7443
Passcode: 607906
Agenda:
- Previous Meeting
- Announcements:
- Project Progress: (Github Project)
- May 2024 Packet Capture Analysis
- JANA2 configuration - Nathan (github issue)
- RTDP workflow monitoring
- Prometheus server - Cissie (github issue)
- Prometheus + ePIC - Cissie (github issue)
- RTDP Configuration
- DPUX format spec. - Vardan
- Graphical editor - Vardan (github issue)
- DPUX example config. - Jeng (github issue)
- May 2024 Packet Capture Analysis
- BDX Status + R&D
- AOT
Milestones
FY24Q2
M05: Create stream splitter program for EVIO or HIPO data formatted filesM06: Create stream splitter program for simulated data in PODIO for ePICM07: Create VTP emulator using files produced by stream splitterM08: Create controller program to synchronize multiple VTP emulators
FY24Q3
- M09: Determine appropriate schema for all aspects of monitoring system
- M10: Establish databases for monitoring system using existing JLab servers.
- M11: Integrate Hydra as monitoring component.
FY24Q4
- M12: Integrate off-line data analysis framework into platform for CLAS12 data
- M13: Integrate off-line data analysis framework into platform for ePIC or GlueX simulated data
- M14: Integrate example JANA2 analysis into platform
Minutes
Attendees: David L., Vardan G., Jeng T., Cissie M.
- Cissie reported trying to use process_exporter with apptainer on the farm but only observing zeros
- Jeng has successfully used it before. They will get together offline and share screens to track down the issue
- They will be prepared to test both process_exporter and node_exporter to see if either (or both) give the desired information for apptainer processes
- Cissie will take another look at the GitHub issues assigned to her. Some of the work has been completed and some needs to be refactored
- e.g. based on her earlier efforts we decided not to pursue a permanent, persistent Prometheus server
- David needs to complete testing the podiostream port update to allow use on the slurm farm. He will do this and notify Cissie or at least point her to the branch that contains the work so she can move forward.
- Vardan reported that work is progressing on the DDPUX/DPOL develeopment
- Apache RDFS parser will be used
- Some discussion on using Camunda vs. updated Java-based JCEdit
- Camunda has many nice features and is well supported by outside group
- JCEdit has interface that is familiar and tailored specifically to CODA-like applications (which RTDP fits in that category)
- Focus for immediate needs (SC24 and RTDP milestones) leans towards the JCEDit option
- Work on DPOL parser for use in command-line tool is becoming a priority
Action Items
- Update Github issues assigned to Cissie (Cissie)
- Complete podiostream port config. and send to Cissie (David)
- Begin work on RTDP config. parser for command-line tool (Jeng/Vardan)