SRO RTDP Jan. 29, 2024
The current weekly meeting time is every other Monday at 10:00 US/Eastern
Connection Info:
You can connect using ZOOM Video conferencing (ID: 160 248 4178). (Click "Expand" to the right for details -->):
One tap mobile: US: +16692545252,,1602484178# or +16468287666,,1602484178#
Meeting URL: https://jlab-org.zoomgov.com/j/1602484178?pwd=UFViZUpyODYrZmsxdkVNbWZTMUR1Zz09&from=addon
Meeting ID: 160 248 4178
Passcode: 104412
Join by Telephone
For higher quality, dial a number based on your current location.
Dial: +1 669 254 5252 US (San Jose)
+1 646 828 7666 US (New York)
+1 646 964 1167 US (US Spanish Line)
+1 551 285 1373 US (New Jersey)
+1 669 216 1590 US (San Jose)
+1 415 449 4000 US (US Spanish Line)
833 568 8864 US Toll-free
Meeting ID: 160 248 4178
International numbers
Join from an H.323/SIP room system
H.323: 161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 160 248 4178
Passcode: 104412
SIP: 1602484178@sip.zoomgov.com
Passcode: 104412
One tap mobile: US: +16692545252,,1601987443# or +16468287666,,1601987443#
Meeting URL: https://jlab-org.zoomgov.com/j/1601987443?pwd=bUVPV3puTHJPU0Fub2Q2Z1dsV0JjQT09&from=addon
Meeting ID: 160 198 7443
Passcode: 607906
Agenda:
- Previous Meeting
- Announcements:
- CLAS12 Data Capture exercise
- Aggregation program
- CLAS12 Reconstruction (ERSAP)
- Visualization
- BDX Experiment
- Milestone Progress: (Github Project)
- FY24Q1
- M01: Create prototype ERSAP configurations for INDRA and CLAS12 test systems (Ayan)
M02: Identify or capture SRO formatted data from CLAS12 and INDRA test systems with data tag/filtering capability (output data ready for further offline processing) (Discussion w/ Sergey)M03: Evaluate existing solutions for configuring and launching remote distributed processes (Jeng, Cissie)M04: Establish code repository(s), project site, and method of documentation (Jeng, Ayan)- FY24Q2
- M05: Create stream splitter program for EVIO or HIPO data formatted files
- M06: Create stream splitter program for simulated data in PODIO for ePIC
- M07: Create VTP emulator using files produced by stream splitter
- M08: Create controller program to synchronize multiple VTP emulators
- FY24Q1
- AOT
Minutes
Attendees: David L., Vardan G., Cissie M., Ayan R., Fabio R., Jeng T., Marco B., Mariangela B.
- CLAS12 Data Capture
- Carl working on stream aggregation (out most of this week)
- Some code already placed in repository (not fully tested and not clear if it is running yet)
- Some discussion on how much is needed from CODA to run aggregator. Need to get better clarification from Carl when he is back. (Currently, Carl is only person in world who understands details of problem)
- EVIO - > HIPO ERSAP actor
- Vardan spoke recently with Gagik who has some code for a CLARA service that does this as part of their online system
- Some additional work/testing is being done. Then Vardan should be able to convert it into an ERSAP actor in a couple of hours.
- Not clear whether it will properly handle SRO bank types since CLAS12 does not use them up to now.
- Several pieces are needed to get data in format that can be consumed by standard CLAS12 recon.. David needs to enumerate and start tracking these.
- Carl working on stream aggregation (out most of this week)
- INDRA lab SRO
- Meeting this afternoon w/ Holly to discuss GEM readout exercise
- Vardan noted that Ed J. is familiar with all details of the setup and should be involved. CNU also has knowledge of data aspect.
- Visualization
- Researched Grafana node-graphs and it seems to provide similar monitoring function as dash-cyto
- Vardan is working on upgrades to JCEdit to support multi-stream configurations.
- We discussed the roles of JCEdit and a Grafana visualization. Consensus that JCEdit addresses creating configurations while the Grafana solution addresses monitoring of a running system.
- Some discussion on whether Prometheus DB could be used for visualization. Cissie noted that it would need some code to transform it into the form needed by Grafana node-graphs. She pointed to a the data model API used by the Grafana implementation which Vardan said he would look at and consider how it might be incorporated into the CODA system so it can be written to in addition to Prometheus.
- BDX
- Marco updated us on the PRAD hardware situation. The hardware we thought was order is not due to Continuing Resolution budget situation. They have pivoted to work with some other available hardware in Genoa. This includes a 64 channel digitizer.
- Fabio showed some slides on some recent data compression testing done at INFN.
- Use of multiple Raspberry Pi computers and a PC to stream data from files through a compression and then decompression stage on different machines.
- Used autoencoder for compression.
- Meeting time ran out before we were able to fully explore details of report. They will report more in two weeks when we will dedicate more time.
- Ayan has started some work on milestone M08 but will report more details at next meeting.
Action Items
- Get details from Carl on limitations of running aggregator outside of CODA context (David)
- Make list of missing components for transforming streaming data into format compatible with CLAS12 recon. (David)