Difference between revisions of "SRO RTDP Feb. 26, 2024"

From epsciwiki
Jump to navigation Jump to search
(Created page with "The current weekly meeting time is every other Monday at 10:00 US/Eastern === Connection Info: === <div class="toccolours mw-collapsible mw-collapsed"> You can connect using...")
 
 
(2 intermediate revisions by the same user not shown)
Line 46: Line 46:
 
# Announcements:
 
# Announcements:
 
#:
 
#:
−
# CLAS12 Data Capture exercise
+
# R&D Projects
−
#* Aggregation program
+
#* BDX Experiment
−
#* CLAS12 Reconstruction (ERSAP)
 
 
#:
 
#:
−
# Visualization
+
#* Visualization
 
#:
 
#:
−
# BDX Experiment
+
#* Configuration
 +
#** JCedit
 +
#** rtdp YAML
 +
#:
 +
# Data Capture and Processing
 +
#* CLAS12 Data Capture exercise
 +
#** Aggregation program
 +
#** CLAS12 Reconstruction (ERSAP)
 +
#:
 +
#* INDRA Data Capture
 +
#** Network enabled readout code
 +
#** [https://jlab.servicenowservices.com/nav_to.do?uri=%2Fincident.do%3Fsys_id%3D5b966d8c1b540e50e1068777624bcb98%26sysparm_view%3Dess%26sysparm_record_target%3Dincident%26sysparm_record_row%3D1%26sysparm_record_rows%3D143%26sysparm_record_list%3Dcaller_id%253Djavascript%253Ags.getUserID%2528%2529%255Eactive%253Dtrue%255ENQu_affected_user%253Djavascript%253Ags.getUserID%2528%2529%255EEQ%255EORDERBYDESCopened_at 100Gbps connection to EJFAT]
 +
#** Reconstruction
 
#:
 
#:
 
# Milestone Progress: ([https://github.com/orgs/JeffersonLab/projects/17 Github Project])
 
# Milestone Progress: ([https://github.com/orgs/JeffersonLab/projects/17 Github Project])
Line 82: Line 93:
  
 
=== Minutes ===
 
=== Minutes ===
−
<--! Attendees: David L., Vardan G., Cissie M., Ayan R., Fabio R., Jeng T., Marco B., Mariangela B. -->
+
Attendees: David L., Vardan G., Cissie M., Ayan R., Fabio R., Jeng T., Marco B.
 +
 
 +
* Marco: Met last week with people from Univ. of Tokyo (SPADI alliance)
 +
** Possible involvement in BDX
 +
** Patrick Achenbach was in Japan and spoke with Taku(sp?)
 +
** Marco will invite reps from SPADI to join our bi-weekly meetings
 +
 
 +
* Fabio: SRO w/ Raspberry Pi [[Media:20240226_RTDP_Fabio.pdf | slides]]
 +
** Compared various batch sizes on Rpi, CPU, GPU
 +
** Batch of 1k waveforms on GPU is not better than 1k batch on CPU
 +
** Interested in moving to FPGA for increased speed
 +
** Gets a compression ration ~4 (n.b. autoencoder is lossy method)
 +
 
 +
* Vardan: JCedit
 +
** Success last week on generalizing code for non-CODA applications (e.g. RTDP)
 +
** BPMN
 +
** Should have demo ready for next time
 +
** Looking at understanding process control
 +
** Configuration will likely end up as XML and not YAML
 +
** Monitoring still expected to be based on Grafana work Cissie is doing
 +
 
 +
* Ayan: RTDP system
 +
** YAML configuration prototype
 +
** Initial version for process launching now in repository (uses pssh)
 +
** Integrated into rtdp application
 +
 
 +
* CLAS12 Captured Data:
 +
** Ayan has been testing Carl's aggregation code and feeding issues back to him
 +
*** Issues with multiple clients
 +
*** Java version on EJFAT not compatible with version Carl developed under. Needs upgrade
 +
 
 +
* INDRA
 +
 
 +
* Cissie reported running speed tests on EJFAT machines, but only seeing about half the rates Carl reported on his wiki page [[Testing Load Balancer Bandwidth | here]]

Latest revision as of 14:57, 27 February 2024

The current weekly meeting time is every other Monday at 10:00 US/Eastern

Connection Info:

You can connect using ZOOM Video conferencing (ID: 160 248 4178). (Click "Expand" to the right for details -->):

One tap mobile: US: +16692545252,,1602484178# or +16468287666,,1602484178#

Meeting URL: https://jlab-org.zoomgov.com/j/1602484178?pwd=UFViZUpyODYrZmsxdkVNbWZTMUR1Zz09&from=addon
Meeting ID: 160 248 4178
Passcode: 104412

Join by Telephone
For higher quality, dial a number based on your current location.
Dial: +1 669 254 5252 US (San Jose)
+1 646 828 7666 US (New York)
+1 646 964 1167 US (US Spanish Line)
+1 551 285 1373 US (New Jersey)
+1 669 216 1590 US (San Jose)
+1 415 449 4000 US (US Spanish Line)
833 568 8864 US Toll-free
Meeting ID: 160 248 4178
International numbers
Join from an H.323/SIP room system
H.323: 161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 160 248 4178
Passcode: 104412

SIP: 1602484178@sip.zoomgov.com
Passcode: 104412

One tap mobile: US: +16692545252,,1601987443# or +16468287666,,1601987443#

Meeting URL: https://jlab-org.zoomgov.com/j/1601987443?pwd=bUVPV3puTHJPU0Fub2Q2Z1dsV0JjQT09&from=addon
Meeting ID: 160 198 7443
Passcode: 607906

Agenda:

  1. Previous Meeting
  2. Announcements:
  3. R&D Projects
    • BDX Experiment
    • Visualization
    • Configuration
      • JCedit
      • rtdp YAML
  4. Data Capture and Processing
    • CLAS12 Data Capture exercise
      • Aggregation program
      • CLAS12 Reconstruction (ERSAP)
  5. Milestone Progress: (Github Project)
    • FY24Q1
    • M01: Create prototype ERSAP configurations for INDRA and CLAS12 test systems (Ayan)
    • M02: Identify or capture SRO formatted data from CLAS12 and INDRA test systems with data tag/filtering capability (output data ready for further offline processing) (Discussion w/ Sergey)
    • M03: Evaluate existing solutions for configuring and launching remote distributed processes (Jeng, Cissie)
    • M04: Establish code repository(s), project site, and method of documentation (Jeng, Ayan)
    • FY24Q2
    • M05: Create stream splitter program for EVIO or HIPO data formatted files
    • M06: Create stream splitter program for simulated data in PODIO for ePIC
    • M07: Create VTP emulator using files produced by stream splitter
    • M08: Create controller program to synchronize multiple VTP emulators
  6. AOT

Minutes

Attendees: David L., Vardan G., Cissie M., Ayan R., Fabio R., Jeng T., Marco B.

  • Marco: Met last week with people from Univ. of Tokyo (SPADI alliance)
    • Possible involvement in BDX
    • Patrick Achenbach was in Japan and spoke with Taku(sp?)
    • Marco will invite reps from SPADI to join our bi-weekly meetings
  • Fabio: SRO w/ Raspberry Pi slides
    • Compared various batch sizes on Rpi, CPU, GPU
    • Batch of 1k waveforms on GPU is not better than 1k batch on CPU
    • Interested in moving to FPGA for increased speed
    • Gets a compression ration ~4 (n.b. autoencoder is lossy method)
  • Vardan: JCedit
    • Success last week on generalizing code for non-CODA applications (e.g. RTDP)
    • BPMN
    • Should have demo ready for next time
    • Looking at understanding process control
    • Configuration will likely end up as XML and not YAML
    • Monitoring still expected to be based on Grafana work Cissie is doing
  • Ayan: RTDP system
    • YAML configuration prototype
    • Initial version for process launching now in repository (uses pssh)
    • Integrated into rtdp application
  • CLAS12 Captured Data:
    • Ayan has been testing Carl's aggregation code and feeding issues back to him
      • Issues with multiple clients
      • Java version on EJFAT not compatible with version Carl developed under. Needs upgrade
  • INDRA
  • Cissie reported running speed tests on EJFAT machines, but only seeing about half the rates Carl reported on his wiki page here
Retrieved from "https://wiki.jlab.org/epsciwiki/index.php?title=SRO_RTDP_Feb._26,_2024&oldid=4627"