Difference between revisions of "SRO RTDP Feb. 26, 2024"

From epsciwiki
Jump to navigation Jump to search
 
(One intermediate revision by the same user not shown)
Line 46: Line 46:
 
# Announcements:
 
# Announcements:
 
#:
 
#:
−
# CLAS12 Data Capture exercise
+
# R&D Projects
−
#* Aggregation program
+
#* BDX Experiment
−
#* CLAS12 Reconstruction (ERSAP)
 
 
#:
 
#:
−
# Visualization
+
#* Visualization
 
#:
 
#:
−
# BDX Experiment
+
#* Configuration
 +
#** JCedit
 +
#** rtdp YAML
 +
#:
 +
# Data Capture and Processing
 +
#* CLAS12 Data Capture exercise
 +
#** Aggregation program
 +
#** CLAS12 Reconstruction (ERSAP)
 +
#:
 +
#* INDRA Data Capture
 +
#** Network enabled readout code
 +
#** [https://jlab.servicenowservices.com/nav_to.do?uri=%2Fincident.do%3Fsys_id%3D5b966d8c1b540e50e1068777624bcb98%26sysparm_view%3Dess%26sysparm_record_target%3Dincident%26sysparm_record_row%3D1%26sysparm_record_rows%3D143%26sysparm_record_list%3Dcaller_id%253Djavascript%253Ags.getUserID%2528%2529%255Eactive%253Dtrue%255ENQu_affected_user%253Djavascript%253Ags.getUserID%2528%2529%255EEQ%255EORDERBYDESCopened_at 100Gbps connection to EJFAT]
 +
#** Reconstruction
 
#:
 
#:
 
# Milestone Progress: ([https://github.com/orgs/JeffersonLab/projects/17 Github Project])
 
# Milestone Progress: ([https://github.com/orgs/JeffersonLab/projects/17 Github Project])
Line 82: Line 93:
  
 
=== Minutes ===
 
=== Minutes ===
−
<!-- Attendees: David L., Vardan G., Cissie M., Ayan R., Fabio R., Jeng T., Marco B., Mariangela B. -->
+
Attendees: David L., Vardan G., Cissie M., Ayan R., Fabio R., Jeng T., Marco B.
 +
 
 +
* Marco: Met last week with people from Univ. of Tokyo (SPADI alliance)
 +
** Possible involvement in BDX
 +
** Patrick Achenbach was in Japan and spoke with Taku(sp?)
 +
** Marco will invite reps from SPADI to join our bi-weekly meetings
 +
 
 +
* Fabio: SRO w/ Raspberry Pi [[Media:20240226_RTDP_Fabio.pdf | slides]]
 +
** Compared various batch sizes on Rpi, CPU, GPU
 +
** Batch of 1k waveforms on GPU is not better than 1k batch on CPU
 +
** Interested in moving to FPGA for increased speed
 +
** Gets a compression ration ~4 (n.b. autoencoder is lossy method)
 +
 
 +
* Vardan: JCedit
 +
** Success last week on generalizing code for non-CODA applications (e.g. RTDP)
 +
** BPMN
 +
** Should have demo ready for next time
 +
** Looking at understanding process control
 +
** Configuration will likely end up as XML and not YAML
 +
** Monitoring still expected to be based on Grafana work Cissie is doing
 +
 
 +
* Ayan: RTDP system
 +
** YAML configuration prototype
 +
** Initial version for process launching now in repository (uses pssh)
 +
** Integrated into rtdp application
 +
 
 +
* CLAS12 Captured Data:
 +
** Ayan has been testing Carl's aggregation code and feeding issues back to him
 +
*** Issues with multiple clients
 +
*** Java version on EJFAT not compatible with version Carl developed under. Needs upgrade
 +
 
 +
* INDRA
 +
 
 +
* Cissie reported running speed tests on EJFAT machines, but only seeing about half the rates Carl reported on his wiki page [[Testing Load Balancer Bandwidth | here]]

Latest revision as of 14:57, 27 February 2024

The current weekly meeting time is every other Monday at 10:00 US/Eastern

Connection Info:

You can connect using ZOOM Video conferencing (ID: 160 248 4178). (Click "Expand" to the right for details -->):

One tap mobile: US: +16692545252,,1602484178# or +16468287666,,1602484178#

Meeting URL: https://jlab-org.zoomgov.com/j/1602484178?pwd=UFViZUpyODYrZmsxdkVNbWZTMUR1Zz09&from=addon
Meeting ID: 160 248 4178
Passcode: 104412

Join by Telephone
For higher quality, dial a number based on your current location.
Dial: +1 669 254 5252 US (San Jose)
+1 646 828 7666 US (New York)
+1 646 964 1167 US (US Spanish Line)
+1 551 285 1373 US (New Jersey)
+1 669 216 1590 US (San Jose)
+1 415 449 4000 US (US Spanish Line)
833 568 8864 US Toll-free
Meeting ID: 160 248 4178
International numbers
Join from an H.323/SIP room system
H.323: 161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 160 248 4178
Passcode: 104412

SIP: 1602484178@sip.zoomgov.com
Passcode: 104412

One tap mobile: US: +16692545252,,1601987443# or +16468287666,,1601987443#

Meeting URL: https://jlab-org.zoomgov.com/j/1601987443?pwd=bUVPV3puTHJPU0Fub2Q2Z1dsV0JjQT09&from=addon
Meeting ID: 160 198 7443
Passcode: 607906

Agenda:

  1. Previous Meeting
  2. Announcements:
  3. R&D Projects
    • BDX Experiment
    • Visualization
    • Configuration
      • JCedit
      • rtdp YAML
  4. Data Capture and Processing
    • CLAS12 Data Capture exercise
      • Aggregation program
      • CLAS12 Reconstruction (ERSAP)
  5. Milestone Progress: (Github Project)
    • FY24Q1
    • M01: Create prototype ERSAP configurations for INDRA and CLAS12 test systems (Ayan)
    • M02: Identify or capture SRO formatted data from CLAS12 and INDRA test systems with data tag/filtering capability (output data ready for further offline processing) (Discussion w/ Sergey)
    • M03: Evaluate existing solutions for configuring and launching remote distributed processes (Jeng, Cissie)
    • M04: Establish code repository(s), project site, and method of documentation (Jeng, Ayan)
    • FY24Q2
    • M05: Create stream splitter program for EVIO or HIPO data formatted files
    • M06: Create stream splitter program for simulated data in PODIO for ePIC
    • M07: Create VTP emulator using files produced by stream splitter
    • M08: Create controller program to synchronize multiple VTP emulators
  6. AOT

Minutes

Attendees: David L., Vardan G., Cissie M., Ayan R., Fabio R., Jeng T., Marco B.

  • Marco: Met last week with people from Univ. of Tokyo (SPADI alliance)
    • Possible involvement in BDX
    • Patrick Achenbach was in Japan and spoke with Taku(sp?)
    • Marco will invite reps from SPADI to join our bi-weekly meetings
  • Fabio: SRO w/ Raspberry Pi slides
    • Compared various batch sizes on Rpi, CPU, GPU
    • Batch of 1k waveforms on GPU is not better than 1k batch on CPU
    • Interested in moving to FPGA for increased speed
    • Gets a compression ration ~4 (n.b. autoencoder is lossy method)
  • Vardan: JCedit
    • Success last week on generalizing code for non-CODA applications (e.g. RTDP)
    • BPMN
    • Should have demo ready for next time
    • Looking at understanding process control
    • Configuration will likely end up as XML and not YAML
    • Monitoring still expected to be based on Grafana work Cissie is doing
  • Ayan: RTDP system
    • YAML configuration prototype
    • Initial version for process launching now in repository (uses pssh)
    • Integrated into rtdp application
  • CLAS12 Captured Data:
    • Ayan has been testing Carl's aggregation code and feeding issues back to him
      • Issues with multiple clients
      • Java version on EJFAT not compatible with version Carl developed under. Needs upgrade
  • INDRA
  • Cissie reported running speed tests on EJFAT machines, but only seeing about half the rates Carl reported on his wiki page here
Retrieved from "https://wiki.jlab.org/epsciwiki/index.php?title=SRO_RTDP_Feb._26,_2024&oldid=4627"