Difference between revisions of "SRO RTDP Nov. 13, 2023"

From epsciwiki
Jump to navigation Jump to search
 
Line 69: Line 69:
 
Attendees: David L., Vardan G., Ayan R., Jeng T., Cissie M., Marco B., Mariangela B.
 
Attendees: David L., Vardan G., Ayan R., Jeng T., Cissie M., Marco B., Mariangela B.
  
−
*
+
* Charge times:
 +
** Ayan and Jeng's nominal charge times for the project were changed from 75%/25% to 100%/0% for the time being until a congressional appropriation is made that will supply funds to the AIOP project. David/Vardan/Cissie will remain at 10%/25%/25%
 +
*:
 +
* BDX: Marco gave an overview on some planning items for the BDX experiment
 +
** Patrick (Hall-B leader) says PRAD electronics can be loaned to BDX for testing purposes. This includes 5 VXS crates that will have 256 readout channels each. Each will be used for a different BDX "module" which consists of 200 CsI blocks and 56 channels for plastic scintillator.
 +
** These are expected next Fall (~1 year from now)
 +
** Initial plan is to use single crate to stream data from prototype.
 +
*:
 +
* Ayan update:
 +
** Code now exists that can be used with ERSAP to move binary file(s) around.
 +
** An ERSAP actor written in Java already exists that serves as an example of accessing config. parameters that ERSAP read from the YAMAL file.
 +
*** This currently is on a branch in the ERSAP repository but we decided it would be better to move it to the SRO-RTDP repository. Ayan will take care of that.
 +
*** Some work has started on the C++ actor. Some issues came up and Ayan is in communication with Vardan about fixing them.
 +
*:
 +
* Cissie update:
 +
** Added ''rtdp.py'' to repository. Did round of review with David and is now merged into main.
 +
** Did some preliminary work on generating documentation with Sphinx. This is on a branch in the SRO-RTDP repository at the moment.
 +
** Started looking at visualizations for ERSAP configurations in YAML form. This will include drawing a flowchart. She will need to understand ERSAP better to do this though.
 +
*:
 +
* Jeng update:
 +
** Looked into the SuperFacility API and realtime QoS at NERSC
 +
** Discussion on Github ([https://github.com/JeffersonLab/SRO-RTDP/issues/17 #17])
 +
*:
 +
* David update:
 +
** Spoke with Chris Cuevas, Fast Electronics Group Lead, about firmware update for DCRB boards to support streaming. He will speak with Ben Raydo to determine schedule constraints.
 +
*:
 +
* Discussed getting exploratory allocation on NERSC for RTDP
 +
** Vardan noted that EJFAT testing has special arrangement with collaborators there to use Debbie Bard's project which we could potentially also use.
 +
** Cissie will look into submitting allocation request.
 +
 
  
 
==== Action Items ====
 
==== Action Items ====
 +
# Submit exploratory allocation request at NERSC - Cissie, David
 
# <s>(from 11/6)Investigate use of ''realtime'' queue at NERSC</s> - Jeng
 
# <s>(from 11/6)Investigate use of ''realtime'' queue at NERSC</s> - Jeng
 
# <s>(from 11/6)Investigate the Superfacility API at NERSC</s> - Cissie
 
# <s>(from 11/6)Investigate the Superfacility API at NERSC</s> - Cissie
−
# (from 10/26) Understand how to retrieve ERSAP config. parameters from within actor - Ayan
+
# <s>(from 10/26) Understand how to retrieve ERSAP config. parameters from within actor</s> - Ayan
−
# (from 10/26) Ask Chris/Ben about schedule for SRO capable DCRB firmware - David
+
# <s>(from 10/26) Ask Chris/Ben about schedule for SRO capable DCRB firmware</s> - David
 
# <s>Update [https://www.overleaf.com/project/64ece8c2d85827b227758e95 test plan] schedule to reflect new accelerator pass change schedule</s> - Fabio
 
# <s>Update [https://www.overleaf.com/project/64ece8c2d85827b227758e95 test plan] schedule to reflect new accelerator pass change schedule</s> - Fabio
 
# <s>Review [[https://docs.google.com/document/d/1W2RavdZbSbhZW3FSpO0ufzFTs4wy01stHkrxHDMrQx0 document] on distributed process launching technologies</s> - All
 
# <s>Review [[https://docs.google.com/document/d/1W2RavdZbSbhZW3FSpO0ufzFTs4wy01stHkrxHDMrQx0 document] on distributed process launching technologies</s> - All

Latest revision as of 15:50, 15 November 2023

The current weekly meeting time is every other Monday at 10:00 US/Eastern

Connection Info:

You can connect using ZOOM Video conferencing (ID: 160 248 4178). (Click "Expand" to the right for details -->):

One tap mobile: US: +16692545252,,1602484178# or +16468287666,,1602484178#

Meeting URL: https://jlab-org.zoomgov.com/j/1602484178?pwd=UFViZUpyODYrZmsxdkVNbWZTMUR1Zz09&from=addon
Meeting ID: 160 248 4178
Passcode: 104412

Join by Telephone
For higher quality, dial a number based on your current location.
Dial: +1 669 254 5252 US (San Jose)
+1 646 828 7666 US (New York)
+1 646 964 1167 US (US Spanish Line)
+1 551 285 1373 US (New Jersey)
+1 669 216 1590 US (San Jose)
+1 415 449 4000 US (US Spanish Line)
833 568 8864 US Toll-free
Meeting ID: 160 248 4178
International numbers
Join from an H.323/SIP room system
H.323: 161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 160 248 4178
Passcode: 104412

SIP: 1602484178@sip.zoomgov.com
Passcode: 104412

One tap mobile: US: +16692545252,,1601987443# or +16468287666,,1601987443#

Meeting URL: https://jlab-org.zoomgov.com/j/1601987443?pwd=bUVPV3puTHJPU0Fub2Q2Z1dsV0JjQT09&from=addon
Meeting ID: 160 198 7443
Passcode: 607906

Agenda:

  1. Previous Meeting
  2. Announcements:
    • No more meetings until Dec. 11
    • FTE shifting
    • BDX Experiment
  3. Milestone Progress: (Github Project)
    • M01: Create prototype ERSAP configurations for INDRA and CLAS12 test systems (Ayan)
    • M02: Identify or capture SRO formatted data from CLAS12 and INDRA test systems with data tag/filtering capability (output data ready for further offline processing) (Discussion w/ Sergey)
    • M03: Evaluate existing solutions for configuring and launching remote distributed processes (Jeng, Cissie)
      Cissie and Jeng's Doc: MQTT, Ansible, Globus, SuperFacility and Fireworks
    • M04: Establish code repository(s), project site, and method of documentation (Jeng, Ayan)
  4. AOT

Minutes

Attendees: David L., Vardan G., Ayan R., Jeng T., Cissie M., Marco B., Mariangela B.

  • Charge times:
    • Ayan and Jeng's nominal charge times for the project were changed from 75%/25% to 100%/0% for the time being until a congressional appropriation is made that will supply funds to the AIOP project. David/Vardan/Cissie will remain at 10%/25%/25%
  • BDX: Marco gave an overview on some planning items for the BDX experiment
    • Patrick (Hall-B leader) says PRAD electronics can be loaned to BDX for testing purposes. This includes 5 VXS crates that will have 256 readout channels each. Each will be used for a different BDX "module" which consists of 200 CsI blocks and 56 channels for plastic scintillator.
    • These are expected next Fall (~1 year from now)
    • Initial plan is to use single crate to stream data from prototype.
  • Ayan update:
    • Code now exists that can be used with ERSAP to move binary file(s) around.
    • An ERSAP actor written in Java already exists that serves as an example of accessing config. parameters that ERSAP read from the YAMAL file.
      • This currently is on a branch in the ERSAP repository but we decided it would be better to move it to the SRO-RTDP repository. Ayan will take care of that.
      • Some work has started on the C++ actor. Some issues came up and Ayan is in communication with Vardan about fixing them.
  • Cissie update:
    • Added rtdp.py to repository. Did round of review with David and is now merged into main.
    • Did some preliminary work on generating documentation with Sphinx. This is on a branch in the SRO-RTDP repository at the moment.
    • Started looking at visualizations for ERSAP configurations in YAML form. This will include drawing a flowchart. She will need to understand ERSAP better to do this though.
  • Jeng update:
    • Looked into the SuperFacility API and realtime QoS at NERSC
    • Discussion on Github (#17)
  • David update:
    • Spoke with Chris Cuevas, Fast Electronics Group Lead, about firmware update for DCRB boards to support streaming. He will speak with Ben Raydo to determine schedule constraints.
  • Discussed getting exploratory allocation on NERSC for RTDP
    • Vardan noted that EJFAT testing has special arrangement with collaborators there to use Debbie Bard's project which we could potentially also use.
    • Cissie will look into submitting allocation request.


Action Items

  1. Submit exploratory allocation request at NERSC - Cissie, David
  2. (from 11/6)Investigate use of realtime queue at NERSC - Jeng
  3. (from 11/6)Investigate the Superfacility API at NERSC - Cissie
  4. (from 10/26) Understand how to retrieve ERSAP config. parameters from within actor - Ayan
  5. (from 10/26) Ask Chris/Ben about schedule for SRO capable DCRB firmware - David
  6. Update test plan schedule to reflect new accelerator pass change schedule - Fabio
  7. Review [document on distributed process launching technologies - All
Retrieved from "https://wiki.jlab.org/epsciwiki/index.php?title=SRO_RTDP_Nov._13,_2023&oldid=4097"