Difference between revisions of "EJFAT EPSCI Meeting Feb. 8, 2023"

From epsciwiki
Jump to navigation Jump to search
Line 35: Line 35:
 
## RE input fifo 50% full as PID set-point for Schedule Density
 
## RE input fifo 50% full as PID set-point for Schedule Density
 
# [https://excalidraw.com/#room=66f0f7fbc2ca25f638bf,aYAB22Gl-Je5rngECJBLJQ Derek Howard (ESnet) to build CP for EJFAT and Perlmutter at NERSC with JLab assisting]
 
# [https://excalidraw.com/#room=66f0f7fbc2ca25f638bf,aYAB22Gl-Je5rngECJBLJQ Derek Howard (ESnet) to build CP for EJFAT and Perlmutter at NERSC with JLab assisting]
 +
## [https://jeffersonlab.sharepoint.com/:u:/r/sites/SciComp/Shared%20Documents/EPSCI/EJFAT/loadbalancer.proto?csf=1&web=1&e=fSbMKT Proposed protobuf schema]
 
## '''Week of 2/6: Other ESnet projects'''
 
## '''Week of 2/6: Other ESnet projects'''
 
## Week of 2/13:   
 
## Week of 2/13:   
Line 44: Line 45:
 
## Week of 3/6: Other ESnet projects
 
## Week of 3/6: Other ESnet projects
 
## Week of 3/13: Start work on integration test tooling.
 
## Week of 3/13: Start work on integration test tooling.
## Resources:
+
# Resources:
### CP [https://itnext.io/streaming-data-with-grpc-2eb983fdee11 gRPC] i/f to RE PID: Non-streaming / Peer-to-Peer ([https://grpc.io/blog/pubsub/  Note on gRPC Publish/Subscribe])
+
## CP [https://itnext.io/streaming-data-with-grpc-2eb983fdee11 gRPC] i/f to RE PID: Non-streaming / Peer-to-Peer ([https://grpc.io/blog/pubsub/  Note on gRPC Publish/Subscribe])
### [https://jeffersonlab.sharepoint.com/:b:/r/sites/SciComp/Shared%20Documents/EPSCI/EJFAT/CP_PID_Sched.pdf?csf=1&web=1&e=JpffJ4 CP PID signal -> LB Schedule Density transform (Draft C++ algorithm '''completed''')]
+
## [https://jeffersonlab.sharepoint.com/:b:/r/sites/SciComp/Shared%20Documents/EPSCI/EJFAT/CP_PID_Sched.pdf?csf=1&web=1&e=JpffJ4 CP PID signal -> LB Schedule Density transform (Draft C++ algorithm '''completed''')]
### [https://jeffersonlab.sharepoint.com/:p:/r/sites/SciComp/Shared%20Documents/EPSCI/EJFAT/ControlPlane.pptx?d=w005fee6e3a464b38aefcb1939b585d8a&csf=1&web=1&e=2tzZgJ Proposed Changes to RE Meta-Data]
+
## [https://jeffersonlab.sharepoint.com/:p:/r/sites/SciComp/Shared%20Documents/EPSCI/EJFAT/ControlPlane.pptx?d=w005fee6e3a464b38aefcb1939b585d8a&csf=1&web=1&e=2tzZgJ Proposed Changes to RE Meta-Data]
### [https://github.com/esnet/esnet-smartnic-fw CP gRPC i/f to LB ('''pending''')]
+
## [https://github.com/esnet/esnet-smartnic-fw CP gRPC i/f to LB ('''pending''')]
 
# [[EJFAT Status | Status]]
 
# [[EJFAT Status | Status]]
 
# AOT
 
# AOT
 
<hr>
 
<hr>

Revision as of 14:01, 8 February 2023

The meeting time is 2:30pm.

Connection Info:


Agenda:

  1. Previous meeting
  2. Announcements:
    1. NERSC-ESnet-JLab on-site workshop Jan 31 - Feb 1
    2. Manuscript ESnet / JLab FPGA Accelerated Transport (No. TNS-00484-2022.R1) FINAL version submitted for publication to IEEE Transactions on Nuclear Science (TNS).
  3. Current Test set-up:
    1. CLAS12 files -> Carl C++ Packetizer -> LB -> Carls's C++ Reassembler -> ERSAP
  4. New Test set-up (pending):
    1. CLAS12 files -> Carl C++ Packetizer -> new LB (delivered) / dynamic CP (in progress) -> Carls's C++ Reassembler -> PID controller (completed) -> ERSAP
    2. RE input fifo 50% full as PID set-point for Schedule Density
  5. Derek Howard (ESnet) to build CP for EJFAT and Perlmutter at NERSC with JLab assisting
    1. Proposed protobuf schema
    2. Week of 2/6: Other ESnet projects
    3. Week of 2/13:
      1. Finish mock API server
      2. create an internal representation of the load balancer calendar
      3. implement the algorithm specified in "EJFAT Load Balancer Schedule Density from Reassembly Engine PID control"
    4. Week of 2/20: Other ESnet projects
    5. Week of 2/27: Add integration for the SmartNIC P4 Controller, synchronizing the internal state of the gRPC server with the P4 tables.
    6. Week of 3/6: Other ESnet projects
    7. Week of 3/13: Start work on integration test tooling.
  6. Resources:
    1. CP gRPC i/f to RE PID: Non-streaming / Peer-to-Peer (Note on gRPC Publish/Subscribe)
    2. CP PID signal -> LB Schedule Density transform (Draft C++ algorithm completed)
    3. Proposed Changes to RE Meta-Data
    4. CP gRPC i/f to LB (pending)
  7. Status
  8. AOT