Difference between revisions of "EJFAT EPSCI Meeting Feb. 8, 2023"

From epsciwiki
Jump to navigation Jump to search
 
(9 intermediate revisions by the same user not shown)
Line 28: Line 28:
 
# Announcements:
 
# Announcements:
 
## NERSC-ESnet-JLab on-site workshop Jan 31 - Feb 1
 
## NERSC-ESnet-JLab on-site workshop Jan 31 - Feb 1
−
## Manuscript ESnet / JLab FPGA Accelerated Transport (No. TNS-00484-2022.R1) FINAL version submitted for publication to IEEE Transactions on Nuclear Science (TNS).
+
## Final version of RT2022 EJFAT/IEEE-TNS submitted 02/07/2023
−
# Current Test set-up:
+
# [https://docs.google.com/document/d/1CsBtDZEhK4k9POSeiLF4kzTQVMl7KwZtubVH-aEIyo4/edit NERSC Test set-up]:
−
## CLAS12 files -> Carl C++ Packetizer -> LB -> Carls's C++ Reassembler ->  ERSAP
+
## Data Source: JLAB, CLAS12, pre-event aggregated - 1 channel
−
# New Test set-up (pending):
+
## [https://excalidraw.com/#room=66f0f7fbc2ca25f638bf,aYAB22Gl-Je5rngECJBLJQ Derek Howard (ESnet) to build CP for EJFAT and Perlmutter at NERSC with JLab assisting]
−
## [https://userweb.jlab.org/~gurjyan/presentations/ejfat-clas12.pdf CLAS12 files -> Carl C++ Packetizer -> new LB '''(delivered)''' / dynamic CP '''(in progress)''' -> Carls's C++ Reassembler -> PID controller '''(completed)''' -> ERSAP]
+
### [https://jeffersonlab.sharepoint.com/:u:/r/sites/SciComp/Shared%20Documents/EPSCI/EJFAT/loadbalancer.proto?csf=1&web=1&e=fSbMKT Proposed protobuf schema]
−
## RE input fifo 50% full as PID set-point for Schedule Density
+
#### Assumes PID loop inside CP - but willing to change.
−
# [https://excalidraw.com/#room=66f0f7fbc2ca25f638bf,aYAB22Gl-Je5rngECJBLJQ Derek Howard (ESnet) to build CP for EJFAT and Perlmutter at NERSC with JLab assisting]
+
### '''Week of 2/6: Other ESnet projects''' - mtg 4PM Thursday
−
## '''Week of 2/6: Other ESnet projects'''
+
### Week of 2/13:   
−
## Week of 2/13:   
+
#### Finish mock API server
−
### Finish mock API server
+
#### create an internal representation of the load balancer calendar
−
### create an internal representation of the load balancer calendar
+
#### implement the algorithm specified in [https://jeffersonlab.sharepoint.com/:b:/r/sites/SciComp/Shared%20Documents/EPSCI/EJFAT/CP_PID_Sched.pdf?csf=1&web=1&e=JpffJ4 "EJFAT Load Balancer Schedule Density from Reassembly Engine PID control"]
−
### implement the algorithm specified in [https://jeffersonlab.sharepoint.com/:b:/r/sites/SciComp/Shared%20Documents/EPSCI/EJFAT/CP_PID_Sched.pdf?csf=1&web=1&e=JpffJ4 "EJFAT Load Balancer Schedule Density from Reassembly Engine PID control"]
+
### Week of 2/20: Other ESnet projects
−
## Week of 2/20: Other ESnet projects
+
### Week of 2/27: Add integration for the SmartNIC P4 Controller, synchronizing the internal state of the gRPC server with the P4 tables.
−
## Week of 2/27: Add integration for the SmartNIC P4 Controller, synchronizing the internal state of the gRPC server with the P4 tables.
+
### Week of 3/6: Other ESnet projects
−
## Week of 3/6: Other ESnet projects
+
### Week of 3/13: Start work on integration test tooling.
−
## Week of 3/13: Start work on integration test tooling.
+
## Data Sink:
−
## Resources:
+
### Perlmutter
−
### CP [https://itnext.io/streaming-data-with-grpc-2eb983fdee11 gRPC] i/f to RE PID: Non-streaming / Peer-to-Peer ([https://grpc.io/blog/pubsub/  Note on gRPC Publish/Subscribe])
+
### <s>SPIN</s>
−
### [https://jeffersonlab.sharepoint.com/:b:/r/sites/SciComp/Shared%20Documents/EPSCI/EJFAT/CP_PID_Sched.pdf?csf=1&web=1&e=JpffJ4 CP PID signal -> LB Schedule Density transform (Draft C++ algorithm '''completed''')]
+
### ERSAP
−
### [https://jeffersonlab.sharepoint.com/:p:/r/sites/SciComp/Shared%20Documents/EPSCI/EJFAT/ControlPlane.pptx?d=w005fee6e3a464b38aefcb1939b585d8a&csf=1&web=1&e=2tzZgJ Proposed Changes to RE Meta-Data]
+
# ACAT2022 Paper due March 5, 2023
−
### [https://github.com/esnet/esnet-smartnic-fw CP gRPC i/f to LB ('''pending''')]
+
# Resources:
 +
## [https://jeffersonlab.sharepoint.com/sites/HPDF HPDF]
 +
## CP [https://itnext.io/streaming-data-with-grpc-2eb983fdee11 gRPC] i/f to RE PID: Non-streaming / Peer-to-Peer ([https://grpc.io/blog/pubsub/  Note on gRPC Publish/Subscribe])
 +
## [https://jeffersonlab.sharepoint.com/:b:/r/sites/SciComp/Shared%20Documents/EPSCI/EJFAT/CP_PID_Sched.pdf?csf=1&web=1&e=JpffJ4 CP PID signal -> LB Schedule Density transform (Draft C++ algorithm '''completed''')]
 +
## [https://jeffersonlab.sharepoint.com/:p:/r/sites/SciComp/Shared%20Documents/EPSCI/EJFAT/ControlPlane.pptx?d=w005fee6e3a464b38aefcb1939b585d8a&csf=1&web=1&e=2tzZgJ Proposed Changes to RE Meta-Data]
 +
## [https://github.com/esnet/esnet-smartnic-fw CP gRPC i/f to LB ('''pending''')]
 
# [[EJFAT Status | Status]]
 
# [[EJFAT Status | Status]]
 
# AOT
 
# AOT
 
<hr>
 
<hr>

Latest revision as of 21:09, 8 February 2023

The meeting time is 2:30pm.

Connection Info:

You can connect using Teams Link. (Click "Expand" to the right for details -->): 

Meeting URL
	https://teams.microsoft.com/l/meetup-join/19%3ameeting_M2ExMzNiYmItNTNiMi00NzE4LTkwYWItOTQwYjJmMTJiMDhh%40thread.v2/0?context=%7b%22Tid%22%3a%22b4d7ee1f-4fb3-4f06-9037-2b5b522042ab%22%2c%22Oid%22%3a%22ff03cbe2-66d5-4741-bf32-ff1c69fa2fcc%22%7d

Meeting ID
273 279 114 915

Passcode
Rkypzi


Agenda:

  1. Previous meeting
  2. Announcements:
    1. NERSC-ESnet-JLab on-site workshop Jan 31 - Feb 1
    2. Final version of RT2022 EJFAT/IEEE-TNS submitted 02/07/2023
  3. NERSC Test set-up:
    1. Data Source: JLAB, CLAS12, pre-event aggregated - 1 channel
    2. Derek Howard (ESnet) to build CP for EJFAT and Perlmutter at NERSC with JLab assisting
      1. Proposed protobuf schema
        1. Assumes PID loop inside CP - but willing to change.
      2. Week of 2/6: Other ESnet projects - mtg 4PM Thursday
      3. Week of 2/13:
        1. Finish mock API server
        2. create an internal representation of the load balancer calendar
        3. implement the algorithm specified in "EJFAT Load Balancer Schedule Density from Reassembly Engine PID control"
      4. Week of 2/20: Other ESnet projects
      5. Week of 2/27: Add integration for the SmartNIC P4 Controller, synchronizing the internal state of the gRPC server with the P4 tables.
      6. Week of 3/6: Other ESnet projects
      7. Week of 3/13: Start work on integration test tooling.
    3. Data Sink:
      1. Perlmutter
      2. SPIN
      3. ERSAP
  4. ACAT2022 Paper due March 5, 2023
  5. Resources:
    1. HPDF
    2. CP gRPC i/f to RE PID: Non-streaming / Peer-to-Peer (Note on gRPC Publish/Subscribe)
    3. CP PID signal -> LB Schedule Density transform (Draft C++ algorithm completed)
    4. Proposed Changes to RE Meta-Data
    5. CP gRPC i/f to LB (pending)
  6. Status
  7. AOT
Retrieved from "https://wiki.jlab.org/epsciwiki/index.php?title=EJFAT_EPSCI_Meeting_Feb._8,_2023&oldid=3103"