Difference between revisions of "EJFAT Group Meeting Feb. 9, 2023"

From epsciwiki
Jump to navigation Jump to search
 
(2 intermediate revisions by the same user not shown)
Line 40: Line 40:
 
## Data Source: JLAB, CLAS12, pre-event aggregated - 1 channel
 
## Data Source: JLAB, CLAS12, pre-event aggregated - 1 channel
 
## ESnet/JLab CP designs have diverged:
 
## ESnet/JLab CP designs have diverged:
 +
{| class="wikitable" style="margin:auto"
 +
|+ CP Designs
 +
|-
 +
! Item !! JLab !! ESnet
 +
|-
 +
| PID || resident in RE || resident in CP
 +
|-
 +
| Comms || RE pushes gRPC messages to CP || CP pulls gRPC messages from RE
 +
|-
 +
| Build || Carl's C++ simulated CP + Mike's C++ schedule density adjustment simulation + Stacey's C++ sn-p4-cli || GoLang server
 +
|}
 
### JLab Design:
 
### JLab Design:
 
#### PID resident in RE
 
#### PID resident in RE
Line 48: Line 59:
 
#### PID resident in CP
 
#### PID resident in CP
 
#### CP pulls gRPC messages from RE
 
#### CP pulls gRPC messages from RE
#### [https://jeffersonlab.sharepoint.com/:u:/r/sites/SciComp/Shared%20Documents/EPSCI/EJFAT/loadbalancer.proto?csf=1&web=1&e=fSbMKT Proposed protobuf schema]
+
#### [https://jeffersonlab.sharepoint.com/:t:/r/sites/SciComp/Shared%20Documents/EPSCI/EJFAT/loadbalancer.proto.txt?csf=1&web=1&e=dePhI4 Proposed protobuf schema]
 
#### CP = GoLang server
 
#### CP = GoLang server
 
## [https://excalidraw.com/#room=66f0f7fbc2ca25f638bf,aYAB22Gl-Je5rngECJBLJQ Derek Howard (ESnet) to build CP for EJFAT and Perlmutter at NERSC with JLab assisting]
 
## [https://excalidraw.com/#room=66f0f7fbc2ca25f638bf,aYAB22Gl-Je5rngECJBLJQ Derek Howard (ESnet) to build CP for EJFAT and Perlmutter at NERSC with JLab assisting]
Line 62: Line 73:
 
## Data Sink:
 
## Data Sink:
 
### Perlmutter
 
### Perlmutter
### <s>SPIN</s>
 
 
### ERSAP
 
### ERSAP
 
# ACAT2022 Paper due March 5, 2023
 
# ACAT2022 Paper due March 5, 2023

Latest revision as of 15:55, 9 February 2023

The meeting time is 11:00am Eastern/USA.

Connection Info:

You can connect using [ https://jlab-org.zoomgov.com/j/1611828967?pwd=UVVCS0pUVW5FMlphT0lRQXdoQ0o4Zz09&from=addon ZoomGov Video conferencing (ID: 161 012 5238)]. (Click "Expand" to the right for details -->):

Meeting URL
 https://jlab-org.zoomgov.com/j/1611828967

Meeting ID
161 182 8967

Passcode
570041

Want to dial in from a phone?

Dial one of the following numbers:
US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free)

Enter the meeting ID and passcode followed by #

Connecting from a room system?
Dial: bjn.vc or 199.48.152.152 and enter your meeting ID & passcode


Agenda:

  1. Previous meeting
  2. Announcements:
    1. NERSC-ESnet-JLab on-site workshop Jan 31 - Feb 1
    2. Final version of RT2022 EJFAT/IEEE-TNS submitted 02/07/2023
  3. NERSC Test set-up:
    1. Data Source: JLAB, CLAS12, pre-event aggregated - 1 channel
    2. ESnet/JLab CP designs have diverged:
CP Designs
Item JLab ESnet
PID resident in RE resident in CP
Comms RE pushes gRPC messages to CP CP pulls gRPC messages from RE
Build Carl's C++ simulated CP + Mike's C++ schedule density adjustment simulation + Stacey's C++ sn-p4-cli GoLang server
      1. JLab Design:
        1. PID resident in RE
        2. RE pushes gRPC messages to CP
        3. Proposed protobuf schema
        4. CP = Carl's C++ simulated CP + Mike's C++ schedule density adjustment simulation + Stacey's C++ sn-p4-cli
      2. ESnet Design:
        1. PID resident in CP
        2. CP pulls gRPC messages from RE
        3. Proposed protobuf schema
        4. CP = GoLang server
    1. Derek Howard (ESnet) to build CP for EJFAT and Perlmutter at NERSC with JLab assisting
      1. Week of 2/6: Other ESnet projects - mtg 4PM Thursday
      2. Week of 2/13:
        1. Finish mock API server
        2. create an internal representation of the load balancer calendar
        3. implement the algorithm specified in "EJFAT Load Balancer Schedule Density from Reassembly Engine PID control"
      3. Week of 2/20: Other ESnet projects
      4. Week of 2/27: Add integration for the SmartNIC P4 Controller, synchronizing the internal state of the gRPC server with the P4 tables.
      5. Week of 3/6: Other ESnet projects
      6. Week of 3/13: Start work on integration test tooling.
    2. Data Sink:
      1. Perlmutter
      2. ERSAP
  1. ACAT2022 Paper due March 5, 2023
  2. Resources:
    1. HPDF
    2. CP gRPC i/f to RE PID: Non-streaming / Peer-to-Peer (Note on gRPC Publish/Subscribe)
    3. CP PID signal -> LB Schedule Density transform (Draft C++ algorithm completed)
    4. Proposed Changes to RE Meta-Data
    5. CP gRPC i/f to LB (pending)
  3. Status
  4. AOT