Difference between revisions of "EJFAT Group Meeting Feb. 9, 2023"
Jump to navigation
Jump to search
(Created page with "The meeting time is 11:00am Eastern/USA. === Connection Info: === <div class="toccolours mw-collapsible mw-collapsed"> You can connect using [ https://jlab-org.zoomgov.com/j/...") |
|||
(3 intermediate revisions by the same user not shown) | |||
Line 40: | Line 40: | ||
## Data Source: JLAB, CLAS12, pre-event aggregated - 1 channel | ## Data Source: JLAB, CLAS12, pre-event aggregated - 1 channel | ||
## ESnet/JLab CP designs have diverged: | ## ESnet/JLab CP designs have diverged: | ||
+ | {| class="wikitable" style="margin:auto" | ||
+ | |+ CP Designs | ||
+ | |- | ||
+ | ! Item !! JLab !! ESnet | ||
+ | |- | ||
+ | | PID || resident in RE || resident in CP | ||
+ | |- | ||
+ | | Comms || RE pushes gRPC messages to CP || CP pulls gRPC messages from RE | ||
+ | |- | ||
+ | | Build || Carl's C++ simulated CP + Mike's C++ schedule density adjustment simulation + Stacey's C++ sn-p4-cli || GoLang server | ||
+ | |} | ||
### JLab Design: | ### JLab Design: | ||
#### PID resident in RE | #### PID resident in RE | ||
#### RE pushes gRPC messages to CP | #### RE pushes gRPC messages to CP | ||
+ | #### [https://jeffersonlab.sharepoint.com/:p:/r/sites/SciComp/Shared%20Documents/EPSCI/EJFAT/ControlPlane.pptx?d=w005fee6e3a464b38aefcb1939b585d8a&csf=1&web=1&e=Lp6rIS Proposed protobuf schema] | ||
#### CP = Carl's C++ simulated CP + Mike's C++ schedule density adjustment simulation + Stacey's C++ sn-p4-cli | #### CP = Carl's C++ simulated CP + Mike's C++ schedule density adjustment simulation + Stacey's C++ sn-p4-cli | ||
### ESnet Design: | ### ESnet Design: | ||
#### PID resident in CP | #### PID resident in CP | ||
#### CP pulls gRPC messages from RE | #### CP pulls gRPC messages from RE | ||
+ | #### [https://jeffersonlab.sharepoint.com/:t:/r/sites/SciComp/Shared%20Documents/EPSCI/EJFAT/loadbalancer.proto.txt?csf=1&web=1&e=dePhI4 Proposed protobuf schema] | ||
#### CP = GoLang server | #### CP = GoLang server | ||
## [https://excalidraw.com/#room=66f0f7fbc2ca25f638bf,aYAB22Gl-Je5rngECJBLJQ Derek Howard (ESnet) to build CP for EJFAT and Perlmutter at NERSC with JLab assisting] | ## [https://excalidraw.com/#room=66f0f7fbc2ca25f638bf,aYAB22Gl-Je5rngECJBLJQ Derek Howard (ESnet) to build CP for EJFAT and Perlmutter at NERSC with JLab assisting] | ||
− | |||
− | |||
### '''Week of 2/6: Other ESnet projects''' - mtg 4PM Thursday | ### '''Week of 2/6: Other ESnet projects''' - mtg 4PM Thursday | ||
### Week of 2/13: | ### Week of 2/13: | ||
Line 62: | Line 73: | ||
## Data Sink: | ## Data Sink: | ||
### Perlmutter | ### Perlmutter | ||
− | |||
### ERSAP | ### ERSAP | ||
# ACAT2022 Paper due March 5, 2023 | # ACAT2022 Paper due March 5, 2023 |
Latest revision as of 15:55, 9 February 2023
The meeting time is 11:00am Eastern/USA.
Connection Info:
You can connect using [ https://jlab-org.zoomgov.com/j/1611828967?pwd=UVVCS0pUVW5FMlphT0lRQXdoQ0o4Zz09&from=addon ZoomGov Video conferencing (ID: 161 012 5238)]. (Click "Expand" to the right for details -->):
Meeting URL https://jlab-org.zoomgov.com/j/1611828967 Meeting ID 161 182 8967 Passcode 570041 Want to dial in from a phone? Dial one of the following numbers: US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free) Enter the meeting ID and passcode followed by # Connecting from a room system? Dial: bjn.vc or 199.48.152.152 and enter your meeting ID & passcode
Agenda:
- Previous meeting
- Announcements:
- NERSC-ESnet-JLab on-site workshop Jan 31 - Feb 1
- Final version of RT2022 EJFAT/IEEE-TNS submitted 02/07/2023
- NERSC Test set-up:
- Data Source: JLAB, CLAS12, pre-event aggregated - 1 channel
- ESnet/JLab CP designs have diverged:
Item | JLab | ESnet |
---|---|---|
PID | resident in RE | resident in CP |
Comms | RE pushes gRPC messages to CP | CP pulls gRPC messages from RE |
Build | Carl's C++ simulated CP + Mike's C++ schedule density adjustment simulation + Stacey's C++ sn-p4-cli | GoLang server |
- JLab Design:
- PID resident in RE
- RE pushes gRPC messages to CP
- Proposed protobuf schema
- CP = Carl's C++ simulated CP + Mike's C++ schedule density adjustment simulation + Stacey's C++ sn-p4-cli
- ESnet Design:
- PID resident in CP
- CP pulls gRPC messages from RE
- Proposed protobuf schema
- CP = GoLang server
- JLab Design:
- Derek Howard (ESnet) to build CP for EJFAT and Perlmutter at NERSC with JLab assisting
- Week of 2/6: Other ESnet projects - mtg 4PM Thursday
- Week of 2/13:
- Finish mock API server
- create an internal representation of the load balancer calendar
- implement the algorithm specified in "EJFAT Load Balancer Schedule Density from Reassembly Engine PID control"
- Week of 2/20: Other ESnet projects
- Week of 2/27: Add integration for the SmartNIC P4 Controller, synchronizing the internal state of the gRPC server with the P4 tables.
- Week of 3/6: Other ESnet projects
- Week of 3/13: Start work on integration test tooling.
- Data Sink:
- Perlmutter
- ERSAP
- ACAT2022 Paper due March 5, 2023
- Resources:
- HPDF
- CP gRPC i/f to RE PID: Non-streaming / Peer-to-Peer (Note on gRPC Publish/Subscribe)
- CP PID signal -> LB Schedule Density transform (Draft C++ algorithm completed)
- Proposed Changes to RE Meta-Data
- CP gRPC i/f to LB (pending)
- Status
- AOT