Difference between revisions of "EJFAT EPSCI Meeting Apr. 6, 2022"

From epsciwiki
Jump to navigation Jump to search
(Created page with "The meeting time is 2:00pm. === Connection Info: === <div class="toccolours mw-collapsible mw-collapsed"> You can connect using [https://jlab-org.zoomgov.com/j/1612038101?pwd...")
 
 
(4 intermediate revisions by 2 users not shown)
Line 51: Line 51:
 
* To Do:
 
* To Do:
 
** Near Term:
 
** Near Term:
*** Hall-B has an old version of the firmware, so VTP will send TCP (no UDP). Could intercept and resend UDP VTP streams (12 streams, if we get 3 crates) to how LB can handle 12 ID's and do effectively an aggregation.
+
*** Hall-B FT calorimeter and hodoscope streaming readout test (scheduled within a week or two)
 +
**** 2 crates for FT calorimeter, furnished with fADC250s. Total 332 channels.
 +
**** 1 crate for the hodoscope that has 12 fADC (total 192 channels)
 +
**** Update firmware on all 3 VTPs to send fADC aggregated data frames in the EVIO format, through UDP.
 +
**** Design ERSAP FE application containing an actor that receives VTP frames through UDP, extracts information about the source/data ID and frame number (tick), and sends it to the EJFAT packetizing engine.
 +
**** Stage 1 testing:  single stream/data-ID
 +
***** EJFAT LB + reassembly (RA) engine overall performance data-rate dependence.
 +
***** EJFAT LB + RA engine performance dependence from the EJFAT packetizing engine MTU settings
 +
**** Stage 2 testing: multi-stream/data_ID
 +
***** Use EJFAT LB firmware that supports load balancing of multiple source/data_IDs.
 +
***** EJFAT LB + RA engine performance as an event builder (i.e. source ID aggregator), a capability to send all available data_ID's with the same tick (time frame) to a single destination. NB Hall-B FT calorimeter and hodoscope setup is capable of sending up to 12 data streams.
 
*** C-based control plane
 
*** C-based control plane
 
**** Feedback from Compute hosts design
 
**** Feedback from Compute hosts design
Line 60: Line 70:
 
*** IPV6 testing
 
*** IPV6 testing
 
*** EJFAT Subnet
 
*** EJFAT Subnet
*** [https://www.epj-conferences.org/articles/epjconf/abs/2021/05/epjconf_chep2021_04005/epjconf_chep2021_04005.html Hall-D EJFAT + SLURM use case]
+
*** [https://www.epj-conferences.org/articles/epjconf/abs/2021/05/epjconf_chep2021_04005/epjconf_chep2021_04005.html HOSS Hall-D EJFAT use case]
 
**** parallelize writing of raw data files
 
**** parallelize writing of raw data files
 
**** distribute raw data across multiple compute nodes for calibration skims
 
**** distribute raw data across multiple compute nodes for calibration skims
 
* AOT
 
* AOT
 
<hr>
 
<hr>

Latest revision as of 00:02, 7 April 2022

The meeting time is 2:00pm.

Connection Info:

You can connect using ZoomGov Video conferencing (ID: 161 203 8101). (Click "Expand" to the right for details -->):

Meeting URL
https://jlab-org.zoomgov.com/j/1612038101?pwd=Yk96QUcyT1NDVTRRUGNtOFVSSTdaUT09&from=addon

Meeting ID
161 203 8101

Passcode
378382

Want to dial in from a phone?

Dial one of the following numbers:
US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free)

Enter the meeting ID and passcode followed by #

Connecting from a room system?
Dial: bjn.vc or 199.48.152.152 and enter your meeting ID & passcode

Agenda:

  • Previous meeting
  • Situation:
    • Testing with End-to-end EJFAT ERSAP solution on FPGA LB
    • Jumbo Frames - indra-s2,s3, alkaid, fpga
    • Linux IP stack buffer size increased
    • Using script based LB Control Plane
    • Control Plane Gratuitous Arp cache updating (Scapy)
    • Benchmarking
    • Successfully Testing Calendar Epoch Advances
    • RT2022 - April 08 submission - August Conference
  • Pending:
    • Compute Equip.- ETA 1 June
    • Networking Equip. - ETA 1 July
    • Support C libraries for LB Host Control Plane
    • ESnet smartnic open-source GitHub repo (April)
    • ESnet private, forkable Jlab P4 and simulations GitHub repo (April)
    • Data_id <-> reassembly port mapping
  • To Do:
    • Near Term:
      • Hall-B FT calorimeter and hodoscope streaming readout test (scheduled within a week or two)
        • 2 crates for FT calorimeter, furnished with fADC250s. Total 332 channels.
        • 1 crate for the hodoscope that has 12 fADC (total 192 channels)
        • Update firmware on all 3 VTPs to send fADC aggregated data frames in the EVIO format, through UDP.
        • Design ERSAP FE application containing an actor that receives VTP frames through UDP, extracts information about the source/data ID and frame number (tick), and sends it to the EJFAT packetizing engine.
        • Stage 1 testing: single stream/data-ID
          • EJFAT LB + reassembly (RA) engine overall performance data-rate dependence.
          • EJFAT LB + RA engine performance dependence from the EJFAT packetizing engine MTU settings
        • Stage 2 testing: multi-stream/data_ID
          • Use EJFAT LB firmware that supports load balancing of multiple source/data_IDs.
          • EJFAT LB + RA engine performance as an event builder (i.e. source ID aggregator), a capability to send all available data_ID's with the same tick (time frame) to a single destination. NB Hall-B FT calorimeter and hodoscope setup is capable of sending up to 12 data streams.
      • C-based control plane
        • Feedback from Compute hosts design
        • Control Plane daemon for compute host
    • Downstream:
      • DPDK
      • P4 enhancements for ipv4/6 ping, arp
      • IPV6 testing
      • EJFAT Subnet
      • HOSS Hall-D EJFAT use case
        • parallelize writing of raw data files
        • distribute raw data across multiple compute nodes for calibration skims
  • AOT