Difference between revisions of "EJFAT Group Meeting Apr. 28, 2022"

From epsciwiki
Jump to navigation Jump to search
 
(4 intermediate revisions by the same user not shown)
Line 43: Line 43:
 
*** VLAN 937 172.19.22.0/24
 
*** VLAN 937 172.19.22.0/24
 
*** 10Gbs NIC, <s>but '''need cables''' </s>(copper twinX will do)
 
*** 10Gbs NIC, <s>but '''need cables''' </s>(copper twinX will do)
−
** DAQ Farm machines ''dafarm61 dafarm62 dafarm63 dafarm64'' currently on 129.57.29.0/24 subnet w/ additional i/f available for EJFAT subnet
+
** EJFAT loaner equip inventory:
 +
*** (2) switches:  ejfat-sw, daq-cc-f109-sw-1
 +
*** (3) DAQ dev machines indra-s[1-3]
 +
*** (4) DAQ Farm machines ''dafarm61 dafarm62 dafarm63 dafarm64'' currently on 129.57.29.0/24 subnet w/ additional i/f available for EJFAT subnet
 +
*** (17) Hall-D machines - gluon120-36
 
** Testing newly received FPGA load
 
** Testing newly received FPGA load
 
*** [https://docs.google.com/document/d/1ssw8sye7jExtPCJVejloe8hNkyWOcxEQzVmm45xs5-w/edit#heading=h.mqilsqsmmpek Specs]
 
*** [https://docs.google.com/document/d/1ssw8sye7jExtPCJVejloe8hNkyWOcxEQzVmm45xs5-w/edit#heading=h.mqilsqsmmpek Specs]
Line 51: Line 55:
 
**** MTU size restricted to max 1500, update pending
 
**** MTU size restricted to max 1500, update pending
 
**** Possibly incorrect control message responses being investigated
 
**** Possibly incorrect control message responses being investigated
 +
*** '''Rec'd new f/w build 28 April'''
 
* Pending:
 
* Pending:
 
** Compute Equip.- ETA 1 June - '''sans 100Gbs NICs''' (ETA 1 July)
 
** Compute Equip.- ETA 1 June - '''sans 100Gbs NICs''' (ETA 1 July)
Line 60: Line 65:
 
** Near Term:
 
** Near Term:
 
*** Hall-B FT calorimeter and hodoscope streaming readout test - Pending OK from Sergey B.
 
*** Hall-B FT calorimeter and hodoscope streaming readout test - Pending OK from Sergey B.
−
**** 2 crates for FT calorimeter, furnished with fADC250s. Total 332 channels.
 
−
**** 1 crate for the hodoscope that has 12 fADC (total 192 channels)
 
−
**** Update firmware on all 3 VTPs to send fADC aggregated data frames in the EVIO format, through UDP.
 
−
**** Design ERSAP FE application containing an actor that receives VTP frames through UDP, extracts information about the source/data ID and frame number (tick), and sends it to the EJFAT packetizing engine.
 
−
**** Stage 1 testing:  single stream/data-ID
 
−
***** EJFAT LB + reassembly (RA) engine overall performance data-rate dependence.
 
−
***** EJFAT LB + RA engine performance dependence from the EJFAT packetizing engine MTU settings
 
−
**** Stage 2 testing: multi-stream/data_ID
 
−
***** Use EJFAT LB firmware that supports load balancing of multiple source/data_IDs.
 
−
***** EJFAT LB + RA engine performance as an event builder (i.e. source ID aggregator), a capability to send all available data_ID's with the same tick (time frame) to a single destination. NB Hall-B FT calorimeter and hodoscope setup is capable of sending up to 12 data streams. 
 
 
**** May be able to use Abbott's indra-s1 setup
 
**** May be able to use Abbott's indra-s1 setup
 
**** May be to use new VTP f/w with  Hall-B VTP's - (Ben Raydo)
 
**** May be to use new VTP f/w with  Hall-B VTP's - (Ben Raydo)
−
**** CODA 3.10 + ERSAP
+
**** CODA 3.10 + ERSAP for new VTP f/w
−
*** Control Plane
+
**** CODA 2.0 for old VTP f/w
−
**** Feedback from Compute hosts
+
*** [https://www.epj-conferences.org/articles/epjconf/abs/2021/05/epjconf_chep2021_04005/epjconf_chep2021_04005.html HOSS Hall-D EJFAT  use case]
−
**** Control Plane daemon for compute host
+
**** parallelize writing of raw data files
−
**** [https://www.epj-conferences.org/articles/epjconf/abs/2021/05/epjconf_chep2021_04005/epjconf_chep2021_04005.html HOSS Hall-D EJFAT  use case]
+
**** distribute raw data across multiple compute nodes for calibration skims
−
***** parallelize writing of raw data files
+
**** 1 Gbs at hi-luminosity
−
***** distribute raw data across multiple compute nodes for calibration skims
+
**** Control Plane
−
***** 1 Gbs at hi-luminosity
+
***** Feedback from Compute hosts
 +
***** Control Plane daemon for compute host
 
***** Demonstrate CP based flexibility/elasticity
 
***** Demonstrate CP based flexibility/elasticity
−
***** Hall-D comms with DAQ 109 subnet require network customization; DAQ 29 subnet available
+
**** Hall-D comms with DAQ 109 subnet require network customization; DAQ 29 subnet available
−
***** [https://docs.google.com/presentation/d/1m3rFm-1GymYv8zGimlAjL1NmWtXVfyIQdGzhx_j_BKE/edit?usp=sharing Slides]
+
**** [https://docs.google.com/presentation/d/1m3rFm-1GymYv8zGimlAjL1NmWtXVfyIQdGzhx_j_BKE/edit?usp=sharing Slides]
−
***** [https://jeffersonlab-my.sharepoint.com/personal/bmorris_jlab_org/Documents/Microsoft%20Teams%20Chat%20Files/JLab%20Network%20-%20HallD-to-EJFAT.png Netwok Diagram]
+
**** [https://jeffersonlab-my.sharepoint.com/personal/bmorris_jlab_org/Documents/Microsoft%20Teams%20Chat%20Files/JLab%20Network%20-%20HallD-to-EJFAT.png Netwok Diagram]
 
** Downstream:
 
** Downstream:
 
*** [http://www.dpdk.org DPDK]
 
*** [http://www.dpdk.org DPDK]

Latest revision as of 15:01, 28 April 2022

The meeting time is 11:00am.

Connection Info:

You can connect using ZoomGov Video conferencing (ID: 161 012 5238). (Click "Expand" to the right for details -->): 

Meeting URL
 https://jlab-org.zoomgov.com/j/1610125238?pwd=QnEvcjV6VFFndWZsQW15SmJKU0RJZz09&from=addon

Meeting ID
161 012 5238

Passcode
503371

Want to dial in from a phone?

Dial one of the following numbers:
US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free)

Enter the meeting ID and passcode followed by #

Connecting from a room system?
Dial: bjn.vc or 199.48.152.152 and enter your meeting ID & passcode

Agenda:

  • Previous meeting
  • Situation:
    • Testing with End-to-end EJFAT ERSAP solution on FPGA LB
    • Jumbo Frames - indra-s2,s3, alkaid, fpga
    • Linux IP stack buffer size increased
    • Using script based LB Control Plane
    • ERSAP feed end bottleneck needs investigation; Timmer's blaster may provide relief
    • EJFAT subnet
      • VLAN 937 172.19.22.0/24
      • 10Gbs NIC, but need cables (copper twinX will do)
    • EJFAT loaner equip inventory:
      • (2) switches: ejfat-sw, daq-cc-f109-sw-1
      • (3) DAQ dev machines indra-s[1-3]
      • (4) DAQ Farm machines dafarm61 dafarm62 dafarm63 dafarm64 currently on 129.57.29.0/24 subnet w/ additional i/f available for EJFAT subnet
      • (17) Hall-D machines - gluon120-36
    • Testing newly received FPGA load
      • Specs
      • arp, ping - working
      • Issues:
        • Port entropy field - currently broken, update pending
        • MTU size restricted to max 1500, update pending
        • Possibly incorrect control message responses being investigated
      • Rec'd new f/w build 28 April
  • Pending:
    • Compute Equip.- ETA 1 June - sans 100Gbs NICs (ETA 1 July)
    • Networking Equip. - ETA 1 July 5 October
    • Support C libraries for LB Host Control Plane
    • ESnet smartnic open-source GitHub repo (April)
    • ESnet private, forkable Jlab P4 and simulations GitHub repo (April)
  • To Do:
    • Near Term:
      • Hall-B FT calorimeter and hodoscope streaming readout test - Pending OK from Sergey B.
        • May be able to use Abbott's indra-s1 setup
        • May be to use new VTP f/w with Hall-B VTP's - (Ben Raydo)
        • CODA 3.10 + ERSAP for new VTP f/w
        • CODA 2.0 for old VTP f/w
      • HOSS Hall-D EJFAT use case
        • parallelize writing of raw data files
        • distribute raw data across multiple compute nodes for calibration skims
        • 1 Gbs at hi-luminosity
        • Control Plane
          • Feedback from Compute hosts
          • Control Plane daemon for compute host
          • Demonstrate CP based flexibility/elasticity
        • Hall-D comms with DAQ 109 subnet require network customization; DAQ 29 subnet available
        • Slides
        • Netwok Diagram
    • Downstream:
  • AOT

Minutes:

Retrieved from "https://wiki.jlab.org/epsciwiki/index.php?title=EJFAT_Group_Meeting_Apr._28,_2022&oldid=1777"