Difference between revisions of "EJFAT Group Meeting Apr. 28, 2022"
Jump to navigation
Jump to search
(5 intermediate revisions by the same user not shown) | |||
Line 43: | Line 43: | ||
*** VLAN 937 172.19.22.0/24 | *** VLAN 937 172.19.22.0/24 | ||
*** 10Gbs NIC, <s>but '''need cables''' </s>(copper twinX will do) | *** 10Gbs NIC, <s>but '''need cables''' </s>(copper twinX will do) | ||
− | ** DAQ Farm machines ''dafarm61 dafarm62 dafarm63 dafarm64'' currently on 129.57.29.0/24 subnet w/ additional i/f available for EJFAT subnet | + | ** EJFAT loaner equip inventory: |
+ | *** (2) switches: ejfat-sw, daq-cc-f109-sw-1 | ||
+ | *** (3) DAQ dev machines indra-s[1-3] | ||
+ | *** (4) DAQ Farm machines ''dafarm61 dafarm62 dafarm63 dafarm64'' currently on 129.57.29.0/24 subnet w/ additional i/f available for EJFAT subnet | ||
+ | *** (17) Hall-D machines - gluon120-36 | ||
** Testing newly received FPGA load | ** Testing newly received FPGA load | ||
*** [https://docs.google.com/document/d/1ssw8sye7jExtPCJVejloe8hNkyWOcxEQzVmm45xs5-w/edit#heading=h.mqilsqsmmpek Specs] | *** [https://docs.google.com/document/d/1ssw8sye7jExtPCJVejloe8hNkyWOcxEQzVmm45xs5-w/edit#heading=h.mqilsqsmmpek Specs] | ||
Line 51: | Line 55: | ||
**** MTU size restricted to max 1500, update pending | **** MTU size restricted to max 1500, update pending | ||
**** Possibly incorrect control message responses being investigated | **** Possibly incorrect control message responses being investigated | ||
+ | *** '''Rec'd new f/w build 28 April''' | ||
* Pending: | * Pending: | ||
− | ** Compute Equip.- ETA 1 June - | + | ** Compute Equip.- ETA 1 June - '''sans 100Gbs NICs''' (ETA 1 July) |
** Networking Equip. - ETA <s>1 July</s> 5 October | ** Networking Equip. - ETA <s>1 July</s> 5 October | ||
** Support C libraries for LB Host Control Plane | ** Support C libraries for LB Host Control Plane | ||
Line 60: | Line 65: | ||
** Near Term: | ** Near Term: | ||
*** Hall-B FT calorimeter and hodoscope streaming readout test - Pending OK from Sergey B. | *** Hall-B FT calorimeter and hodoscope streaming readout test - Pending OK from Sergey B. | ||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
**** May be able to use Abbott's indra-s1 setup | **** May be able to use Abbott's indra-s1 setup | ||
**** May be to use new VTP f/w with Hall-B VTP's - (Ben Raydo) | **** May be to use new VTP f/w with Hall-B VTP's - (Ben Raydo) | ||
− | **** CODA 3.10 + ERSAP | + | **** CODA 3.10 + ERSAP for new VTP f/w |
− | * | + | **** CODA 2.0 for old VTP f/w |
− | *** | + | *** [https://www.epj-conferences.org/articles/epjconf/abs/2021/05/epjconf_chep2021_04005/epjconf_chep2021_04005.html HOSS Hall-D EJFAT use case] |
− | + | **** parallelize writing of raw data files | |
− | + | **** distribute raw data across multiple compute nodes for calibration skims | |
− | + | **** 1 Gbs at hi-luminosity | |
− | + | **** Control Plane | |
− | + | ***** Feedback from Compute hosts | |
+ | ***** Control Plane daemon for compute host | ||
***** Demonstrate CP based flexibility/elasticity | ***** Demonstrate CP based flexibility/elasticity | ||
− | + | **** Hall-D comms with DAQ 109 subnet require network customization; DAQ 29 subnet available | |
− | + | **** [https://docs.google.com/presentation/d/1m3rFm-1GymYv8zGimlAjL1NmWtXVfyIQdGzhx_j_BKE/edit?usp=sharing Slides] | |
− | + | **** [https://jeffersonlab-my.sharepoint.com/personal/bmorris_jlab_org/Documents/Microsoft%20Teams%20Chat%20Files/JLab%20Network%20-%20HallD-to-EJFAT.png Netwok Diagram] | |
** Downstream: | ** Downstream: | ||
*** [http://www.dpdk.org DPDK] | *** [http://www.dpdk.org DPDK] |
Latest revision as of 15:01, 28 April 2022
The meeting time is 11:00am.
Connection Info:
You can connect using ZoomGov Video conferencing (ID: 161 012 5238). (Click "Expand" to the right for details -->):
Meeting URL https://jlab-org.zoomgov.com/j/1610125238?pwd=QnEvcjV6VFFndWZsQW15SmJKU0RJZz09&from=addon Meeting ID 161 012 5238 Passcode 503371 Want to dial in from a phone? Dial one of the following numbers: US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free) Enter the meeting ID and passcode followed by # Connecting from a room system? Dial: bjn.vc or 199.48.152.152 and enter your meeting ID & passcode
Agenda:
- Previous meeting
- Situation:
Testing with End-to-end EJFAT ERSAP solution on FPGA LBJumbo Frames - indra-s2,s3, alkaid, fpga- Linux IP stack buffer size increased
- Using script based LB Control Plane
- ERSAP feed end bottleneck needs investigation; Timmer's blaster may provide relief
- EJFAT subnet
- VLAN 937 172.19.22.0/24
- 10Gbs NIC,
but need cables(copper twinX will do)
- EJFAT loaner equip inventory:
- (2) switches: ejfat-sw, daq-cc-f109-sw-1
- (3) DAQ dev machines indra-s[1-3]
- (4) DAQ Farm machines dafarm61 dafarm62 dafarm63 dafarm64 currently on 129.57.29.0/24 subnet w/ additional i/f available for EJFAT subnet
- (17) Hall-D machines - gluon120-36
- Testing newly received FPGA load
- Specs
- arp, ping - working
- Issues:
- Port entropy field - currently broken, update pending
- MTU size restricted to max 1500, update pending
- Possibly incorrect control message responses being investigated
- Rec'd new f/w build 28 April
- Pending:
- Compute Equip.- ETA 1 June - sans 100Gbs NICs (ETA 1 July)
- Networking Equip. - ETA
1 July5 October - Support C libraries for LB Host Control Plane
- ESnet smartnic open-source GitHub repo (April)
- ESnet private, forkable Jlab P4 and simulations GitHub repo (April)
- To Do:
- Near Term:
- Hall-B FT calorimeter and hodoscope streaming readout test - Pending OK from Sergey B.
- May be able to use Abbott's indra-s1 setup
- May be to use new VTP f/w with Hall-B VTP's - (Ben Raydo)
- CODA 3.10 + ERSAP for new VTP f/w
- CODA 2.0 for old VTP f/w
- HOSS Hall-D EJFAT use case
- parallelize writing of raw data files
- distribute raw data across multiple compute nodes for calibration skims
- 1 Gbs at hi-luminosity
- Control Plane
- Feedback from Compute hosts
- Control Plane daemon for compute host
- Demonstrate CP based flexibility/elasticity
- Hall-D comms with DAQ 109 subnet require network customization; DAQ 29 subnet available
- Slides
- Netwok Diagram
- Hall-B FT calorimeter and hodoscope streaming readout test - Pending OK from Sergey B.
- Downstream:
- DPDK
- IPV6 testing
- RT2022 - August 01-05 Conference
- Near Term:
- AOT