EJFAT Group Meeting Apr. 28, 2022
Jump to navigation
Jump to search
The meeting time is 11:00am.
Connection Info:
You can connect using ZoomGov Video conferencing (ID: 161 012 5238). (Click "Expand" to the right for details -->):
Meeting URL https://jlab-org.zoomgov.com/j/1610125238?pwd=QnEvcjV6VFFndWZsQW15SmJKU0RJZz09&from=addon Meeting ID 161 012 5238 Passcode 503371 Want to dial in from a phone? Dial one of the following numbers: US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free) Enter the meeting ID and passcode followed by # Connecting from a room system? Dial: bjn.vc or 199.48.152.152 and enter your meeting ID & passcode
Agenda:
- Previous meeting
- Situation:
Testing with End-to-end EJFAT ERSAP solution on FPGA LBJumbo Frames - indra-s2,s3, alkaid, fpga- Linux IP stack buffer size increased
- Using script based LB Control Plane
- ERSAP feed end bottleneck needs investigation; Timmer's blaster may provide relief
- EJFAT subnet
- VLAN 937 172.19.22.0/24
- 10Gbs NIC,
but need cables(copper twinX will do)
- DAQ Farm machines dafarm61 dafarm62 dafarm63 dafarm64 currently on 129.57.29.0/24 subnet w/ additional i/f available for EJFAT subnet
- Testing newly received FPGA load
- Specs
- arp, ping - working
- Issues:
- Port entropy field - currently broken, update pending
- MTU size restricted to max 1500, update pending
- Possibly incorrect control message responses being investigated
- Rec'd new f/w build 28 April
- Pending:
- Compute Equip.- ETA 1 June - sans 100Gbs NICs (ETA 1 July)
- Networking Equip. - ETA
1 July5 October - Support C libraries for LB Host Control Plane
- ESnet smartnic open-source GitHub repo (April)
- ESnet private, forkable Jlab P4 and simulations GitHub repo (April)
- To Do:
- Near Term:
- Hall-B FT calorimeter and hodoscope streaming readout test - Pending OK from Sergey B.
- 2 crates for FT calorimeter, furnished with fADC250s. Total 332 channels.
- 1 crate for the hodoscope that has 12 fADC (total 192 channels)
- Update firmware on all 3 VTPs to send fADC aggregated data frames in the EVIO format, through UDP.
- Design ERSAP FE application containing an actor that receives VTP frames through UDP, extracts information about the source/data ID and frame number (tick), and sends it to the EJFAT packetizing engine.
- Stage 1 testing: single stream/data-ID
- EJFAT LB + reassembly (RA) engine overall performance data-rate dependence.
- EJFAT LB + RA engine performance dependence from the EJFAT packetizing engine MTU settings
- Stage 2 testing: multi-stream/data_ID
- Use EJFAT LB firmware that supports load balancing of multiple source/data_IDs.
- EJFAT LB + RA engine performance as an event builder (i.e. source ID aggregator), a capability to send all available data_ID's with the same tick (time frame) to a single destination. NB Hall-B FT calorimeter and hodoscope setup is capable of sending up to 12 data streams.
- May be able to use Abbott's indra-s1 setup
- May be to use new VTP f/w with Hall-B VTP's - (Ben Raydo)
- CODA 3.10 + ERSAP
- Control Plane
- Feedback from Compute hosts
- Control Plane daemon for compute host
- HOSS Hall-D EJFAT use case
- parallelize writing of raw data files
- distribute raw data across multiple compute nodes for calibration skims
- 1 Gbs at hi-luminosity
- Demonstrate CP based flexibility/elasticity
- Hall-D comms with DAQ 109 subnet require network customization; DAQ 29 subnet available
- Slides
- Netwok Diagram
- Hall-B FT calorimeter and hodoscope streaming readout test - Pending OK from Sergey B.
- Downstream:
- DPDK
- IPV6 testing
- RT2022 - August 01-05 Conference
- Near Term:
- AOT