EJFAT Group Meeting Apr. 7, 2022
Jump to navigation
Jump to search
The meeting time is 11:00am.
Connection Info:
You can connect using ZoomGov Video conferencing (ID: 161 012 5238). (Click "Expand" to the right for details -->):
Meeting URL https://jlab-org.zoomgov.com/j/1610125238?pwd=QnEvcjV6VFFndWZsQW15SmJKU0RJZz09&from=addon Meeting ID 161 012 5238 Passcode 503371 Want to dial in from a phone? Dial one of the following numbers: US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free) Enter the meeting ID and passcode followed by # Connecting from a room system? Dial: bjn.vc or 199.48.152.152 and enter your meeting ID & passcode
Agenda:
- Previous meeting
- Situation:
- Testing with End-to-end EJFAT ERSAP solution on FPGA LB
- Jumbo Frames - indra-s2,s3, alkaid, fpga
- Linux IP stack buffer size increased
- Using script based LB Control Plane
- Control Plane Gratuitous Arp cache updating (Scapy)
- Benchmarking
- Successfully Testing Calendar Epoch Advances
- RT2022 - April 08 submission - August 01-05 Conference
- Pending:
- Compute Equip.- ETA 1 June
- Networking Equip. - ETA 1 July
- Support C libraries for LB Host Control Plane
- ESnet smartnic open-source GitHub repo (April)
- ESnet private, forkable Jlab P4 and simulations GitHub repo (April)
- Data_id <-> reassembly port mapping for powers-of-two ports per host
- To Do:
- Near Term:
- Hall-B FT calorimeter and hodoscope streaming readout test (scheduled for week of 04/10 or 04/17)
- 2 crates for FT calorimeter, furnished with fADC250s. Total 332 channels.
- 1 crate for the hodoscope that has 12 fADC (total 192 channels)
- Update firmware on all 3 VTPs to send fADC aggregated data frames in the EVIO format, through UDP.
- Design ERSAP FE application containing an actor that receives VTP frames through UDP, extracts information about the source/data ID and frame number (tick), and sends it to the EJFAT packetizing engine.
- Stage 1 testing: single stream/data-ID
- EJFAT LB + reassembly (RA) engine overall performance data-rate dependence.
- EJFAT LB + RA engine performance dependence from the EJFAT packetizing engine MTU settings
- Stage 2 testing: multi-stream/data_ID
- Use EJFAT LB firmware that supports load balancing of multiple source/data_IDs.
- EJFAT LB + RA engine performance as an event builder (i.e. source ID aggregator), a capability to send all available data_ID's with the same tick (time frame) to a single destination. NB Hall-B FT calorimeter and hodoscope setup is capable of sending up to 12 data streams.
- C-based control plane
- Feedback from Compute hosts design
- Control Plane daemon for compute host
- Hall-B FT calorimeter and hodoscope streaming readout test (scheduled for week of 04/10 or 04/17)
- Downstream:
- DPDK
- P4 enhancements for ipv4/6 ping, arp
- IPV6 testing
- EJFAT Subnet
- HOSS Hall-D EJFAT use case
- parallelize writing of raw data files
- distribute raw data across multiple compute nodes for calibration skims
- Near Term:
- AOT
Minutes:
- EJFAT subnet: VLAN 937 172.19.22.0/24
- DAQ Farm machines dafarm61 dafarm62 dafarm63 dafarm64 currently on 129.57.29.0/24 subnet w/ additional i/f available for EJFAT subnet
- Running CentOS 7.7
- 10Gbs NIC, but need cables (copper twinX will do)
- New P4 to include
- ARP, ping, iCMP ipv4/6
- ipv6 neighbor discovery TBD
- ERSAP feed end bottleneck needs investigation; Timmer's blaster may provide relief
- Peter Nugent/LBNL: LDRD LBNL+JLAB combines JLAB streaming + LBNL compute