EJFAT EPSCI Meeting Dec. 18, 2024

From epsciwiki
Revision as of 15:06, 18 December 2024 by Goodrich (talk | contribs) (Created page with "The meeting time is 2:30pm. === Connection Info: === <div class="toccolours mw-collapsible mw-collapsed"> You can connect using [https://teams.microsoft.com/l/meetup-join/19%...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

The meeting time is 2:30pm.

Connection Info:

You can connect using Teams Link. (Click "Expand" to the right for details -->): 

Meeting URL
	https://teams.microsoft.com/l/meetup-join/19%3ameeting_M2ExMzNiYmItNTNiMi00NzE4LTkwYWItOTQwYjJmMTJiMDhh%40thread.v2/0?context=%7b%22Tid%22%3a%22b4d7ee1f-4fb3-4f06-9037-2b5b522042ab%22%2c%22Oid%22%3a%22ff03cbe2-66d5-4741-bf32-ff1c69fa2fcc%22%7d

Meeting ID
273 279 114 915

Passcode
Rkypzi


Agenda:

  1. Previous meeting
  2. Announcements:
    1. ESnet CONFAB event, which runs from April 7 to 11. 
      1. EJFAT developer meeting all day Thursday 10th
      2. April 10th 2025 in San Francisco
    2. SkuTech Interest in EJFAT
  3. Topics
    1. Local CP testing
    2. IRI Test Development:
      1. Data Source:
        1. JLAB, CLAS12, pre-triggered events - 1 channel
      2. Data Sink:
        1. Perlmutter - 80 nodes
        2. ORNL/ESnet/JLab IRI Testbed / Defiant - 4 nodes allocated
        3. JLab - 7 nodes available
        4. FABRIC - nodes available
        5. ERSAP
      3. Test Plans - JLab, ESnet, NERSC:
      4. Prometheus Dashboards
      5. The Prometheus dashboard can be accessed on port 1717 of the ejfat-fs node. The test data is located at "100g-nersc-ornl / ejfat-nersc-ornl". The test time interval is around UTC 17:05 to 18:20 on August 29, 2024. To log in to Grafana, please use the username and password "ejfat".
    3. E2SAR Integration
    4. JLab FEG/SRO
      1. will use interim UDP solution for event sync
      2. Special Events Issue - Completely Out-of-band
        1. Cloud message queue solutions include Kafka and RabbitMQ, ...
        2. LB isolation from any non-LB processing
    5. E2SAR 0.1.4
      1. segmentation/reassembly complete
      2. .deb packages for Ubuntu 20, 22 and 24 are now available (they contain E2SAR library, headers, executables as well as appropriate versions of gRPC and Boost dependencies, all installed under /usr/local), as well as the latest Docker image
    6. ALS: E2SAR integration
    7. IB
    8. Storage
      1. SSD drives on ejfat-fs - 20TB used of 28TB - mounted for EJFAT farm - permissions issue
      2. Ram Disks: 1TB Total Mem on ejfat-fs, 0.5 TB others
      3. Repurposing /dev/sdb to be used for user storage
      4. Storage Areas NOT to be backed up could be marked as scratch
      5. Have an opportunity to consolidate wares on SSD for consistent SC backup procedure ?.
    9. Experiment Halls - beam returns late January/February 2025
    10. Ubuntu 20.04 LTS - support ends in 2025 - next ESnet target 22.04
    11. CP: Control Web UI (127.0.0.1:8081) needs SSH tunnel
    12. EJFAT II
    13. ESnet interested in partnering for beachhead in FPGA/GPU AI space
      1. Separate Project
      2. FAST program coming up
      3. May get free help from Xilinx
      4. Might target VERSA release
  4. Resources:
    1. HPDF
    2. EJFAT API
    3. EJFAT Status
  5. U280’s are discontinued.
    1. New LB purchases U55C
    2. U55C bitfiles available 1 year out
    3. U280 Supported indefinitely
  6. ACAT 2024 Paper - In Review

Notes

  1. LLDP needs IOMMU
  2. FW containers need boot init script
  3. EJFAT nodes:
    1. 16 NUMA domains
    2. DPDK must run portmode driver on CPU in NUMA domain of FPGA for LLDP messages
  4. EJFAT II
    1. architecture change in control/data paths for FPGA (SRIOV)
    2. adding PCIE AES
  5. AOT

Minutes

Retrieved from "https://wiki.jlab.org/epsciwiki/index.php?title=EJFAT_EPSCI_Meeting_Dec._18,_2024&oldid=5940"