Difference between revisions of "EPSCI SRO Meeting Sep. 30 2024"

From epsciwiki
Jump to navigation Jump to search
(Created page with " === Connection Info: === <div class="toccolours mw-collapsible mw-collapsed"> Microsoft Teams Meeting ID: 284 014 929 953 Passcode: hBrrMRYou <font size="-3">(Click "Expand"...")
 
Line 24: Line 24:
 
** NVIDIA Holoscan Bootcamp
 
** NVIDIA Holoscan Bootcamp
 
*'''ERSAP'''
 
*'''ERSAP'''
−
** Reassembly Engine: Integrating with Prometheus for enhanced metrics support (completed)
+
** Reassembly Engine: Integrating with Prometheus for enhanced metrics support. (completed)
−
** Updated CLAS12 data processing workflow in preparation for a new data-stream processing test.
+
** Updated CLAS12 data processing workflow for a new data-stream processing test. (completed)
−
*** Scheduled this Thursday, October 3, at 1 pm.
+
** E2SAR C++ actor development (Srinivas)
−
**** 80 Perlmutter, 4 Defiant, x FABRIC nodes
+
** Support for C++ terminal actors (in the design stage)
−
** E2SAR actor development (Srinivas)
+
** Java E2SAR for ERSAP Java users (in consideration)
−
 
+
*'''SC24 Demo Preparation'''
−
 
+
** A new remote data stream processing campaign is scheduled this Thursday, October 3, at 1 pm.
−
 
+
*** 80 Perlmutter, 4 Defiant, x FABRIC nodes, estimated to process 100 Gbps data stream remotely (Jeng, Vardan).
−
** SC24 Demo Preparation: Finalizing elements for the upcoming SC24 demo.
+
** Updated deployment diagram with animation (in progress. Ilya, Vardan)
−
* '''Preparing a new data-stream processing test'''
+
*'''RTDP/DPUX'''
−
 
+
** DPOL JAVA class hierarchy (in progress. Jeng)
−
** TDP/DPUX as JIRIAF Front-End: Implementing the RTDP/DPUX framework at the JIRIAF front-end for testing.
+
** DPOL parser (in progress. Jeng, Vardan)
−
** EJFAT Testbed Commissioning: Commissioning the data-stream test on the EJFAT platform.
+
** Simple workflow design and deployment (Jeng)
 +
*** The demo at the end of next week is our desired milestone.  
 
* '''Streaming CODA'''
 
* '''Streaming CODA'''
−
** CODA control events
+
** cMsg and cMsg rc-domain pub-sub servers on CP node.
−
*** Discussion on communicating VTP/ROC configurations (run-type) to the Event Builders (EBs).
+
*** Possible replacement with xMsg pub-sub.
−
*** Strategies for informing EBs when all VTPs or ROCs have entered the prestarted state.
+
** AFECS will support the gRPC protocol in communicating with the CP (The design has not yet started).
−
*** Mechanisms to notify CODA components about the end of a run.
 
−
** Role of the load balancer (LB)
 
−
*** The LB simplifies CODA component discovery and networking.
 
−
*** Control event broadcasting via the Data Plane (DP) is not viable and of limited use.
 
−
*** CODA run-control (AFECS) platform as the manager for control events and the streaming DAQ state machine. CODA control events will be handled out-of-band for streaming workflows.
 
−
* ''' CODA AFECS platform'''
 
−
** CODA platform and LB communication
 
−
*** Verifying or discovering the readiness of CODA "back-end" components.
 
−
*** Investigating the potential for accessing stream source data via the Control Plane (CP).
 
−
** AFECS Pub-Sub servers for CODA-3.x
 
−
*** General discussion on cMsg and cMsg rc-domain servers.
 
−
*** Evaluating the feasibility of extending the LB CP as the sole pub-sub server for streaming CODA, potentially replacing cMsg with gRPC.
 
 
* AOT
 
* AOT
  

Revision as of 17:31, 30 September 2024


Connection Info:

Microsoft Teams Meeting ID: 284 014 929 953 Passcode: hBrrMRYou (Click "Expand" to the right for details -->):

Microsoft Teams
Meeting ID: 284 014 929 953
Passcode: hBrrMRYou


Agenda:

  • Announcements
  • ERSAP
    • Reassembly Engine: Integrating with Prometheus for enhanced metrics support. (completed)
    • Updated CLAS12 data processing workflow for a new data-stream processing test. (completed)
    • E2SAR C++ actor development (Srinivas)
    • Support for C++ terminal actors (in the design stage)
    • Java E2SAR for ERSAP Java users (in consideration)
  • SC24 Demo Preparation
    • A new remote data stream processing campaign is scheduled this Thursday, October 3, at 1 pm.
      • 80 Perlmutter, 4 Defiant, x FABRIC nodes, estimated to process 100 Gbps data stream remotely (Jeng, Vardan).
    • Updated deployment diagram with animation (in progress. Ilya, Vardan)
  • RTDP/DPUX
    • DPOL JAVA class hierarchy (in progress. Jeng)
    • DPOL parser (in progress. Jeng, Vardan)
    • Simple workflow design and deployment (Jeng)
      • The demo at the end of next week is our desired milestone.
  • Streaming CODA
    • cMsg and cMsg rc-domain pub-sub servers on CP node.
      • Possible replacement with xMsg pub-sub.
    • AFECS will support the gRPC protocol in communicating with the CP (The design has not yet started).
  • AOT

Useful References

Minutes:

Retrieved from "https://wiki.jlab.org/epsciwiki/index.php?title=EPSCI_SRO_Meeting_Sep._30_2024&oldid=5616"