Difference between revisions of "EPSCI SRO Meeting Apr. 15 2024"

From epsciwiki
Jump to navigation Jump to search
(Created page with " === Connection Info: === <div class="toccolours mw-collapsible mw-collapsed"> You can connect using [https://jlab-org.zoomgov.com/j/1617825253 https://jlab-org.zoomgov.com/j...")
 
 
(One intermediate revision by the same user not shown)
Line 37: Line 37:
 
=== Agenda: ===
 
=== Agenda: ===
 
* Announcements
 
* Announcements
 +
** [https://indico.cern.ch/event/1338689/ CHEP2024]
 
* 100Gbps to ESnet data-stream processing
 
* 100Gbps to ESnet data-stream processing
 
** Fast data processing workflow
 
** Fast data processing workflow
Line 48: Line 49:
 
** [https://github.com/secondspass/olcf-user-docs/blob/subil_defiant_container_docs/ace_testbed/defiant_quick_start_guide.rst Instructions] from Ross Miller.  
 
** [https://github.com/secondspass/olcf-user-docs/blob/subil_defiant_container_docs/ace_testbed/defiant_quick_start_guide.rst Instructions] from Ross Miller.  
 
* ERSAP data stream pipeline for APS and ALS   
 
* ERSAP data stream pipeline for APS and ALS   
 +
** EJFAT source that uses EPICS PV access.
 
* RTDP  
 
* RTDP  
 
* INDRA SAMPA [https://wiki.jlab.org/epsciwiki/index.php/SAMPA_SRO#How_to_write_your_ERSAP_processor_engine.3F SRO]   
 
* INDRA SAMPA [https://wiki.jlab.org/epsciwiki/index.php/SAMPA_SRO#How_to_write_your_ERSAP_processor_engine.3F SRO]   
 
* '''ERSAP UI project'''  
 
* '''ERSAP UI project'''  
 
** Camunda platform for its feasibility to support ERSAP, JIRIAF, and CODA components through BPMN plugin integration  
 
** Camunda platform for its feasibility to support ERSAP, JIRIAF, and CODA components through BPMN plugin integration  
* '''ERSAP generic data stream mining actors.'''
+
* '''ERSAP generic data stream mining actor-store project'''
** Change detection, Clustering, Pattern identification
+
** Change detection, Clustering, Pattern identification, etc.
* '''ERSAP transient data transport system upgrade.'''
+
* '''ERSAP transient data transport system upgrade project.'''
 
** Kafka, OpenHFT/Chronicle-Queue.
 
** Kafka, OpenHFT/Chronicle-Queue.
 
* AOT
 
* AOT

Latest revision as of 17:54, 15 April 2024


Connection Info:

You can connect using https://jlab-org.zoomgov.com/j/1617825253 (Meeting ID: 1160 855 6097). (Click "Expand" to the right for details -->):

One tap mobile: US: +16692545252,,1618740469# or +16468287666,,1618740469#
Meeting URL: https://jlab-org.zoomgov.com/j/1617825253?pwd=bTQ2enh3QlBnb2JEd1JUK3BRSjFJdz09&from=addon&from=addon
Meeting ID: 161 782 5253
Passcode: 923910

Join by Telephone
For higher quality, dial a number based on your current location.
Dial:
US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free)
Meeting ID: 161 782 5253

International numbers
Join from an H.323/SIP room system
H.323: 161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 161 782 5253
Passcode: 923910
SIP: 1608556097@sip.zoomgov.com
Passcode: 923910


Agenda:

  • Announcements
  • 100Gbps to ESnet data-stream processing
    • Fast data processing workflow
    • Multiple data source streams, using NTP sync time as event number.
      • Estimated 11-12 streams to achieve accumulated 100Gbps source.
      • Estimated 37-38 nodes to process 100GBps data stream at NERSC.
    • Update clasBlasterNTP.cpp and EjfatPacketzer.java (ERSAP source actor) to use EJFAT CP's new API.
  • ERSAP data stream pipeline at ORNL
    • Accounts are set.
      • Issues with podman pull docker.io/gurjyan/ersap:v0.1
    • Instructions from Ross Miller.
  • ERSAP data stream pipeline for APS and ALS
    • EJFAT source that uses EPICS PV access.
  • RTDP
  • INDRA SAMPA SRO
  • ERSAP UI project
    • Camunda platform for its feasibility to support ERSAP, JIRIAF, and CODA components through BPMN plugin integration
  • ERSAP generic data stream mining actor-store project
    • Change detection, Clustering, Pattern identification, etc.
  • ERSAP transient data transport system upgrade project.
    • Kafka, OpenHFT/Chronicle-Queue.
  • AOT

Useful References


Minutes: