JIRIAF Meeting Jan. 12 2023
Connection Info:
You can connect using https://jlab-org.zoomgov.com/j/1601588698 (Meeting ID: 160 158 8698). (Click "Expand" to the right for details -->):
One tap mobile: US: +16692545252,,1601588698# or +16468287666,,1601588698#
Meeting URL: https://jlab-org.zoomgov.com/j/1601588698?pwd=Q3FRR0xjd1lheU5vS3NHcTZBdkp6QT09&from=addon
Meeting ID: 160 158 8698
Passcode: 508845
Join by Telephone
For higher quality, dial a number based on your current location.
Dial:
US: +1 669 254 5252 or ++1 646 828 7666 or ++1 669 216 1590 or ++1 415 449 4000 or 833 568 8864 (Toll Free)
Meeting ID: 160 158 8698
International numbers
Join from an H.323/SIP room system
H.323: 161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 160 158 8698
Passcode: 508845
SIP: 11601588698@sip.zoomgov.com
Passcode: 923910
Agenda:
- Announcements
- Streaming CODA
- CODA PAAG and SAAG components
- JCEdit-5.0: CODA COOL streaming front-end
- New CODA types: PAAG and SAAG
- AFECS updates to support new CODA types
- CODA connection mechanism to a data-processing pipeline
- Remote ET FIFO
- CODA EPICS interface
- ActiveMQ
- Prototype GEM detector readout
- instructions at SAMPA-SRO
- DSPDecoder engine (on hold)
- Formatting output data in EVIO-6 (in progress)
- ML-based anomaly detection: Adaptive sliding window (ADWIN) algorithm-based actor development (completed, testing)
- Cluster finding in a stream of data
- New GEM detector installation
- Integration with the streaming CODA data acquisition system.
- EJFAT
- Port CLAS12 CLARA services into ERSAP (completed)
- EJFAT reassemble - ERSAP BE interface (completed)
- Successfully run CLAS12 reconstruction application on ejfat-1, streaming data from ejfat-5 through LB on ejfat-1
- Corrupted reassembled events
- Introducing data lake as a stream-source actor (testing)
- PID loop in the BE receiver actor (completed)
- TriDAS
- ERSAP planning
- Development efforts
- Monitoring
- Support for InfluxDB (done)
- Support for Prometheus (active)
- Prometheus ERSAP Exporter (active)
- Tiered data storage
- Redis as a source actor (on hold)
- Data-lake as a source actor
- Developed EjfatReaderEngine that includes a large ring buffer. (Testing)
- Develop EjfatReaderEngine that talks to ET (designing)
- Data stream transport
- Implementing Kafka as internal transport (research)
- Support for P2P (client-server) communication (on hold)
- Transient data format
- Use EVIO-6 as default
- Evaluate Apache Arrow as a transient data format (active)
- EvioArrow, ArrowEvio convertor engines (designing)
- Application graphical designer (research)
- Extend COOL to describe data-stream processing pipelines
- Considering using Spring Boot for web interface and object persistency (research)
- Engine provisioning and deployment improvements (on hold)
- Extend COOL to describe data-stream processing pipelines
- CLI improvements
- New language bindings (on hold)
- General-purpose data-stream processing engines (on hold)
- Benchmarking and testing (active)
- Monitoring
- Commissioning and field studies
- EIC prototype detector components data stream readout and processing
- Upcoming beam tests at the JLAB
- EIC prototype detector components data stream readout and processing
- Development efforts
- AOT
Useful References
- SRO Meetings
- CLAS12 SRO page
- ERSAP Document
- Vardan's WMS draft
- Graham's Paper describing SRO
- Dave Abbott's slides on data format