JIRIAF Meeting Sep. 28 2023

From epsciwiki
Revision as of 00:53, 28 September 2023 by Gurjyan (talk | contribs) (Created page with " === Connection Info: === <div class="toccolours mw-collapsible mw-collapsed"> You can connect using [https://jlab-org.zoomgov.com/j/1602836193?pwd=TkdVUnlkbTVVek5XV01TN3Jzd0...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search


Connection Info:

You can connect using the following link (Meeting ID: 160 851 8798). (Click "Expand" to the right for details -->):

One tap mobile: US: +16692545252,,1608518798# or +16468287666,,1608518798#
Meeting URL: https://jlab-org.zoomgov.com/j/1608518798?pwd=NnU3cW1ZZFhTTUQ2Y0hIRU5JTWg0UT09&from=addon
Meeting ID: 160 851 8798
Passcode: 205601

Join by Telephone
For higher quality, dial a number based on your current location.
Dial:
US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free)
Meeting ID: 160 851 8798

International numbers
Join by SIP
1608518798@sip.zoomgov.com
Join by H.323
161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 160 851 8798
Passcode: 205601


Agenda:

  1. Announcements
    1. The initial manuscript outlining our project has been submitted to the EPJ.
    2. The JIRIAF LDRD project has been chosen to receive funding for its second year of operation.
  2. Running Remote JRM with Virtual Kubelet (vk-cmd)
    1. Discuss the setup of running a remote JRM using the k8s API server on jiriaf2301.
    2. Share any recent developments or challenges in this area.
  3. Running JRM as a SLURM Job
    1. Explore the process of running JRM as a SLURM job.
    2. Discuss any benefits or limitations of this approach.
  4. Advantages of Running JRM Using SWIF
    1. Explain the advantages and benefits of utilizing SWIF for running JRM.
    2. Address any questions or concerns regarding this choice.
  5. JCS and k8s API Server Updates
    1. Provide an update on how the JCS and/or k8s API server updates the available resources in the MariaDB table.
    2. Discuss how SLURM job records are maintained in the database.
  6. Running CLAS12 Data-Stream Processing Pipeline
    1. Outline the steps to prepare a Docker image for the CLAS12 data-stream processing pipeline.
    2. Discuss running the pipeline container as a pod inside a JRM on a Perlmutter node at NERSC.
  7. Remote Access to jiriaf2301/02
    1. Verify if remote access to jiriaf2301/02 is resolved.
    2. Discuss the need for acceptable remote access performance on jiriaf2301/03 for prototyping purposes.
  8. Status of the Front-End
    1. Provide an update on the current status of the front-end system.
    2. JIRIAF Entry Web Page
      1. Discuss whether a web server running on jiriaf2301 is required for the JIRIAF entry web page.
    3. Connection to MariaDB Back-End
      1. Confirm if there is a connection to the MariaDB back-end for populating the "user-job-request" table.
    4. Status of the JIRIAF REST API
      1. Provide an update on the current status and functionality of the JIRIAF REST API.
  9. Authentication of JIRIAF Users
    1. Explore the authentication mechanisms used by SWIF and OSG.
    2. Discuss the feasibility of adopting these mechanisms for JIRIAF.
  10. Metadata Characterizing User Resources and Processing Requests
    1. Discuss the metadata related to user resources and processing requests, including data source, core requirements, memory, disk space, walk time, preferred site, and other relevant factors.
  11. JIRIAF Workflow Request Matching Server (JMS)
    1. Explain the role of JMS in running Kubernetes pods.
    2. Share any updates or changes in this area.
  12. JMS Matching Algorithms
    1. Discuss different matching algorithms used by JMS, such as exact matching and distributed resource allocation.
    2. Explore the implications and benefits of these algorithms.
  13. AOT

Useful References

Minutes:

Retrieved from "https://wiki.jlab.org/epsciwiki/index.php?title=JIRIAF_Meeting_Sep._28_2023&oldid=3852"