JIRIAF Meeting Nov. 16 2023
Jump to navigation
Jump to search
Connection Info:
You can connect using the following link (Meeting ID: 161 690 3130). (Click "Expand" to the right for details -->):
One tap mobile: US: +16692545252,,1608518798# or +16468287666,,1608518798#
Meeting URL: https://jlab-org.zoomgov.com/j/1616903130?pwd=cjg3U0Y4SndXL05SeFBmQjVHZkhrQT09&from=addon
Meeting ID: 161 690 3130
Passcode: 018094
Join by Telephone
For higher quality, dial a number based on your current location.
Dial:
US: +1 669 254 5252 or +1 646 828 7666 or +1 551 285 1373 or +1 669 216 1590 or 833 568 8864 (Toll Free)
Meeting ID: 161 690 3130
International numbers
Join by SIP
1616903130@sip.zoomgov.com
Join by H.323
161.199.138.10 (US West)
161.199.136.10 (US East)
Meeting ID: 160 851 8798
Passcode: 018094
Agenda:
- Announcements
- Successful deployment and data-stream processing from JLAB to NERSC Perlmutter.
- In the process of hiring a student from ODU.
- Summary of the project's undertakings and key achievements
- M1 (Complete)
- Multiple pods within the vk-cmd
- M2 (Complete)
- Prometheus scraper that uses UNIX perf
- M3
- Define mechanisms to act on user workflows, such as
- Reduce previously allocated resources to the user workflow/application
- Define mechanisms to act on user workflows, such as
- M4
- JCS design and development
- Finalize and prototype JIRIAF central service database. Tabes, such as
- available resource, user requests, and user workflow status.
- Examine the site resources database table (constantly updated by SWIF2) and submit SWIF2 requests to launch JRM and allocate/lease resources.
- Communicate with the k8s App server, ensuring submitted jobs are running, updating JIRIAF's available resource DB table.
- Develop a resource-request matching algorithm that compares user requests with the available resources.
- Define and suggest metadata structure for requests for accurate matching.
- Monitor/scrape Prometheus database process-related metrics and update active user workflows status DB table.
- Finalize and prototype JIRIAF central service database. Tabes, such as
- JCS design and development
- M5 (Complete)
- JIRIAF k8s node/vk_cmd: Implement a function that can use ConfigMap configuration to write files in pods.
- M1 (Complete)
- Slides for upcoming presentations in preparation for the publications
- Slide describing JIRIAF virtual k8s cluster creation, emphasizing its dynamic nature.
- Slide showing Prometheus integration to monitor JIRIAF k8s cluster and pods.
- Start working on a paper describing JIRIAF resource acquisition and workflow deployment within a dynamic k8s cluster.
- Work requirement for the student to work on FE.
- AOT
Useful References