AI Surrogate Models LDRD
Running Legacy Code on Heterogeneous Hardware via Surrogate Models
Project Description
PHASM ("Parallel Hardware viA Surrogate Models") is a software toolkit, currently under development, for creating AI-based surrogate models of scientific code. AI-based surrogate models are widely used for creating fast and inverse simulations. The project anticipates an additional, future use case: adapting legacy code to modern hardware. Data centers are investing in heterogeneous hardware such as GPUs and FPGAs; meanwhile, many important codebases are unable to take advantage of this hardware's superior parallelism without undergoing a costly rewrite. An alternative is to train a neural net surrogate model to mimic the computationally intensive functions in the code, and deploy the surrogate on the exotic hardware instead. PHASM addresses three specific challenges: (1) systematically discovering which functions can be effectively replaced with a surrogate, (2) automatically identifying, for a given function, the true space of inputs and outputs including those not apparent from the type signature, and (3) integrating a machine learning model into a legacy codebase cleanly and with a high level of abstraction. In the first year of development, a proof of concept has been developed for each challenge. A surrogate API makes it easy to bring PyTorch models into the C++ ecosystem and uses profunctor optics to establish a two-way data binding between C++ datatypes and tensors. A model variable discovery tool performs a dynamic binary analysis using Intel PIN in order to identify a target function's model variable space, including types, shapes, and ranges, and generate the optics code necessary to bind the model to the function. Future work may include exploring the limits of surrogate models for functions of increasing size and complexity, and adaptively generating synthetic training data based on uncertainty estimates.
General Resources
- Source code lives here: https://github.com/nathanwbrei/phasm
- SRGS 2022
- Project planning (Trello page)
Meetings
Thursday 2-3pm, bi-weekly. Teams.
Meeting ID: 281 724 015 543
Passcode: cWidgE
Documents
Proposals
Presentations
| Date | Event | Presenter | Slides |
|---|---|---|---|
| 2022-06-27 | SRGS 2022 | Nathan Brei, David Lawrence | |
| 2022-08-24 | W&M collab | Nathan Brei | |
| 2022-10-27 | ACAT 2022 | Nathan Brei | |
| 2023-05-01 | CHEP 2023 | Xinxin Mei | poster |
Publications
| Date | Journal | Title |
|---|---|---|
| March 2023 | ACAT 2022 proceedings (preprint) | PHASM: A toolkit for creating AI surrogate models within legacy codebases |
Graphics
PHASM flowchart
Rectangles denote programs or scripts, parallelograms denote data, diamonds denote decisions, and arrows denote data flow.
Notes
- The NVIDIA GPU profiling tool for the GPU Roofline analysis, Xinxin Mei
- Utilizing Advisor and Likwid for CPU Roofline analysis, Xinxin Mei
- The Roofline analysis of a libtorch C++ GPU PINN-heat equation implementation, Xinxin Mei