utep-pnnl-ddl

Project Proposal

See abstract and narrative PDF files in the proposal directory

Graph Neural Networks Tutorial

Hands-On Graph Neural Networks Using Python

https://github.com/PacktPublishing/Hands-On-Graph-Neural-Networks-Using-Python

Access the book on oreilly.com using UTEP SSO

Analytical Modeling

Article with an analytical model of the memory consumption of a CNN:

https://frankdenneman.nl/2022/07/15/training-vs-inference-memory-consumption-by-neural-networks/

Paper with analytical models of computation, memory usage, and communication for parallel training of CNNs:

An Oracle for Guiding Large-Scale Model/Hybrid Parallel Training of Convolutional Neural Networks

https://dl.acm.org/doi/abs/10.1145/3431379.3460644

Also available at https://arxiv.org/abs/2104.09075