Sharath Turuvekere Sreenivas 41f582bd9f [JAX] Add JAX models with reference to Rosetta Github 2 years ago
..
README.md 41f582bd9f [JAX] Add JAX models with reference to Rosetta Github 2 years ago

README.md

Paxml (aka Pax) is a framework for training LLMs. It allows for advanced and configurable experimentation and parallelization. It is based on JAX and Praxis.

PAXML on GPUs

Please refer to Rosetta PAXML, NVIDIA's project that enables seamless training of LLMs, CV models and multimodal models in JAX, for information about running models and experiments on GPUs in PAXML.