Popular repositories Loading

1. maxtext maxtext Public

   A simple, performant and scalable Jax LLM!

   Python 1.6k 308

2. JetStream JetStream Public

   JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

   Python 258 32

3. maxdiffusion maxdiffusion Public

   Python 169 18

4. xpk xpk Public

   xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerators such as TPUs and GPUs on GKE.

   Python 91 29

5. jetstream-pytorch jetstream-pytorch Public

   PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"

   Python 42 16

6. gpu-recipes gpu-recipes Public

   Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.

   Python 25 3