New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FR: Create mpi4jax.pmap working as a GlobalShardedDeviceArray #122

Open

PhilipVinc opened this issue Feb 14, 2022 · 1 comment

Member

PhilipVinc commented Feb 14, 2022

We could implement a tracer, mpi4jax.pmap, which behaves as jax.pmap but is multi-process aware.

The text was updated successfully, but these errors were encountered:

Contributor

chaserileyroberts commented Feb 14, 2022

I like this idea. Would we basically map the jax.lax.p* primitives to mpi4jax primitives?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.

Alternative Proxies:

Alternative Proxy