Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Shmap/PartialAuto] Temporary solution for debug.print inside a partial-auto shard map. #25705

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

yliu120
Copy link
Contributor

@yliu120 yliu120 commented Jan 1, 2025

This commit needs the XLA commit: openxla/xla#20944 to work.

However this is not the ultimate fix for this. We want some solution that works in very short term as this feature is crucial for debugging.

The issue with debug.print not working inside a partial-auto shard map is because,

  1. The tensor will be further partitioned in GSPMD however the host callback is created during IR lowering time with the shape traced in shard map.
  2. based on 1), a permanent fix would be serializing the args info into the opaque string and after SPMD partitioning, XLA should pack the partitioned args info into the backend config opaque string.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant