Skip to content

Continue DDP implementation from existing branch ddp-support-wip #269

Description

@guillaume-byte

Summary

Continue and complete the existing Distributed Data Parallel (DDP) implementation work from branch ddp-support-wip.

Scope

  • Review and continue current implementation from ddp-support-wip.
  • Validate end-to-end DDP training flow in WeightsLab.
  • Ensure behavior parity with single-GPU baseline for core metrics/logging/checkpointing.
  • Document launch/config usage and known limitations.

Acceptance Criteria

  • DDP path is runnable from documented command/config.
  • Multi-GPU training completes for at least one reference workload.
  • Metrics, logging, and checkpointing are validated under DDP.
  • Existing branch work is merged (or superseded) with migration notes if needed.

Branch Reference

  • Existing work branch: ddp-support-wip

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions