[Enhancement] Adding parallelism info to Accelerator for parallelism logging in W&B

[WoosungMyung]

When using tools like Weights & Bias or other loggers, it is often very useful to track the parallelism size(TP,DP,PP) used in distributed pre training.

Currently, users must manually write something like:

wandb.config.update({
"tp": accelerator.parallelism_config.tp_size,
...
all other parallelism info
...
})

This can become repetitive and error-prone, especially as more parallelism modes are added or used in combination.

I’d like to propose parallelism_info method, which returns a dictionary containing all configured parallelism
sizes in a unified way. If this method is accepted in Accelerate, I’d be happy to do another PR to the Transformers library to enable automatic logging of parallelism information when using Accelerate and W&B together.

Thank you for your time and consideration!

[S1ro1]

We already have something as such, which is parallelism_config._sizes (afaik), so we can just extend the class with extra property if needed.

[WoosungMyung]

@S1ro1 Thanks for your help. The property I needed is already there.
THanks**** Have a good day!

[S1ro1]

Closing this then, thank you!