(5/n) Support 2D Parallelism in Lightning Trainer #13057

Job	Run time
pl-cpu (macOS-11, lightning, 3.10, 2.0)	26m 20s
pl-cpu (ubuntu-20.04, lightning, 3.10, 2.0)	13m 53s
pl-cpu (windows-2022, lightning, 3.10, 2.0)	16m 4s
pl-cpu (macOS-11, lightning, 3.10, 2.1)	27m 48s
pl-cpu (ubuntu-20.04, lightning, 3.10, 2.1)	15m 49s
pl-cpu (windows-2022, lightning, 3.10, 2.1)	17m 45s
pl-cpu (macOS-11, lightning, 3.10, 2.2)	28m 8s
pl-cpu (ubuntu-20.04, lightning, 3.10, 2.2)	15m 5s
pl-cpu (windows-2022, lightning, 3.10, 2.2)	17m 52s
pl-cpu (macOS-14, lightning, 3.10, 2.3)	14m 44s
pl-cpu (ubuntu-20.04, lightning, 3.10, 2.3)	15m 8s
pl-cpu (windows-2022, lightning, 3.10, 2.3)	20m 18s
pl-cpu (macOS-12, pytorch, 3.11, 2.0)	22m 35s
pl-cpu (ubuntu-22.04, pytorch, 3.11, 2.0)	14m 49s
pl-cpu (windows-2022, pytorch, 3.11, 2.0)	17m 53s
pl-cpu (macOS-12, pytorch, 3.11, 2.1)	22m 23s
pl-cpu (ubuntu-22.04, pytorch, 3.11, 2.1)	14m 59s
pl-cpu (windows-2022, pytorch, 3.11, 2.1)	19m 59s
pl-cpu (macOS-11, lightning, 3.8, 2.0, oldest)	25m 51s
pl-cpu (ubuntu-20.04, lightning, 3.8, 2.0, oldest)	13m 15s
pl-cpu (windows-2022, lightning, 3.8, 2.0, oldest)	17m 33s
pl-cpu (macOS-11, pytorch, 3.8, 2.0)	26m 47s
pl-cpu (ubuntu-20.04, pytorch, 3.8, 2.0)	13m 31s
pl-cpu (windows-2022, pytorch, 3.8, 2.0)	15m 25s
	7h 33m 54s

Provide feedback