Skip to content

Commit 87f4c20

Browse files
authored
add checkpoint and resume title in docs (#7050)
1 parent bf6f41e commit 87f4c20

File tree

3 files changed

+8
-6
lines changed

3 files changed

+8
-6
lines changed

docs/source/use_with_jax.mdx

+2-2
Original file line numberDiff line numberDiff line change
@@ -77,7 +77,7 @@ True
7777
Note that if the `device` argument is not provided to `with_format` then it will use the default
7878
device which is `jax.devices()[0]`.
7979

80-
## N-dimensional arrays
80+
### N-dimensional arrays
8181

8282
If your dataset consists of N-dimensional arrays, you will see that by default they are considered as the same tensor if the shape is fixed:
8383

@@ -120,7 +120,7 @@ To avoid this, you must explicitly use the [`Array`] feature type and specify th
120120
[7, 8]]], dtype=int32)}
121121
```
122122

123-
## Other feature types
123+
### Other feature types
124124

125125
[`ClassLabel`] data is properly converted to arrays:
126126

docs/source/use_with_pytorch.mdx

+4-2
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,7 @@ To load the data as tensors on a GPU, specify the `device` argument:
3838
{'data': tensor([1, 2], device='cuda:0')}
3939
```
4040

41-
## N-dimensional arrays
41+
### N-dimensional arrays
4242

4343
If your dataset consists of N-dimensional arrays, you will see that by default they are considered as the same tensor if the shape is fixed:
4444

@@ -82,7 +82,7 @@ To avoid this, you must explicitly use the [`Array`] feature type and specify th
8282
```
8383

8484

85-
## Other feature types
85+
### Other feature types
8686

8787
[`ClassLabel`] data are properly converted to tensors:
8888

@@ -223,6 +223,8 @@ If the dataset is split in several shards (i.e. if the dataset consists of multi
223223

224224
In this case each worker is given a subset of the list of shards to stream from.
225225

226+
### Checkpoint and resume
227+
226228
If you need a DataLoader that you can checkpoint and resume in the middle of training, you can use the `StatefulDataLoader` from [torchdata](https://github.com/pytorch/data):
227229

228230
```py

docs/source/use_with_tensorflow.mdx

+2-2
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ array([[1, 2],
3939
[3, 4]])>}
4040
```
4141

42-
## N-dimensional arrays
42+
### N-dimensional arrays
4343

4444
If your dataset consists of N-dimensional arrays, you will see that by default they are considered as the same tensor if the shape is fixed:
4545

@@ -88,7 +88,7 @@ To avoid this, you must explicitly use the [`Array`] feature type and specify th
8888
```
8989

9090

91-
## Other feature types
91+
### Other feature types
9292

9393
[`ClassLabel`] data are properly converted to tensors:
9494

0 commit comments

Comments
 (0)