After a task has been learned for n amount of steps, we switch to another task to learn never to repeat the same task. The performance on older tasks decreases because of catastrophic forgetting.
Small note:
The task is defined as a regression task where the input is a flattend image and the output is the corresponding number.
Different scale is used for each subplot.
