Skip to content

Reproducing CIFAR10 experiments #1

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
junsu-kim0807 opened this issue Aug 9, 2023 · 2 comments
Open

Reproducing CIFAR10 experiments #1

junsu-kim0807 opened this issue Aug 9, 2023 · 2 comments

Comments

@junsu-kim0807
Copy link

First of all, thank you for sharing the code for the community!

I am trying to reproduce Table 1 but I got the lower accuracy than reported results on CIFAR10 dataset.

I got the results of 10 runs below:

Memory 100 200 500 1000
33.76±1.6 40.03±1.67 46.43±1.89 48.13±2.7

Can you check if it is right?

Thanks.

@FelixHuiweiLin
Copy link
Owner

First of all, thank you for sharing the code for the community!

I am trying to reproduce Table 1 but I got the lower accuracy than reported results on CIFAR10 dataset.

I got the results of 10 runs below:

Memory 100 200 500 1000 33.76±1.6 40.03±1.67 46.43±1.89 48.13±2.7

Can you check if it is right?

Thanks.

Hi,

I confirm that the code is OK.
I think the result you mentioned is the result of dividing CIFAR10 into 10 tasks.
However, CIFAR10 is divided into 5 tasks in our paper.
Please confirm whether it is true.

Thanks.

@comewei
Copy link

comewei commented Feb 26, 2024

hello, when i use
--num_runs 1 --data cifar10 --cl_type nc --agent PCR --retrieve random --update random --mem_size 200 ,when it runs, it show the message RuntimeWarning: Degrees of freedom <= 0 for slice keepdims=keepdims) in the
avg_end_acc, avg_end_fgt, avg_acc, avg_bwtp, avg_fwt = compute_performance(accuracy_array) print('----------- Total {} run: {}s -----------'.format(params.num_runs, end - start)) print('----------- Avg_End_Acc {} Avg_End_Fgt {} Avg_Acc {} Avg_Bwtp {} Avg_Fwt {}-----------' .format(avg_end_acc, avg_end_fgt, avg_acc, avg_bwtp, avg_fwt)) in the run.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants