Skip to content

Metrics vs model size scatter plots #241

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 10 commits into from
Apr 5, 2025
Merged

Conversation

janosh
Copy link
Owner

@janosh janosh commented Apr 4, 2025

Screenshot 2025-04-05 at 5 49 35 PM

janosh added 5 commits April 4, 2025 13:42
…e table

- rename `training-sets.yml` to `datasets.yml`
- make vite.config.ts watch for changes to `dataset-schema.yml` and auto-update `dataset-schema.d.ts`
- modify related tests to reflect the changes in dataset structure and naming conventions
…anges or model_params

phonons/+page.svelte add MetricScatter x_property="model_params"
use SelectToggle on /discovery/+page.svelte
lib/metrics.ts simplify CPS calculations
…SD, CPS) and two x-axes: date ranges or model_params

- readme.md add title and add fallback model count (20+) in model_count slot for readers on GitHub
- update app.d.ts to import Dataset from dataset-schema.d.ts
- add dataset-schema.d.ts converted from dataset-schema.yml
- refactor RadarChart to use CombinedMetricConfig and improve weight handling
@janosh janosh added analysis New model analysis site Website related labels Apr 4, 2025
….test.svelte.ts TableControls.test.svelte.ts

- add key and label to DEFAULT_CPS_CONFIG in metrics.ts and CombinedMetricConfig in types.ts
…l names on points in the scatter plot

- Bump elementari in package.json
@janosh janosh merged commit 2839f30 into main Apr 5, 2025
5 of 7 checks passed
@janosh janosh deleted the metric-vs-model-size-scatter branch April 5, 2025 21:58
janosh added a commit that referenced this pull request Apr 6, 2025
* training-sets.yml add OC20, NOMAD, AFLOW, OQMD, MatPES PBE, MatPES r2SCAN

* add new /datasets page listing all items in `datasets.yml` in sortable table

- rename `training-sets.yml` to `datasets.yml`
- make vite.config.ts watch for changes to `dataset-schema.yml` and auto-update `dataset-schema.d.ts`
- modify related tests to reflect the changes in dataset structure and naming conventions

* big MetricScatter.svelte overhaul to support different x-axes: date ranges or model_params

phonons/+page.svelte add MetricScatter x_property="model_params"
use SelectToggle on /discovery/+page.svelte
lib/metrics.ts simplify CPS calculations

* landing page add MetricScatter with selectable y-axis (F1, κ_SRME, RMSD, CPS) and two x-axes: date ranges or model_params

- readme.md add title and add fallback model count (20+) in model_count slot for readers on GitHub
- update app.d.ts to import Dataset from dataset-schema.d.ts
- add dataset-schema.d.ts converted from dataset-schema.yml
- refactor RadarChart to use CombinedMetricConfig and improve weight handling

* add SelectToggle component for metric selection used by landing page

* fix site unit tests: LandingPage.test.ts metrics.test.ts MetricsTable.test.svelte.ts TableControls.test.svelte.ts

- add key and label to DEFAULT_CPS_CONFIG in metrics.ts and CombinedMetricConfig in types.ts

* add unit tests DatasetsPage.test.ts, ScatterMetric.test.svelte.ts, SelectToggle.test.svelte.ts

* MetricScatter.svelte add prop `show_model_labels` for displaying model names on points in the scatter plot

- Bump elementari in package.json

* MetricScatter.svelte different colors for each model
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
analysis New model analysis site Website related
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant