Skip to content

ckhened/tuner

Repository files navigation

tuner

Setup

  • Build VLLM container with Dockerfile.cpu
  • Build dq container (update Dockerfile with the built vllm image)
  • Make sure configs are aligned with the test (update containers.json to add the containers built)

Steps to run

  • export HUGGING_FACE_HUB_TOKEN=<your token>
  • python tuner.py

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published