feat: Add litellm and configurable service loading

[thesteganos]

This commit introduces LiteLLM as a new optional service and provides a mechanism to selectively load Docker services.

Key changes:

• Added litellm service to docker-compose.yml.
  • Uses ghcr.io/berriai/litellm:main-stable image.
  • Exposes port 4000 internally.
  • Mounts a configuration file from ./litellm/config.yaml.
  • Depends on ollama and redis.
• Created litellm/config.yaml with a default configuration to connect to a local Ollama model.
• Updated Caddyfile to include a reverse proxy for litellm (defaulting to port 8009).
• Modified start_services.py:
  • Added a --services command-line argument to specify a comma-separated list of services to start (e.g., litellm,ollama,open-webui).
  • If --services is not provided, all services are started by default.
  • Service dependencies are automatically resolved and started. For example, selecting open-webui will also start ollama. Selecting litellm will start ollama and redis.
  • The supabase services are always started.
  • The caddy service is automatically started if any other application services are selected.
• Updated README.md to:
  • Document the new --services flag and its usage.
  • List available services.
  • Explain how to configure litellm using litellm/config.yaml.
  • Provide details on accessing litellm via Caddy.

[leex279]

Thx, I will take a look after the other PR is merged #72

We also working at a UI Configurator for the services, so we need to take a look if we can combine your efforts or how it makes sense to include.

[thesteganos]

Looks cool. How can i help?

[leex279]

@thesteganos sry for the late response. Was sick and busy then last week. Started today working on that and took your PR as base/idea. I like the custom_services approach but not in the command directly, instead in a json file the webapp now saves.

wip branch in my git: https://github.com/leex279/local-ai-packaged-dev/tree/feature/webapp-custom-services-integration

Feel free to bring in/help with ideas. I try at the moment to get the environment variables configurator to work properly as well and then I need to clean up some stuff.