Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

idea: Use llama.cpp HIP build for AMD GPUs #2168

Open
@gau-nernst

Description

@gau-nernst

Problem Statement

Currently we use llama.cpp Vulkan build for AMD GPUs. HIP build should have better perf. (we should have benchmark test for that too)

Once #2128 lands, we should be able to use upstream HIP builds for Windows

Image

There is no upstream HIP builds for Linux. We might need to build it ourselves, though I think we need AMD GPUs for that.

cc: @david-menloai @sangjanai @qnixsynapse

Feature Idea

See above

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    Status

    Investigating

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions