[Issue]: supermassive RAM usage with TensileCreateLibrary

[assistant-librarian]

[Migrated from original issue] ROCm/hipBLASLt#1834

Original issue author: @aviallon

Problem Description

When trying to build hipblaslt, it has to use Tensile, more precisely, TensileCreateLibrary.py
Even with 64 GB of RAM, Zswap enabled + 32GB of swap and limiting build to only ONE core, the script gets killed by the OOM killer!
I sincerely think there might be a way not too load all the data at once during whatever TensileCreateLibrary.
That or it is leaking memory, since its memory usage steadily increases all the way up!

Operating System

NixOS 25.05 (experimental branch)

CPU

AMD Ryzen 9 5950X

GPU

AMD Radeon RX 6700 XT + AMD Radeon RX Vega 64

ROCm Version

ROCm 6.3.3

ROCm Component

Tensile

Steps to Reproduce

No response

(Optional for Linux users) Output of /opt/rocm/bin/rocminfo --support

No response

Additional Information

No response

[assistant-librarian]

Comment by @ppanchad-amd on 2025-03-27T15:12:36Z

Hi @aviallon. Internal ticket has been created to investigate your issue. Thanks!

[assistant-librarian]

Comment by @TorreZuk on 2025-03-27T15:36:33Z

I think this should be transferred to hipBLASLt issue as although they reuse the name Tensile it is a self contained version in hipblasLt.

[assistant-librarian]

Comment by @ellosel on 2025-04-10T23:02:28Z

@aviallon this is a known issue that we are working on. We will follow up over the next few weeks once we have the relevant changes in.

[assistant-librarian]

Comment by @ellosel on 2025-05-28T22:51:03Z

@aviallon we've had some changes that improve memory usage over the last month or so. All changes should be in develop.