Test GPU (VisionTek Radeon 5450 1GB)

[geerlingguy]

I want to see if an AMD card works out of the box with the drivers built into Linux, as everyone on the Internet seems to say. For X86 Linux, that definitely seems to be the case, but will it work on ARM32? ARM64?

I settled on the Radeon HD 5450 1GB PCIe 2.1 card, mostly because it's available at a local retailer for $35.

Phoronix did a pretty extensive article on this board, and while it's no screamer... or even that fast... it is a simple, fanless, low-power board, and that might just be perfect for the Pi CM4. Here's that article: ATI Radeon HD 5450 On Linux.

I don't expect it to be fast, or amazing, but I do expect to get it to work. Maybe.

Related links:

• Gist: Increase the BAR memory address space for PCIe devices on CM4
• Gist: Setting up the Nvidia GeForce GT 710 on Raspberry Pi Compute Module 4
• Pi Forum Topic: BAR space for PCIe allocation on CM4?

[dtischler]

AMD cards do work on Arm64...but...that is on machines with proper UEFI+ACPI and enough BAR. So, not apples to apples here. Just saying that the drivers are in fact functional.

[geerlingguy]

@dtischler - Very good to know! I'm heading out to pick up the card from Micro Center in a little bit... fingers crossed this experience is a little easier :)

[geerlingguy]

$ sudo lspci -v
00:00.0 PCI bridge: Broadcom Limited Device 2711 (rev 20) (prog-if 00 [Normal decode])
	Flags: fast devsel
	Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
	I/O behind bridge: 00000000-00000fff
	Memory behind bridge: f8000000-f80fffff
	Capabilities: [48] Power Management version 3
	Capabilities: [ac] Express Root Port (Slot-), MSI 00
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [180] Vendor Specific Information: ID=0000 Rev=0 Len=028 <?>
	Capabilities: [240] L1 PM Substates

01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Cedar [Radeon HD 5000/6000/7350/8350 Series] (prog-if 00 [VGA controller])
	Subsystem: VISIONTEK Cedar [Radeon HD 5000/6000/7350/8350 Series]
	Flags: fast devsel, IRQ 255
	Memory at <unassigned> (64-bit, prefetchable) [disabled]
	Memory at 600000000 (64-bit, non-prefetchable) [disabled] [size=128K]
	I/O ports at <unassigned> [disabled]
	[virtual] Expansion ROM at 600020000 [disabled] [size=128K]
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Legacy Endpoint, MSI 00
	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting

01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Cedar HDMI Audio [Radeon HD 5400/6300/7300 Series]
	Subsystem: VISIONTEK Cedar HDMI Audio [Radeon HD 5400/6300/7300 Series]
	Flags: fast devsel, IRQ 255
	Memory at 600040000 (64-bit, non-prefetchable) [disabled] [size=16K]
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Legacy Endpoint, MSI 00
	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting

[geerlingguy]

Same BAR address space issue as the Zotac GeForce GT 710:

[    1.047548] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01
[    1.047591] pci 0000:00:00.0: BAR 9: no space for [mem size 0x10000000 64bit pref]
[    1.047604] pci 0000:00:00.0: BAR 9: failed to assign [mem size 0x10000000 64bit pref]
[    1.047618] pci 0000:00:00.0: BAR 8: assigned [mem 0x600000000-0x6000fffff]
[    1.047638] pci 0000:01:00.0: BAR 0: no space for [mem size 0x10000000 64bit pref]
[    1.047650] pci 0000:01:00.0: BAR 0: failed to assign [mem size 0x10000000 64bit pref]
[    1.047664] pci 0000:01:00.0: BAR 2: assigned [mem 0x600000000-0x60001ffff 64bit]
[    1.047701] pci 0000:01:00.0: BAR 6: assigned [mem 0x600020000-0x60003ffff pref]
[    1.047716] pci 0000:01:00.1: BAR 0: assigned [mem 0x600040000-0x600043fff 64bit]
[    1.047749] pci 0000:01:00.0: BAR 4: no space for [io  size 0x0100]
[    1.047760] pci 0000:01:00.0: BAR 4: failed to assign [io  size 0x0100]
[    1.047774] pci 0000:00:00.0: PCI bridge to [bus 01]
[    1.047793] pci 0000:00:00.0:   bridge window [mem 0x600000000-0x6000fffff]
[    1.047897] pci 0000:01:00.1: D0 power state depends on 0000:01:00.0

So I'm going to follow the same process for increasing the BAR addressable memory range (see step 1 here: https://gist.github.com/geerlingguy/9f1510ab028e68b712381520308db2af).

[geerlingguy]

Well that's weird. I extended the address range and am still gettting:

[    1.006265] brcm-pcie fd500000.pcie: host bridge /scb/pcie@7d500000 ranges:
[    1.006284] brcm-pcie fd500000.pcie:   No bus range found for /scb/pcie@7d500000, using [bus 00-ff]
[    1.006343] brcm-pcie fd500000.pcie:      MEM 0x0600000000..0x060fffffff -> 0x00e0000000
[    1.006398] brcm-pcie fd500000.pcie:   IB MEM 0x0000000000..0x00ffffffff -> 0x0100000000
[    1.023282] brcm-pcie fd500000.pcie: link up, 2.5 GT/s x1 (SSC)
[    1.023571] brcm-pcie fd500000.pcie: PCI host bridge to bus 0000:00
[    1.023586] pci_bus 0000:00: root bus resource [bus 00-ff]
[    1.023603] pci_bus 0000:00: root bus resource [mem 0x600000000-0x60fffffff] (bus address [0xe0000000-0xefffffff])
[    1.023655] pci 0000:00:00.0: [14e4:2711] type 01 class 0x060400
[    1.023874] pci 0000:00:00.0: PME# supported from D0 D3hot
[    1.027287] pci 0000:00:00.0: bridge configuration invalid ([bus ff-ff]), reconfiguring
[    1.027475] pci 0000:01:00.0: [1002:68f9] type 00 class 0x030000
[    1.027563] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x0fffffff 64bit pref]
[    1.027603] pci 0000:01:00.0: reg 0x18: [mem 0x00000000-0x0001ffff 64bit]
[    1.027630] pci 0000:01:00.0: reg 0x20: [io  0x0000-0x00ff]
[    1.027673] pci 0000:01:00.0: reg 0x30: [mem 0x00000000-0x0001ffff pref]
[    1.027702] pci 0000:01:00.0: enabling Extended Tags
[    1.027858] pci 0000:01:00.0: supports D1 D2
[    1.027913] pci 0000:01:00.0: 2.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s x1 link at 0000:00:00.0 (capable of 32.000 Gb/s with 2.5 GT/s x16 link)
[    1.028051] pci 0000:01:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[    1.028125] pci 0000:01:00.1: [1002:aa68] type 00 class 0x040300
[    1.028209] pci 0000:01:00.1: reg 0x10: [mem 0x00000000-0x00003fff 64bit]
[    1.028315] pci 0000:01:00.1: enabling Extended Tags
[    1.028470] pci 0000:01:00.1: supports D1 D2
[    1.031733] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01
[    1.031776] pci 0000:00:00.0: BAR 9: assigned [mem 0x600000000-0x60fffffff 64bit pref]
[    1.031791] pci 0000:00:00.0: BAR 8: no space for [mem size 0x00100000]
[    1.031803] pci 0000:00:00.0: BAR 8: failed to assign [mem size 0x00100000]
[    1.031823] pci 0000:01:00.0: BAR 0: assigned [mem 0x600000000-0x60fffffff 64bit pref]
[    1.031858] pci 0000:01:00.0: BAR 2: no space for [mem size 0x00020000 64bit]
[    1.031870] pci 0000:01:00.0: BAR 2: failed to assign [mem size 0x00020000 64bit]
[    1.031883] pci 0000:01:00.0: BAR 6: no space for [mem size 0x00020000 pref]
[    1.031894] pci 0000:01:00.0: BAR 6: failed to assign [mem size 0x00020000 pref]
[    1.031907] pci 0000:01:00.1: BAR 0: no space for [mem size 0x00004000 64bit]
[    1.031918] pci 0000:01:00.1: BAR 0: failed to assign [mem size 0x00004000 64bit]
[    1.031929] pci 0000:01:00.0: BAR 4: no space for [io  size 0x0100]
[    1.031940] pci 0000:01:00.0: BAR 4: failed to assign [io  size 0x0100]
[    1.031953] pci 0000:00:00.0: PCI bridge to [bus 01]
[    1.031978] pci 0000:00:00.0:   bridge window [mem 0x600000000-0x60fffffff 64bit pref]
[    1.032077] pci 0000:01:00.1: D0 power state depends on 0000:01:00.0

I'm also seeing a lot of these messages:

[   12.014589] broken atomic modeset userspace detected, disabling atomic
[   12.527461] broken atomic modeset userspace detected, disabling atomic
[   13.463488] broken atomic modeset userspace detected, disabling atomic
[   13.980834] broken atomic modeset userspace detected, disabling atomic

I also have to wonder if there are any issues with the super cheap x16 to x1 adapter cable I'm using :/ — I might have to let 'red shirt Jeff' have a go at hacking out the side of the PCIe x1 slot...

[geerlingguy]

I was also looking into RadeonOpenCompute, but it seems Debian 10 is not a supported OS: https://rocmdocs.amd.com/en/latest/Current_Release_Notes/Current-Release-Notes.html#list-of-supported-operating-systems

[geerlingguy]

I'm going to re-flash 32-bit Pi OS and see if that makes any difference.

[dtischler]

Before taking a saw to the x1 slot, you could try a SATA, Network, or other PCIe card in the x16 slot, and see if that enumerates and functions properly, just to confirm the adapter works. If not, then, reach for the saw.

[geerlingguy]

@dtischler - Good point. Will test another card.

Edit: Other card worked fine, mounted a USB 3.0 drive:

pi@raspberrypi:~ $ lsusb -t
/:  Bus 02.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/4p, 5000M
    |__ Port 4: Dev 2, If 0, Class=Mass Storage, Driver=usb-storage, 5000M
/:  Bus 01.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/1p, 480M
    |__ Port 1: Dev 2, If 0, Class=Hub, Driver=hub/4p, 480M

[geerlingguy]

Same thing under 32-bit Pi OS, unfortunately:

[    0.955978] pci 0000:00:00.0: BAR 9: assigned [mem 0x600000000-0x60fffffff 64bit pref]
[    0.955997] pci 0000:00:00.0: BAR 8: no space for [mem size 0x00100000]
[    0.956013] pci 0000:00:00.0: BAR 8: failed to assign [mem size 0x00100000]
[    0.956039] pci 0000:01:00.0: BAR 0: assigned [mem 0x600000000-0x60fffffff 64bit pref]
[    0.956084] pci 0000:01:00.0: BAR 2: no space for [mem size 0x00020000 64bit]
[    0.956100] pci 0000:01:00.0: BAR 2: failed to assign [mem size 0x00020000 64bit]
[    0.956118] pci 0000:01:00.0: BAR 6: no space for [mem size 0x00020000 pref]
[    0.956134] pci 0000:01:00.0: BAR 6: failed to assign [mem size 0x00020000 pref]
[    0.956151] pci 0000:01:00.1: BAR 0: no space for [mem size 0x00004000 64bit]
[    0.956167] pci 0000:01:00.1: BAR 0: failed to assign [mem size 0x00004000 64bit]
[    0.956183] pci 0000:01:00.0: BAR 4: no space for [io  size 0x0100]
[    0.956200] pci 0000:01:00.0: BAR 4: failed to assign [io  size 0x0100]

[elFarto]

It looks like you're running out of BAR space again. BAR 9 gets allocated all the BAR space available, which is why the rest fail (well, apart from the IO one).

[geerlingguy]

@elFarto - I just noted over in the Pi Forums issue that expanding the space to 1 GB seems to have fixed that issue:

ranges = <0x02000000 0x0 0xc0000000 0x6 0x00000000 0x0 0x40000000>;

However, I'm now realizing that just like the nouveau driver, it seems the amd drm drivers are nowhere in sight on Raspberry Pi OS (find /lib/modules/$(uname -r) -type f -name '*.ko*' | grep amd reveals nothing).

So I'm going to try to rebuild the kernel with those modules, on 32-bit Pi OS (I tried earlier on 64-bit, but must've missed something because I couldn't get nouveau to work). Fingers crossed!