If we can catch Karate errors then a CI process in the test repo can report errors with tests. See https://github.com/solid/specification-tests/issues/8