We might want to rethink how create_if_needed works in non interactive mode (it fails, but should it?)