ci(binding/swift): Don't use release build for develop

[Xuanwo]

It takes up to 10 mins to build swift binding in CI. Maybe we don't need to use release build for develop.

cc @unixzii, what do you think?

[unixzii]

Yep, I think we can use debug build for CI.

By the way, I feel like macOS host is slower than Ubuntu host almost every time the pipeline is triggered. Do you think we should remove it?

[Xuanwo]

By the way, I feel like macOS host is slower than Ubuntu host almost every time the pipeline is triggered. Do you think we should remove it?

I'm fine with this change. We can add it back if we have users from macOS.

[unixzii]

Ok, I will file a PR for that.

[Xuanwo]

Ok, I will file a PR for that.

Thanks!