Google Nest integration failed to set up

[timconinx]

The problem

The devices and entities provided by the google nest integration became unavailable on upgrade to 2021.9.2

What is version of Home Assistant Core has the issue?

core-2021.9.2

What was the last working version of Home Assistant Core?

core-2021.8.8

What type of installation are you running?

Home Assistant Core

Integration causing the issue

Google Nest

Link to integration documentation on our website

https://www.home-assistant.io/integrations/nest/

Example YAML snippet

No response

Anything in the logs that might be useful for us?

Logger: homeassistant.config_entries
Source: components/nest/__init__.py:166
First occurred: 8:51:45 PM (1 occurrences)
Last logged: 8:51:45 PM

Error setting up entry Nest for nest
Traceback (most recent call last):
  File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/config_entries.py", line 304, in async_setup
    result = await component.async_setup_entry(hass, self)  # type: ignore
  File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/components/nest/__init__.py", line 166, in async_setup_entry
    await subscriber.start_async()
  File "/srv/homeassistant/lib/python3.9/site-packages/google_nest_sdm/google_nest_subscriber.py", line 172, in start_async
    await self._subscriber_factory.async_new_subscriber(
  File "/srv/homeassistant/lib/python3.9/site-packages/google_nest_sdm/google_nest_subscriber.py", line 80, in async_new_subscriber
    return await loop.run_in_executor(
  File "/usr/lib/python3.9/concurrent/futures/thread.py", line 52, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/srv/homeassistant/lib/python3.9/site-packages/google_nest_sdm/google_nest_subscriber.py", line 101, in _new_subscriber
    subscriber = pubsub_v1.SubscriberClient(credentials=creds)
  File "/srv/homeassistant/lib/python3.9/site-packages/google/cloud/pubsub_v1/subscriber/client.py", line 102, in __init__
    channel = grpc_helpers.create_channel(
  File "/srv/homeassistant/lib/python3.9/site-packages/google/api_core/grpc_helpers.py", line 306, in create_channel
    composite_credentials = _create_composite_credentials(
  File "/srv/homeassistant/lib/python3.9/site-packages/google/api_core/grpc_helpers.py", line 236, in _create_composite_credentials
    credentials = google.auth.credentials.with_scopes_if_required(
TypeError: with_scopes_if_required() got an unexpected keyword argument 'default_scopes'

Additional information

No response

[probot-home-assistant]

nest documentation
nest source
_{^{(message by IssueLinks)}}

[probot-home-assistant]

Hey there @allenporter, mind taking a look at this issue as it has been labeled with an integration (nest) you are listed as a code owner for? Thanks!
_{^{(message by CodeOwnersMention)}}

[timconinx]

When searching for the exact errormessage, I stumble upon: https://stackoverflow.com/questions/67652313/python-app-hosted-on-app-engine-is-not-able-to-connect-with-firestore-where-as-w
where it is suggested there is a mismatch with the google-auth lib

[allenporter]

Hi, Thanks. There are a bunch of restrictions on google auth libraries right now due to an armv7 bug so i worry its getting a bit out of control trying to hold everything back. (e.g. see #53427)

Do you happen to have handy all the various google python library versions you've got installed? (e.g. pip3 freeze | grep google)

[allenporter]

My impression is this is not specific to a particular home assistant version, but rather that home assistant is not pinning a specific python version for these libraries and so they're moving ahead and have breaking changes. (e.g. if you go back to a previous home assistant version it may not help). I think temporary workaround include downgrading to older versions using pip so let me know if you are stuck and need help with that in the mean time.

[allenporter]

As mentioned in other bug "Discovered the problem while upgrading to 2021.9.2 but rollback to previous release 2021.8.8 did not change anything" so this is not necessarily about 2021.9.X.

Still curious to see output of pip3 freeze | grep google. @LoicRivoal see previous update for suggested workaround if you're stuck

[timconinx]

This is what I got:

(homeassistant) homeassistant@server:~$ pip3 freeze | grep google
google-api-core==1.31.2
google-auth==1.24.0
google-auth-oauthlib==0.4.2
google-cloud-pubsub==2.1.0
google-nest-sdm==0.3.6
googleapis-common-protos==1.52.0
grpc-google-iam-v1==0.12.3
(homeassistant) homeassistant@server:~$

[vidvisionify]

I also seem to be having this issue;

bash-5.1# pip3 freeze | grep google
 
 google-api-core==1.31.2
 google-api-python-client==1.6.4
 google-auth==1.35.0
 google-auth-oauthlib==0.4.6
 google-cloud-pubsub==2.1.0
 google-cloud-texttospeech==0.4.0
 google-nest-sdm==0.3.6
 googleapis-common-protos==1.53.0
 googlemaps==2.5.1
 grpc-google-iam-v1==0.12.3

[allenporter]

Interesting. On my container image that is working I have these packages installed:

google-api-core==1.31.2
google-auth==1.35.0
google-auth-oauthlib==0.4.6
google-cloud-pubsub==2.1.0
google-nest-sdm==0.3.6
googleapis-common-protos==1.53.0
grpc-google-iam-v1==0.12.3

I was assuming the problem is that google-api-core version 1.31.2 requires google-auth>=1.25.0 based on reading the logs.

I was expecting this would work:

$ pip3 install google-auth>=1.25.0

However, @vidvisionify is having the problem with 1.35.0 which surprises me.

[LoicRivoal]

this is what I have :

google-api-core==1.31.2
google-api-python-client==1.6.4
google-auth==1.24.0
google-auth-oauthlib==0.4.2
google-cloud-pubsub==2.1.0
google-nest-sdm==0.3.6
googleapis-common-protos==1.52.0
grpc-google-iam-v1==0.12.3

[timconinx]

I managed to solve it

pip3 install google-auth>=1.25.0 didn't do anything visible (no output), so in my naivity I did a pip3 install --upgrade google-auth which installed version 2.0.2 which was completely incompatible.

After that I did pip3 install google-auth==1.25.0 (with double equals) which installed the correct version and solved the issue: the nest devices/entities are back

I'm not at all familiar with python library installation/upgrading, so I probably took a few unnecessary turns, but there it is ;)

Thanks again for your help, @allenporter !

[LoicRivoal]

works here with 2.0.2

Thanks.