import error with shapely.geos

[vnesh-san]

during the import the aiplatform, I get the following error.

from google.cloud import aiplatform
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/vignesh/miniconda3/envs/the_new_age/lib/python3.10/site-packages/google/cloud/aiplatform/__init__.py", line 24, in <module>
    from google.cloud.aiplatform import initializer
  File "/home/vignesh/miniconda3/envs/the_new_age/lib/python3.10/site-packages/google/cloud/aiplatform/initializer.py", line 34, in <module>
    from google.cloud.aiplatform.metadata import metadata
  File "/home/vignesh/miniconda3/envs/the_new_age/lib/python3.10/site-packages/google/cloud/aiplatform/metadata/metadata.py", line 25, in <module>
    from google.cloud.aiplatform import pipeline_jobs
  File "/home/vignesh/miniconda3/envs/the_new_age/lib/python3.10/site-packages/google/cloud/aiplatform/pipeline_jobs.py", line 31, in <module>
    from google.cloud.aiplatform.metadata import artifact
  File "/home/vignesh/miniconda3/envs/the_new_age/lib/python3.10/site-packages/google/cloud/aiplatform/metadata/artifact.py", line 25, in <module>
    from google.cloud.aiplatform import models
  File "/home/vignesh/miniconda3/envs/the_new_age/lib/python3.10/site-packages/google/cloud/aiplatform/models.py", line 46, in <module>
    from google.cloud.aiplatform import jobs
  File "/home/vignesh/miniconda3/envs/the_new_age/lib/python3.10/site-packages/google/cloud/aiplatform/jobs.py", line 26, in <module>
    from google.cloud import bigquery
  File "/home/vignesh/miniconda3/envs/the_new_age/lib/python3.10/site-packages/google/cloud/bigquery/__init__.py", line 35, in <module>
    from google.cloud.bigquery.client import Client
  File "/home/vignesh/miniconda3/envs/the_new_age/lib/python3.10/site-packages/google/cloud/bigquery/client.py", line 75, in <module>
    from google.cloud.bigquery.dataset import Dataset
  File "/home/vignesh/miniconda3/envs/the_new_age/lib/python3.10/site-packages/google/cloud/bigquery/dataset.py", line 25, in <module>
    from google.cloud.bigquery.routine import RoutineReference
  File "/home/vignesh/miniconda3/envs/the_new_age/lib/python3.10/site-packages/google/cloud/bigquery/routine/__init__.py", line 18, in <module>
    from google.cloud.bigquery.enums import DeterminismLevel
  File "/home/vignesh/miniconda3/envs/the_new_age/lib/python3.10/site-packages/google/cloud/bigquery/enums.py", line 21, in <module>
    from google.cloud.bigquery.query import ScalarQueryParameterType
  File "/home/vignesh/miniconda3/envs/the_new_age/lib/python3.10/site-packages/google/cloud/bigquery/query.py", line 23, in <module>
    from google.cloud.bigquery.table import _parse_schema_resource
  File "/home/vignesh/miniconda3/envs/the_new_age/lib/python3.10/site-packages/google/cloud/bigquery/table.py", line 44, in <module>
    _read_wkt = shapely.geos.WKTReader(shapely.geos.lgeos).read
AttributeError: module 'shapely.geos' has no attribute 'WKTReader'

google-cloud-aiplatform version 1.19.1

[davidcavazos]

Same happens with google-cloud-aiplatform==1.20.0. The issue is that shapely just released version 2.0.0 on Dec 12, and it's apparently not compatible with either aiplatform or bigquery.

Steps to reproduce

In a clean virtual environment.

# Edit: must install shapely as well
pip install -U google-cloud-aiplatform shapely

In a Python script:

from google.cloud import aiplatform

Workaround

Pinning to the shapely latest version <2.0 as a constraint seems to fix it.

pip install -U google-cloud-aiplatform "shapely<2"

[davidcavazos]

Assigning as a P0 since it blocks people from installing the library, the fix should be pinning the shapely version constraint so it should be fairly straightforward.

[davidcavazos]

I was able to reproduce in Colab.

[davidcavazos]

Changing to P1 since it's not reproducible in local clean virtual environment, but it's reproducible in Colab. It's most likely a dependency conflict with a pre-installed package available in Colab.

[davidcavazos]

To reproduce the issue locally, we have to install shapely as well. So pip install google-cloud-aiplatform shapely will reproduce it.

In Colab, shapely is used by imgaug (found out with pip show shapely), so anyone using imgaug alongside with aiplatform will run into this.

[davidcavazos]

Adding a constraint with shapely<2 in google-cloud-aiplatform should fix this.

[helinwang]

This is breaking quite a few Vertex notebooks in colab. Could we prioritize the fix rollout? I think we are in RRC1:Guarded not in freeze yet. Thanks!

[nayaknishant]

1efd816 has been pushed out. We are pinning shapely < 2.0.0 to fix this error. Thanks for all the feedback and contribution!