[source-pipedrive] Sync no longer extracts/loads all records

[NayifSirdab]

Connector Name

Pipedrive

Connector Version

latest

What step the error happened?

During the sync

Relevant information

For ex: we have over 18000 records in the deals table. We noticed some discrepancies in the destination (BigQuery) and the source (Pipedrive) out of nowhere last couple of weeks as our BD team who relies on the data being loaded into BigQuery (and subsequently a BI tool) complained. We tried refreshing, clearing then syncing, deleting the connection all together and resync, and nothing worked. Each attempt resulted in just 7-8K records instead of the expected 18K (that used to work with no problems before). I attached log of most recent sync.

https://cloud.airbyte.com/workspaces/7a71d128-8a72-4264-85f1-02ed94ec4b5e/connections/a83ceffd-82c9-4028-9d6c-d36093a97496/timeline?openLogs=true&eventId=8ffe465e-50c5-49ac-a126-0c6657f20f37&attemptNumber=1.

^ link to the logs

Relevant log output

Contribute

• Yes, I want to contribute