Source JDBC: Support `start_date` configuration field

[ro8inmorgan]

Tell us about the problem you're trying to solve

It would be nice if we can adjust the query the source connector uses to retrieve data, for example sometimes you only want to sync data starting from a certain date.

Describe the solution you’d like

Adjust the query the source connector uses

Are you willing to submit a PR?

yes

[misteryeo]

Hi @ro8inmorgan can you elaborate a little bit more on what you're referring to when you say "query"?

Most of our connectors today offer a configuration field that allows you to specify the start date. Is your request relating to a specific connector or our Connector Development Kit (CDK)?

[ro8inmorgan]

Hi @misteryeo I've currently been using MSSQL and Postgress source connector, but have not seen an start date option. Maybe i've been looking in the wrong place?

[misteryeo]

Ah, thanks for clarifying! Looks like our database connectors don't specifically offer this. Are those the only ones you're looking for to support this?

The way this is added is at the individual level today not broadly across all connectors.

[ro8inmorgan]

@misteryeo for me personally only these 2, but can imagine others would love this functionality too. We deal with some databases going back many years but mostly only the last 5 years are relevant to us, it would help us out allot with managing sync times and specially costs. I can imagine it's not so easy to implement as this probably would need to be configured on a per table basis.