Support user-specified test read limits in connector_builder code

airbyte-cdk/python/airbyte_cdk/connector_builder/README.md

@@ -22,6 +22,7 @@ Note:
 *See [ConnectionSpecification](https://docs.airbyte.com/understanding-airbyte/airbyte-protocol/#actor-specification) for details on the `"config"` key if needed.
 
 - When the `__command` is `resolve_manifest`, the argument to `catalog` should be an empty string.
+- The config can optionally contain an object under the `__test_read_config` key which can define custom test read limits with `max_records`, `max_slices`, and `max_pages_per_slice` properties. All custom limits are optional; a default will be used for any limit that is not provided.
 
 ### Locally running the docker image
 

airbyte-cdk/python/airbyte_cdk/connector_builder/message_grouper.py

@@ -52,8 +52,8 @@ def get_message_groups(
         configured_catalog: ConfiguredAirbyteCatalog,
         record_limit: Optional[int] = None,
     ) -> StreamRead:
-        if record_limit is not None and not (1 <= record_limit <= 1000):
-            raise ValueError(f"Record limit must be between 1 and 1000. Got {record_limit}")
+        if record_limit is not None and not (1 <= record_limit <= self._max_record_limit):
+            raise ValueError(f"Record limit must be between 1 and {self._max_record_limit}. Got {record_limit}")
         schema_inferrer = SchemaInferrer()
         datetime_format_inferrer = DatetimeFormatInferrer()