-
Notifications
You must be signed in to change notification settings - Fork 50
V3 state crawler #1142
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
V3 state crawler #1142
Conversation
Add env MOONSTREAM_DB_V3_CONTROLLER_API.
Determines the table names based on the blockchain and labels version. | ||
Returns an empty dictionary if blockchain is not provided. | ||
""" | ||
if not request_data.blockchain: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe better to throw exception here?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
No need that resolution just for return block_number and block_timestamp.
That enough for see state of database but if was send actual blockchain you can see even more related to query data.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lg
Added V3 support fo state tasks
QueryAPI sql Handling Improvements:
resolve_table_names
andprepare_query
functions to dynamically resolve table names and prepare SQL queries with placeholders replaced by actual table names (crawlers/mooncrawl/mooncrawl/actions.py
). [1] [2]QueryTextClauseException
for handling errors when transforming queries toTextClause
(crawlers/mooncrawl/mooncrawl/actions.py
).queries_data_update_handler
to use the new query preparation functions and handle exceptions accordingly (crawlers/mooncrawl/mooncrawl/api.py
). [1] [2]Blockchain Support Enhancements:
AvailableBlockchainType
with corresponding environment variables and configurations (crawlers/mooncrawl/mooncrawl/blockchain.py
,crawlers/mooncrawl/mooncrawl/settings.py
). [1] [2] [3] [4]Data Model Updates:
ViewTasks
model to include optionalcustomer_id
,instance_id
, andv3
fields (crawlers/mooncrawl/mooncrawl/data.py
).These changes collectively improve the flexibility and robustness of the Mooncrawl project's query handling and blockchain support.State jobs have ability run over v3 instaces.
Added --customer-db-uri parameter.
new types of jobs available.