Skip to content

Extract, transform and load #402

Extract, transform and load

Extract, transform and load #402

Manually triggered August 16, 2024 16:19
Status Success
Total duration 1h 47m 14s
Artifacts 4

etl.yaml

on: workflow_dispatch
Start self-hosted EC2 runner
2m 22s
Start self-hosted EC2 runner
Extract, transform and load
1h 39m
Extract, transform and load
Upload data to Big Local News
3m 58s
Upload data to Big Local News
Stop self-hosted EC2 runner
4s
Stop self-hosted EC2 runner
Fit to window
Zoom out
Zoom in

Annotations

1 error and 10 warnings
Extract, transform and load
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Start self-hosted EC2 runner
The following actions uses node12 which is deprecated and will be forced to run on node16: aws-actions/configure-aws-credentials@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Start self-hosted EC2 runner
The following actions use a deprecated Node.js version and will be forced to run on node20: aws-actions/configure-aws-credentials@v1. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Start self-hosted EC2 runner
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Extract, transform and load
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Stop self-hosted EC2 runner
The following actions uses node12 which is deprecated and will be forced to run on node16: aws-actions/configure-aws-credentials@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Stop self-hosted EC2 runner
The following actions use a deprecated Node.js version and will be forced to run on node20: aws-actions/configure-aws-credentials@v1. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Stop self-hosted EC2 runner
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Upload data to Big Local News
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Upload data to Big Local News
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/download-artifact@v3, actions/setup-python@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "logs", "processed-data", "raw-data", "source". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/

Artifacts

Produced during runtime
Name Size Digest
logs Expired
860 KB
processed-data Expired
9.71 GB
raw-data Expired
7.79 GB
source Expired
1.24 GB