|
1 | 1 | # Changelog
|
2 | 2 |
|
| 3 | +## 09/09/2021 Summary |
| 4 | + |
| 5 | +We're going over the changes from 0.29.17 and before... and there's a lot of big improvements here, so don't miss them! |
| 6 | + |
| 7 | +**New Source**: Facebook Pages |
| 8 | +**New Destination**: MongoDB |
| 9 | +**New Destination**: DynamoDB |
| 10 | + |
| 11 | +* 🎉 You can now send notifications via webhook for successes and failures on Airbyte syncs. (This is a massive contribution by @Pras, thank you) :tada: |
| 12 | +* 🎉 Scheduling jobs and worker jobs are now separated, allowing for workers to be scaled horizontally. |
| 13 | +* 🎉 When developing a connector, you can now preview what your spec looks like in real time with this process. |
| 14 | +* 🎉 Oracle destination: Now has basic normalization. |
| 15 | +* 🎉 Add XLSB (binary excel) support to the Files source (contributed by Muutech). |
| 16 | +* 🎉 You can now properly cancel K8s deployments. |
| 17 | + |
| 18 | +* ✨ S3 source: Support for Parquet format. |
| 19 | +* ✨ Github source: Branches, repositories, organization users, tags, and pull request stats streams added (contributed by @Christopher Wu). |
| 20 | +* ✨ BigQuery destination: Added GCS upload option. |
| 21 | +* ✨ Salesforce source: Now Airbyte native. |
| 22 | +* ✨ Redshift destination: Optimized for performance. |
| 23 | + |
| 24 | +* 🏗 CDK: :tada: We’ve released a tool to generate JSON Schemas from OpenAPI specs. This should make specifying schemas for API connectors a breeze! :tada: |
| 25 | +* 🏗 CDK: Source Acceptance Tests now verify that connectors correctly format strings which are declared as using date-time and date formats. |
| 26 | +* 🏗 CDK: Add private options to help in testing: _limit and _page_size are now accepted by any CDK connector to minimze your output size for quick iteration while testing. |
| 27 | + |
| 28 | +* 🐛 Fixed a bug that made it possible for connector definitions to be duplicated, violating uniqueness. |
| 29 | +* 🐛 Pipedrive source: Output schemas no longer remove timestamp from fields. |
| 30 | +* 🐛 Github source: Empty repos and negative backoff values are now handled correctly. |
| 31 | +* 🐛 Harvest source: Normalization now works as expected. |
| 32 | +* 🐛 All CDC sources: Removed sleep logic which caused exceptions when loading data from high-volume sources. |
| 33 | +* 🐛 Slack source: Increased number of retries to tolerate flaky retry wait times on the API side. |
| 34 | +* 🐛 Slack source: Sync operations no longer hang indefinitely. |
| 35 | +* 🐛 Jira source: Now uses updated time as the cursor field for incremental sync instead of the created time. |
| 36 | +* 🐛 Intercom source: Fixed inconsistency between schema and output data. |
| 37 | +* 🐛 Hubspot source: Streams with the items property now have their schemas fixed. |
| 38 | +* 🐛 Hubspot source: Empty strings are no longer handled as dates, fixing the deals, companies, and contacts streams. |
| 39 | +* 🐛 Typeform source: Allows for multiple choices in responses now. |
| 40 | +* 🐛 Shopify source: The type for the amount field is now fixed in the schema. |
| 41 | +* 🐛 Postgres destination: \u0000(NULL) value processing is now fixed. |
| 42 | + |
| 43 | +As usual... thank you to our wonderful contributors this week: Pras, Christopher Wu, Brian M, yahu98, Michele Zuccala, jinnig, and luizgribeiro! |
| 44 | + |
| 45 | +## 09/01/2021 Summary |
| 46 | + |
| 47 | +Got the changes from 0.29.13... with some other surprises! |
| 48 | + |
| 49 | +* 🔥 There's a new way to create Airbyte sources! The team at Faros AI has created a Javascript/Typescript CDK which can be found here and in our docs here. This is absolutely awesome and give a huge thanks to Chalenge Masekera, Christopher Wu, eskrm, and Matthew Tovbin! |
| 50 | +* ✨ New Destination: Azure Blob Storage :sparkles: |
| 51 | + |
| 52 | +**New Source**: Bamboo HR (contributed by @Oren Haliva) |
| 53 | +**New Source**: BigCommerce (contributed by @James Wilson) |
| 54 | +**New Source**: Trello |
| 55 | +**New Source**: Google Analytics V4 |
| 56 | +**New Source**: Amazon Ads |
| 57 | + |
| 58 | +* 💎 Alpine Docker images are the new standard for Python connectors, so image sizes have dropped by around 100 MB! |
| 59 | +* ✨ You can now apply tolerations for Airbyte Pods on K8s deployments (contributed by @Pras). |
| 60 | +* 🐛 Shopify source: Rate limit throttling fixed. |
| 61 | +* 📚 We now have a doc on how to deploy Airbyte at scale. Check it out here! |
| 62 | +* 🏗 Airbyte CDK: You can now ignore HTTP status errors and override retry parameters. |
| 63 | + |
| 64 | +As usual, thank you to our awesome contributors: Oren Haliva, Pras, James Wilson, and Muutech. |
| 65 | + |
| 66 | +## 08/26/2021 Summary |
| 67 | + |
| 68 | +New Source: Short.io (contributed by @Apostol Tegko) |
| 69 | +* 💎 GitHub source: Added support for rotating through multiple API tokens! |
| 70 | +* ✨ Syncs are now scheduled with a 3 day timeout (contributed by @Vladimir Remar). |
| 71 | +* ✨ Google Ads source: Added UserLocationReport stream (contributed by @Max Krog). |
| 72 | +* ✨ Cart source: Added the order_items stream. |
| 73 | +* 🐛 Postgres source: Fixed out-of-memory issue with CDC interacting with large JSON blobs. |
| 74 | +* 🐛 Intercom source: Pagination now works as expected. |
| 75 | + |
| 76 | +As always, thank you to our awesome community contributors this week: Apostol Tegko, Vladimir Remar, Max Krog, Pras, Marco Fontana, Troy Harvey, and damianlegawiec! |
3 | 77 | ## 08/20/2021 Summary
|
4 | 78 |
|
5 | 79 | Hey Airbyte community, we got some patch notes for y'all. Here's all the changes we've pushed since the last update.
|
|
0 commit comments