Skip to content

Commit aeabe99

Browse files
potiukpotiuk
authored
Prepare docs for May 2022 provider's release (#24231)
This documentation update also (following the rule agreed in https://github.com/apache/airflow/blob/main/README.md#support-for-providers) bumps mininimum supported version of Airflow for all providers to 2.2 and it constitutes a breaking change and major version bump for all providers.
1 parent 3e51d80 commit aeabe99

File tree

303 files changed

+7156
-4204
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

303 files changed

+7156
-4204
lines changed

‎.github/workflows/ci.yml‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -801,20 +801,20 @@ ${{ hashFiles('.pre-commit-config.yaml') }}"
801801
run: >
802802
breeze verify-provider-packages --use-airflow-version wheel --use-packages-from-dist
803803
--package-format wheel
804-
- name: "Remove airflow package and replace providers with 2.1-compliant versions"
804+
- name: "Remove airflow package and replace providers with 2.2-compliant versions"
805805
run: |
806806
rm -vf dist/apache_airflow-*.whl \
807807
dist/apache_airflow_providers_cncf_kubernetes*.whl \
808808
dist/apache_airflow_providers_celery*.whl
809809
pip download --no-deps --dest dist \
810810
apache-airflow-providers-cncf-kubernetes==3.0.0 \
811811
apache-airflow-providers-celery==2.1.3
812-
- name: "Install and test provider packages and airflow on Airflow 2.1 files"
812+
- name: "Install and test provider packages and airflow on Airflow 2.2 files"
813813
run: >
814-
breeze verify-provider-packages --use-airflow-version 2.1.0
815-
--use-packages-from-dist --package-format wheel --airflow-constraints-reference constraints-2.1.0
814+
breeze verify-provider-packages --use-airflow-version 2.2.0
815+
--use-packages-from-dist --package-format wheel --airflow-constraints-reference constraints-2.2.0
816816
env:
817-
# The extras below are all extras that should be installed with Airflow 2.1.0
817+
# The extras below are all extras that should be installed with Airflow 2.2.0
818818
AIRFLOW_EXTRAS: "airbyte,alibaba,amazon,apache.atlas.apache.beam,apache.cassandra,apache.drill,\
819819
apache.druid,apache.hdfs,apache.hive,apache.kylin,apache.livy,apache.pig,apache.pinot,\
820820
apache.spark,apache.sqoop,apache.webhdfs,arangodb,asana,async,\

‎.pre-commit-config.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -336,7 +336,7 @@ repos:
336336
# This check might be removed when min-airflow-version in providers is 2.2
337337
- id: check-airflow-2-1-compatibility
338338
name: Check that providers are 2.1 compatible.
339-
entry: ./scripts/ci/pre_commit/pre_commit_check_2_1_compatibility.py
339+
entry: ./scripts/ci/pre_commit/pre_commit_check_2_2_compatibility.py
340340
language: python
341341
pass_filenames: true
342342
files: ^airflow/providers/.*\.py$

‎README.md‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -399,14 +399,14 @@ might decide to add additional limits (and justify them with comment)
399399
## Support for providers
400400

401401
Providers released by the community have limitation of a minimum supported version of Airflow. The minimum
402-
version of Airflow is the `MINOR` version (2.1, 2.2 etc.) indicating that the providers might use features
402+
version of Airflow is the `MINOR` version (2.2, 2.3 etc.) indicating that the providers might use features
403403
that appeared in this release. The default support timespan for the minimum version of Airflow
404404
(there could be justified exceptions) is that we increase the minimum Airflow version, when 12 months passed
405405
since the first release for the MINOR version of Airflow.
406406

407407
For example this means that by default we upgrade the minimum version of Airflow supported by providers
408-
to 2.2.0 in the first Provider's release after 21st of May 2022 (21st of May 2021 is the date when the
409-
first `PATCHLEVEL` of 2.1 (2.1.0) has been released.
408+
to 2.3.0 in the first Provider's release after 11th of October 2022 (11th of October 2021 is the date when the
409+
first `PATCHLEVEL` of 2.2 (2.2.0) has been released.
410410

411411
## Contributing
412412

‎airflow/providers/airbyte/CHANGELOG.rst‎

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,20 @@
2424
Changelog
2525
---------
2626

27+
3.0.0
28+
.....
29+
30+
Breaking changes
31+
~~~~~~~~~~~~~~~~
32+
33+
* This release of provider is only available for Airflow 2.2+ as explained in the Apache Airflow
34+
providers support policy https://github.com/apache/airflow/blob/main/README.md#support-for-providers
35+
36+
.. Below changes are excluded from the changelog. Move them to
37+
appropriate section above if needed. Do not delete the lines(!):
38+
* ``Add explanatory note for contributors about updating Changelog (#24229)``
39+
40+
2741
2.1.4
2842
.....
2943

‎airflow/providers/airbyte/provider.yaml‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,6 +22,7 @@ description: |
2222
`Airbyte <https://airbyte.io/>`__
2323
2424
versions:
25+
- 3.0.0
2526
- 2.1.4
2627
- 2.1.3
2728
- 2.1.2
@@ -31,7 +32,7 @@ versions:
3132
- 1.0.0
3233

3334
additional-dependencies:
34-
- apache-airflow>=2.1.0
35+
- apache-airflow>=2.2.0
3536

3637
integrations:
3738
- integration-name: Airbyte

‎airflow/providers/alibaba/CHANGELOG.rst‎

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,31 @@
2424
Changelog
2525
---------
2626

27+
2.0.0
28+
.....
29+
30+
Breaking changes
31+
~~~~~~~~~~~~~~~~
32+
33+
* This release of provider is only available for Airflow 2.2+ as explained in the Apache Airflow
34+
providers support policy https://github.com/apache/airflow/blob/main/README.md#support-for-providers
35+
36+
Features
37+
~~~~~~~~
38+
39+
* ``SSL Bucket, Light Logic Refactor and Docstring Update for Alibaba Provider (#23891)``
40+
41+
Misc
42+
~~~~
43+
44+
* ``Apply per-run log templates to log handlers (#24153)``
45+
46+
.. Below changes are excluded from the changelog. Move them to
47+
appropriate section above if needed. Do not delete the lines(!):
48+
* ``Migrate Alibaba example DAGs to new design #22437 (#24130)``
49+
* ``Add explanatory note for contributors about updating Changelog (#24229)``
50+
51+
2752
1.1.1
2853
.....
2954

‎airflow/providers/alibaba/provider.yaml‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,13 +22,14 @@ description: |
2222
Alibaba Cloud integration (including `Alibaba Cloud <https://www.alibabacloud.com//>`__).
2323
2424
versions:
25+
- 2.0.0
2526
- 1.1.1
2627
- 1.1.0
2728
- 1.0.1
2829
- 1.0.0
2930

3031
additional-dependencies:
31-
- apache-airflow>=2.1.0
32+
- apache-airflow>=2.2.0
3233

3334
integrations:
3435
- integration-name: Alibaba Cloud OSS

‎airflow/providers/amazon/CHANGELOG.rst‎

Lines changed: 45 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,51 @@
2424
Changelog
2525
---------
2626

27+
4.0.0
28+
.....
29+
30+
Breaking changes
31+
~~~~~~~~~~~~~~~~
32+
33+
* This release of provider is only available for Airflow 2.2+ as explained in the Apache Airflow
34+
providers support policy https://github.com/apache/airflow/blob/main/README.md#support-for-providers
35+
36+
Features
37+
~~~~~~~~
38+
39+
* ``Add partition related methods to GlueCatalogHook: (#23857)``
40+
* ``Add support for associating custom tags to job runs submitted via EmrContainerOperator (#23769)``
41+
* ``Add number of node params only for single-node cluster in RedshiftCreateClusterOperator (#23839)``
42+
43+
Bug Fixes
44+
~~~~~~~~~
45+
46+
* ``fix: StepFunctionHook ignores explicit set 'region_name' (#23976)``
47+
* ``Fix Amazon EKS example DAG raises warning during Imports (#23849)``
48+
* ``Move string arg evals to 'execute()' in 'EksCreateClusterOperator' (#23877)``
49+
50+
Misc
51+
~~~~
52+
53+
* ``Light Refactor and Clean-up AWS Provider (#23907)``
54+
* ``Update sample dag and doc for RDS (#23651)``
55+
* ``Reformat the whole AWS documentation (#23810)``
56+
* ``Replace "absolute()" with "resolve()" in pathlib objects (#23675)``
57+
* ``Apply per-run log templates to log handlers (#24153)``
58+
* ``Refactor GlueJobHook get_or_create_glue_job method. (#24215)``
59+
* ``Update the DMS Sample DAG and Docs (#23681)``
60+
* ``Update doc and sample dag for Quicksight (#23653)``
61+
* ``Update doc and sample dag for EMR Containers (#24087)``
62+
* ``Add AWS project structure tests (re: AIP-47) (#23630)``
63+
* ``Add doc and sample dag for GCSToS3Operator (#23730)``
64+
* ``Remove old Athena Sample DAG (#24170)``
65+
* ``Clean up f-strings in logging calls (#23597)``
66+
67+
.. Below changes are excluded from the changelog. Move them to
68+
appropriate section above if needed. Do not delete the lines(!):
69+
* ``Add explanatory note for contributors about updating Changelog (#24229)``
70+
* ``Introduce 'flake8-implicit-str-concat' plugin to static checks (#23873)``
71+
2772
3.4.0
2873
.....
2974

‎airflow/providers/amazon/provider.yaml‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,6 +22,7 @@ description: |
2222
Amazon integration (including `Amazon Web Services (AWS) <https://aws.amazon.com/>`__).
2323
2424
versions:
25+
- 4.0.0
2526
- 3.4.0
2627
- 3.3.0
2728
- 3.2.0
@@ -41,7 +42,7 @@ versions:
4142
- 1.0.0
4243

4344
additional-dependencies:
44-
- apache-airflow>=2.1.0
45+
- apache-airflow>=2.2.0
4546

4647
integrations:
4748
- integration-name: Amazon Athena

‎airflow/providers/apache/beam/CHANGELOG.rst‎

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,31 @@
2424
Changelog
2525
---------
2626

27+
4.0.0
28+
.....
29+
30+
Breaking changes
31+
~~~~~~~~~~~~~~~~
32+
33+
* This release of provider is only available for Airflow 2.2+ as explained in the Apache Airflow
34+
providers support policy https://github.com/apache/airflow/blob/main/README.md#support-for-providers
35+
36+
Features
37+
~~~~~~~~
38+
39+
* ``Added missing project_id to the wait_for_job (#24020)``
40+
* ``Support impersonation service account parameter for Dataflow runner (#23961)``
41+
42+
Misc
43+
~~~~
44+
45+
* ``chore: Refactoring and Cleaning Apache Providers (#24219)``
46+
47+
.. Below changes are excluded from the changelog. Move them to
48+
appropriate section above if needed. Do not delete the lines(!):
49+
* ``Add explanatory note for contributors about updating Changelog (#24229)``
50+
* ``AIP-47 - Migrate beam DAGs to new design #22439 (#24211)``
51+
2752
3.4.0
2853
.....
2954

0 commit comments

Comments
 (0)