Skip to content

Conversation

@mik-laj
Copy link
Member

@mik-laj mik-laj commented Feb 23, 2020

CC: @kaxil @nuclearpinguin

@ANiteckiP Dear SQLAlchemy expert. Do you want to add something?


Issue link: AIRFLOW-6894

Make sure to mark the boxes below before creating PR: [x]

  • Description above provides context of the change
  • Commit message/PR title starts with [AIRFLOW-NNNN]. AIRFLOW-NNNN = JIRA ID*
  • Unit tests coverage for changes (not needed for documentation changes)
  • Commits follow "How to write a good git commit message"
  • Relevant documentation is updated including usage instructions.
  • I will engage committers as explained in Contribution Workflow Example.

* For document-only changes commit message can start with [AIRFLOW-XXXX].


In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.
Read the Pull Request Guidelines for more information.

@boring-cyborg boring-cyborg bot added the provider:google Google (including GCP) related issues label Feb 23, 2020
@mik-laj mik-laj changed the title [AIRFLOW-6894] Prevent db query in example_dags [AIRFLOW-6894] Prevent DB query in example_dags Feb 23, 2020
@mik-laj mik-laj force-pushed the AIRFLOW-6894-db-example branch from 84df80c to 41ce068 Compare February 23, 2020 21:34
Copy link
Member Author

@mik-laj mik-laj Feb 23, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I want to use this decorator also to prevent regression in scheduler performance. Some methods are critical and I have optimized it to use very few queries, but it can be easily broken. This context manager will allow us to detect a regression regarding it.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

awesome

@mik-laj mik-laj force-pushed the AIRFLOW-6894-db-example branch from 41ce068 to 7a3707f Compare February 23, 2020 22:18
@codecov-io
Copy link

Codecov Report

Merging #7516 into master will decrease coverage by 0.26%.
The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #7516      +/-   ##
==========================================
- Coverage   86.79%   86.53%   -0.27%     
==========================================
  Files         887      893       +6     
  Lines       41976    42191     +215     
==========================================
+ Hits        36432    36508      +76     
- Misses       5544     5683     +139
Impacted Files Coverage Δ
...flow/providers/google/cloud/operators/cloud_sql.py 84.68% <100%> (+0.06%) ⬆️
airflow/kubernetes/volume_mount.py 44.44% <0%> (-55.56%) ⬇️
airflow/kubernetes/volume.py 52.94% <0%> (-47.06%) ⬇️
airflow/kubernetes/pod_launcher.py 47.18% <0%> (-45.08%) ⬇️
...viders/cncf/kubernetes/operators/kubernetes_pod.py 69.38% <0%> (-25.52%) ⬇️
airflow/kubernetes/refresh_config.py 50.98% <0%> (-23.53%) ⬇️
airflow/utils/file.py 87.83% <0%> (-1.36%) ⬇️
airflow/utils/dag_processing.py 87.93% <0%> (-0.2%) ⬇️
airflow/api/common/experimental/trigger_dag.py 98.03% <0%> (-0.04%) ⬇️
airflow/models/baseoperator.py 96.52% <0%> (ø) ⬆️
... and 33 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4e0e2f0...7a3707f. Read the comment docs.

@mik-laj mik-laj merged commit dcf8743 into apache:master Feb 24, 2020
galuszkak pushed a commit to FlyrInc/apache-airflow that referenced this pull request Mar 5, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:performance provider:google Google (including GCP) related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants