Skip to content

try latest pycurl release#7069

Merged
auvipy merged 11 commits intomainfrom
pycurlup
Jun 7, 2023
Merged

try latest pycurl release#7069
auvipy merged 11 commits intomainfrom
pycurlup

Conversation

@auvipy
Copy link
Copy Markdown
Member

@auvipy auvipy commented Nov 10, 2021

@auvipy auvipy added this to the 5.2.x milestone Nov 10, 2021
@codecov
Copy link
Copy Markdown

codecov bot commented Nov 10, 2021

Codecov Report

Patch and project coverage have no change.

Comparison is base (d34146f) 87.16% compared to head (a508f37) 87.16%.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #7069   +/-   ##
=======================================
  Coverage   87.16%   87.16%           
=======================================
  Files         148      148           
  Lines       18469    18469           
  Branches     2524     2524           
=======================================
  Hits        16098    16098           
  Misses       2091     2091           
  Partials      280      280           
Flag Coverage Δ
unittests 87.12% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@auvipy auvipy changed the title try pycurl latest pypy release try pycurl latest pycurl release Nov 10, 2021
Copy link
Copy Markdown
Member Author

@auvipy auvipy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i think windows failures are expected. we need to use https://docs.pytest.org/en/6.2.x/skipping.html in the test for windows

@auvipy auvipy linked an issue Nov 10, 2021 that may be closed by this pull request
18 tasks
@auvipy
Copy link
Copy Markdown
Member Author

auvipy commented Nov 10, 2021

@hannseman what do think about my thoughts on windows build

@hannseman
Copy link
Copy Markdown

@auvipy I'm not that familiar with working on Python stuff in Windows but it looks like pycurl should have wheels for Windows so it should be installable. The error I'm looking at is this one:

  Collecting pycurl~=7.44.1
131
    Downloading pycurl-7.44.1.tar.gz (227 kB)
132
    Preparing metadata (setup.py): started
133
    Preparing metadata (setup.py): finished with status 'error'
134
    ERROR: Command errored out with exit status 10:
135
     command: 'D:\a\celery\celery\.tox\3.8-unit\Scripts\python.EXE' -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\runneradmin\\AppData\\Local\\Temp\\pip-install-innclb3y\\pycurl_875358ca3df246c5b05c8fef321401cb\\setup.py'"'"'; __file__='"'"'C:\\Users\\runneradmin\\AppData\\Local\\Temp\\pip-install-innclb3y\\pycurl_875358ca3df246c5b05c8fef321401cb\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Users\runneradmin\AppData\Local\Temp\pip-pip-egg-info-cy3b6h_w'
136
         cwd: C:\Users\runneradmin\AppData\Local\Temp\pip-install-innclb3y\pycurl_875358ca3df246c5b05c8fef321401cb\
137
    Complete output (1 lines):
138
    Please specify --curl-dir=/path/to/built/libcurl
139

From https://github.com/celery/celery/runs/4165002584?check_suite_focus=true

It looks like the 7.44.1 does not have any wheels, the latest one I can find which do is 7.43.05 (https://pypi.org/project/pycurl/7.43.0.5/#files). Also see this issue pycurl/pycurl#710.

@auvipy
Copy link
Copy Markdown
Member Author

auvipy commented Nov 10, 2021

we officially don't support windows so we are safe on that. I have also added a comment there to release a wheel for latest release

@hannseman
Copy link
Copy Markdown

we officially don't support windows so we are safe on that. I have also added a comment there to release a wheel for latest release

Looks like there's no immediate plan to bring back wheels to pycurl, see pycurl/pycurl#657

If the intention is to drop the pin of pycurl to the wheeled version (as already done in kombu) one could look into specifying --curl-dir on windows runs in CI. See https://github.com/pycurl/pycurl/blob/master/INSTALL.rst#windows

@auvipy
Copy link
Copy Markdown
Member Author

auvipy commented Nov 16, 2021

@graingert we don't support windows 32 bit should we follow the --curl-dir path for windows build for latest pycurl release?

@auvipy auvipy changed the title try pycurl latest pycurl release try latest pycurl release Dec 11, 2021
@@ -1 +1,5 @@
kombu[sqs]~=5.3.0b3
boto3>=1.9.12
pycurl>=7.43.0.5; sys_platform != 'win32'
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this seems to working by not running on windows

@auvipy
Copy link
Copy Markdown
Member Author

auvipy commented Jun 4, 2023

couchbase>=3.0.0; platform_python_implementation!='PyPy' and (platform_system != 'Windows' or python_version < '3.10') --- got this and will adjust accordingly

Copy link
Copy Markdown
Member Author

@auvipy auvipy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

merging as is

@@ -1 +1,4 @@
boto3>=1.26.143
pycurl>=7.43.0.5; sys_platform != 'win32' and platform_python_implementation=="CPython"
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is pycurl no longer required for sqs on windows?

Copy link
Copy Markdown

@sparrowt sparrowt Jul 20, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also why do these 3 need duplicating in here when they're already in https://github.com/celery/kombu/blob/main/requirements/extras/sqs.txt which the kombu[sqs] below should pull in?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we just don't test it on windows due to lack of wheels

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Installation by a requirements.txt generated by pip-tools fails

3 participants