Skip to content

Enforce utf8 when opening files in python scripts#16376

Merged
jsoriano merged 3 commits intoelastic:masterfrom
jsoriano:enforce-utf8-docs-collector
Feb 18, 2020
Merged

Enforce utf8 when opening files in python scripts#16376
jsoriano merged 3 commits intoelastic:masterfrom
jsoriano:enforce-utf8-docs-collector

Conversation

@jsoriano
Copy link
Copy Markdown
Member

@jsoriano jsoriano commented Feb 17, 2020

What does this PR do?

Enforce use of utf8 when opening files in python scripts that check or generate other files in make update and make check.

Why is it important?

Since the migration to Python 3 (#14798) these scripts fail in environments not configured with unicode locales with this error. We saw this in the new jenkins pipelines, and can be reproduced at least on Linux with LANG=C make check.

How to test this PR locally

make check should work both with unicode and non-unicode locales, e.g. with LANG=C.UTF-8 and LANG=C.

Related issues

@jsoriano jsoriano added review :Testing [zube]: In Review Team:Services (Deprecated) Label for the former Integrations-Services team labels Feb 17, 2020
@jsoriano jsoriano self-assigned this Feb 17, 2020
@jsoriano
Copy link
Copy Markdown
Member Author

jenkins, test this again please

@jsoriano jsoriano merged commit c2f6358 into elastic:master Feb 18, 2020
@jsoriano jsoriano deleted the enforce-utf8-docs-collector branch February 18, 2020 16:00
jsoriano added a commit to jsoriano/beats that referenced this pull request Feb 18, 2020
Since the migration to Python 3 (elastic#14798) these scripts fail in environments
not configured with unicode locales with this error. We saw this in the new
jenkins pipelines, and can be reproduced at least on Linux running make check
with LANG=C.

(cherry picked from commit c2f6358)
@zube zube bot removed the v7.7.0 label Feb 18, 2020
jsoriano added a commit that referenced this pull request Feb 18, 2020
Since the migration to Python 3 (#14798) these scripts fail in environments
not configured with unicode locales with this error. We saw this in the new
jenkins pipelines, and can be reproduced at least on Linux running make check
with LANG=C.

(cherry picked from commit c2f6358)
kvch pushed a commit to kvch/beats that referenced this pull request Feb 20, 2020
Since the migration to Python 3 (elastic#14798) these scripts fail in environments
not configured with unicode locales with this error. We saw this in the new
jenkins pipelines, and can be reproduced at least on Linux running make check
with LANG=C.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

review Team:Services (Deprecated) Label for the former Integrations-Services team :Testing v7.9.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants