Skip to content

ARROW-4444: [Testing] Add CSV test file for use by DataFusion unit tests and examples#1

Merged
wesm merged 7 commits intoapache:masterfrom
andygrove:ARROW-4444
Feb 4, 2019
Merged

ARROW-4444: [Testing] Add CSV test file for use by DataFusion unit tests and examples#1
wesm merged 7 commits intoapache:masterfrom
andygrove:ARROW-4444

Conversation

@andygrove
Copy link
Copy Markdown
Member

No description provided.

Comment thread data/csv/uk_cities.csv Outdated
@@ -0,0 +1,37 @@
"Elgin, Scotland, the UK",57.653484,-3.335724
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Where does this file originate from?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm trying to remember ... if I can't find it, I will download fresh from here:

https://simplemaps.com/data/world-cities

The free download here uses the Creative Commons Attribution License.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you write a LICENSE file and remark that in there?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@xhochy For now I removed the files that are not used, and I manually created a new uk_cities.csv with just two cities and looked up lat/lon online, so this is safe to merge.

Once the DataFusion donation is accepted I'll create some better test files and delete the trivial ones. I don't want to complicate the donation by doing that now and updating all the tests.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@andygrove It's ok to have these files as long as the license is APL 2.0 compatible and mentioned correctly in LICENSE.

@andygrove andygrove changed the title ARROW-4444: [Testing] Add test files that originated in DataFusion ARROW-4444: [Testing] Add CSV test file for use by DataFusion unit tests and examples Feb 2, 2019
@andygrove
Copy link
Copy Markdown
Member Author

@xhochy I deleted all the files and started again. There is now a single generated file. I have updated my DataFusion tests and examples to use this file now.

Copy link
Copy Markdown
Member

@wesm wesm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@wesm wesm merged commit bf0abe4 into apache:master Feb 4, 2019
@andygrove andygrove deleted the ARROW-4444 branch August 1, 2019 19:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants