-
-
Notifications
You must be signed in to change notification settings - Fork 7
Closed
Labels
enhancementNew feature or requestNew feature or request
Description
The plugin currently works by kicking off a long-running operation in the single "write" thread and parsing the CSV file entirely within that operation:
| await db.execute_write_fn(insert_docs_catch_errors, block=False) |
I'm having trouble getting the tests to pass against Datasette 1.0 - see #36 - which has made me think that this might not be the best approach.
I'd rather not tie up the write connection for so long - ideally I'd like the parsing to happen in a separate thread with rows written to the database 100 at a time or so.
I'm not entirely sure how to do that, so I'll likely get a good TIL out of it.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request