This aims to scrape this page (embedded here) to turn it into a CSV.
Uses https://mircozeiss.com/json2csv/ for creating the CSV.
- Write the scraper: INN/umbrella-currentorg#135
- Conversion task (old): INN/umbrella-currentorg#121
- Final scrape: INN/umbrella-currentorg#136
- Clone this repo
- Run
make - In the browser window opened by the
scrapetarget, open your browser's dev tools. - Find the console log item that is the contents of a CSV. Save it.
Other make targets:
make cleanremoves all files generated bymakemake downloadredownloads the databasemake injectedinserts our scraping JS into the downloaded page and performs some text replacements that are undone byinjection.jsmake scrapeopens the post-injection page in the browser
- you're on a Mac with all the Homebrew dependencies, including
makeandopen- Linux users may be able to
alias open=xdg-open
- Linux users may be able to