html2rss
html2rss copied to clipboard
Set appropriate User-Agent header when requesting sites by default
The User-Agent should be configurable.
i.e. for version 1.0:
- [ ]
html2rss/1.0
Aha I think I am running into this. So setting User-Agent as a header has no effect?
Aha, I figured to have oversighted the setting of custom headers when using auto_source in html2rss-web. https://github.com/html2rss/html2rss-web/pull/691 fixes it.
This issue asks for this gem enable configurable headers via Config. :)