Skip to content

Robotparser fails to parse some robots.txt #61605

@benmezger

Description

@benmezger
mannequin
BPO 17403
Nosy @orsenthil, @ezio-melotti, @bitdancer, @mher, @ambv, @berkerpeksag, @vadmium
Files
  • parser.patch
  • parser2.patch
  • Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.

    Show more details

    GitHub fields:

    assignee = 'https://github.com/ambv'
    closed_at = <Date 2015-03-13.00:39:31.985>
    created_at = <Date 2013-03-12.10:58:24.526>
    labels = ['type-bug', 'library']
    title = 'Robotparser fails to parse some robots.txt'
    updated_at = <Date 2015-03-13.00:39:31.983>
    user = 'https://bugs.python.org/benmezger'

    bugs.python.org fields:

    activity = <Date 2015-03-13.00:39:31.983>
    actor = 'berker.peksag'
    assignee = 'lukasz.langa'
    closed = True
    closed_date = <Date 2015-03-13.00:39:31.985>
    closer = 'berker.peksag'
    components = ['Library (Lib)']
    creation = <Date 2013-03-12.10:58:24.526>
    creator = 'benmezger'
    dependencies = []
    files = ['29457', '29476']
    hgrepos = []
    issue_num = 17403
    keywords = ['patch']
    message_count = 17.0
    messages = ['184017', '184525', '184609', '184614', '185311', '185312', '185313', '185314', '187523', '187552', '187557', '187560', '187561', '190304', '190306', '237995', '237998']
    nosy_count = 10.0
    nosy_names = ['orsenthil', 'ezio.melotti', 'acooke', 'r.david.murray', 'mher', 'lukasz.langa', 'python-dev', 'berker.peksag', 'martin.panter', 'benmezger']
    pr_nums = []
    priority = 'normal'
    resolution = 'fixed'
    stage = 'resolved'
    status = 'closed'
    superseder = None
    type = 'behavior'
    url = 'https://bugs.python.org/issue17403'
    versions = ['Python 2.7', 'Python 3.3', 'Python 3.4']

    Metadata

    Metadata

    Assignees

    Labels

    stdlibStandard Library Python modules in the Lib/ directorytype-bugAn unexpected behavior, bug, or error

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions