{"id":340,"date":"2024-01-28T11:28:13","date_gmt":"2024-01-28T11:28:13","guid":{"rendered":"https:\/\/learnpython.elegantwallp.com\/?p=340"},"modified":"2024-01-28T11:28:14","modified_gmt":"2024-01-28T11:28:14","slug":"python-regular-expressions","status":"publish","type":"post","link":"https:\/\/learnpython.elegantwallp.com\/2024\/01\/28\/python-regular-expressions\/","title":{"rendered":"Python Regular Expressions"},"content":{"rendered":"\n

Summary<\/strong>: in this tutorial, you\u2019ll learn about Python regular expressions and how to use the most commonly used regular expression functions.<\/p>\n\n\n\n

Introduction to the Python regular expressions<\/h2>\n\n\n\n

Regular expressions (called regex or regexp) specify search patterns. Typical examples of regular expressions are the patterns for matching email addresses, phone numbers, and credit card numbers.<\/p>\n\n\n\n

Regular expressions are essentially a specialized programming language embedded in Python. And you can interact with regular expressions via the built-in re<\/code> module in Python.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

The following shows an example of a simple regular expression:<\/p>\n\n\n\n

'\\d'<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
In this example, a regular expression is a string that contains a search pattern. The\u00a0'\\d'<\/code>\u00a0is a digit\u00a0character set\u00a0that matches any single digit from 0 to 9.<\/p>\n\n\n\n
Note that you\u2019ll learn how to construct more complex and advanced patterns in the next tutorials. This tutorial focuses on the functions that deal with regular expressions.<\/p>\n\n\n\n
To use this regular expression, you follow these steps:<\/p>\n\n\n\n
First, import the\u00a0re<\/code>\u00a0module:<\/p>\n\n\n\n
import re<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
Second, compile the regular expression into a\u00a0Pattern<\/code>\u00a0object:<\/p>\n\n\n\n
p = re.compile('\\d')<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
Third, use one of the methods of the\u00a0Pattern<\/code>\u00a0object to match a string:<\/p>\n\n\n\n
s = \"Python 3.10 was released on October 04, 2021\" result = p.findall(s) print(result)<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
Output:<\/p>\n\n\n\n
['3', '1', '0', '0', '4', '2', '0', '2', '1']<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
The findall()<\/code> method returns a list of single digits in the string s.<\/p>\n\n\n\n
The following shows the complete program:<\/p>\n\n\n\n
import re p = re.compile('\\d') s = \"Python 3.10 was released on October 04, 2021\" results = p.findall(s) print(results)<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
Besides the findall()<\/code> method, the Pattern<\/code> object has other essential methods that allow you to match a string:<\/p>\n\n\n\n
Method<\/th>Purpose<\/th><\/tr><\/thead>
match()<\/a><\/code><\/td>Find the pattern at the beginning of a string<\/td><\/tr>
search()<\/code><\/td>Return the first match of a pattern in a string<\/td><\/tr>
findall()<\/code><\/td>Return all matches of a pattern in a string<\/td><\/tr>
finditer()<\/code><\/td>Return all matches of a pattern as an iterator<\/a><\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n
Python regular expression functions<\/h2>\n\n\n\n
Besides the Pattern<\/code> class, the re<\/code> module has some functions that match a string for a pattern:<\/p>\n\n\n\n
    \n
  • match()<\/code><\/li>\n\n\n\n
  • search()<\/code><\/li>\n\n\n\n
  • findall()<\/code><\/li>\n\n\n\n
  • finditer()<\/code><\/li>\n<\/ul>\n\n\n\n
    These functions have the same names as the methods of the Pattern<\/code> object. Also, they take the same arguments as the corresponding methods of the Pattern<\/code> object. However, you don\u2019t have to manually compile the regular expression before using it.<\/p>\n\n\n\n
    The following example shows the same program that uses the\u00a0findall()<\/code>\u00a0function instead of the\u00a0findall()<\/code>\u00a0method of a\u00a0Pattern<\/code>\u00a0object:<\/p>\n\n\n\n
    import re s = \"Python 3.10 was released on October 04, 2021.\" results = re.findall('\\d',s) print(results)<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
    Using the functions in the re<\/code> module is more concise than the methods of the Pattern<\/code> object because you don\u2019t have to compile regular expressions manually.<\/p>\n\n\n\n
    Under the hood, these functions create a Pattern<\/code> object and call the appropriate method on it. They also store the compiled regular expression in a cache for speed optimization.<\/p>\n\n\n\n
    It means that if you call the same regular expression from the second time, these functions will not need to recompile the regular expression. Instead, they get the compiled regular expression from the cache.<\/p>\n\n\n\n
    Should you use the re<\/code> functions or methods of the Pattern<\/code> object?<\/p>\n\n\n\n
    If you use a regular expression within a\u00a0loop, the\u00a0Pattern<\/code>\u00a0object may save a few function calls. However, if you use it outside of loops, the difference is very little due to the internal cache.<\/p>\n\n\n\n
    The following sections discuss the most commonly used functions in the re<\/code> module including search()<\/code>, match()<\/code>, and fullmatch()<\/code>.<\/p>\n\n\n\n
    search() function<\/h3>\n\n\n\n
    The\u00a0search()<\/code>\u00a0function searches for a pattern within a string. If there is a match, it returns the first Match object or None otherwise. For example:<\/p>\n\n\n\n
    import re s = \"Python 3.10 was released on October 04, 2021.\" pattern = '\\d{2}' match = re.search(pattern, s) print(type(match)) print(match)<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
    Output:<\/p>\n\n\n\n
    <class 're.Match'> <re.Match object; span=(9, 11), match='10'><\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
    In this example, the search()<\/code> function returns the first two digits in the string s<\/code> as the Match<\/code> object.<\/p>\n\n\n\n
    Match object<\/h3>\n\n\n\n
    The Match<\/code> object provides the information about the matched string. It has the following important methods:<\/p>\n\n\n\n
    Method<\/th>Description<\/th><\/tr><\/thead>
    group()<\/code><\/td>Return the matched string<\/td><\/tr>
    start()<\/code><\/td>Return the starting position of the match<\/td><\/tr>
    end()<\/code><\/td>Return the ending position of the match<\/td><\/tr>
    span()<\/code><\/td>Return a tuple (start, end) that specifies the positions of the match<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n
    The following example examines the\u00a0Match<\/code>\u00a0object:<\/p>\n\n\n\n
    import re s = \"Python 3.10 was released on October 04, 2021.\" result = re.search('\\d', s) print('Matched string:',result.group()) print('Starting position:', result.start()) print('Ending position:',result.end()) print('Positions:',result.span())<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
    Output:<\/p>\n\n\n\n
    Matched string: 3 Starting position: 7 Ending position: 8 Positions: (7, 8)<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
    match() function<\/h3>\n\n\n\n
    The match() function returns a\u00a0Match<\/code>\u00a0object if it finds a pattern at the beginning of a string. For example:<\/p>\n\n\n\n
    import re l = ['Python', 'CPython is an implementation of Python written in C', 'Jython is a Java implementation of Python', 'IronPython is Python on .NET framework'] pattern = '\\wython' for s in l: result = re.match(pattern,s) print(result)<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
    Output:<\/p>\n\n\n\n
    <re.Match object; span=(0, 6), match='Python'> None <re.Match object; span=(0, 6), match='Jython'> None<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
    In this example, the \\w<\/code> is the word character set that matches any single character.<\/p>\n\n\n\n
    The \\wython<\/code> matches any string that starts with any sing word character and is followed by the literal string ython<\/code>, for example, Python<\/code>.<\/p>\n\n\n\n
    Since the\u00a0match()<\/code>\u00a0function only finds the pattern at the beginning of a string, the following strings match the pattern:<\/p>\n\n\n\n
    Python Jython is a Java implementation of Python<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
    And the following string doesn\u2019t match:<\/p>\n\n\n\n
    'CPython is an implementation of Python written in C' 'IronPython is Python on .NET framework'<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
    fullmatch() function<\/h3>\n\n\n\n
    The\u00a0fullmatch()<\/code>\u00a0function returns a\u00a0Match<\/code>\u00a0object if the whole string matches a pattern or\u00a0None<\/code>\u00a0otherwise. The following example uses the\u00a0fullmatch()<\/code>\u00a0function to match a string with four digits:<\/p>\n\n\n\n
    import re s = \"2021\" pattern = '\\d{4}' result = re.fullmatch(pattern, s) print(result)<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
    Output:<\/p>\n\n\n\n
    <re.Match object; span=(0, 4), match='2019'><\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
    The pattern '\\d{4}'<\/code> matches a string with four digits. Therefore, the fullmatch()<\/code> function returns the string 2021<\/code>.<\/p>\n\n\n\n
    If you place the number\u00a02021<\/code>\u00a0at the middle or the end of the string, the\u00a0fullmatch()<\/code>\u00a0will return\u00a0None<\/code>. For example:<\/p>\n\n\n\n
    import re s = \"Python 3.10 released in 2021\" pattern = '\\d{4}' result = re.fullmatch(pattern, s) print(result)<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
    Output:<\/p>\n\n\n\n
    None<\/code>Code language: Python (python)<\/small><\/code><\/pre>\n\n\n\n
    Regular expressions and raw strings<\/h2>\n\n\n\n
    It\u2019s important to note that Python and regular expression are different programming languages. They have their own syntaxes.<\/p>\n\n\n\n
    The re<\/code> module is the interface between Python and regular expression programming languages. It behaves like an interpreter between them.<\/p>\n\n\n\n
    To construct a pattern, regular expressions often use a backslash '\\'<\/code> for example \\d<\/code> and \\w<\/code> . But this collides with Python\u2019s usage of the backslash for the same purpose in string literals.<\/p>\n\n\n\n
    For example, suppose you need to match the following string:<\/p>\n\n\n\n
    s = '\\section'<\/code>Code language: JavaScript (javascript)<\/small><\/code><\/pre>\n\n\n\n
    In Python, the\u00a0backslash\u00a0(\\<\/code>) is a special character. To construct a regular expression, you need to escape any backslashes by preceding each of them with a backslash (\\<\/code>):<\/p>\n\n\n\n
    pattern = '\\\\section'<\/code>Code language: JavaScript (javascript)<\/small><\/code><\/pre>\n\n\n\n
    In regular expressions, the pattern must be\u00a0'\\\\section'<\/code>. However, to express this pattern in a string literal in Python, you need to use two more backslashes to escape both backslashes again:<\/p>\n\n\n\n
    pattern = '\\\\\\\\section'<\/code>Code language: JavaScript (javascript)<\/small><\/code><\/pre>\n\n\n\n
    Simply put, to match a literal backslash ('\\'<\/code>), you have to write '\\\\\\\\'<\/code> because the regular expression must be '\\\\'<\/code> and each backslash must be expressed as '\\\\'<\/code> inside a string literal in Python.<\/p>\n\n\n\n
    This results in lots of repeated backslashes. Hence, it makes the regular expressions difficult to read and understand.<\/p>\n\n\n\n
    A solution is to use the\u00a0raw strings\u00a0in Python for regular expressions because raw strings treat the backslash (\\<\/code>) as a literal character, not a special character.<\/p>\n\n\n\n
    To turn a regular string into a raw string, you prefix it with the letter\u00a0r<\/code>\u00a0or\u00a0R<\/code>. For example:<\/p>\n\n\n\n
    import re s = '\\section' pattern = r'\\\\section' result = re.findall(pattern, s) print(result) <\/code>Code language: JavaScript (javascript)<\/small><\/code><\/pre>\n\n\n\n
    Output:<\/p>\n\n\n\n
    ['\\\\section']<\/code>Code language: JSON \/ JSON with Comments (json)<\/small><\/code><\/pre>\n\n\n\n
    Note that in Python \u2018\\section\u2019 and \u2018\\\\section\u2019 are the same:<\/p>\n\n\n\n
    p1 = '\\\\section' p2 = '\\section' print(p1==p2) # true<\/em><\/code>Code language: PHP (php)<\/small><\/code><\/pre>\n\n\n\n
    In practice, you\u2019ll find the regular expressions constructed in Python using the raw strings.<\/p>\n","protected":false},"excerpt":{"rendered":"
    Summary: in this tutorial, you\u2019ll learn about Python regular expressions and how to use the most commonly used regular expression functions. Introduction to the Python regular expressions Regular expressions (called regex or regexp) specify search patterns. Typical examples of regular expressions are the patterns for matching email addresses, phone numbers, and credit card numbers. Regular […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[42],"tags":[],"class_list":["post-340","post","type-post","status-publish","format-standard","hentry","category-2-python-regex"],"_links":{"self":[{"href":"https:\/\/learnpython.elegantwallp.com\/wp-json\/wp\/v2\/posts\/340","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/learnpython.elegantwallp.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/learnpython.elegantwallp.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/learnpython.elegantwallp.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/learnpython.elegantwallp.com\/wp-json\/wp\/v2\/comments?post=340"}],"version-history":[{"count":1,"href":"https:\/\/learnpython.elegantwallp.com\/wp-json\/wp\/v2\/posts\/340\/revisions"}],"predecessor-version":[{"id":341,"href":"https:\/\/learnpython.elegantwallp.com\/wp-json\/wp\/v2\/posts\/340\/revisions\/341"}],"wp:attachment":[{"href":"https:\/\/learnpython.elegantwallp.com\/wp-json\/wp\/v2\/media?parent=340"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/learnpython.elegantwallp.com\/wp-json\/wp\/v2\/categories?post=340"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/learnpython.elegantwallp.com\/wp-json\/wp\/v2\/tags?post=340"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}