6. Text Processing Services

The modules described in this chapter provide a wide range of string manipulation operations and other text processing services.

The codecs module described under Binary Data Services is also highly relevant to text processing. In addition, see the documentation for Python’s built-in string type in Text Sequence Type — str.

• 6.1. string — Common string operations
  • 6.1.1. String constants
    • ascii_letters
    • ascii_lowercase
    • ascii_uppercase
    • digits
    • hexdigits
    • octdigits
    • punctuation
    • printable
    • whitespace
  • 6.1.2. Custom String Formatting
    • Formatter
      • Formatter.format()
      • Formatter.vformat()
      • Formatter.parse()
      • Formatter.get_field()
      • Formatter.get_value()
      • Formatter.check_unused_args()
      • Formatter.format_field()
      • Formatter.convert_field()
  • 6.1.3. Format String Syntax
    • 6.1.3.1. Format Specification Mini-Language
    • 6.1.3.2. Format examples
  • 6.1.4. Template strings
    • Template
      • Template.substitute()
      • Template.safe_substitute()
      • Template.template
  • 6.1.5. Helper functions
    • capwords()
• 6.2. re — Regular expression operations
  • 6.2.1. Regular Expression Syntax
  • 6.2.2. Module Contents
    • compile()
    • A
    • ASCII
    • DEBUG
    • I
    • IGNORECASE
    • L
    • LOCALE
    • M
    • MULTILINE
    • S
    • DOTALL
    • X
    • VERBOSE
    • search()
    • match()
    • fullmatch()
    • split()
    • findall()
    • finditer()
    • sub()
    • subn()
    • escape()
    • purge()
    • error
      • error.msg
      • error.pattern
      • error.pos
      • error.lineno
      • error.colno
  • 6.2.3. Regular Expression Objects
    • regex.search()
    • regex.match()
    • regex.fullmatch()
    • regex.split()
    • regex.findall()
    • regex.finditer()
    • regex.sub()
    • regex.subn()
    • regex.flags
    • regex.groups
    • regex.groupindex
    • regex.pattern
  • 6.2.4. Match Objects
    • match.expand()
    • match.group()
    • match.__getitem__()
    • match.groups()
    • match.groupdict()
    • match.start()
    • match.end()
    • match.span()
    • match.pos
    • match.endpos
    • match.lastindex
    • match.lastgroup
    • match.re
    • match.string
  • 6.2.5. Regular Expression Examples
    • 6.2.5.1. Checking for a Pair
    • 6.2.5.2. Simulating scanf()
    • 6.2.5.3. search() vs. match()
    • 6.2.5.4. Making a Phonebook
    • 6.2.5.5. Text Munging
    • 6.2.5.6. Finding all Adverbs
    • 6.2.5.7. Finding all Adverbs and their Positions
    • 6.2.5.8. Raw String Notation
    • 6.2.5.9. Writing a Tokenizer
• 6.3. difflib — Helpers for computing deltas
  • SequenceMatcher
  • Differ
  • HtmlDiff
    • HtmlDiff.__init__()
    • HtmlDiff.make_file()
    • HtmlDiff.make_table()
  • context_diff()
  • get_close_matches()
  • ndiff()
  • restore()
  • unified_diff()
  • diff_bytes()
  • IS_LINE_JUNK()
  • IS_CHARACTER_JUNK()
  • 6.3.1. SequenceMatcher Objects
    • SequenceMatcher
      • SequenceMatcher.set_seqs()
      • SequenceMatcher.set_seq1()
      • SequenceMatcher.set_seq2()
      • SequenceMatcher.find_longest_match()
      • SequenceMatcher.get_matching_blocks()
      • SequenceMatcher.get_opcodes()
      • SequenceMatcher.get_grouped_opcodes()
      • SequenceMatcher.ratio()
      • SequenceMatcher.quick_ratio()
      • SequenceMatcher.real_quick_ratio()
  • 6.3.2. SequenceMatcher Examples
  • 6.3.3. Differ Objects
    • Differ
      • Differ.compare()
  • 6.3.4. Differ Example
  • 6.3.5. A command-line interface to difflib
• 6.4. textwrap — Text wrapping and filling
  • wrap()
  • fill()
  • shorten()
  • dedent()
  • indent()
  • TextWrapper
    • TextWrapper.width
    • TextWrapper.expand_tabs
    • TextWrapper.tabsize
    • TextWrapper.replace_whitespace
    • TextWrapper.drop_whitespace
    • TextWrapper.initial_indent
    • TextWrapper.subsequent_indent
    • TextWrapper.fix_sentence_endings
    • TextWrapper.break_long_words
    • TextWrapper.break_on_hyphens
    • TextWrapper.max_lines
    • TextWrapper.placeholder
    • TextWrapper.wrap()
    • TextWrapper.fill()
• 6.5. unicodedata — Unicode Database
  • lookup()
  • name()
  • decimal()
  • digit()
  • numeric()
  • category()
  • bidirectional()
  • combining()
  • east_asian_width()
  • mirrored()
  • decomposition()
  • normalize()
  • unidata_version
  • ucd_3_2_0
• 6.6. stringprep — Internet String Preparation
  • in_table_a1()
  • in_table_b1()
  • map_table_b2()
  • map_table_b3()
  • in_table_c11()
  • in_table_c12()
  • in_table_c11_c12()
  • in_table_c21()
  • in_table_c22()
  • in_table_c21_c22()
  • in_table_c3()
  • in_table_c4()
  • in_table_c5()
  • in_table_c6()
  • in_table_c7()
  • in_table_c8()
  • in_table_c9()
  • in_table_d1()
  • in_table_d2()
• 6.7. readline — GNU readline interface
  • 6.7.1. Init file
    • parse_and_bind()
    • read_init_file()
  • 6.7.2. Line buffer
    • get_line_buffer()
    • insert_text()
    • redisplay()
  • 6.7.3. History file
    • read_history_file()
    • write_history_file()
    • append_history_file()
    • get_history_length()
    • set_history_length()
  • 6.7.4. History list
    • clear_history()
    • get_current_history_length()
    • get_history_item()
    • remove_history_item()
    • replace_history_item()
    • add_history()
    • set_auto_history()
  • 6.7.5. Startup hooks
    • set_startup_hook()
    • set_pre_input_hook()
  • 6.7.6. Completion
    • set_completer()
    • get_completer()
    • get_completion_type()
    • get_begidx()
    • get_endidx()
    • set_completer_delims()
    • get_completer_delims()
    • set_completion_display_matches_hook()
  • 6.7.7. Example
• 6.8. rlcompleter — Completion function for GNU readline
  • 6.8.1. Completer Objects
    • Completer.complete()