class documentation

class Lexer: (source)

Known subclasses: django.utils.jslex.JsLexer

View In Hierarchy

A generic multi-state regex-based lexer.

Method __init__ Undocumented
Method lex Lexically analyze `text`.
Instance Variable regexes Undocumented
Instance Variable state Undocumented
Instance Variable toks Undocumented
def __init__(self, states, first): (source)

Undocumented

def lex(self, text): (source)

Lexically analyze `text`. Yield pairs (`name`, `tokentext`).

Undocumented

Undocumented

Undocumented