class documentation

Lexer for Snowball source code. .. versionadded:: 2.2

Method __init__ Undocumented
Method get_tokens_unprocessed Split ``text`` into (tokentype, text) pairs. If ``context`` is given, use this lexer context instead.
Class Variable aliases Undocumented
Class Variable filenames Undocumented
Class Variable name Undocumented
Class Variable tokens Undocumented
Class Variable url Undocumented
Method _reset_stringescapes Undocumented
Method _string Undocumented
Method _stringescapes Undocumented
Class Variable _ws Undocumented
Instance Variable _end Undocumented
Instance Variable _start Undocumented

Inherited from Lexer (via ExtendedRegexLexer, RegexLexer):

Method __repr__ Undocumented
Method add_filter Add a new stream filter to this lexer.
Method analyse_text Has to return a float between ``0`` and ``1`` that indicates if a lexer wants to highlight this text. Used by ``guess_lexer``. If this method returns ``0`` it won't highlight it in any case, if it returns ``1`` highlighting with this lexer is guaranteed.
Method get_tokens Return an iterable of (tokentype, value) pairs generated from `text`. If `unfiltered` is set to `True`, the filtering mechanism is bypassed even if filters are defined.
Class Variable alias_filenames Undocumented
Class Variable mimetypes Undocumented
Class Variable priority Undocumented
Instance Variable encoding Undocumented
Instance Variable ensurenl Undocumented
Instance Variable filters Undocumented
Instance Variable options Undocumented
Instance Variable stripall Undocumented
Instance Variable stripnl Undocumented
Instance Variable tabsize Undocumented
def __init__(self, **options): (source)

Undocumented

def get_tokens_unprocessed(self, text=None, context=None): (source)

Split ``text`` into (tokentype, text) pairs. If ``context`` is given, use this lexer context instead.

Undocumented

filenames: list[str] = (source)

Undocumented

Undocumented

Undocumented

def _reset_stringescapes(self): (source)

Undocumented

def _string(do_string_first): (source)

Undocumented

def _stringescapes(lexer, match, ctx): (source)

Undocumented

Undocumented

Undocumented

Undocumented