/opt/alt/python27/lib/python2.7/site-packages/jinja2
Edit: /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyo (23226B)
Rc @ s d Z d d k Z d d k l Z d d k l Z d d k l Z d d k l Z d d k
l Z l Z l
Z
l Z l Z e d Z e i d e i Z e i d
e i Z e i d Z y e d d
d Wn" e j
o e i d Z n1 Xd d k l Z e i d e i e i f Z e i d Z e i d Z e d Z e d Z e d Z! e d Z" e d Z# e d Z$ e d Z% e d Z& e d Z' e d Z( e d Z) e d Z* e d Z+ e d! Z, e d" Z- e d# Z. e d$ Z/ e d% Z0 e d& Z1 e d' Z2 e d( Z3 e d) Z4 e d* Z5 e d+ Z6 e d, Z7 e d- Z8 e d. Z9 e d/ Z: e d0 Z; e d1 Z< e d2 Z= e d3 Z> e d4 Z? e d5 Z@ e d6 ZA e d7 ZB e d8 ZC e d9 ZD e d: ZE e d; ZF e d< ZG e d= ZH e d> ZI e d? ZJ e d@ ZK e dA ZL e dB ZM e dC ZN e dD ZO h e dE 6e7 dF 6e# dG 6e& dH 6e/ dI 6e. dJ 6e2 dK 6e8 dL 6e* dM 6e4 dN 6e+ dO 6e5 dP 6e) dQ 6e3 dR 6e% dS 6e0 dT 6e' dU 6e( dV 6e, dW 6e- dX 6e dY 6e$ dZ 6e! d[ 6e1 d\ 6e" d] 6e6 d^ 6ZP eQ g ZR e eP D] \ ZS ZT eR eT eS f qa[R ZU e i d_ d\ iV d` eW eP da db D ZX eY eE eG eF e9 e9 eJ eK eL g ZZ eY e9 eM eG eL g Z[ dc Z\ dd Z] de Z^ df Z_ dg Z` dh ea f di YZb dj ec f dk YZd e
dl ea f dm Y Ze e
dn ea f do Y Zf dp Zg dq ea f dr YZh d S(s s
jinja2.lexer
~~~~~~~~~~~~
This module implements a Jinja / Python combination lexer. The
`Lexer` class provided by this module is used to do some preprocessing
for Jinja.
On the one hand it filters out invalid operators like the bitshift
operators we don't allow in templates. On the other hand it separates
template code and python code in expressions.
:copyright: (c) 2010 by the Jinja Team.
:license: BSD, see LICENSE for more details.
iN( t
itemgetter( t deque( t TemplateSyntaxError( t LRUCache( t nextt iteritemst implements_iteratort text_typet interni2 s \s+s7 ('([^'\\]*(?:\\.[^'\\]*)*)'|"([^"\\]*(?:\\.[^"\\]*)*)")s \d+s föös
t evals \b[a-zA-Z_][a-zA-Z0-9_]*\b( t _stringdefss [%s][%s]*s (?s >=t s t keyc C s t | S( ( t len( RS ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt s c C sz | t j o t | Sh d t 6d t 6d t 6d t 6d t 6d t 6d t 6d t 6d t 6d t
6d
t 6d t 6i
| | S( Ns begin of comments end of commentR3 s begin of statement blocks end of statement blocks begin of print statements end of print statements begin of line statements end of line statements template data / texts end of template( t reverse_operatorst TOKEN_COMMENT_BEGINt TOKEN_COMMENT_ENDt
TOKEN_COMMENTt TOKEN_LINECOMMENTt TOKEN_BLOCK_BEGINt TOKEN_BLOCK_ENDt TOKEN_VARIABLE_BEGINt TOKEN_VARIABLE_ENDt TOKEN_LINESTATEMENT_BEGINt TOKEN_LINESTATEMENT_ENDt
TOKEN_DATAt TOKEN_EOFt get( t
token_type( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt _describe_token_type s
c C s% | i d j o | i St | i S( s# Returns a description of the token.R( ( t typet valueRf ( t token( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt describe_token s c C sK d | j o. | i d d \ } } | d j o | Sn | } t | S( s0 Like `describe_token` but for token expressions.RL i R( ( t splitRf ( t exprRg Rh ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt describe_token_expr s
c C s t t i | S( ss Count the number of newline characters in the string. This is
useful for extensions that filter a stream.
( RU t
newline_ret findall( Rh ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt count_newlines s c C s t i } t | i d | | i f t | i d | | i f t | i d | | i f g } | i d
j o0 | i t | i d d | | i f n | i d
j o0 | i t | i d d | | i f n g } t
| d t D] } | | d q ~ S( sA Compiles all the rules from the environment into a list of rules.R3 t blockt variablet
linestatements ^[ \t\v]*R8 s (?:^|(?<=\S))[^\S\r\n]*t reversei N( RP RQ RU t comment_start_stringt block_start_stringt variable_start_stringt line_statement_prefixt Nonet appendt line_comment_prefixt sortedt True( t environmentt et rulest _[1]RS ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt
compile_rules s t Failurec B s# e Z d Z e d Z d Z RS( sj Class that raises a `TemplateSyntaxError` if called.
Used by the `Lexer` to specify known errors.
c C s | | _ | | _ d S( N( t messaget error_class( t selfR t cls( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt __init__ s c C s | i | i | | d S( N( R R ( R t linenot filename( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt __call__ s ( t __name__t
__module__t __doc__R R R ( ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyR s t Tokenc B s` e Z d Z d Z d e d D \ Z Z Z d Z d Z d Z
d Z d Z RS( s Token class.c c s% x | ] } t t | Vq Wd S( N( t propertyR ( RR RS ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pys s i c C s% t i | | t t | | f S( N( t tuplet __new__R t str( R R Rg Rh ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyR s c C s; | i t j o t | i S| i d j o | i S| i S( NR( ( Rg RW Rh ( R ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt __str__ s
c C sI | i | j o t Sd | j o# | i d d | i | i g j St S( s Test a token against a token expression. This can either be a
token type or ``'token_type:token_value'``. This can only test
against string values and types.
RL i ( Rg R} Rk Rh t False( R Rl ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt test s
#c G s* x# | D] } | i | o t Sq Wt S( s( Test against multiple token expressions.( R R} R ( R t iterableRl ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt test_any s
c C s d | i | i | i f S( Ns Token(%r, %r, %r)( R Rg Rh ( R ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt __repr__ s ( (
R R R t __slots__t rangeR Rg Rh R R R R R ( ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyR s
t TokenStreamIteratorc B s) e Z d Z d Z d Z d Z RS( s` The iterator for tokenstreams. Iterate over the stream
until the eof token is reached.
c C s
| | _ d S( N( t stream( R R ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyR s c C s | S( N( ( R ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt __iter__ s c C sG | i i } | i t j o | i i t n t | i | S( N( R t currentRg Rc t closet
StopIterationR ( R Ri ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt __next__ s
( R R R R R R ( ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyR s t TokenStreamc B s e Z d Z d Z d Z d Z e Z e d d d Z d Z d Z
d d
Z d Z d Z
d
Z d Z d Z RS( s A token stream is an iterable that yields :class:`Token`\s. The
parser however does not iterate over it but calls :meth:`next` to go
one token ahead. The current active token is stored as :attr:`current`.
c C sY t | | _ t | _ | | _ | | _ t | _ t d t d | _
t | d S( Ni t ( t itert _iterR t _pushedR( R R t closedR t
TOKEN_INITIALR R ( R t generatorR( R ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyR ( s c C s
t | S( N( R ( R ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyR 1 s c C s t | i p | i i t j S( N( t boolR R Rg Rc ( R ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt __bool__4 s c C s | S( ( ( RS ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyRV 8 s t docs Are we at the end of the stream?c C s | i i | d S( s Push a token back to the stream.N( R Rz ( R Ri ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt push: s c C s/ t | } | i } | i | | | _ | S( s Look at the next token.( R R R ( R t old_tokent result( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt look> s
i c C s% x t | D] } t | q
Wd S( s Got n tokens ahead.N( R R ( R t nRS ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt skipF s
c C s" | i i | o t | Sd S( sq Perform the token test and return the token if it matched.
Otherwise the return value is `None`.
N( R R R ( R Rl ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt next_ifK s c C s | i | d j S( s8 Like :meth:`next_if` but only returns `True` or `False`.N( R Ry ( R Rl ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt skip_ifR s c C sz | i } | i o | i i | _ nN | i i t j o: y t | i | _ Wqv t j
o | i qv Xn | S( s) Go one token ahead and return the old one( R R t popleftRg Rc R R R R ( R t rv( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyR V s
c C s1 t | i i t d | _ d | _ t | _ d S( s Close the stream.R N( R R R Rc Ry R R} R ( R ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyR b s c C s | i i | p t | } | i i t j o) t d | | i i | i | i n t d | t | i f | i i | i | i n z | i SWd t
| Xd S( s} Expect a given token type and return it. This accepts the same
argument as :meth:`jinja2.lexer.Token.test`.
s( unexpected end of template, expected %r.s expected token %r, got %rN( R R Rm Rg Rc R R R( R Rj R ( R Rl ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt expecth s ( R R R R R R t __nonzero__R t eosR R R R R R R R ( ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyR ! s c C s | i | i | i | i | i | i | i | i | i | i | i
| i f } t i
| } | d j o t | } | t | (?:\s*%s\-|%s)\s*raw\s*(?:\-%s\s*|%s))s (?P<%s_begin>\s*%s\-|%s)s #bygroups .+t roots (.*?)((?:\-%s\s*|%s)%s)s #pops (.)s Missing end of comment tags (?:\-%s\s*|%s)%ss
\-%s\s*|%ss1 (.*?)((?:\s*%s\-|%s)\s*endraw\s*(?:\-%s\s*|%s%s))s Missing end of raw directives \s*(\n|$)s (.*?)()(?=\n|$)(/ RP RQ t
whitespace_ret TOKEN_WHITESPACERy t float_ret TOKEN_FLOATt
integer_ret
TOKEN_INTEGERt name_ret
TOKEN_NAMEt string_ret TOKEN_STRINGt operator_ret TOKEN_OPERATORR R R Rv t matchRu t groupRw R R t joinR Rd Rb R RZ RY R RX R] R\ R R_ R^ t
TOKEN_RAW_ENDt TOKEN_RAW_BEGINRa R` R[ t TOKEN_LINECOMMENT_ENDt TOKEN_LINECOMMENT_BEGINR ( R R~ t cR t tag_rulest root_tag_rulest block_suffix_ret prefix_ret no_lstrip_ret
block_difft mt comment_difft no_variable_ret lstrip_ret block_prefix_ret comment_prefix_reR R t r( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyR s
++'
>
"
" c C s t i | i | S( s@ Called for strings and template data to normalize it to unicode.( Rn R# R ( R Rh ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt _normalize_newlines s c C s7 | i | | | | } t | i | | | | | S( sC Calls tokeniter + tokenize and wraps it in a token stream.
( t tokeniterR t wrap( R t sourceR( R t stateR ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt tokenize s c c s x| D]\ } } } | t j o q n| d j o
d } n| d j o
d } np| d j o q n\| d j o | i | } n<| d j o
| } n%| d j o t | } n| d
j o y/ | i | d d ! i d
d i d } WnI t j
o= } t | i d d i } t | | | | n Xy t | } Wqt j
o qXnV | d j o t
| } n9 | d j o t | } n | d j o t | } n t
| | | Vq Wd S( s This is called with the stream as returned by `tokenize` and wraps
every token in a :class:`Token` and converts the value.
R4 R+ R5 R, R/ R0 R9 t keywordR( R) i it asciit backslashreplaces unicode-escapeRL R' R& R* N( R/ R0 ( t ignored_tokensR R t encodet decodet ExceptionRk t stripR t UnicodeErrort intR& t operatorsR ( R R R( R R Ri Rh R t msg( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyR $ sF
c
c s t | } | i } | i o> | o7 x4 d D]( } | i | o | i d Pq0 q0 Wn d i | } d } d } d g } | d j o" | d j o | i | d n d } | i | d }
t | } g } xx|
D]i\ }
} } |
i | | } | d j o q n | o | d j o q n t
| t ox%t | D] \ } } | i
t j o | | | qS| d
j oj x t | i D]? \ } } | d j o& | | | f V| | i d 7} PqqWt d |
qS| i | d } | p
| t j o | | | f Vn | | i d 7} qSWn"| i } | d j o | d j o | i d q5| d j o | i d q5| d j o | i d q5| d j od | p t d | | | | n | i } | | j o# t d | | f | | | q1q5n | p
| t j o | | | f Vn | | i d 7} | i } | d j o | d j o | i nq | d
j oV x` t | i D]+ \ } } | d j o | i | PqqWt d |
n | i | | i | d }
n" | | j o t d |
n | } Pq W| | j o d St d | | | f | | | q d S( s This method tokenizes the text and returns the tokens in a
generator. Use this method if you just want to tokenize a template.
s
s
s
R i i R t _beginiR. R, R5 s #bygroups? %r wanted to resolve the token dynamically but no group matchedR* RF RG RD RE RB RC s unexpected '%s's unexpected '%s', expected '%s's #popsC %r wanted to resolve the new state dynamically but no group matcheds, %r yielded empty string without stack changeNs unexpected char %r at %d( s
s
s
( R. s block_ends linestatement_end( RG RE RC ( R t
splitlinesR t endswithRz R Ry R RU R t
isinstanceR t enumeratet __class__R R t groupdictt countt RuntimeErrorR t ignore_if_emptyR t popt end( R R R( R R t linest newlinet posR t stackt statetokenst
source_lengtht balancing_stackt regext tokenst new_stateR t idxRi RT Rh R9 t expected_opt pos2( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyR Q s
N( R R R R R Ry R R R ( ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyR s -(i R RP R* R t collectionsR t jinja2.exceptionsR t jinja2.utilsR t jinja2._compatR R R R R R R t UR R R R t SyntaxErrorR t jinja2R
t xid_startt xid_continueR Rn t TOKEN_ADDt TOKEN_ASSIGNt TOKEN_COLONt TOKEN_COMMAt TOKEN_DIVt TOKEN_DOTt TOKEN_EQt TOKEN_FLOORDIVt TOKEN_GTt
TOKEN_GTEQt TOKEN_LBRACEt TOKEN_LBRACKETt TOKEN_LPARENt TOKEN_LTt
TOKEN_LTEQt TOKEN_MODt TOKEN_MULt TOKEN_NEt
TOKEN_PIPEt TOKEN_POWt TOKEN_RBRACEt TOKEN_RBRACKETt TOKEN_RPARENt TOKEN_SEMICOLONt TOKEN_SUBt TOKEN_TILDER R R R R R R\ R] R^ R_ R R RX RY RZ R` Ra R R R[ Rb R Rc R t dictR t kt vRW R R| R t frozensetR R Rf Rj Rm Rp R t objectR R R R R R R ( ( ( s= /opt/alt/python27/lib/python2.7/site-packages/jinja2/lexer.pyt s (
9
+[