/usr/lib64/python2.6/site-packages/jinja2
Edit: /usr/lib64/python2.6/site-packages/jinja2/lexer.pyo (20397B)
yJc @ sb d Z d d k Z d d k l Z d d k l Z d d k l Z d d k l Z l
Z
e d Z e i d e i
Z e i d e i Z e i d
Z y e d d d
Wn" e j
o e i d Z n1 Xd d k l Z e i d e i e i f Z e i d Z e i d Z e d Z e d Z e d Z e d Z e d Z e d Z e d Z! e d Z" e d Z# e d Z$ e d Z% e d Z& e d Z' e d Z( e d! Z) e d" Z* e d# Z+ e d$ Z, e d% Z- e d& Z. e d' Z/ e d( Z0 e d) Z1 e d* Z2 e d+ Z3 e d, Z4 e d- Z5 e d. Z6 e d/ Z7 e d0 Z8 e d1 Z9 e d2 Z: e d3 Z; e d4 Z< e d5 Z= e d6 Z> e d7 Z? e d8 Z@ e d9 ZA e d: ZB e d; ZC e d< ZD e d= ZE e d> ZF e d? ZG e d@ ZH e dA ZI e dB ZJ e dC ZK h e dD 6e3 dE 6e dF 6e" dG 6e+ dH 6e* dI 6e. dJ 6e4 dK 6e& dL 6e0 dM 6e' dN 6e1 dO 6e% dP 6e/ dQ 6e! dR 6e, dS 6e# dT 6e$ dU 6e( dV 6e) dW 6e dX 6e dY 6e dZ 6e- d[ 6e d\ 6e2 d] 6ZL eM g ZN eL iO D] \ ZP ZQ eN eQ eP f q?[N ZR e i d^ d[ iS d_ eT eL d` da D ZU eV eA eC eB e5 e5 eF eG eH g ZW eV e5 eI eC eH g ZX db ZY dc ZZ dd e[ f de YZ\ df e] f dg YZ^ dh e[ f di YZ_ dj e[ f dk YZ` dl Za dm e[ f dn YZb d S(o s
jinja2.lexer
~~~~~~~~~~~~
This module implements a Jinja / Python combination lexer. The
`Lexer` class provided by this module is used to do some preprocessing
for Jinja.
On the one hand it filters out invalid operators like the bitshift
operators we don't allow in templates. On the other hand it separates
template code and python code in expressions.
:copyright: (c) 2009 by the Jinja Team.
:license: BSD, see LICENSE for more details.
iN( t
itemgetter( t deque( t TemplateSyntaxError( t LRUCachet nexti2 s \s+s7 ('([^'\\]*(?:\\.[^'\\]*)*)'|"([^"\\]*(?:\\.[^"\\]*)*)")s \d+s föös
t evals \b[a-zA-Z_][a-zA-Z0-9_]*\b( t _stringdefss [%s][%s]*s (?s >=t s t keyc C s t | S( ( t len( RO ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt s c C s t t i | S( ss Count the number of newline characters in the string. This is
useful for extensions that filter a stream.
( RQ t
newline_ret findall( t value( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt count_newlines s c C s t i } t | i d | | i f t | i d | | i f t | i d | | i f g } | i d
j o0 | i t | i d d | | i f n | i d
j o0 | i t | i d d | | i f n g } t
| d t D] } | | d q ~ S( sA Compiles all the rules from the environment into a list of rules.R/ t blockt variablet
linestatements ^\s*R4 s (?:^|(?<=\S))[^\S\r\n]*t reversei N( RL RM RQ t comment_start_stringt block_start_stringt variable_start_stringt line_statement_prefixt Nonet appendt line_comment_prefixt sortedt True( t environmentt et rulest _[1]RO ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt
compile_rules s t Failurec B s# e Z d Z e d Z d Z RS( sj Class that raises a `TemplateSyntaxError` if called.
Used by the `Lexer` to specify known errors.
c C s | | _ | | _ d S( N( t messaget error_class( t selfRj t cls( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt __init__ s c C s | i | i | | d S( N( Rk Rj ( Rl t linenot filename( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt __call__ s ( t __name__t
__module__t __doc__R Rn Rq ( ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyRi s t Tokenc B s` e Z d Z d Z d e d D \ Z Z Z d Z d Z d Z
d Z d Z RS( s Token class.c c s% x | ] } t t | Vq Wd S( N( t propertyR ( RN RO ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pys s i c C s% t i | | t t | | f S( N( t tuplet __new__t internt str( Rm Ro t typeRU ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyRx s c C s; | i t j o t | i S| i d j o | i S| i S( NR$ ( R{ t reverse_operatorsRU ( Rl ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt __str__ s
c C sI | i | j o t Sd | j o# | i d d | i | i g j St S( s Test a token against a token expression. This can either be a
token type or ``'token_type:token_value'``. This can only test
against string values and types.
RH i ( R{ Rc t splitRU t False( Rl t expr( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt test s
#c G s* x# | D] } | i | o t Sq Wt S( s( Test against multiple token expressions.( R Rc R ( Rl t iterableR ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt test_any s
c C s d | i | i | i f S( Ns Token(%r, %r, %r)( Ro R{ RU ( Rl ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt __repr__ s ( (
Rr Rs Rt t __slots__t rangeRo R{ RU Rx R} R R R ( ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyRu s
t TokenStreamIteratorc B s) e Z d Z d Z d Z d Z RS( s` The iterator for tokenstreams. Iterate over the stream
until the eof token is reached.
c C s
| | _ d S( N( t stream( Rl R ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyRn s c C s | S( N( ( Rl ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt __iter__ s c C sG | i i } | i t j o | i i t n t | i | S( N( R t currentR{ t TOKEN_EOFt closet
StopIterationR ( Rl t token( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyR s
( Rr Rs Rt Rn R R ( ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyR s t TokenStreamc B s e Z d Z d Z d Z d Z e d d d Z d Z d Z d d
Z
d Z d Z d
Z
d Z d Z RS( s A token stream is an iterable that yields :class:`Token`\s. The
parser however does not iterate over it but calls :meth:`next` to go
one token ahead. The current active token is stored as :attr:`current`.
c C s\ t | i | _ t | _ | | _ | | _ t | _ t d t
d | _ t | d S( Ni t ( t iterR t _nextR t _pushedR$ Rp R t closedRu t
TOKEN_INITIALR ( Rl t generatorR$ Rp ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyRn s c C s
t | S( N( R ( Rl ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyR s c C s t | i p | i i t j S( N( t boolR R R{ R ( Rl ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt __nonzero__
s c C s | S( ( ( RO ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyRR
s t docs Are we at the end of the stream?c C s | i i | d S( s Push a token back to the stream.N( R R` ( Rl R ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt push s c C s/ t | } | i } | i | | | _ | S( s Look at the next token.( R R R ( Rl t old_tokent result( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt look s
i c C s% x t | D] } t | q
Wd S( s Got n tokens ahead.N( t xrangeR ( Rl t nRO ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt skip s
c C s" | i i | o t | Sd S( sq Perform the token test and return the token if it matched.
Otherwise the return value is `None`.
N( R R R ( Rl R ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt next_if s c C s | i | d j S( s8 Like :meth:`next_if` but only returns `True` or `False`.N( R R_ ( Rl R ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt skip_if' s c C sw | i } | i o | i i | _ nK | i i t j o7 y | i | _ Wqs t j
o | i qs Xn | S( s) Go one token ahead and return the old one( R R t popleftR{ R R R R ( Rl t rv( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyR + s
c C s1 t | i i t d | _ d | _ t | _ d S( s Close the stream.R N( Ru R Ro R R_ R Rc R ( Rl ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyR 7 s c C s | i i | p d | j o | i d d } n | i i t j o) t d | | i i | i | i n t d | t | i f | i i | i | i n z | i SWd t
| Xd S( s} Expect a given token type and return it. This accepts the same
argument as :meth:`jinja2.lexer.Token.test`.
RH i s( unexpected end of template, expected %r.s expected token %r, got %rN( R R R~ R{ R R Ro R$ Rp Rz R ( Rl R ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt expect= s
( Rr Rs Rt Rn R R Rv t eosR R R R R R R R ( ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyR s c
C s| | i | i | i | i | i | i | i | i | i | i f
} t
i | } | d j o t
| } | t
| (?:\s*%s\-|%s)\s*raw\s*%s)s (?P<%s_begin>\s*%s\-|%s)s #bygroups .+t roots (.*?)((?:\-%s\s*|%s)%s)s #pops (.)s Missing end of comment tags (?:\-%s\s*|%s)%ss
\-%s\s*|%ss1 (.*?)((?:\s*%s\-|%s)\s*endraw\s*(?:\-%s\s*|%s%s))s Missing end of raw directives \s*(\n|$)s (.*?)()(?=\n|$)(( RL RM t
whitespace_ret TOKEN_WHITESPACER_ t float_ret TOKEN_FLOATt
integer_ret
TOKEN_INTEGERt name_ret
TOKEN_NAMEt string_ret TOKEN_STRINGt operator_ret TOKEN_OPERATORRh R R t joinR\ R t
TOKEN_DATAR t
TOKEN_COMMENTt TOKEN_COMMENT_ENDRi t TOKEN_COMMENT_BEGINt TOKEN_BLOCK_ENDt TOKEN_BLOCK_BEGINR t TOKEN_VARIABLE_ENDt TOKEN_VARIABLE_BEGINt
TOKEN_RAW_ENDt TOKEN_RAW_BEGINt TOKEN_LINESTATEMENT_ENDt TOKEN_LINESTATEMENT_BEGINt TOKEN_LINECOMMENTt TOKEN_LINECOMMENT_ENDt TOKEN_LINECOMMENT_BEGINRf (
Rl Rd t cRe t tag_rulest root_tag_rulest block_suffix_reRg R t r( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyRn n sd 2
"
" c C s t i | i | S( s? Called for strings and template data to normlize it to unicode.( RS R R ( Rl RU ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt _normalize_newlines s c C s7 | i | | | | } t | i | | | | | S( sC Calls tokeniter + tokenize and wraps it in a token stream.
( t tokeniterR t wrap( Rl t sourceR$ Rp t stateR ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt tokenize s c c s x| D]\ } } } | t j o q n| d j o
d } n| d j o
d } np| d j o q n\| d j o | i | } n<| d j o
| } n%| d j o t | } n| d
j o y/ | i | d d ! i d
d i d } WnI t j
o= } t | i d d i } t | | | | n Xy t | } Wqt j
o qXnV | d j o t
| } n9 | d j o t | } n | d j o t | } n t
| | | Vq Wd S( s This is called with the stream as returned by `tokenize` and wraps
every token in a :class:`Token` and converts the value.
R0 R' R1 R( R+ R, R5 t keywordR$ R% i it asciit backslashreplaces unicode-escapeRH R# R" R& N( R+ R, ( t ignored_tokensR Rz t encodet decodet ExceptionR~ t stripR t UnicodeErrort intR" t operatorsRu ( Rl R R$ Rp Ro R RU Re t msg( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyR sF
c c s; d i t | i } d } d } d g } | d j o" | d j o | i | d n d } | i | d } t | } g }
xx| D]i\ } } }
| i | | } | d j o q n |
o | d j o q n t | t ox%t
| D] \ } } | i t j o | | | q | d
j oj x | i
i D]? \ } } | d j o& | | | f V| | i d 7} PqNqNWt d | q | i | d } | p
| t j o | | | f Vn | | i d 7} q Wn"| i } | d j o | d
j o |
i d q| d j o |
i d q| d j o |
i d q| d j od |
p t d | | | | n |
i } | | j o# t d | | f | | | qqn | p
| t j o | | | f Vn | | i d 7} | i } |
d j o |
d j o | i nq |
d
j oV x` | i
i D]+ \ } } | d j o | i | PqnqnWt d | n | i |
| i | d } n" | | j o t d | n | } Pq W| | j o d St d | | | f | | | q d S( s This method tokenizes the text and returns the tokens in a
generator. Use this method if you just want to tokenize a template.
s
i i R t _beginiR* R( R1 s #bygroups? %r wanted to resolve the token dynamically but no group matchedR& RB RC R@ RA R> R? s unexpected "%s"s unexpected "%s", expected "%s"s #popsC %r wanted to resolve the new state dynamically but no group matcheds, %r yielded empty string without stack changeNs unexpected char %r at %d( R* s block_ends linestatement_end( RC RA R? ( R t unicodet
splitlinesR_ R` Rf RQ t matcht
isinstanceRw t enumeratet __class__Ri t groupdictt iteritemst countt RuntimeErrort groupt ignore_if_emptyR t popt end( Rl R R$ Rp R t posRo t stackt statetokenst
source_lengtht balancing_stackt regext tokenst new_statet mt idxR RP RU R5 t expected_opt pos2( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyR s
N( Rr Rs Rt Rn R R_ R R R ( ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyR f s Z ,(c Rt RL R& R t collectionsR t jinja2.exceptionsR t jinja2.utilsR R R R t UR R R R t SyntaxErrorR t jinja2R t xid_startt xid_continueR RS Ry t TOKEN_ADDt TOKEN_ASSIGNt TOKEN_COLONt TOKEN_COMMAt TOKEN_DIVt TOKEN_DOTt TOKEN_EQt TOKEN_FLOORDIVt TOKEN_GTt
TOKEN_GTEQt TOKEN_LBRACEt TOKEN_LBRACKETt TOKEN_LPARENt TOKEN_LTt
TOKEN_LTEQt TOKEN_MODt TOKEN_MULt TOKEN_NEt
TOKEN_PIPEt TOKEN_POWt TOKEN_RBRACEt TOKEN_RBRACKETt TOKEN_RPARENt TOKEN_SEMICOLONt TOKEN_SUBt TOKEN_TILDER R R R R R R R R R R R R R R R R R R R R R R R t dictRg R t kt vR| R Rb R t frozensetR R RV Rh t objectRi Rw Ru R R R R ( ( ( s2 /usr/lib64/python2.6/site-packages/jinja2/lexer.pyt s
9
+[