Edit:
Jc # @ s= d d k Z d d k l Z d d k l Z d d k Z d d k Z d d g Z y
e Z Wn e
j
o
e Z n Xy e d Z
Wn e e
f j
o
e Z
n Xd Z e d Z d Z d
Z d Z d Z d
Z d Z d Z d Z e d Z d Z d dk d YZ d dl d YZ d e f d YZ d Z d Z! d Z" d Z# d Z$ d Z% d e f d YZ& d! e& f d" YZ' d# e& f d$ YZ( e) d% Z* e) d& Z+ e i, d' e i- e i. B Z/ e i, d( e i- e i. B Z0 e i, d) e i- e i. B Z1 d* Z2 e i, d+ Z3 d, Z4 dm Z5 dn Z6 do Z7 e dY Z8 dZ Z9 e i, d[ Z: d\ Z; d] Z< d^ Z= d_ Z> d` Z? da Z@ e db ZA dc ZB dd ZC de ZD df ZE dg e iF f dh YZG eH di j o d dj k lI ZI eI iJ n d S(p iN( t etree( t fragment_fromstringt
html_annotatet htmldifft
basestringc C s d t i t | d | f S( Ns %si ( t cgit escapet _unicode( t textt version( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyt default_markup s c C s g } | D] \ } } | t | | q ~ } | d } x% | d D] } t | | | } qE Wt | } t | | } d i | i S( s
doclist should be ordered from oldest to newest, like::
>>> version1 = 'Hello World'
>>> version2 = 'Goodbye World'
>>> print(html_annotate([(version1, 'version 1'),
... (version2, 'version 2')]))
Goodbye World
The documents must be *fragments* (str/UTF8 or unicode), not
complete documents
The markup argument is a function to markup the spans of words.
This function is called like markup('Hello', 'version 2'), and
returns HTML. The first argument is text and never includes any
markup. The default uses a span with a title:
>>> print(default_markup('Some Text', 'by Joe'))
Some Text
i i t ( t tokenize_annotatedt html_annotate_merge_annotationst compress_tokenst markup_serialize_tokenst joint strip( t doclistt markupt _[1]t docR t tokenlistt
cur_tokenst tokenst result( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s )
c C s0 t | d t } x | D] } | | _ q W| S( sF Tokenize a document and add an annotation attribute to each token
t
include_hrefs( t tokenizet Falset
annotation( R R R t tok( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR D s
c C s} t d | d | } | i } xU | D]M \ } } } } } | d j o+ | | | !} | | | !}
t | |
q( q( Wd S( s Merge the annotations from tokens_old into tokens_new, when the
tokens in the new document already existed in the old document.
t at bt equalN( t InsensitiveSequenceMatchert get_opcodest copy_annotations( t
tokens_oldt
tokens_newt st commandst commandt i1t i2t j1t j2t eq_oldt eq_new( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR
L s
c C sP t | t | j p t x) t | | D] \ } } | i | _ q0 Wd S( sN
Copy annotations from the tokens listed in src to the tokens in dest
N( t lent AssertionErrort zipR ( t srct destt src_tokt dest_tok( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR$ Y s c C su | d g } xa | d D]U } | d i o3 | i o( | d i | i j o t | | q | i | q W| S( sm
Combine adjacent tokens when there is no HTML between the tokens,
and they share an annotation
i i i( t post_tagst pre_tagsR t compress_merge_backt append( R R R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR a s
c C s | d } t | t j p t | t j o | i | nl t | } | i o | d 7} n | | 7} t | d | i d | i d | i } | i | _ | | d /usr/lib64/python2.6/site-packages/lxml/html/diff.pyc (28696B)
tag, if the del looks like (DEL_START,
'Text
', DEL_END)iR; s ']
>>> doc = ['
', 'Text', '
', '', 'More Text', '
']
>>> pre, post = doc[:3], doc[3:]
>>> pre, post
(['', 'Text', '
'], ['', 'More Text', '
'])
>>> locate_unbalanced_start(unbalanced_start, pre, post)
>>> pre, post
(['', 'Text', '
', ''], ['More Text', '
'])
As you can see, we moved the point so that the dangling that
we found will be effectively replaced by the div in the original
document. If this doesn't work out, we just throw away
unbalanced_start without doing anything.
i s <>Rl i Rm t inst dels Unexpected delete tag: %rN( Ro R R_ Rn R1 Rq R: ( R\ Rj Rk t findingt finding_namet nextRx ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyRg f s*
c C s x | p Pn | d } | i d i d } | p Pn | d } | t j p | i d o Pn | i d i d } | d j p
| d j o Pn | | j o$ | i | i d | i q Pq d S( st like locate_unbalanced_start, except handling end tags and
possibly moving the point earlier in the document. ii s <>/s c B s8 e Z d Z e Z d d e d Z d Z d Z RS( s8 Represents a diffable token, generally a word that is displayed to
the user. Opening tags are attached to this token when they are
adjacent (pre_tags) and closing tags that follow the word
(post_tags). Some exceptions occur when there are empty tags
adjacent to a word, so there may be close tags in pre_tags, or
open tags in post_tags.
We also keep track of whether the word was originally followed by
whitespace, even though we do not want to treat the word as
equivalent to a similar word that does not have a trailing
space.c C se t i | | } | d j o
| | _ n
g | _ | d j o
| | _ n
g | _ | | _ | S( N( R t __new__Rr R8 R7 R< ( t clsR R8 R7 R< t obj( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s
c C s d t i | | i | i f S( Ns token(%s, %r, %r)( R t __repr__R8 R7 ( t self( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s c C s
t | S( N( R ( R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyRA s N( R` Ra Rd R RX Rr R R RA ( ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR> s
t tag_tokenc B s2 e Z d Z d d e d Z d Z d Z RS( s Represents a token that is actually a tag. Currently this is just
the ![]()
tag, which takes up visible space just like a word but
is only represented in a document by a tag. c C sM t i | d t | f d | d | d | } | | _ | | _ | | _ | S( Ns %s: %sR8 R7 R< ( R> R R= Rz t datat html_repr( R Rz R R R8 R7 R< R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s c C s, d | i | i | i | i | i | i f S( NsR tag_token(%s, %s, html_repr=%s, post_tags=%r, pre_tags=%r, trailing_whitespace=%s)( Rz R R R8 R7 R< ( R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s c C s | i S( N( R ( R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyRA s N( R` Ra Rd Rr R R R RA ( ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s
t
href_tokenc B s e Z d Z e Z d Z RS( sh Represents the href in an anchor tag. Unlike other words, we only
show the href when it changes. c C s d | S( Ns Link: %s( ( R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyRA s ( R` Ra Rd RP RX RA ( ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s c C sN t i | o
| } n t | d t } t | d t d | } t | S( sk
Parse the given HTML and returns token objects (words with attached tags).
This parses only the content of a page; anything in the head is
ignored, and the and elements are themselves
optional. The content is then parsed by lxml, which ensures the
validity of the resulting parsed document (though lxml may make
incorrect guesses when the markup is particular bad).
and tags are also eliminated from the document, as
that gets confusing.
If include_hrefs is true, then the href attribute of tags is
included as a special kind of diffable token.t cleanupt skip_tagR ( R t iselementt
parse_htmlRP t
flatten_elt fixup_chunks( RA R t body_elRi ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s
c C s' | o t | } n t | d t S( s
Parses an HTML fragment, returning an lxml element. Note that the HTML will be
wrapped in a
tag that was not in the original document.
If cleanup is true, make sure there's no or , and get
rid of any and tags.
t
create_parent( t cleanup_htmlR RP ( RA R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s s s
s c C sj t i | } | o | | i } n t i | } | o | | i } n t i d | } | S( s This 'cleans' the HTML, meaning that any page structure is removed
(only the contents of are used, if there is any and tags are removed. R ( t _body_ret searchRt t _end_body_reRs t _ins_del_ret sub( RA t match( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR ) s s
[ \t\n\r]$c C s* g } d
} g } x| D]} t | t o | d d j ov | d } | d } | i d o | d } t } n t } t d | d | d | d | } g } | i | q | d d
j o9 | d } t | d | d t } g } | i | q q n t | oY | i d o | d } t } n t } t
| d | d | } g } | i | q t | o | i | q t | oM | o | i | q| p t
d | | | | f | i i | q d p t
q W| p t
d d | g S| d i i | | S( sM
This function takes a list of chunks and produces a list of tokens.
i t imgi i R; iR R8 R< t hrefs4 Weird state, cur_word=%r, result=%r, chunks=%r of %rR N( Rr t
isinstancet tupleRZ RP R R R: R t is_wordR> t is_start_tagt
is_end_tagR1 R7 RN ( Ri t tag_accumt cur_wordR Rv R3 Rz R< R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR 9 s\
t paramR t areat brt basefontt inputt baset metat linkt colt addresst
blockquotet centert dirt divt dlt fieldsett formt h1t h2t h3t h4t h5t h6t hrt isindext menut noframest noscriptt olt pRC t tablet ult ddt dtt framesett lit tbodyt tdt tfoott tht theadt trc c sg | p> | i d j o d | i d t | f VqE t | Vn | i t j o) | i o t | o | i o d St | i } x | D] } t i | Vq Wx0 | D]( } x t
| d | D] } | Vq Wq W| i d j o0 | i i d o | o d | i d f Vn | p= t | Vt | i } x | D] } t i | VqGWn d S( s Takes an lxml element el, and generates all the text chunks for
that tag. Each start tag is a chunk, each word is a chunk, and each
end tag is a chunk.
If skip_tag is true, then the outermost container tag is
not returned (just its contents).R R3 NR R R (
Rz t attribt start_tagRp R R0 t tailt split_wordsR R R t gett end_tag( t elR R t start_wordst wordt childt itemt end_words( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s. 4
* c C sv | p | i o g Sg } | i i D] } | | d q2 ~ } t i | p | d d | d R s %s="%s"( Rz R R t itemsR R RP ( R R Rx t value( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s c C s> | i o t i | i o
d } n d } d | i | f S( sg The text representation of an end tag for a tag. Includes
trailing whitespace when appropriate. R; R s %s( R t start_whitespace_reR Rz ( R t extra( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s
c C s | i d S( NRl ( Rn ( R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s c C s
| i d S( Ns or tags inside of any
block-level elements, e.g. transform , etc.
( Rz t block_level_tagst block_level_container_tagsRP R R ( R R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s
c C sj xq | D] } t | o Pq q Wd d k } t i | } | i | _ d | _ | i t | | g | (d Sx t | D] } t | o` t | | | i oE t i | } | i | _ d | _ | i
| i | d | q q t i | } | i | | | i
| q W| i o8 t i | } | i | _ d | _ | i
d | n d S( st helper for _fixup_ins_del_tags; actually takes the etc tags
and moves them inside any block-level tags. iNi i ( R t sysR t ElementR Rr RN t listR R RK R} RL R: ( R Rz R R t children_tagt tail_tagt child_tagt text_tag( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s8
%
c C s7 | i } | i p d } | i oZ t | p | | i 7} q | d i o | d i | i 7_ q | i | d _ n | i | } | o | d j o
d } n | | d } | d j o* | i o | i | 7_ q| | _ q | i o | i | 7_ q | | _ n | i | | | d +d S( s
Removes an element, but merges its contents into its place, e.g.,
given s
(
& ' ( 2 (
<
! "
word
toword
R t skip_outer( R R t _fixup_ins_del_tagst serialize_html_fragmentRP ( RA R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyRF s c C s~ t | t p t d | t i | d d d t } | o5 | | i d d } | | i d } | i S| Sd S( s Serialize a single lxml element as HTML. The serialized form includes the elements tail. If skip_outer is true, then don't serialize the outermost tag s3 You should pass in an element, not a string like %rt methodRA t encodingt >i Rl N( R R R1 R t tostringR t findt rfindR ( R R RA ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s c C sg x` d d g D]R } xI | i d | D]4 } t | p q' n t | d | | i q' Wq Wd S( s? fixup_ins_del_tags that works on an lxml document in-place R R s descendant-or-self::%sRz N( t xpatht _contains_block_level_tagt _move_el_inside_blockt drop_tag( R Rz R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR s c C sL | i t j p | i t j o t Sx | D] } t | o t Sq, Wt S( sP True if the element contains any block-level elements, like,
Hi there!
, if you remove the element you getHi there!
R ii i N( t getparentR R R0 R} Rr t getchildren( R t parentR R} t previous( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyt _merge_element_contents4 s* R" c B s e Z d Z d Z d Z RS( st Acts like SequenceMatcher, but tries not to find very small equal blocks amidst large spans of changes i c C s t t | i t | i } t | i | d } t i i | } g } | D]. } | d | j p | d o | | qT qT ~ S( Ni i ( t minR0 R t thresholdt difflibt SequenceMatchert get_matching_blocks( R t sizeR t actualR R ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR ^ s !( R` Ra Rd R R ( ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyR" V s t __main__( t _diffcommand( ( ( R s imgR R R s inputs baseR s linkR ( R R s centers dirR R R R R R R R R R R R R R R R R s preR R ( R R R R R R R R R R (K R t lxmlR t lxml.htmlR R t ret __all__t unicodeR t NameErrort strt __builtins__R t KeyErrorR R R R R$ R R9 R R RE R RO RQ R_ Rb t ExceptionRc RR RS RY Rf Rg Rh R> R R RP R R t compilet It SR R R R R R Rp R R R R R R R R R R RF R R R R R R R" R` R t main( ( ( s4 /usr/lib64/python2.6/site-packages/lxml/html/diff.pyt