']
>>> doc = ['
', 'Text', '
', '', 'More Text', '
']
>>> pre, post = doc[:3], doc[3:]
>>> pre, post
(['', 'Text', '
'], ['', 'More Text', '
'])
>>> locate_unbalanced_start(unbalanced_start, pre, post)
>>> pre, post
(['', 'Text', '
', ''], ['More Text', '
'])
As you can see, we moved the point so that the dangling that
we found will be effectively replaced by the div in the original
document. If this doesn't work out, we just throw away
unbalanced_start without doing anything.
html_annotate_merge_annotations Weird state, cur_word=%r, result=%r, chunks=%r of %r Represents the href in an anchor tag. Unlike other words, we only
show the href when it changes. Represents a token that is actually a tag. Currently this is just
the ![]()
tag, which takes up visible space just like a word but
is only represented in a document by a tag. Represents a diffable token, generally a word that is displayed to
the user. Opening tags are attached to this token when they are
adjacent (pre_tags) and closing tags that follow the word
(post_tags). Some exceptions occur when there are empty tags
adjacent to a word, so there may be close tags in pre_tags, or
open tags in post_tags.
We also keep track of whether the word was originally followed by
whitespace, even though we do not want to treat the word as
equivalent to a similar word that does not have a trailing
space. Raised when the document no longer contains any pending deletes
(DEL_START/DEL_END)
Acts like SequenceMatcher, but tries not to find very small equal
blocks amidst large spans of changes
doclist should be ordered from oldest to newest, like::
>>> version1 = 'Hello World'
>>> version2 = 'Goodbye World'
>>> print(html_annotate([(version1, 'version 1'),
... (version2, 'version 2')]))
Goodbye World
The documents must be *fragments* (str/UTF8 or unicode), not
complete documents
The markup argument is a function to markup the spans of words.
This function is called like markup('Hello', 'version 2'), and
returns HTML. The first argument is text and never includes any
markup. The default uses a span with a title:
>>> print(default_markup('Some Text', 'by Joe'))
Some Text
block_level_container_tags InsensitiveSequenceMatcher split_trailing_whitespace _contains_block_level_tag serialize_html_fragment markup_serialize_tokens locate_unbalanced_start Unexpected delete tag: %r _merge_element_contents src/lxml/html/diff.py locate_unbalanced_end html_annotate (line 31) _move_el_inside_block _fixup_ins_del_tags descendant-or-self::%s trailing_whitespace start_whitespace_re %s get_matching_blocks fragment_fromstring compress_merge_back tokenize_annotated fixup_ins_del_tags cline_in_traceback end_whitespace_re unbalanced_start tag_token.__repr__ split_unbalanced copy_annotations block_level_tags tag_token.__new__ stripped_length old_html_tokens new_html_tokens htmldiff_tokens href_token.html hide_when_equal compress_tokens SequenceMatcher unbalanced_end tag_token.html split_words_re lxml.html.diff default_markup cleanup_delete token(%s, %r, %r, %r) include_hrefs html_annotate expand_tokens create_parent token.__repr__ split_delete merge_insert merge_delete is_start_tag html2_tokens html1_tokens fixup_chunks finding_name cleanup_html children_tag token.__new__ start_words split_words post_delete markup_func html_escape getchildren get_opcodes _end_body_re _diffcommand ImportError tokens_old tokens_new token.html startswith skip_outer pre_delete parse_html is_end_tag ins_tokens _ins_del_re ins_chunks href_token flatten_el empty_tags del_tokens del_chunks cur_tokens blockquote basestring annotation ValueError tokenlist threshold tag_token tag_stack tag_accum start_tag post_tags __metaclass__ lxml.html iselement html_repr getparent end_words child_tag NoDeletes NameError DEL_START tostring tokenize text_tag tail_tag skip_tag __qualname__ previous pre_tags old_html noscript noframes new_html htmldiff frameset fieldset endswith encoding drop_tag dest_tok cur_word commands basefont balanced version _unicode ^[ \t\n\r] src_tok replace __prepare__ isindex is_word finding findall end_tag doclist difflib compile command cleanup _body_re body_el address Element DEL_END tokens search rstrip result parent __name__ __module__ method merged markup main insert __import__ extend escape eq_old eq_new endtag delete chunks center attrib append actual Link: %s xpath words value token throw thead tfoot tbody table [ \t\n\r]$ strip start split %s %s="%s" <%s%s> rfind param match items ins input index extra etree equal __doc__ del close chunk child word text __test__ tail size send self __repr__ post pos2 next name meta menu __main__ lxml link last join item html href form find dest data base args area zip tok tag sys sub src %s: %s pre pos pop obj __new__ img get end doc div dir col cls cgi __all__ > <>/ / < \S+(?:\s+|$) ul tr th td re ol li j2 j1 i2 i1 hr h6 h5 h4 h3 h2 h1 el dt dl dd br s p b a U S I ?; x( (P h X 8 X , @ T h X H, x@ T p 8 8 x (< XP l ظ @ \ 8 H,
H
x
X h X (< X 8t 8 , hH d h 8 \ | X 8 h@ h X H L ! " 8$ H%P h& ) (-X X0 X3 3, 84L 5 h6 H7 x7 7 9l ; H; 8<4 h=| ? (@$ HA HB C Ex hF H JT K HN, Sx XV Y [4 (]h b d g L \ JBB A(A0^(A BBBAW0 D ( ' BHA s
ABG M
ABH f
CBE @ p ! FAA D0
DABC L
DABE ` P# BBB B(A0D8G@
8A0A(B BBBC O
8A0A(B BBBG \ # BBI D(D@o
(A ABBF X
(A ABBB D
(C ABBD @ x $ BAA D0e
AABG I
AABK H x%z BBE E(D0A8D@
8D0A(B BBBG ` &H QBB B(A0D8DP
8A0A(B BBBH HHPL l 'O BBA A(D@`
(C ABBF
(F ABBG ( (\ AAD@
AAF \ * BBA D(D@
(A ABBD X
(A ABBJ D
(C ABBD 8 H ,, BBA A(D0Y
(A ABBG , BBB E(A0D8GP
8F0A(B BBBB PXB`BhApBxBBBIPH
8A0A(B BBBH c
8A0A(B BBBC H /@ FBB B(D0A8D`
8A0A(B BBBH 8 l 4 FBA A(GP
(A ABBF H 6 FBB B(A0A8G`(
8A0A(B BBBI 0 9 FAD D@m
AABH 0 ( L; FAD D@
AABF H \ < FBE B(A0A8D`
8A0A(B BBBI 8 B FBD A(DP
(A ABBJ H C BBE B(A0A8Dp3
8A0A(B BBBB 0 TF D
E ( L FS FJ V
AI XAG < x G AAG }
DAE W
DAL IGA h \GU FBB B(A0A8GALAu
8A0A(B BBBG
BE \ $ PR FBB B(A0D8DHqAv
8A0A(B BBBI T [ SAA G0_
AABA P0\
FABE H h]
FBB B(A0D8D
8A0A(B BBBD h ( g? FEB B(A0A8D
8A0A(B BBBD AGA
OL H s FBB B(D0A8Dp$
8A0A(B BBBE h T}
FBB B(A0A8G
8A0A(B BBBA HALA0
BE | L BBB B(A0D8D`
8D0A(B BBBF
8D0A(B BBBE v
8D0A(B BBBE h 8/ FBB B(A0A8J
ALA|
8A0A(B BBBH J
BE L 8 ̼2 FBB E(A0A8D
8A0A(B BBBH h \ FBB B(A0A8GALAr
8A0A(B BBBJ
BE L M FBB B(D0A8DB
8A0A(B BBBG D! l
FFB B(A0D8G
8A0A(B BBBJ BGABYD
BB D
BB 8 ! BBD A(GP
(A ABBH H " X BBB B(A0A8D`
8A0A(B BBBH 0 P" ENQHhPTHC@q
AAA " p6 EG0W
AD " EG0u
AF X " FBB B(A0D8DHqAv
8A0A(B BBBH h (# \. FBB B(A0A8GALAu
8A0A(B BBBG .
BE L # FBB B(A0D8D
8A0A(B BBBA L # FBB B(A0D8Dk
8A0A(B BBBF L 4$ "t
FBB B(D0A8Dr
8A0A(B BBBG H $ , FBB B(A0A8G
8A0A(B BBBE L $ 52 FBB B(D0A8D
8A0A(B BBBF L % tC FBB B(A0A8G
8A0A(B BBBG L p% T FBB B(A0D8D
8A0A(B BBBD p % o FBB B(A0A8GHKBIPA
8A0A(B BBBD t 4& FBB B(A0A8JLALAy
8A0A(B BBBK
BE
BE & v) FBB B(A0A8JGaBALA{
8A0A(B BBBA 4GaBG`B
BE P' FBB B(A0A8J ALA{
8A0A(B BBBI /GVBuGUBI
BE \ ' ' FBB B(A0D8G MXAC
8A0A(B BBBF L @( *+ FEB B(D0A8G
8A0A(B BBBH \ ( . FBB B(D0A8D`HqAv
8A0A(B BBBA L ( T>. FBB B(A0A8G
8A0A(B BBBH | @) 4Pt FBB B(D0A8DAHQBJMA?HqAu
8A0A(B BBBJ h ) 4^: FBB B(A0A8GALAv
8A0A(B BBBF
BE L ,* rj FEE B(D0A8D
8A0A(B BBBD L |* (@/ FBB B(A0A8Gu
8A0A(B BBBD | * FBB B(A0A8GOQBALAu
8A0A(B BBBG F
BE L L+ FBB B(A0D8G
8A0A(B BBBH t + h FBB B(A0A8JLALAy
8A0A(B BBBK
BE H
BE L , m FEE E(A0A8D
8A0A(B BBBH L d, )* FBE B(A0A8Gy
8A0A(B BBBE h , E FBB B(A0A8GALAu
8A0A(B BBBG
BE @ - {WtE FBB B(A0A8DVaAsTVBTSBMKAsTSArTSBsTSBMKBrTRAsTSBsTRBTSBxMKAsTSArTSBsTSBMKBsTRA]Y\BV\BV[AY^AV\BV\BKV[BaTRATSBTRB_TSBMKA&VaA#TSB_TSBMKBrTRAsTSBsTRBsTSBMKATSArTSBsTSBMKBV[Ax8A0A(B BBB GNU ` (%
"
/
:
D
N
b
r
L (% (% o `
0+% w xZ o o o o o (% Ё 0 @ P ` p Ђ 0 @ P ` p Ѓ 0 @ P ` p Є 0 @ P ` p Ѕ 0 @ P ` p І 0 @ P ` p Ї 0 @
Removes an element, but merges its contents into its place, e.g.,
given , etc.
fixup_ins_del_tags that works on an lxml document in-place
Serialize a single lxml element as HTML. The serialized form
includes the elements tail.
If skip_outer is true, then don't serialize the outermost tag
Given an html string, move any or tags inside of any
block-level elements, e.g. transform and tags are removed.
Parses an HTML fragment, returning an lxml element. Note that the HTML will be
wrapped in a
Hi there!
, if you remove the element you getHi there!
helper for _fixup_ins_del_tags; actually takes the etc tags and moves them inside any block-level tags. True if the element contains any block-level elements, like,
word
toword
The text representation of an end tag for a tag. Includes trailing whitespace when appropriate. The text representation of the start tag for a tag. Splits some text into words. Includes trailing whitespace on each word when appropriate. Takes an lxml element el, and generates all the text chunks for that tag. Each start tag is a chunk, each word is a chunk, and each end tag is a chunk. If skip_tag is true, then the outermost container tag is not returned (just its contents). This function takes a list of chunks and produces a list of tokens. This function takes a word, such as 'test ' and returns ('test',' ') This 'cleans' the HTML, meaning that any page structure is removed (only the contents of are used, if there is any tag that was not in the original document.
If cleanup is true, make sure there's no or , and get
rid of any and tags.
Parse the given HTML and returns token objects (words with attached tags).
This parses only the content of a page; anything in the head is
ignored, and the and elements are themselves
optional. The content is then parsed by lxml, which ensures the
validity of the resulting parsed document (though lxml may make
incorrect guesses when the markup is particular bad).
and tags are also eliminated from the document, as
that gets confusing.
If include_hrefs is true, then the href attribute of tags is
included as a special kind of diffable token. like locate_unbalanced_start, except handling end tags and
possibly moving the point earlier in the document. pre_delete and post_delete implicitly point to a place in the
document (where the two were split). This moves that point (by
popping items from one and pushing them onto the other). It moves
the point to try to find a place where unbalanced_start applies.
As an example::
>>> unbalanced_start = ['
']
>>> doc = ['
', 'Text', '
', '', 'More Text', '
']
>>> pre, post = doc[:3], doc[3:]
>>> pre, post
(['', 'Text', '
'], ['', 'More Text', '
'])
>>> locate_unbalanced_start(unbalanced_start, pre, post)
>>> pre, post
(['', 'Text', '
', ''], ['More Text', '
'])
As you can see, we moved the point so that the dangling that
we found will be effectively replaced by the div in the original
document. If this doesn't work out, we just throw away
unbalanced_start without doing anything.
Returns (stuff_before_DEL_START, stuff_inside_DEL_START_END,
stuff_after_DEL_END). Returns the first case found (there may be
more DEL_STARTs in stuff_after_DEL_END). Raises NoDeletes if
there's no DEL_START found. Return (unbalanced_start, balanced, unbalanced_end), where each is
a list of text and tag chunks.
unbalanced_start is a list of all the tags that are opened, but
not closed in this span. Similarly, unbalanced_end is a list of
tags that are closed but were not opened. Extracting these might
mean some reordering of the chunks. Cleans up any DEL_START/DEL_END markers in the document, replacing
them with tags. doc is the already-handled document (as a list of text chunks);
here we add ins_chunks to the end of that. Given a list of tokens, return a generator of the chunks of
text for the data in the tokens.
Does a diff on the tokens themselves, returning a list of text
chunks (not tokens).
Do a diff of the old and new document. The documents are HTML
*fragments* (str/UTF8 or unicode), they are not complete documents
(i.e., no tag).
Returns HTML with and tags added around the
appropriate text.
Markup is generally ignored, with the markup from new_html
preserved, and possibly some markup from old_html (though it is
considered acceptable to lose some of the old markup). Only the
words in the HTML are diffed. The exception is ![]()
tags, which
are treated like words, and the href attribute of tags, which
are noted inside the tag itself when there are changes.
Serialize the list of tokens into a list of text chunks, calling
markup_func around text to add annotations.
Merge tok into the last element of tokens (modifying the list of
tokens in-place).
Combine adjacent tokens when there is no HTML between the tokens,
and they share an annotation
Copy annotations from the tokens listed in src to the tokens in dest
Merge the annotations from tokens_old into tokens_new, when the
tokens in the new document already existed in the old document.
Tokenize a document and add an annotation attribute to each token
doclist should be ordered from oldest to newest, like::
>>> version1 = 'Hello World'
>>> version2 = 'Goodbye World'
>>> print(html_annotate([(version1, 'version 1'),
... (version2, 'version 2')]))
Goodbye World
The documents must be *fragments* (str/UTF8 or unicode), not
complete documents
The markup argument is a function to markup the spans of words.
This function is called like markup('Hello', 'version 2'), and
returns HTML. The first argument is text and never includes any
markup. The default uses a span with a title:
>>> print(default_markup('Some Text', 'by Joe'))
Some Text
% @% % % (% % % % % `% % % % % X% % % x% % % % (% % (% X% % % `% % % % % % % p% % % % P% % % p% % % % 8% % % 8% % @% % % x A 8 0 S% R% `R% & u p @ t H ` h p P ` A 0 ( U% U% @V% ` 0 + 6 A J R u ` ` \ e o x Б Б ` 4 ` Е P % u % % h
% % % % % / ئ%
Ц% X
Ȧ% H
% Z % ` 9 % % i % %
% % % x% X p% 5 h% 4 `% X% P% H% @%
8% 0% (% % % % % % H % % , % ' % إ% Х% ȥ% " % % 8 % % @ % ( %
% x % % x% p% l h% `% | X% 8
P% X
H% v @% e 8% 0% P (% H
% % p % % % % % % % ؤ% Ф% Ȥ% % % % % % @ % % h % ` % x% p% ^ h% ` `% X% P%
H% x @% 8% ~ 0% (% z % X % p % % % % % % x % v أ%
У% h ȣ% % (
% h % W % P % I % P % B % J % x% ; p% D h% X `% X% ` P% X H% 8
@% (
8% ` 0% @ (% % % % H % r % % % %
% آ% Т% Ȣ% % % % % % % % % %
x%
p% h% `% X% P%
H% 8 @% 8% 0% (% n % 0 % x % > % 8 % h % 0 % ( % % @ ء% С% ȡ% % % %
% 8 %
% 0 % % " % % x% p% h% `% X% P% ` H% @ # @% 8%
0% 0 (% % % % % @ % % %
% %
ؠ% Р% Ƞ% % % % % % % ` % ( % % x% p% h% \ `% X% P% H%
@% 8% 0% x (% X % T % % % %
% P % h % % ؟% П% ȟ%
% % % % % % % % I % x% p% h% `% X% P% H% @% X 8% 0% (% %
% % % % % E % % % ؞%
О% Ȟ% x % H % % % A % = % % % % 9 x%
p%
h%
`% ` X% P% H% S @% 8% 0% (% % % % % % % % x
% % 5 ؝% Н% h ȝ% % 8 % ` % % @ % h
% % ( % % x x% p% h% `% X% P% H% @% 8% 0% (% % 1 A& ȿ h A& p ` A& 0 b 0% @ 0% l c @1% O 1% a 1% 0/ 2% p1 6 9 % `3% P 3% 9 4% 4% 5% z 6% } `6% a W 7% ~ ? @8% = > G P@ 0 @ G `n @ :% ) @;% @ ?% 5 0 @% ` 0 `A% % C% C% 9 P `D% A D% 0p @E% O G% F Z `H% B H% A PL @I% 0 I% s @J% e J% p (% GA$3a1 Y GA$3p1029 K GA* GA$annobin gcc 8.5.0 20210514 GA$plugin name: annobin GA$running gcc 8.5.0 20210514 GA* GA* GA!
GA*FORTIFY GA+GLIBCXX_ASSERTIONS GA*GOW * GA*cf_protection GA+omit_frame_pointer GA+stack_clash GA!stack_realign GA*GOW * l K
GA*FORTIFY 4 GA+GLIBCXX_ASSERTIONS diff.so-4.2.3-6.module_el8.6.0+2781+fed64c13.x86_64.debug آ 7zXZ ִF ! t/3 ] ?Eh=ڊ2N iu1C!H*V Gp0' wW? |vX䵊|jcc 1 uX?SqۚĢ?م=FLx`
@9m$Ko\E#-Ҙ,pRz`R]ikr!}zZ/ȑ5GnYi_:W[4pw#\F_e"jɡxy[ Ӽ
L{R2NC;$2 n~0 wZ*
-sեl
hH:6a?/Χ,8[ +fEqO_/J7m4aJղ2SPL&8@L yd
E2Z;rq VrPGA%="@(V)һm)Ԋ-zE層2j.IUPJ8MT('B!P2Y
u+zD/4gFK7e=;2 h 2T ptk[ Xuqq yuM$i1 "#lstZk1 !-?$] Qy۲rPJS
87/|WY Y֦ϥ|+k~)!K+++v7,08Qit%뫰\3; Ґ#pcy` (.z" ĪzĈ Xgκ {RTնashXOԄŠ pŸ> `OݾTV|P ŴuEDa'
tvۘ~5&m/̱{,DU/Dv%AWH ƒȾq~g4LS^٩om',ad-ЉrR۱507O >hUIIfJsite/Q:mr^Ve,a:7Y۽]/:3J{'ұ1~C?3 y~=/UȈ
4n[[coP&~^\p+>D
c_ )~h?p/c쨊S$#nG ,)jLOb_6 yLYdixY"tU %)|:6'F zt6~[V M㚙UXqK/Qn \1ms ͷoĿP⑾1D[xkT* { :S|c!mK Z?,5:-I$gBf:W;H19z &ȩ],d@꙾\TTZWDFGLPd| #lۚߵ{2R:];,lUIL)2ϋ Eɶ;@[rVs Y
j;*$KmB 7uy [:oe5 S9XuԂK[](lgxʢ^w|&
SA5E-z&j
嶻3 /5m&c-#?A>M@S2mZOȃRӜ|}O_ a&']![v%> ~!DdN vxT5Rݥ=NQ پPAt 0æ:%Ϸ DTlY9@rkdnutt\'b3㷳B}Ƽs YRLE(T# ѿ-,?P[40Vg6YXtn "B3̢ b ;>N =֞ʤ%zQ$/Io~Gw"^# )S@4^VE
3+;4p<@8@Ae-`nO~^bA`Jq8oQ fQŲs>l u, Me\Q
GЪ#=ğ0g͐i /~DۗOw&.>TM; q-
]{^{cMX`Q 3BNH47/P
s@tCR .w`WE {~Q+c %T^*f[~I+ZʫcpQ6DYH4D4"~~R{ :ì9qh˱xB
Ã#ns$-@NO_d e9v Hq{>~*W'?OU @oIW l(dZa+KEdN3/Rx|\0v j&ꚛ/߰`qxXG
h:7`-B_<ʃãpvoc{*o n CCk&+~SZSv V8Vw,3#=bQ.s
ߡN%|A}f {'ؤL> 2raN69>n5*دQF@+>(%h{yhIh6-(b쒑u6?E7pn;w} 1P xAo \TEjA =KY^Ngި7
5ƶ?QڤQ-=sbp7DpҘ:65فp!ktW30HØn轑k8*2aICjO4pɸNNu
KJ^|W9=Qfp
[;k[ ܫ3u g O$$g YZ .shstrtab .note.gnu.build-id .gnu.hash .dynsym .dynstr .gnu.version .gnu.version_r .rela.dyn .rela.plt .init .plt.sec .text .fini .rodata .eh_frame_hdr .eh_frame .note.gnu.property .init_array .fini_array .data.rel.ro .dynamic .got .data .bss .gnu.build.attributes .gnu_debuglink .gnu_debugdata 8 8 $ o ` ` 8 ( p 0
8 o 4 E o 0 T xZ ^ B w w h c n P P w [# } L L
` ` 0 ( ( 8 8 d0 (% ( (% ( (% ( (% ( ` 0+% 0+ 0% 0 f % e l
t @ H (
tag, if the del looks like (DEL_START,
'Text
', DEL_END) Adds the text chunks in del_chunks to the document doc (another
list of text chunks) with marker to show it is a delete.
cleanup_delete later resolves these markers into