/usr/lib/python2.6/site-packages/chardet
Edit: /usr/lib/python2.6/site-packages/chardet/universaldetector.pyc (4130B)
Ñò
á*ÎGc
@ s“ d d k Z d d k Z d d k l Z d d k l Z d d k l Z d d k l Z d d k
Z
d Z d Z d Z
d Z d
d d „ ƒ YZ d S(
iÿÿÿÿN( t Latin1Prober( t MBCSGroupProber( t SBCSGroupProber( t EscCharSetProbergš™™™™™É?i i i t UniversalDetectorc B s, e Z d „ Z d „ Z d „ Z d „ Z RS( c C sD t i d ƒ | _ t i d ƒ | _ d | _ g | _ | i ƒ d S( Ns [\x80-\xFF]s (\033|~{)( t ret compilet _highBitDetectort _escDetectort Nonet _mEscCharSetProbert _mCharSetProberst reset( t self( ( s= /usr/lib/python2.6/site-packages/chardet/universaldetector.pyt __init__* s
c C sŠ h d d 6d d 6| _ t i | _ t i | _ t i | _ t | _ d | _
| i o | i i ƒ n x | i
D] } | i ƒ qr Wd S( Nt encodingg t
confidencet ( R t resultt constantst Falset donet Truet _mStartt _mGotDatat
ePureAsciit _mInputStatet
_mLastCharR
R R ( R
t prober( ( s= /usr/lib/python2.6/site-packages/chardet/universaldetector.pyR 1 s
c C sE | i o d St | ƒ } | p d S| i p8| d d j o h d d 6d d 6| _ qi| d d j o h d d 6d d 6| _ qi| d d
j o h d d 6d d 6| _ qi| d d j o h d
d 6d d 6| _ qi| d d j o h d d 6d d 6| _ qi| d d j o h d d 6d d 6| _ qi| d d j o h d d 6d d 6| _ qin t i | _ | i d o% | i d d j o t i | _ d S| i t j o[ | i i | ƒ o
t
| _ q| i t j o' | i i | i | ƒ o
t
| _ qn | d | _ | i t
j os | i p t ƒ | _ n | i i | ƒ t i j o9 h | i i ƒ d 6| i i ƒ d 6| _ t i | _ qAnŸ | i t
j oŽ | i p t ƒ t ƒ t ƒ g | _ n xb | i D]S } | i | ƒ t i j o4 h | i ƒ d 6| i ƒ d 6| _ t i | _ PqæqæWn d S( Ni s s UTF-8R g ð?R i s ÿþ s UTF-32LEt þÿs UTF-32BEs þÿ s X-ISO-10646-UCS-4-3412t ÿþs X-ISO-10646-UCS-4-2143i s ÿþs UTF-16LEs þÿs UTF-16BEg iÿÿÿÿ( R t lenR R R R R R R t searcht eHighbyteR R t eEscAsciiR
R t feedt eFoundItt get_charset_namet get_confidenceR R R R ( R
t aBuft aLenR ( ( s= /usr/lib/python2.6/site-packages/chardet/universaldetector.pyR# = s^
"
*
c C s˜ | i o d S| i p# t i o t i i d ƒ n d St i | _ | i t j o h d d 6d d 6| _
| i
S| i t j o d } d } d } xH | i
D]= } | p q£ n | i ƒ } | | j o | } | } q£ q£ W| o8 | t j o+ h | i ƒ d 6| i ƒ d 6| _
| i
Sn t i oc t i i d ƒ xP | i
d i D]: } | p qRn t i i d | i ƒ | i ƒ f ƒ qRWn d S(
Ns no data received!
t asciiR g ð?R g s" no probers hit minimum threshhold
i s %s confidence = %s
( R R R t _debugt syst stderrt writeR R R R R! R R R& t MINIMUM_THRESHOLDR% t mProbers( R
t proberConfidencet maxProberConfidencet maxProberR ( ( s= /usr/lib/python2.6/site-packages/chardet/universaldetector.pyt closey sF
( t __name__t
__module__R R R# R3 ( ( ( s= /usr/lib/python2.6/site-packages/chardet/universaldetector.pyR ) s <( ( R R+ t latin1proberR t mbcsgroupproberR t sbcsgroupproberR t escproberR R R. R R" R! R ( ( ( s= /usr/lib/python2.6/site-packages/chardet/universaldetector.pyt
s