/usr/lib64/python2.6/multiprocessing
Edit: /usr/lib64/python2.6/multiprocessing/pool.pyo (18172B)
Ñò
« gc
@ s5 d g Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k l Z l Z l Z d d k
l Z l Z d Z
d Z d Z e i ƒ Z d „ Z e f d „ Z d e f d
„ ƒ YZ d e f d „ ƒ YZ d
e f d „ ƒ YZ d e f d „ ƒ YZ d e f d „ ƒ YZ d e f d „ ƒ YZ d S( t PooliÿÿÿÿN( t Processt cpu_countt TimeoutError( t Finalizet debugi i i c C s
t | ΠS( N( t map( t args( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyt mapstar& s c
C s | i } | i } t | d ƒ o | i i ƒ | i i ƒ n | d j o | | Œ n x¸ y
| ƒ } Wn$ t t f j
o t d ƒ Pn X| d j o t d ƒ Pn | \ } } } }
} y t
| |
| Ž f } Wn! t j
o }
t |
f } n X| | | | f ƒ q^ d S( Nt _writers) worker got EOFError or IOError -- exitings worker got sentinel -- exiting(
t putt gett hasattrR t closet _readert Nonet EOFErrort IOErrorR t Truet Exceptiont False( t inqueuet outqueuet initializert initargsR
R t taskt jobt it funcR t kwdst resultt e( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyt worker- s,
c B sò e Z d Z e Z d d d d „ Z d „ Z d h d „ Z d d „ Z d d „ Z d d „ Z
d h d d „ Z d d d „ Z e
d
„ ƒ Z e
d „ ƒ Z e
d „ ƒ Z d
„ Z d „ Z d „ Z d „ Z e
d „ ƒ Z e d „ ƒ Z RS( sH
Class which supports an async version of the `apply()` builtin
c C sé | i ƒ t i ƒ | _ h | _ t | _ | d j o- y
t ƒ } Wqe t j
o
d } qe Xn g | _ xy t
| ƒ D]k } | i d t d | i
| i | | f ƒ } | i i | ƒ | i i d d ƒ | _ t | _ | i ƒ q{ Wt i d t i d | i | i | i | i f ƒ | _ t | i _ t | i _ | i i ƒ t i d t i d | i | i | i f ƒ | _ t | i _ t | i _ | i i ƒ t | | i d | i | i
| i | i | i | i | i f d d ƒ| _ d S( Ni t targetR R t
PoolWorkert exitpriorityi (! t
_setup_queuest Queuet
_taskqueuet _cachet RUNt _stateR R t NotImplementedErrort _poolt rangeR R t _inqueuet _outqueuet appendt namet replaceR t daemont startt threadingt ThreadR t
_handle_taskst
_quick_putt
_task_handlert _handle_resultst
_quick_gett _result_handlerR t _terminate_poolt
_terminate( t selft processesR R R t w( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyt __init__S sH
$
c C sP d d k l } | ƒ | _ | ƒ | _ | i i i | _ | i i i | _ d S( Ni ( t SimpleQueue(
t queuesRB R- R. R t sendR7 R t recvR: ( R> RB ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyR$ s
c C s | i | | | ƒ i ƒ S( s1
Equivalent of `apply()` builtin
( t apply_asyncR ( R> R R R ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyt applyˆ s c C s | i | | | ƒ i ƒ S( s/
Equivalent of `map()` builtin
( t map_asyncR ( R> R t iterablet chunksize( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyR s i c s¸ | d j oF t | i ƒ ‰ | i i ‡ ‡ f d † t | ƒ Dƒ ˆ i f ƒ ˆ St i ˆ | | ƒ } t | i ƒ ‰ | i i ‡ f d † t | ƒ Dƒ ˆ i f ƒ d „ ˆ Dƒ Sd S( sZ
Equivalent of `itertools.imap()` -- can be MUCH slower than `Pool.map()`
i c 3 s4 x- | ]& \ } } ˆ i | ˆ | f h f Vq Wd S( N( t _job( t .0R t x( R R ( s, /usr/lib64/python2.6/multiprocessing/pool.pys
s c 3 s4 x- | ]& \ } } ˆ i | t | f h f Vq Wd S( N( RK R ( RL R RM ( R ( s, /usr/lib64/python2.6/multiprocessing/pool.pys ¤ s c s s* x# | ] } x | D] } | Vq Wq Wd S( N( ( RL t chunkt item( ( s, /usr/lib64/python2.6/multiprocessing/pool.pys ¦ s N( t IMapIteratorR' R& R
t enumeratet _set_lengthR t
_get_tasks( R> R RI RJ t task_batches( ( R R s, /usr/lib64/python2.6/multiprocessing/pool.pyt imap– s
c s¸ | d j oF t | i ƒ ‰ | i i ‡ ‡ f d † t | ƒ Dƒ ˆ i f ƒ ˆ St i ˆ | | ƒ } t | i ƒ ‰ | i i ‡ f d † t | ƒ Dƒ ˆ i f ƒ d „ ˆ Dƒ Sd S( sK
Like `imap()` method but ordering of results is arbitrary
i c 3 s4 x- | ]& \ } } ˆ i | ˆ | f h f Vq Wd S( N( RK ( RL R RM ( R R ( s, /usr/lib64/python2.6/multiprocessing/pool.pys ¯ s c 3 s4 x- | ]& \ } } ˆ i | t | f h f Vq Wd S( N( RK R ( RL R RM ( R ( s, /usr/lib64/python2.6/multiprocessing/pool.pys ¶ s c s s* x# | ] } x | D] } | Vq Wq Wd S( N( ( RL RN RO ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pys ¸ s N( t IMapUnorderedIteratorR' R& R
RQ RR R RS ( R> R RI RJ RT ( ( R R s, /usr/lib64/python2.6/multiprocessing/pool.pyt imap_unordered¨ s
c C sA t | i | ƒ } | i i | i d | | | f g d f ƒ | S( s>
Asynchronous equivalent of `apply()` builtin
N( t ApplyResultR' R& R
RK R ( R> R R R t callbackR ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyRF º s +c sÑ t | d ƒ p t | ƒ } n | d j oA t t | ƒ t | i ƒ d ƒ \ } } | o | d 7} qn n t i | | | ƒ } t | i | t | ƒ | ƒ ‰ | i
i ‡ f d † t | ƒ Dƒ d f ƒ ˆ S( s<
Asynchronous equivalent of `map()` builtin
t __len__i i c 3 s4 x- | ]& \ } } ˆ i | t | f h f Vq Wd S( N( RK R ( RL R RM ( R ( s, /usr/lib64/python2.6/multiprocessing/pool.pys Ò s N(
R t listR t divmodt lenR+ R RS t MapResultR' R& R
RQ ( R> R RI RJ RY t extraRT ( ( R s, /usr/lib64/python2.6/multiprocessing/pool.pyRH Ã s
( c
C s9 t i ƒ } x¼ t | i d ƒ D]ž \ } } d } xˆ t | ƒ D]T \ } } | i o t d ƒ Pn y | | ƒ Wq> t j
o t d ƒ Pq> Xq> W| o t d ƒ | | d ƒ q q Pq Wt d ƒ y@ t d ƒ | i d ƒ t d ƒ x | D] } | d ƒ qö WWn t j
o t d ƒ n Xt d
ƒ d S( Niÿÿÿÿs' task handler found thread._state != RUNs could not put task on queues doing set_length()i s task handler got sentinels/ task handler sending sentinel to result handlers( task handler sending sentinel to workerss/ task handler got IOError when sending sentinelss task handler exiting(
R4 t current_threadt iterR R RQ R) R R R
(
t taskqueueR
R t poolt threadt taskseqt
set_lengthR R t p( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyR6 Ö s<
c C sô t i ƒ } x© y
| ƒ } Wn$ t t f j
o t d ƒ d SX| i o t d ƒ Pn | d j o t d ƒ Pn | \ } } } y | | i | | ƒ Wq t j
o q Xq x« | o£ | i t j o“ y
| ƒ } Wn$ t t f j
o t d ƒ d SX| d j o t d ƒ q» n | \ } } } y | | i | | ƒ Wq» t j
o q» Xq» Wt
| d ƒ oa t d ƒ y7 x0 t d ƒ D]" } | i i
ƒ p Pn | ƒ qWWq×t t f j
o q×Xn t d t | ƒ | i ƒ d S( Ns. result handler got EOFError/IOError -- exitings, result handler found thread._state=TERMINATEs result handler got sentinels& result handler ignoring extra sentinelR s" ensuring that outqueue is not fulli
s7 result handler exiting: len(cache)=%s, thread._state=%s( R4 R` R R R R) R t _sett KeyErrort TERMINATER R, R t pollR] ( R R t cacheRd R R R t obj( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyR9 ý sZ
c c sE t | ƒ } x2 t t i | | ƒ ƒ } | p d S| | f Vq d S( N( Ra t tuplet itertoolst islice( R t itt sizeRM ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyRS 7 s c C s t d ƒ ‚ d S( Ns: pool objects cannot be passed between processes or pickled( R* ( R> ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyt
__reduce__@ s c C s; t d ƒ | i t j o t | _ | i i d ƒ n d S( Ns closing pool( R R) R( t CLOSER& R
R ( R> ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyR
E s
c C s! t d ƒ t | _ | i ƒ d S( Ns terminating pool( R Rj R) R= ( R> ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyt terminateK s
c C sF t d ƒ | i i ƒ | i i ƒ x | i D] } | i ƒ q. Wd S( Ns joining pool( R R8 t joinR; R+ ( R> Rg ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyRv P s
c C sZ t d ƒ | i i ƒ x< | i ƒ o. | i i ƒ o | i i ƒ t i d ƒ q Wd S( Ns7 removing tasks from inqueue until task handler finishedi ( R t _rlockt acquiret is_aliveR Rk RE t timet sleep( R t task_handlerRr ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyt _help_stuff_finishX s
c C s t d ƒ t | _ | i d ƒ t d ƒ | i | | t | ƒ ƒ t | _ | i d ƒ | o= t | d d ƒ o) t d ƒ x | D] } | i ƒ q… Wn t d ƒ | i d ƒ t d ƒ | i d ƒ | o= t | d d ƒ o) t d ƒ x | D] } | i ƒ q÷ Wn d S(
Ns finalizing pools& helping task handler/workers to finishi Ru s terminating workerss joining task handlerg}Ô%I²Ts joining result handlers joining pool workers(
R Rj R) R
R R} R] R Ru Rv ( t clsRb R R Rc R| t result_handlerRl Rg ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyR< a s*
N( ( ( ( t __name__t
__module__t __doc__R R RA R$ RG R RU RW RF RH t staticmethodR6 R9 RS Rs R
Ru Rv R} t classmethodR< ( ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyR M s& . ': RX c B sD e Z d „ Z d „ Z d „ Z d d „ Z d d „ Z d „ Z RS( c C sS t i t i ƒ ƒ | _ t i ƒ | _ | | _ t | _ | | _
| | | i Rl RY ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyRA ˆ s c C s | i S( N( RŠ ( R> ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyt ready s c C s | i S( N( t _success( R> ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyt
successful“ s c C sD | i i ƒ z" | i p | i i | ƒ n Wd | i i ƒ Xd S( N( R‡ Rx RŠ t waitt release( R> t timeout( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyR — s
c C s@ | i | ƒ | i p
t ‚ n | i o | i S| i ‚ d S( N( R RŠ R R t _value( R> R‘ ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyR Ÿ s
c C sƒ | \ | _ | _ | i o | i o | i | i ƒ n | i i ƒ z t | _ | i i ƒ Wd | i i ƒ X| i | i
=d S( N( R R’ R‹ R‡ Rx R RŠ t notifyR R' RK ( R> R Rm ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyRh ¨ s
N( R€ R RA RŒ RŽ R R R Rh ( ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyRX † s R^ c B s e Z d „ Z d „ Z RS( c C sw t i | | | ƒ t | _ d g | | _ | | _ | d j o d | _ t | _ n | | t | | ƒ | _ d S( Ni (
RX RA R R R R’ t
_chunksizet _number_leftRŠ t bool( R> Rl RJ t lengthRY ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyRA º s
c C s | \ } } | o¬ | | i | | i | d | i +| i d 8_ | i d j og | i o | i | i ƒ n | i | i =| i i ƒ z t | _ | i i
ƒ Wd | i i ƒ XqnX t | _
| | _ | i | i =| i i ƒ z t | _ | i i
ƒ Wd | i i ƒ Xd S( Ni i ( R’ R” R• R‹ R' RK R‡ Rx R RŠ R“ R R R ( R> R t success_resultt successR ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyRh Å s* "
( R€ R RA Rh ( ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyR^ ¸ s RP c B s> e Z d „ Z d „ Z d d „ Z e Z d „ Z d „ Z RS( c C sk t i t i ƒ ƒ | _ t i ƒ | _ | | _ t i ƒ | _
d | _ d | _
h | _ | | | i Rl ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyRA æ s c C s | S( N( ( R> ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyt __iter__ð s c C sæ | i i ƒ z¦ y | i i ƒ } WnŒ t j
o€ | i | i j o
t ‚ n | i i | ƒ y | i i ƒ } Wq² t j
o* | i | i j o
t ‚ n t ‚ q² Xn XWd | i i
ƒ X| \ } } | o | S| ‚ d S( N( R‡ Rx Rœ t popleftt
IndexErrorR Rž t
StopIterationR R R ( R> R‘ RO R™ t value( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyR‰ ó s&
c C sæ | i i ƒ zÄ | i | j o | i i | ƒ | i d 7_ xL | i | i j o8 | i i | i ƒ } | i i | ƒ | i d 7_ qB W| i i ƒ n | | i | <| i | i j o | i | i
=n Wd | i i ƒ Xd S( Ni ( R‡ Rx R Rœ R/ RŸ t popR“ Rž R' RK R ( R> R Rm ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyRh s
c C s` | i i ƒ z> | | _ | i | i j o | i i ƒ | i | i =n Wd | i i ƒ Xd S( N( R‡ Rx Rž R R“ R' RK R ( R> R— ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyRR s
N( R€ R RA R R R‰ t __next__Rh RR ( ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyRP ä s
RV c B s e Z d „ Z RS( c C sv | i i ƒ zT | i i | ƒ | i d 7_ | i i ƒ | i | i j o | i | i =n Wd | i i ƒ Xd S( Ni (
R‡ Rx Rœ R/ R R“ Rž R' RK R ( R> R Rm ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyRh / s
( R€ R Rh ( ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyRV - s t
ThreadPoolc B sB e Z d d k l Z d d d d „ Z d „ Z e d „ ƒ Z RS( i ( R c C s t i | | | | ƒ d S( N( R RA ( R> R? R R ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyRA B s c C s@ t i ƒ | _ t i ƒ | _ | i i | _ | i i | _ d S( N( R% R- R. R
R7 R R: ( R> ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyR$ E s c C sW | i i ƒ z5 | i i ƒ | i i d g | ƒ | i i ƒ Wd | i i ƒ Xd S( N( t not_emptyRx t queuet cleart extendR t
notify_allR ( R R| Rr ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyR} K s
N( ( R€ R t dummyR R RA R$ Rƒ R} ( ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyR§ > s ( t __all__R4 R% Ro Rš Rz t multiprocessingR R R t multiprocessing.utilR R R( Rt Rj t countRˆ R R R t objectR RX R^ RP RV R§ ( ( ( s, /usr/lib64/python2.6/multiprocessing/pool.pyt s( ÿ :2,I