/usr/lib/python2.6/site-packages/boto
Edit: /usr/lib/python2.6/site-packages/boto/connection.pyo (38430B)
P5Tc & @ s d Z d d k l Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z
d d k Z d d k l
Z
d d k l Z d d k Z d d k Z d d k Z d d k Z d d k l Z l Z d d k l Z l Z l Z l Z l Z d d k l Z d d k l Z d d
k l Z d d k l Z d d k l Z d d
k! l" Z" e# Z$ y: d d k% Z% d d k l& Z& e' e% d o
e( Z$ n Wn e) j
o n Xy d d k* Z* Wn e) j
o d d k+ Z* n Xe, d d d d f D Z- h d e( 6d e# 6Z. e i/ i0 e i/ i1 e i/ i2 e i3 i4 d Z5 d e6 f d YZ7 d e6 f d YZ8 d e6 f d YZ9 d e i: f d YZ: d e6 f d YZ; d! e; f d" YZ< d S(# s"
Handles basic connections to AWS
i( t datetimeN( t auth( t auth_handler( t configt UserAgent( t sixt http_clientt urlparset quotet encodebytes( t AWSConnectionError( t BotoClientError( t BotoServerError( t PleaseRetryException( t Provider( t ResultSet( t https_connectiont SSLErrorc c s" x | ] } | t i j Vq Wd S( N( t ost environ( t .0t key( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pys
W s t
USER_IS_ADMINt CURRENT_VERSION_IDt APPLICATION_IDi iP s cacerts.txtt HostConnectionPoolc B sM e Z d Z d Z d Z d Z d Z d Z d Z d Z RS( s
A pool of connections for one remote (host,port,is_secure).
When connections are added to the pool, they are put into a
pending queue. The _mexe method returns connections to the pool
before the response body has been read, so they connections aren't
ready to send another request yet. They stay in the pending queue
until they are ready for another request, at which point they are
returned to the pool of ready connections.
The pool of ready connections is an ordered list of
(connection,time) pairs, where the time is the time the connection
was returned from _mexe. After a certain period of time,
connections are considered stale, and discarded rather than being
reused. This saves having to wait for the connection to time out
if AWS has decided to close it on the other end because of
inactivity.
Thread Safety:
This class is used only from ConnectionPool while it's mutex
is held.
c C s
g | _ d S( N( t queue( t self( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt __init__z s c C s
t | i S( s
Returns the number of connections in the pool for this host.
Some of the connections may still be in use, and may not be
ready to be returned by get().
( t lenR ( R ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt size} s c C s | i i | t i f d S( sZ
Adds a connection to the pool, along with the time it was
added.
N( R t appendt time( R t conn( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt put s c C sh | i xW t t | i D]@ } | i i d \ } } | i | o | S| i | q Wd S( s
Returns the next connection in this pool that is ready to be
reused. Returns None if there aren't any.
i N( t cleant rangeR R t popt _conn_readyR" t None( R t _R! ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt get s
c C s9 t o t St | d d } | d j p
| i Sd S( sZ
There is a nice state diagram at the top of http_client.py. It
indicates that once the response headers have been read (which
_mexe does before adding the connection to the pool), a
response is attached to the connection, and it stays there
until it's done reading. This isn't entirely true: even after
the client is done reading, the response may be closed, but
not removed from the connection yet.
This is ugly, reading a private instance variable, but the
state we care about isn't available in any public methods.
t _HTTPConnection__responseN( t
ON_APP_ENGINEt Falset getattrR' t isclosed( R R! t response( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyR& s
c C sI xB t | i d j o+ | i | i d o | i i d q Wd S( s/
Get rid of stale connections.
i N( R R t _pair_staleR% ( R ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyR# s -c C s) | \ } } t i } | t i | j S( s[
Returns true of the (connection,time) pair is too old to be
used.
( R t ConnectionPoolt STALE_DURATION( R t pairt _connt return_timet now( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyR0 s (
t __name__t
__module__t __doc__R R R" R) R& R# R0 ( ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyR ` s R1 c B sY e Z d Z d Z d Z d Z d Z d Z d Z d Z d Z
d Z RS(
s
A connection pool that expires connections after a fixed period of
time. This saves time spent waiting for a connection that AWS has
timed out on the other end.
This class is thread-safe.
g @g N@c C s@ h | _ d | _ t i | _ t i d d t i t _ d S( Ng t Botot connection_stale_duration( t host_to_poolt last_clean_timet threadingt Lockt mutexR t getfloatR1 R2 ( R ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyR s
c C s' t i | i } h | d <| d =| S( NR< R@ ( t copyt __dict__( R t pickled_dict( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt __getstate__ s
c C s | i d S( N( R ( R t dct( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt __setstate__ s c C s t d | i i D S( s@
Returns the number of connections in the pool.
c s s x | ] } | i Vq Wd S( N( R ( R t pool( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pys s ( t sumR< t values( R ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyR s c C s^ | i | i i i z9 | | | f } | | i j o d S| i | i SWd QXd S( s
Gets a connection from the pool for the named host. Returns
None if there is no connection that can be reused. It's the caller's
responsibility to call close() on the connection when it's no longer
needed.
N( R# R@ t __exit__t __enter__R< R' R) ( R t hostt portt is_secureR ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt get_http_connection s
c C sf | i i i zK | | | f } | | i j o t | i | | d d j o- | i d j o | i | _ | i d =n
| | _ | | _
d S( sy Represents an HTTP request.
:type method: string
:param method: The HTTP method name, 'GET', 'POST', 'PUT' etc.
:type protocol: string
:param protocol: The http protocol used, 'http' or 'https'.
:type host: string
:param host: Host to which the request is addressed. eg. abc.com
:type port: int
:param port: port on which the request is being sent. Zero means unset,
in which case default port will be chosen.
:type path: string
:param path: URL path that is being accessed.
:type auth_path: string
:param path: The part of the URL path used when creating the
authentication string.
:type params: dict
:param params: HTTP url query parameters, with key as name of
the param, and value as value of param.
:type headers: dict
:param headers: HTTP headers, with key as name of the header and value
as value of header.
:type body: string
:param body: Body of the HTTP request. If not present, will be None or
empty string ('').
s Transfer-Encodingt chunkedt PUTN( t methodt protocolRM RN t pathR' t auth_patht paramsRB t headerst body(
R RX RY RM RN RZ R[ R\ R] R^ ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyR 1 s $
c C s8 d | i | i | i | i | i | i | i | i f S( NsT method:(%s) protocol:(%s) host(%s) port(%s) path(%s) params(%s) headers(%s) body(%s)( RX RY RM RN RZ R\ R] R^ ( R ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt __str__h s c K s t | d t pq xZ | i D]O } | i | } t | t i o) d } t | i d | | i | ?@[\]^`{|}~s utf-8s
User-Agents Content-Lengths Transfer-EncodingRV ( R- R, R] t
isinstanceR t text_typeR t encodet setattrt TrueR t
_auth_handlert add_authR R^ ( R t
connectiont kwargsR t valt safe( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt authorizen s
'
( R7 R8 R R_ Rl ( ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyRU / s 7 t HTTPResponsec B s e Z d Z d d Z RS( c O s# t i i | | | d | _ d S( Nt ( R Rm R t _cached_response( R t argsRi ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyR s c C sO | d j o+ | i p t i i | | _ n | i St i i | | Sd S( s< Read the response.
This method does not have the same behavior as
http_client.HTTPResponse.read. Instead, if this method is called with
no ``amt`` arg, then the response body will be cached. Subsequent
calls to ``read()`` with no args **will return the cached response**.
N( R' Ro R Rm t read( R t amt( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyRq s
N( R7 R8 R R' Rq ( ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyRm s t AWSAuthConnectionc B s e Z d d e d d d d d d d d d d e e d d Z d Z d Z d Z d Z e e e Z
d Z d Z e e e Z
d
Z e e Z d Z e e Z e Z e Z d Z e e Z e Z e Z d
Z e e Z d d Z d d Z d Z d Z d Z d Z d Z d d d Z d d Z d Z d Z d Z! d Z" d d d d Z# d d d d d Z$ d d d d d d d d d Z% d Z& RS(! i t /t awsc C s` | | _ d | _ t i d d o t i d d } n | | _ t i d d | | _ | i o t o t d n t i
d d t } | d j o
d } n | | _
| o
| | _ n t | | _ | i | | | | t i t i t i t i f | _ g | _ t o | i i t i n t i f | _ | d j o$ | d | _ | i | d 7_ n
d | _ | o
d
| _ n
d | _ | | _! | | _" t# |
t$ i% p
d }
n t i& d d |
| _' d | _( h | _) t* i+ d t* i+ d f d j o t i& d d d | i) d s c C s g S( N( ( R ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyR A s c C s t | i d S( Nt service_name( R- Rf ( R ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt _get_auth_service_nameD s c C s | | i _ d S( N( Rf R ( R t value( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt _set_auth_service_nameJ s c C s t | i d S( Nt region_name( R- Rf ( R ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt _get_auth_region_nameN s c C s | | i _ d S( N( Rf R ( R R ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt _set_auth_region_nameQ s c C s | i | i S( N( RP R ( R ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyRh U s c C s
| i i S( N( R t
access_key( R ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyR Y s c C s
| i i S( N( R t
secret_key( R ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyR _ s c C s
| i i S( N( R R ( R ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyR e s c C s& | i p | i t i d d | S| i d } | d j o | | } | | } n d } | d d j o
t } n t } | i i d } | i | i d g } | D] } | o | | q q ~ } d d i
| } | d d j o | o | d 7} n | o | | } n | S( Ns ^(/*)/s \1t ?i iRt ( R RZ t ret subt findR' Re R, t splitt extendt join( R RZ t posR\ t
need_trailingt
path_elementst _[1]t p( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt get_pathi s&
,c C s | p
| i } n | d j o
| i } n] t o t i d d j p t i d d j o | d j o
| i } n d | i | f } | S( NiP i s 2.5s 2.6s 2.7i s %s:%d( s 2.6s 2.7( RN RM R+ R t version( R RN t signature_host( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt server_name s
!
c C s | | _ | | _ | | _ | | _ d t i j o | i o| t i d } | i t i d } | oL | i d | _ | i d | _ | i d | _ | i d | _ qSn | i p t
i d d d | _ n | i p t
i d d d | _ n | i p t
i d d
d | _ n | i p t
i d d d | _ n | i o | i o d GH| i
| _ n t i i d
d p t i i d d | _ | i d j | _ d S( Nt
http_proxysX (?:http://)?(?:(?P[\w\-\.]+):(?P.*)@)?(?P[\w\-\.]+)(?::(?P\d+))?RM RN t usert passR: R R R R sF http_proxy environment variable does not specify a port, using defaultt no_proxyRn t NO_PROXY( R R R R R R R t compilet matcht groupR R R' RN R) R t use_proxy( R R R R R t patternR ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyR s4
.c C sA | i i | | | } | d j o | S| i | | | Sd S( N( R RP R' t new_http_connection( R RM RN RO R! ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyRP s
c C s | i p t S| i d j o t S| } | i d d } xF | i i d D]2 } | o% | i | p | i | o t SqP Wt S( Nt *t :i t ,( R R, Re R t endswith( R RM t hostonlyt name( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt
skip_proxy s
' c C s | d j o | i } n | i d d d } | i i } | | d <| i o9 | o1 | i | o | i } t | i | d |
\ } } } | o t i i | n t' i( | wIq7n | i) d. j o^ d | i) } | d | 7} t i i | | i* } t | t o | i+ d } qnq| i) d j p | i) d j p | ou | i% d } | d! j o |
i, n | i- | i | i | i |
| i. d- j o | i. i/ | | n | St0 | \ } | _ | _ } } } | o | i d" | 7_ n d# | i j o% | i i1 d# d$ \ | _ | _ n d% | d& } | | i | i 7} t i i | | i | i | i | d' j }
d- } wIWn t2 j
oD } t i i d( | | i3 | i | i | i }
| i4 } n | i5 j
o } xB | i6 D]7 } t | | o! t i i d) | i7 i8 qqWt i i d* | i7 i8 | i3 | i | i | i }
n Xt' i( | | d$ 7} qIW| i. d- j o | i. i/ | | d+ t9 n | o t: | i) | i; | n! | o n d, } t< | d- S(/ s>
mexe - Multi-execute inside a loop, retrying multiple times to handle
transient Internet errors by simply trying again.
Also handles redirects.
This code was inspired by the S3Utils classes posted to the boto-users
Google group by Larry Bates. Thanks!
s
Method: %ss Path: %ss Data: %ss Headers: %ss Host: %ss Port: %ss
Params: %sR: R i Rc s utf-8i t max_retry_delayi< s Token: %sRh t s3t anons Final headers: %ss Response headers: %st locationt HEADRV i i i i s Received %d response. s Retrying in %3.1f secondsi, i R R R i s Redirecting: %ss ://Ry s! encountered a retry exception: %ss0 encountered unretryable %s exception, re-raisings& encountered %s exception, reconnectingR s- Please report this exception as a Boto Issue!N( i i i i (= R R R{ RX RZ R^ R] RM RN R\ R' R R R RP RO Ra t bytesR Rc t mint randomR) R R Rl R R- R, R R R6 t
start_timet callableR t getresponset
getheaderst getheaderRV R t sleepR Rq t decodeR RQ R t handle_request_dataR R R
R R/ R R R R7 Re R R R ( R R t sendert override_num_retriest
retry_handlerR/ R^ t eR t iRh t
next_sleepR R R t conn_header_valuet schemeR\ t queryt fragmentt unretryable( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt _mexev s
$%
Rn c
C sF | i | } | d j o | i | } n | d j o
h } n
| i } | d j o
h } n
| i } | i o( t i i d | o | i | d R/ R^ t rsR ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt get_list s$
c C sA | p
| } n | i | | | | } | i } t i i | | p3 t i i d | | i | i | i | n | i d j o_ | | } t i i
| | }
t | t i
o | i d } n t i i | |
| St i i d | i | i f t i i d | | i | i | i | d S( Ns Null body %si s utf-8s %s %ss %s( R1 Rq R R R{ R RI R R RJ RK Ra R Rb Rc RL RM RN ( R R= R\ t clsRZ RP R> R/ R^ t objR ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt
get_object s$
c
C s | p
| } n | i | | | | } | i } t i i | | p3 t i i d | | i | i | i | n | i d j o9 t } t i
i | | } t i
i | | | i St i i d | i | i f t i i d | | i | i | i | d S( Ns Null body %si s %s %ss %s( R1 Rq R R R{ R RI R R R RJ RK RL RM RN (
R R= R\ RZ RP R> R/ R^ RQ R ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt
get_status s
N( R7 R8 R< R RI R' Re R R R8 R1 RA RH RR RU RV ( ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyR6 6 s"
*(= R9 R R R R R R R R t xml.saxRL RB R R R t
boto.utilst boto.handlert boto.cacertsR R t boto.compatR R R R R t boto.exceptionR
R R R
t
boto.providerR t boto.resultsetR R, R R R R Re t ImportErrorR> t dummy_threadingt allR+ R RZ R t dirnamet abspatht cacertst __file__R t objectR R1 RU Rm Rs R6 ( ( ( s3 /usr/lib/python2.6/site-packages/boto/connection.pyt , sb (
3jeT