/usr/lib/python2.6/site-packages/boto
Edit: /usr/lib/python2.6/site-packages/boto/utils.pyo (34695B)
P5Tc 6 @ s d Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k
Z
d d k Z d d k Z
d d k Z
d d k Z
d d k Z
d d k Z
d d k Z d d k Z d d k Z d d k l Z l Z l Z l Z d d k l Z d d k l Z l Z e Z d d k l Z y d d k! l" Z" Wn e# j
o
e$ Z" n Xd d d
d d d
d d d d d d d d d d d d d d d d d d d d! d" d# g Z% e i& d$ Z' e i& d% Z( e i& d& Z) d' Z* d d d( Z, d d) Z- d d* Z. e/ d+ d d, Z0 d d- Z1 d. e2 f d/ YZ3 d0 Z4 d1 d2 d3 d d4 d5 Z5 d1 d2 d d4 d6 Z6 d1 d d2 d d4 d7 Z7 d8 Z8 d9 Z9 d: Z: e i; Z< e d; Z= d d< Z> d= Z? d d> Z@ d? ZA d d d d@ ZB dA eC f dB YZD dC e iE iF f dD YZG dE e2 f dF YZH dG eC f dH YZI d d d d e/ dI ZJ dJ ZK dK ZL dL ZM eN dM dN dO ZO dP ZP dQ d dR ZQ dQ d e dS ZR dT ZS dU ZT dV eC f dW YZU d S(X s7
Some handy utility functions used by several classes.
iN( t sixt StringIOt urllibt encodebytes( t contextmanager( t md5t sha512( t json( t JSONDecodeErrort aclt corst defaultObjectAclt locationt loggingt
partNumbert policyt requestPaymentt torrentt
versioningt versionIdt versionst websitet uploadst uploadIds response-content-types response-content-languages response-expiress response-cache-controls response-content-dispositions response-content-encodingt deletet lifecyclet taggingt restoret storageClasst
websiteConfigt composes (.)([A-Z][a-z]+)s ([a-z])([0-9]+)s ([a-z0-9])([A-Z])c C s: t | d j o | S| d t i i | d f Sd S( Ni i ( t lenR t parset unquote( t nv( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt unquote_vd s c
C s | p t i i } n h } xi | D]a } | i } | | d j o> | d j p | i | i o t | | i | |
s N( s content-md5s content-typeR$ ( t botot providert get_defaultt lowert Nonet
startswitht
header_prefixt strt stript date_headert sortedt keyst splitR t qsa_of_interestR# t sortt join( t methodt patht headerst expiresR- t interesting_headersR) t lkt sorted_header_keyst buft valt tt qsat _[1]t at _[2]t _[3]( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt canonical_stringk sL
"
-<*
c C s | p t i i } n | i } | i } xW | i D]I } | i t i i i i
j o | | | | t metadataR- RL t
final_headerst k( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt
merge_meta s
c C s | p t i i } n | i } h } x | i D] } | i i | or t i i | | } t
| t o- y | i d } Wq t
j
o q Xn | | | t | <| | =q6 q6 W| S( Ns utf-8( R, R- R. RL R7 R/ R1 R R R! t
isinstancet bytest decodet UnicodeDecodeErrorR ( R> R- RL RQ t hkeyRD ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt get_aws_metadata s
i
c C sm xVt d | D]E} y t i i h } t i i | } t i i | } | i | d | } | i } t | t i
o# t | d o | i d } n | SWnU t i
i j
o/ }
|
i } | d j o
| o d Sn t j
o }
n Xt i i d | d | j o0 t i t d | t i i d
d d q q Wt i i
d
d S( s
Retry a url. This is specifically used for accessing the metadata
service on an instance. Since this address should never be proxied
(for security reasons), we create a ProxyHandler with a NULL
dictionary to override any proxy settings in the environment.
i t timeoutRW s utf-8i R% s& Caught exception reading instance datai i t Botot max_retry_delayi< s' Unable to read instance data, giving up( t rangeR t requestt ProxyHandlert build_openert Requestt opent readRU R t string_typest hasattrRW t errort HTTPErrort getcodet ExceptionR, t logt exceptiont timet sleept mint configt get( t urlt retry_on_404t num_retriesR[ t it
proxy_handlert openert reqt rt resultt et code( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt retry_url s0 $c C s t | | | S( N( t LazyLoadMetadata( Rr Rt R[ ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt _get_instance_metadata s R~ c B sV e Z d d Z d Z d Z d d Z d Z d Z d Z d Z
RS( c
C s | | _ | | _ h | _ g | _ | | _ t i i | i d | i d | i } | o | i d } x | D] } | i d o! | d d !} | i i
| nW | i d } | d j o# | | d } | d | !d } n | } } | | i | >> _build_instance_metadata_url('http://169.254.169.254', 'latest', 'meta-data/')
http://169.254.169.254/latest/meta-data/
:type url: string
:param url: URL to metadata service, e.g. 'http://169.254.169.254'
:type version: string
:param version: Version of the metadata to get, e.g. 'latest'
:type path: string
:param path: Path of the metadata to get, e.g. 'meta-data/'. If a trailing
slash is required it must be passed in with the path.
:return: The full metadata URL
s %s/%s/%s( ( Rr t versionR= ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt _build_instance_metadata_urlc s t latests http://169.254.169.254s
meta-data/i c C sM y, t | | | } t | d | d | SWn t i i j
o d SXd S( s
Returns the instance metadata as a nested Python dictionary.
Simple values (e.g. local_hostname, hostname, etc.) will be
stored as string values. Values such as ancestor-ami-ids will
be stored in the dict as a list of string values. More complex
fields such as public-keys and will be stored as nested dicts.
If the timeout is specified, the connection to the specified url
will time out after the specified number of seconds.
Rt R[ N( R R R Rg t URLErrorR0 ( R Rr R R[ Rt t metadata_url( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt get_instance_metadata{ s
c
C s h } t | | d } y t | d | d | } | i d } xk | D]c } t | d | d d | d | } | d d j o t i | } n | o | | | t t d i | d d ! | } q> W| SWn d SXd S( Ns %s.%st .i i i( R8 R0 t getattrt
__import__R; ( t module_namet
class_namet modulest ct m( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt
find_class s )c C s< d } | d 7} t i i | | | | | f } | i S( s=
Update your Dynamic DNS record with DNSMadeEasy.com
s, https://www.dnsmadeeasy.com/servlet/updateips$ ?username=%s&password=%s&id=%s&ip=%s( R R_ t urlopenRd ( t usernamet passwordt dme_idt
ip_addresst dme_urlt s( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt
update_dme s
"c
C sv t i i d | | d j o t i } n y| i d oi | t d i d d \ } } t i d | d | } | i
| } | i | } | i | n | od | o] t
i i } | i d | | | t
i i | }
t
i i |
} t
i i | n t
i i | } | i | i | i d Wn$ t i i d | d } n X| S(
s
Fetch a file based on the URI provided.
If you do not pass in a file pointer a tempfile.NamedTemporaryFile,
or None if the file could not be retrieved is returned.
The URI can be either an HTTP url, or "s3://bucket_name/key_name"
s Fetching %ss s3://R i t aws_access_key_idt aws_secret_access_keyi s Problem Retrieving file: %sN( R, Rk t infoR0 t tempfilet NamedTemporaryFileR1 R R8 t
connect_s3t
get_buckett get_keyt get_contents_to_fileR R_ t HTTPPasswordMgrWithDefaultRealmt add_passwordt HTTPBasicAuthHandlerRa t install_openerR t writeRd t seekRl (
t urit fileR R t bucket_namet key_nameR t bucketR) t passmant authhandlerRw R ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt
fetch_file s2
"
t ShellCommandc B sk e Z e e d d Z d d Z d Z d Z e e e d d Z
d Z e e e d d Z RS( c C sD d | _ | | _ t | _ | | _ | | _ | i d | d S( Ni t cwd( t exit_codet commandR t log_fpt waitt fail_fastt run( R R R R R ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR s c C s/ t i i d | i t i | i d t d t i d t i d t i d | | _ | i o x_ | i i
d j oH t i
d | i i } | i i | d | i i | d q` Wt i i | i i | i i | _ | i o2 | i d j o" t d | i d
| i n | i Sd S( Ns
running:%st shellt stdint stdoutt stderrR i i s Command s failed with status ( R, Rk R R t
subprocesst Popent Truet PIPEt processR t pollR0 Rm Rn t communicateR R t getvaluet
returncodeR R Rj ( R R RE ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR # s&
c C s
t d S( N( t AttributeError( R t value( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt setReadOnly9 s c C s | i S( N( R ( R ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt getStatus< s s The exit code for the commandc C s
| i i S( N( R R ( R ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt getOutputB s s* The STDIN and STDERR output of the commandN(
R R R R R0 R R R R
t propertyt statusR t output( ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR s t AuthSMTPHandlerc B s e Z d Z d Z d Z RS( s
This class extends the SMTPHandler in the standard Python logging module
to accept a username and password on the constructor and to then use those
credentials to authenticate with the SMTP server. To use this, you could
add something like this in your boto config file:
[handler_hand07]
class=boto.utils.AuthSMTPHandler
level=WARN
formatter=form07
args=('localhost', 'username', 'password', 'from@abc', ['user1@abc', 'user2@xyz'], 'Logger Subject')
c C s5 t t | i | | | | | | _ | | _ d S( s
Initialize the handler.
We have extended the constructor to accept a username/password
for SMTP authentication.
N( R R R R R ( R t mailhostR R t fromaddrt toaddrst subject( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR W s
c C s y | i } | p
t i } n t i | i | } | i | i | i | i | } d | i d i
| i | i | t
i i | f } | i | i | i | | i Wn/ t t f j
o
n | i | n Xd S( s
Emit a record.
Format the record and send it to the specified addressees.
It would be really nice if I could add authorization to this class
without having to resort to cut and paste inheritance but, no.
s- From: %s
To: %s
Subject: %s
Date: %s
%st ,N( t mailportt smtplibt SMTP_PORTt SMTPR t loginR R t formatR R; R t
getSubjectt emailR t
formatdatet sendmailt quitt KeyboardInterruptt
SystemExitt handleError( R t recordt portt smtpt msg( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt emitd s$
( R R t __doc__R R' ( ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR I s
t LRUCachec B s~ e Z d Z d e f d YZ d Z d Z d Z d Z d Z d Z
d Z d
Z d Z
d Z RS(
sq A dictionary-like object that stores only a certain number of items, and
discards its least recently used item when full.
>>> cache = LRUCache(3)
>>> cache['A'] = 0
>>> cache['B'] = 1
>>> cache['C'] = 2
>>> len(cache)
3
>>> cache['A']
0
Adding new items to the cache does not increase its size. Instead, the least
recently used item is dropped:
>>> cache['D'] = 3
>>> len(cache)
3
>>> 'B' in cache
False
Iterating over the cache returns the keys, starting with the most recently
used:
>>> for key in cache:
... print key
D
A
C
This code is based on the LRUCache class from Genshi which is based on
`Myghty `_'s LRUCache from ``myghtyutils.util``,
written by Mike Bayer and released under the MIT license (Genshi uses the
BSD License).
t _Itemc B s e Z d Z d Z RS( c C s& d | _ | _ | | _ | | _ d S( N( R0 t previoust nextR) R ( R R) R ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR s c C s
t | i S( N( t reprR ( R ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR s ( R R R R ( ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR* s c C s+ t | _ | | _ d | _ d | _ d S( N( t dictt _dictt capacityR0 t headt tail( R R0 ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR s c C s
| | i j S( N( R/ ( R R) ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt __contains__ s c c s- | i } x | o | i V| i } q Wd S( N( R1 R) R, ( R t cur( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt __iter__ s
c C s
t | i S( N( R R/ ( R ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt __len__ s c C s! | i | } | i | | i S( N( R/ t _update_itemR ( R R) t item( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR s
c C ss | i i | } | d j o0 | i | | } | | i | <| i | n! | | _ | i | | i d S( N( R/ Rq R0 R* t _insert_itemR R7 t _manage_size( R R) R R8 ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt __setitem__ s
c C s
t | i S( N( R- R/ ( R ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR s c C sU d | _ | i | _ | i d j o | | i _ n
| | _ | | _ | i d S( N( R0 R+ R1 R, R2 R: ( R R8 ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR9 s c C sw xp t | i | i j oV | i | i i =| i | i j o | i i | _ d | i _ q d | _ | _ q Wd S( N( R R/ R0 R2 R) R1 R+ R0 R, ( R ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR: s c C s | i | j o d S| i } | i | _ | i d j o | | i _ n
| | _ d | _ | i | _ | | i _ | _ d S( N( R1 R+ R, R0 R2 ( R R8 R+ ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR7 s ( R R R( t objectR* R R3 R5 R6 R R; R R9 R: R7 ( ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR) s $
t Passwordc B sG e Z d Z e Z d d d Z d Z d Z d Z d Z
RS( sp
Password object that stores itself as hashed.
Hash defaults to SHA512 if available, MD5 otherwise.
c C s! | | _ | o
| | _ n d S( sh
Load the string from an initial value, this should be the
raw hashed password.
N( R3 t hashfunc( R R3 R> ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR s c C s? t | t p | i d } n | i | i | _ d S( Ns utf-8( RU RV t encodeR> t hexdigestR3 ( R R ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt set s c C s
t | i S( N( R3 ( R ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR s c C s] | d j o t St | t p | i d } n t | i | i t | i j S( Ns utf-8( R0 R RU RV R? R3 R> R@ ( R t other( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt __eq__ s
c C s | i o t | i Sd Sd S( Ni ( R3 R ( R ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR6 s
N( R R R( t _hashfnR> R0 R RA R RC R6 ( ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR= s c
C s | p g } | o# d t i i d d | f } n | p t i i d d d } n | o-yt i i d d d } t i i i } | | d <| | d <| | d
'camel_case'
pythonize_name('already_pythonized') -> 'already_pythonized'
pythonize_name('HTTPRequest') -> 'http_request'
pythonize_name('HTTPStatus200Ok') -> 'http_status_200_ok'
pythonize_name('UPPER') -> 'upper'
pythonize_name('') -> ''
s \1_\2( t _first_cap_regext subt _number_cap_regext _end_cap_regexR/ ( R t s1t s2( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt pythonize_namek s
s
text/plaint :c C s; t i i i } x | D] \ } } t | | } | i d d \ } } | d j o t i i i | d | }
n6 t i i i | | }
|
i
| t i i |
|
i
d d d | | i |
q W| i } | oP t } t i d d d
| }
z |
i | Wd |
i X| i } n | S( s Description:
:param content: A list of tuples of name-content pairs. This is used
instead of a dict to ensure that scripts run in order
:type list of tuples:
:param compress: Use gzip to compress the scripts, defaults to no compression
:type bool:
:param deftype: The type that should be assumed if nothing else can be figured out
:type str:
:param delimiter: mime delimiter
:type str:
:return: Final mime multipart
:rtype: str:
R i RN t _subtypes Content-Dispositiont
attachmentt filenamet modet wbt fileobjN( R RW RX RY t guess_mime_typeR8 RN R[ R\ R] R^ R_ R` t
add_headerRZ Re R t gzipt GzipFileR t closeR ( t contentt compresst deftypet delimitert wrapperR t cont
definite_typet maintypet subtypet mime_cont rcontentRC t gz( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt write_mime_multipart} s*
c C sr h d d 6d d 6d d 6d d 6d d
6d d 6} | } x5 | i D]' \ } } | i | o | } PqC qC W| S(
s Description: Guess the mime type of a block of text
:param content: content we're finding the type of
:type str:
:param deftype: Default mime type
:type str:
:rtype: :
:return:
s text/x-include-urls #includes text/x-shellscripts #!s text/cloud-configs
#cloud-configs text/upstart-jobs #upstart-jobs text/part-handlers
#part-handlers text/cloud-boothooks #cloud-boothook( R R1 ( R R t starts_with_mappingst rtypet
possible_typet mimetype( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR s
i c C s t | | | d t S( s
Compute MD5 hash on passed file and return results in a tuple of values.
:type fp: file
:param fp: File pointer to the file to MD5 hash. The file pointer
will be reset to its current location before the
method returns.
:type buf_size: integer
:param buf_size: Number of bytes per read request.
:type size: int
:param size: (optional) The Maximum number of bytes to read from
the file pointer (fp). This is useful when uploading
a file in multiple parts where the file is being
split inplace into different parts. Less bytes may
be available.
:rtype: tuple
:return: A tuple containing the hex digest version of the MD5 hash
as the first element, the base64 encoded version of the
plain digest as the second element and the data size as
the third element.
t hash_algorithm( t compute_hashR ( t fpt buf_sizet size( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt compute_md5 s c
C s` | } | i } | o | | j o | i | } n | i | } x | o t | t p | i d } n | i | | o& | t | 8} | d j o Pq n | o | | j o | i | } qN | i | } qN W| i } t | i i
d } | d d j o | d d !} n | i | } | i | | | | f S( Ns utf-8i is
( t tellRd RU RV R? t updateR R@ R t digestRW R (
R R R R t hash_objt sposR t
hex_digestt
base64_digestt data_size( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR s0
c C s< g } | D]* } | i | i j o | | q q ~ S( s
Takes a specific header name and a dict of headers {"name": "value"}.
Returns a list of matching header names, case-insensitive.
( R/ ( R R> RG t h( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt find_matching_headers s c s, t | } d i f d | D S( s
Takes a specific header name and a dict of headers {"name": "value"}.
Returns a string of all header values, comma-separated, that match the
input header name, case-insensitive.
R c 3 s8 x1 | ]* } | d j o t | Vq q Wd S( N( R0 R3 ( t .0R ( R> ( s. /usr/lib/python2.6/site-packages/boto/utils.pys s ( R R; ( R R> t matching_headers( ( R> s. /usr/lib/python2.6/site-packages/boto/utils.pyt merge_headers_by_name s t RequestHookc B s e Z d Z e d Z RS( s
This can be extended and supplied to the connection object
to gain access to request and response object after the request completes.
One use for this would be to implement some specific request logging.
c C s d S( N( ( R R_ t responseRg ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt handle_request_data s ( R R R( R R ( ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyR s (V R( R Rm t logging.handlersR
R, t
boto.providerR R R R t ret email.mime.multipartR t email.mime.baset email.mime.textt email.utilst email.encodersR t threadingR t boto.compatR R R R t
contextlibR t hashlibR R RD R t boto.compat.jsonR t ImportErrorR R9 t compileRu Rw Rx R# R0 RK RT RZ R R} R R. R~ R R R R R R R t LockR R R R R R R R< R t handlerst SMTPHandlerR R) R= Rn Rq Rt R{ R R R R R R R R ( ( ( s. /usr/lib/python2.6/site-packages/boto/utils.pyt ( s " 9 # v
#0 7w& 7
-