/opt/cloudlinux/venv/lib/python3.11/site-packages/xray/agent/__pycache__
Edit: /opt/cloudlinux/venv/lib/python3.11/site-packages/xray/agent/__pycache__/daemon.cpython-311.pyc (25463B)
fJ d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl
Z
ddl Z ddl m
Z
mZmZ ddl mZmZmZmZ ddlmZ ddlZddlmZ ddlmZ dd l m Z dd
l m Z dd l m!Z!m"Z" dd l#m$Z$ dd
l%m&Z&m'Z'm(Z( ddl)m*Z* ddl+m,Z, ddl-m.Z.m/Z/ e j0 r
ddl1m2Z2m3Z3m4Z4 e G d d Z5 ej6 e7 Z8 G d d Z9dS )zJ
This module contains contains classes implementing X-Ray Agent behaviour
N)Threadcurrent_threadLock)AnyOptionalDictTuple) dataclass )BoundedThreadExecutor)gettext)
get_client)local_tasks_storage) XRayError XRayAPIError)
FaultDetector)open_local_storageflush_memory_storage get_task_ids)Task)
extract_creds) dbm_storage get_current_cpu_throttling_time)
SendClientSmartAdviceAPIClient APIClientc $ e Zd ZU ded< eed< dS )APIDataContainerr clienttaskN)__name__
__module__ __qualname____annotations__r H/opt/cloudlinux/venv/lib64/python3.11/site-packages/xray/agent/daemon.pyr r 6 s%
JJJJJr& r c e Zd ZdZdZdZdZ ej dz ej dz ej dz fdZ d Z
d
Z d2d Z d
Z
d3dej dedee dd fdZd ZdedefdZdededefdZdej dedd fd Zd ej defd Z d e dd fd!Z d e de d e f fd"Z!d4d#Z"dedd fd$Z#d%ed&e defd'Z$ d2d(d)d*ed+ee dd fd,Z%d-e dd fd.Z&d/ Z'e(d0e de fd1 Z)d S )5Agentz
X-Ray Agent class
< i c || _ || _ || _ || _ t j t j t j h t d } || j | _ t d } | | _
t | _ t | _
t | _ t! | _ d | _ d | _ d S )Napi_req) system_idadviser)sys_id maxqueuesizemax_connections max_workerssignalpthread_sigmask SIG_BLOCKSIGUSR2r send_clientadviser_clienttask_client_objectr api_data_cache_lockdictapi_data_cacher fault_detectorsignal_handler_threadflusher_thread)selfr1 r5 r6 r4 clickhouse_client_objectadviser_client_objects r' __init__zAgent.__init__H s ( . & v /&.1ABBB =Gy
">">D % % ' ' '
" , ! .0 0 0 3? ! 0
" ,%,,,&*kkmm#
G'$++ 7"L2 2 2 2 z ' ' 'LL "` a a a $$&&&&&'
$QJE !,%,,, sZ E%5 E
C10E
1=D1.E
0D11E
E%
E E%E E%%E),E)c D | || \ |d< |d< dS )zj
Calculate throttling values and update given data
with resulting throttling stat
hitting_limitsthrottled_timeN)rA )rD datat_key cpu_values r' add_limit_faultszAgent.add_limit_faults s5
:>9L9L 9: : 6
%5 6 6 6r& php_pid cpu_usagec t d|| | j || | j dS )z
Called when php request starts and sends us welcome
request meaning that request started on the php side.
z;Received request init trigger from php=%s with cpu_usage=%sN)r\ rK rA saveflush)rD r r s r' _handle_request_initzAgent._handle_request_init sX
QY ( ( (
)444 !!#####r& request_datac 0 | d | ||| t dt j | d | d | | d S )Nr z&[%s] Processing trace for task %s (%s)tracing_task_idurl)getr r\ rK r nameprocess_request_data)rD r r r s r' _handle_request_endzAgent._handle_request_end s , - - 5 ! !, C C C <"$$) $$%677 $$U++ - - -
!!,/////r& r r c t | \ }}}t | }| d } | | }nn# t j $ r\} t dt | dt j
i Y d} ~ | dS d} ~ ww xY w | n# | w xY w | | | j
|| dS | | j ||| dS # t j $ r t d Y dS w xY w)
a
Handle incoming connection
:param connection: socket object usable to
send and receive data on the connection
:param workers_pool: pool where we can place
tasks for the futher processing
ignore)errorszJSON decode failed: %st_nameextraN)r r )r r r zRequest %s was rejected because our workers thread pool is full of tasks. Increase queuemaxsize or max_threads in configuration.)r r makefile
read_inputjsonJSONDecodeErrorr\ r} strr r r~ ry r r r{ r| )
rD r r _pid_uid_gid current_cpufileobj
input_dataes
r' rz z Agent.handle_incoming_connection s )44dD5d;; !+!4!4H!4!E!E 11JJ# LL1 !!ffX~7G7G7L,M
O
O
O FFF
J e ! ##D$=t.9 $ ; ; ; ; ; ##D$# t $ r1}t t d t | z d}~ww xY w| | j
| S )z<
Initialize MongoDB client for current task
z9Cannot resolve tracing_task_id: no match found in storage)idall_idsr Nz"Cannot resolve tracing_task_id: %s)r1 r ) r r decodeKeyErrorr _keys RuntimeErrorr r= r3 )rD r task_storagereal_idr s r' instantiate_mongo_clientz Agent.instantiate_mongo_client- so
N 011
@\@ *< 8 ? ? A AGG @ @ @#UVV%1*6*;*;*=*= ? ?@ @ @ @@
@
@
@
@
@
@
@
@
@
@
@
@
@
@
@ N N NA B C Cc!ff LMM M N &&7> ' @ @ @sN B
B3B>A11B5 B
BB
B B
C,CCc \ t d| j | j | }||j |j fS | | }| }t d||| t || | j |< ||fS )z
Returns a client and task from cache of API data or
initialize client and GET task from MongoDB and add to cache
zCached API data: %sNz,Adding new container in cache: %s --> %s, %s)r r ) r\ r r@ r r r r get_taskr )rD r cached_datare _ts r' r] zAgent.get_cached_or_loadB s
*D,?@@@)--l;; " %{'77 711,??
!
! C&I 7 7 7,z0Agent.cleanup_api_data_cache..\ s H H Hq
H H Hr& Nz,Unable to cleanup cache, storage unavailablez!Cleaning up inactive container %s) r r r r r\ rQ listr@ r> rK pop)rD r active_tasks_tasks r' rm z Agent.cleanup_api_data_cacheU s
011
I\ H HL4E4E4G4G H H H
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I NN>
@
@
@ FF
$-224455 3 3E)
3
3D ///E 4M4MKK CUKKK'++E222
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3 3 3sF A
A A
AA
A A
$A54A5'AC66C: =C: c | |d \ }}t d|j t |d |j 5 }| |j |j dk r(t d ddd dS | || }t d |
| t d | | n# t $ r Y nw xY w|xj d
z
c_ | |j ddd n # 1 swxY w Y |j r|
|j |j d k r"|j dk r| | dS dS dS ) z
Increment request ID in /usr/share/alt-php-xray/requests/{tracing_task_id} file
Substitute request_id and tracing_task_id in request_data.
Send request_data to ClickHouse
:param request_data: original request data
r zProcessing task: %s)r rY r z*Tracing count is 0, nothing should be doneNzSending to ClickHousezSending to SmartAdvicer r[ )r] r\ rK rc r is_manualr^ rZ rb update_request_datar; r< r rM fake_idr_
complete_task)rD r r r rf updated_request_datas r' r zAgent.process_request_datah sZ )),7H*IJJ4 )4<888
-> ?&*n6 6 6 Q9@ ' '8O ' P P P!Q&& HIII Q Q Q Q Q Q Q Q $(#;#;L<@$B $B
KK/ 0 0 0 1 2 2 2
4555##$89999
# #q ( # # ' '8O ' P P P1 Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q4 > 7 ( ( 6 6 6 ?f $ $);q)@)@ t $ $ $ $ $ % $)@)@s> AE'*AE'0/D E'
D-*E',D--.E''E+.E+r r c |j dz |d< |j |d< |d D ]C}|j dz |d< |j |d< |d dk r | |d |d< Dt d| d | d t d | |S )
z
Substitute request_id and tracing_task_id
:param data: original input
:param task: a Task instance
:return: updated input
r
request_idr r type mysql_queryqueryz5Input updated: tracing_task_id = %s & request_id = %szFull updated input %s)ra rc hide_symbolsr\ rK r r )rD r r items r' r zAgent.update_request_data s " /! 3\"&,
L A AD!%!3a!7D &*lD" #F|},, $ 1 1$w- @ @W
K "344dhh|6L6L N N N ,d333 r& r zAPIClient instancera rb c 4 | || dS )z:
Update task counters in mongodb instance
)rb ra N)update_counts_only)rD r ra rb s r' r` zAgent.update_counts s0 !!
0= " ? ? ? ? ?r& r c t d|j t j d | |j dS )z_
Stop and complete request_qty task
:param _task: tracing task to stop
zTask %s should be completedr N)r\ rK rc r[ ri _run_complete_task_cmd)rD r s r' r zAgent.complete_task sM
1 ( ( (
1
##EM22222r& c D t j ddd| j d|g d S )Nzcloudlinux-xray-managerstopz --system_idz--tracing_task_id)
subprocess check_outputr3 )rD rc s r' r z Agent._run_complete_task_cmd s7 %v 4; !
r& r c \ d }t j d }t j ||| S )zA
Sanitize data in single quotes from MySQL query
c | d }| d }d }t j d|| d }| | |p| S )zL
Works with whole string in single or double quotes
quotetruncc b | d rdS | d rdS dS )zE
Works with characters inside quotes
digit0symbolxN)group)inner_ms r'
inner_replz8Agent.hide_symbols..replacer..inner_repl s@ ==)) 3 ]]8,, 3 r& z.((?P\d)|(?P[^0-9_:;\-/',. \\]))in_quote)r resub)mqtr sanitizeds r' replacerz$Agent.hide_symbols..replacer sz A A
P )177:+>+>@ @I ,,AF,, ,r& zH(?P['"])(?P.*?)((?\.{3})))r compiler )r r patterns r' r zAgent.hide_symbols s7
- - -2 * lmmvgx555r& )N)FN)rt N)*r! r" r# __doc__rj rk rl psutil cpu_countrG rS rW rM rp socketboolr intrw r r r? r r rz io
TextIOBaser r r r r r r] rm r r r` r r staticmethodr r% r& r' r) r) ? s ! "2!1!3!3a!7 -V - / /! 3 .f . 0 02 5 5 5 5 5@ U U U Z Z Z 7 7 7 743 3 3. */%)) ) M) "&) c]) /3) ) ) ) V
$C
$C
$
$
$
$ 03 03 0d 0 0 0 0!eV] !eRg !elp !e !e !e !eF 6 63 6 6 6 6@/2@7B@ @ @ @* s u[$=N7O &3 3 3 3&&% &%$ &% &% &% &%P D T , 6:? ?$8 ?%(?%-c]?>B? ? ? ? 34 3D 3 3 3 3 6# 6# 6 6 6 \ 6 6 6r& r) ):r r r rJ rN r{ r r7 r r r[ typing threadingr r r r r r r dataclassesr
r executorr xrayr
r xray.apiclientr xray.internal.constantsr xray.internal.exceptionsr r rA r xray.internal.local_countersr r r xray.internal.typesr xray.internal.user_plugin_utilsr xray.internal.utilsr r
TYPE_CHECKINGxray.apiclient.api_clientr r r r getLoggerr! r\ r) r% r& r' r s
2 2 2 2 2 2 2 2 2 2 - - - - - - - - - - - - ! ! ! ! ! !
+ + + + + + % % % % % % 7 7 7 7 7 7 < < < < < < < < ) ) ) ) ) )
% $ $ $ $ $ 9 9 9 9 9 9
8 $ $_6 _6 _6 _6 _6 _6 _6 _6 _6 _6r&