One Hat Cyber Team
Your IP :
3.14.254.47
Server IP :
192.145.235.60
Server :
Linux ngx365.inmotionhosting.com 5.14.0-427.33.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Aug 30 09:45:56 EDT 2024 x86_64
Server Software :
Apache
PHP Version :
8.2.27
Buat File
|
Buat Folder
Eksekusi
Dir :
~
/
opt
/
sharedrads
/
__pycache__
/
View File Name :
move_generator.cpython-39.pyc
a �g�( � @ s� d Z ddlmZ ddlmZ ddlZddlZddlZddlm Z ddl m Z m Z ddl mZ ddlZddlZddlmZ ddlZe d �Zd Zd d � Zd d� Zdd� Zed�dd�Zee d�dd�Z eee f dd�dd�Z dd�dd�Z ee e e ee e!eee"df f d �d d �Z#e e e e ee ee!eee"f d �d d!�Z$d"d#� Z%ee!eee"f d$�d%d&�Z&eee"d'�d(d)�Z'e(d*k�r�e� dS )+zWDisk Move Generator - generates disk move tickets according to arguments and exclusions� )� itemgetter)�nodeN)�Path)�ThreadPoolExecutor� as_completed)�Union)�tabulatez/var/log/disk_exclude� c C s� t jtd�} | �� }| jddtddg dd� | jdd td d d � | jd dtdd� | jddtdd� |jddtddg dd� |jddddd � | jd d dd d � | jd d!dd"d � | �� }|jd#u r�|j d#u r�|j s�t d$d%� t � d&� |S )'zParse arguments)� descriptionz-az--add�add_user�+z3Add user to exclusion list. Entries survive 30 days)�type�dest�nargs�default�helpz-mz--min� z3Minimum size of account to migrate in GB, default 8)r r r z-xz--maxz(Maximum size of account to migrate in GB)r r z-tz--totalz<Lists several eligible accounts whose size totals up to X GBz-ez --exclude�exc_userz1List of users to exclude alongside exclusion listz-nz --noexclude� store_truezDo not use exclusion list)�actionr z-lz --listaccountz Print list of eligible accountsz-dz--ticketz/Email eligible accounts to the disk moves queueFz"--ticket (-d), --listaccount (-l),z or --add (-a) [user] is required� )�argparse�ArgumentParser�__doc__Z add_mutually_exclusive_group� add_argument�str�int� parse_args�ticket� listaccountr �print�sys�exit)�parser�group�args� r& �"./opt/sharedrads/move_generator.py�get_args s| � ���� ���� r( c C sJ t ddd�� } t�| tj�}W d � n1 s00 Y |du rFi S |S )zParse /etc/trueuserownersz/etc/trueuserownerszutf-8��encodingN)�open�yaml�load�radsZDumbYamlLoader)Zhandle� user_ownersr& r& r' �get_user_ownersY s ,r0 c C s� t � } t� | jr`| js | jr&td� | jD ](}t�|�s,t|� d�� | j�|� q,t | j� | jsl| jr�t | j | j | j | j| j�}| jr�t|� | jr�t|� | S )Nz!Adding to exclusion list first...z is not a valid cpanel user)r( �refresh_exclusion_listr r r r r. Z is_cpuser�remove�add_excluded_users�collect_accounts�min�max�total� noexcluder � list_accounts�email_accounts)r% �user�accountsr& r& r' �mainb s& �r= )�returnc C s� i } zXt tdd��}t�|�} W d � n1 s20 Y t| t�sZtd� i } t| � W nP tjt fy� } z2tt |�j |dd� tdt� t| � W Y d}~n d}~0 0 | S )z4Read from the exclusion list and return it as a dict�asciir) Nz#Error in exclusion list, rebuilding�: )�sepZ Recreating) r+ �EXCLUSION_LISTr, r- � isinstance�dictr �write_exclusion_listZ YAMLError�OSErrorr �__name__)�dataZ exclusionlist�excr& r& r' �get_exclusion_list� s ( rJ )�usersc C s8 | D ].}t � }t�� j||< t|� t|� d�� qdS )z<Format user information and timestamp for the exclusion listz added to exclusion listN)rJ �arrow�now� int_timestamprE r )rK r; �exclusion_listr& r& r' r3 � s r3 )rO r> c C sZ zBt tddd�� }tj| |dd� W d � n1 s60 Y W n tyT Y n0 dS )zWrite to the exclusion list�wr? r) � )�indentN)r+ rB r, �dump� Exception)rO Zoutfiler& r& r' rE � s 2 rE c C sj zRt � } i }| D ]6}t�� j| | ttjtd��� �k r| | ||< qt |� W n t yd Y n0 dS )z)If a timeout has expired, remove the user)ZdaysN) rJ rL rM rN r �datetimeZ timedelta�TIMERZ total_secondsrE rT )ZtimeoutsZnew_dictr; r& r& r' r1 � s � r1 )r; �min_size�max_sizer8 rO r> c C s� z�t �| �r| dfW S td| ��� r*W dS |s@| |v r@| dfW S t �� �| �d }||k rd| dfW S |rz||krz| dfW S | |fW S ty� | df Y S 0 dS )zLRun the user through the first gamut to determine if eligible for a moveNz/var/cpanel/suspendedi @)r. Z cpuser_safer �is_fileZQuotaCtlZgetquota�KeyboardInterrupt)r; rW rX r8 rO �size_gbr& r& r' �initial_disqualify� s r\ )rW rX �total_gbr8 �excluder> c C s� d}g }g }g }zt t� �� �} W nB tyd } z*tdt| �j� d| � �� g } W Y d} ~ n d} ~ 0 0 | |7 } t| ||| d�} g }t� } t dd���} zng }| � � D ]"\}}|� | j t |fi | ��� q�t|�D ]0}|�� \}}|dur�| | }|� |||f� q�W n< t�y> td� | jd d d � g Y W d � S 0 W d � n1 �sV0 Y |�sj|S |jtd �d d � |�r�d}|D ]<}t|�dk �s�||k �r�|� |� ||d 7 }n �qȐq�|}|dd� }|S )z|Get a list of users, and then eliminate them based on suspension status, size, and eligibility based on options providedr zSkipping exception file - r@ N)rW rX r8 rO rQ )� max_workerszCaught KeyboardInterrupt.FT)�waitZcancel_futures� )�key�reverse� � )�listrJ �keysrT r r rG rD r0 r �items�appendZsubmitr\ r �resultrZ Zshutdown�sortr �len)rW rX r] r8 r^ Z size_totalr< Zeligible_accountsZ final_listrO rI �kwargsr/ ZpoolZjobsr; �ownerZfuturer[ Zaccountr& r& r' r4 � sZ � 8 r4 c C sV | st d� dS t tt| �g d�dd�� tdd� | D �� }rRt d|d �d �� dS ) z5Print the list of eligible accounts in a pretty tablezNo accounts match criteria.N)ZUserZOwnerz Size (GB)z.1f)ZheadersZfloatfmtc s s | ]}|d V qdS )ra Nr& )�.0�xr& r& r' � <genexpr>$ � z list_accounts.<locals>.<genexpr>z!Total size of matching accounts: z.2fz GB)r r �reversed�sum)r< r7 r& r& r' r9 s ��r9 )r< c C sF t � �d�d }g }| D ] \}}}t|||� |�|� qt|� dS )z'Send an email for each user in accounts�.r N)r �split�mail_disk_moveri r3 )r< �serverr^ r; �_r[ r& r& r' r: ( s r: )�usernamerx r[ c C sf d}d| � d|� �}d| � d|� d| � d|� d| � d� }t �|||�rXtd | � d �� n td d � d S )z#Sends email to the disk moves queuezmoves@imhadmin.netz DISK MOVE: z @ z, A new server disk move is required for z Move Username: z Account Size: a� GiB Please review the account to determine if they are eligible for a migration: * hasn't been moved recently (e.g. in the past year/no current move scheduled) * is not storing ToS content * is not large to the point of absurdity * other reasons left to the discretion of the administrator If the account is not eligible for a migration, please add them to the exception list to prevent further tickets being generated for their account: move_generator.py -a a4 If the account is not eligible for reasons of ToS content, please respond to this ticket with the relevant information and leave it open to address further. For convenience, you may also update the subject line with the date on which this should be addressed again and/or notice count. zDisk move tickets sent for ru z@Sending of disk_move ticket failed. You can use the -l option toz view eligible accounts to moveN)r. Z send_emailr )rz rx r[ Zto_addrZsubject�bodyr& r& r' rw 2 s& ������rw �__main__))r �operatorr �platformr rU r r! �pathlibr �concurrent.futuresr r �typingr rL r, r r. rB rV r( r0 r= rD rJ rf r r3 r rE r1 �bool�tuple�floatr\ r4 r9 r: rw rG r& r& r& r' �<module> sP D � #� A "