Viewing: tarfile.cpython-36.pyc
3 �I�i� � ' @ sB d Z dZdZdZdZdZddlmZ ddl Z ddl Z ddl Z ddl Z ddl Z ddlZddlZddlZddlZddlZy ddlZW n ek r� dZY nX y ddlZW n ek r� dZY nX eefZyeef7 ZW n ek r� Y nX d d d d d ddddddddddgZdZ dZ dZ dZ e d Z d Z!d Z"d Z#d Z$d Z%d!Z&dZ'd"Z(d#Z)d$Z*d%Z+d&Z,d'Z-d(Z.d)Z/d*Z0d+Z1d,Z2d-Z3d.Z4dZ5d/Z6d0Z7e6Z8e&e'e(e)e,e-e.e*e+e/e0e1f Z9e&e'e.e1fZ:e/e0e1fZ;d�Z<d1d2d7d8hZ=e>e>e>e?e?e?d9�Z@e jAd:k�r�d;ZBne jC� ZBd<d=� ZDd>d?� ZEd@dA� ZFdBe8fdCdD�ZGdEdF� ZHdedfdGdH�ZIdIdJ� ZJdKdL� ZKG dMd � d eL�ZMG dNd� deM�ZNG dOd � d eM�ZOG dPd� deM�ZPG dQd� deM�ZQG dRd� deM�ZRG dSdT� dTeR�ZSG dUdV� dVeR�ZTG dWdX� dXeR�ZUG dYdZ� dZeR�ZVG d[d\� d\eR�ZWG d]d^� d^�ZXG d_d`� d`�ZYG dadb� dbeZ�Z[G dcdd� ddeZ�Z\G dedf� dfe j]�Z^G dgdh� dheM�Z_G didj� dje_�Z`G dkdl� dle_�ZaG dmdn� dne_�ZbG dodp� dpe_�ZcG dqdr� dre_�ZdG dsdt� dte_�Zee_eeNfZfd�dudv�Zgdwdx� Zhdydz� Zid{d|� Zjeheiejd}�ZkeZ� Zlejmd~�ZnG dd � d eZ�ZoG d�d � d eZ�Zpd�d � ZqepjZd�d�� Zresd�k�r>er� dS )�z,Read from and write to tar format archives. z0.9.0u" Lars Gustäbel (lars@gustaebel.de)z5$Date: 2011-02-25 17:42:01 +0200 (Fri, 25 Feb 2011) $z?$Id: tarfile.py 88586 2011-02-25 15:42:01Z marc-andre.lemburg $u4 Gustavo Niemeyer, Niels Gustäbel, Richard Townsend.� )�openN�TarFile�TarInfo� is_tarfile�TarError� ReadError�CompressionError� StreamError� ExtractError� HeaderError�ENCODING� USTAR_FORMAT� GNU_FORMAT� PAX_FORMAT�DEFAULT_FORMATr Tz/etc/python/tarfile.cfg� i � s ustar s ustar 00�d � � 0� 1� 2� 3� 4� 5� 6� 7� L� K� S� x� g� X� � �path�linkpath�size�mtime�uid�gid�uname�gname)ZatimeZctimer( r) r* r' �ntzutf-8c C s8 | dkrt d��| j||�} | d|� |t| � t S )z8Convert a string to a null-terminated bytes object. Nz metadata cannot contain None)� ValueError�encode�len�NUL)�s�length�encoding�errors� r6 � /usr/lib64/python3.6/tarfile.py�stn� s r8 c C s* | j d�}|dkr | d|� } | j||�S )z8Convert a null-terminated bytes object to a string. r r# N���)�find�decode)r2 r4 r5 �pr6 r6 r7 �nts� s r= c C s� | d d krfd}x0t t| �d �D ] }|dK }|| |d 7 }q"W | d dkr�dt| �d | }n@y"t| dd�} t| j� p�d d�}W n tk r� td ��Y nX |S ) z/Convert a number field to a python number. r � � r# � � �ascii�strict�0zinvalid header)r> r? )�ranger0 r= �int�stripr. �InvalidHeaderError)r2 �n�ir6 r6 r7 �nti� s rK r@ c C s� t | �} d| ko"d|d k n rDtd|d | f d�t }n�|tkr�d|d | kopd|d k n r�| dkr�tdg�}ntdg�}d| | } x6t|d �D ] }|jd| d@ � | dL } q�W ntd ��|S ) z/Convert a python number to a number field. r r@ r# z%0*orB rA r> r? zoverflow in number field)rF �bytesr1 r � bytearrayrE �insertr. )rI �digits�formatr2 rJ r6 r6 r7 �itn� s 2 rQ c C s0 dt tjd| �� }dt tjd| �� }||fS )a� Calculate the checksum for a member's header by summing up all characters except for the chksum field which is treated as if it was filled with spaces. According to the GNU tar sources, some tars (Sun and NeXT) calculate chksum with signed char, which will be different if there are chars in the buffer with the high bit set. So we calculate two checksums, unsigned and signed. rA Z 148B8x356BZ 148b8x356b)�sum�structZ unpack_from)�bufZunsigned_chksumZ signed_chksumr6 r6 r7 � calc_chksums� s rU c C s� |pd}|dkrdS |dkr.t j| ||� dS t||�\}}x8t|�D ],}| j|�}t|�|k rh|d��|j|� qFW |dkr�| j|�}t|�|k r�|d��|j|� dS )zjCopy length bytes from fileobj src to fileobj dst. If length is None, copy the entire content. � i r Nzunexpected end of datai @ )�shutil� copyfileobj�divmodrE �readr0 �write) �src�dstr3 � exception�bufsize�blocks� remainder�brT r6 r6 r7 rX � s$ rX c C s ddl }|jdtd� tj| �S )z/Deprecated in this location; use stat.filemode.r Nz$deprecated in favor of stat.filemoder$ )�warnings�warn�DeprecationWarning�stat�filemode)�moderc r6 r6 r7 rg s rg c C s8 t tjdd �}|d k r(| j|d�j|�} t| dd� d S )Nr4 �backslashreplace� )�end)�getattr�sys�stdoutr/ r; �print)r2 r4 r6 r6 r7 � _safe_print s rp c @ s e Zd ZdZdS )r zBase exception.N)�__name__� __module__� __qualname__�__doc__r6 r6 r6 r7 r s c @ s e Zd ZdZdS )r z%General exception for extract errors.N)rq rr rs rt r6 r6 r6 r7 r ! s c @ s e Zd ZdZdS )r z&Exception for unreadable tar archives.N)rq rr rs rt r6 r6 r6 r7 r $ s c @ s e Zd ZdZdS )r z.Exception for unavailable compression methods.N)rq rr rs rt r6 r6 r6 r7 r ' s c @ s e Zd ZdZdS )r z=Exception for unsupported operations on stream-like TarFiles.N)rq rr rs rt r6 r6 r6 r7 r * s c @ s e Zd ZdZdS )r z!Base exception for header errors.N)rq rr rs rt r6 r6 r6 r7 r - s c @ s e Zd ZdZdS )�EmptyHeaderErrorz Exception for empty headers.N)rq rr rs rt r6 r6 r6 r7 ru 0 s ru c @ s e Zd ZdZdS )�TruncatedHeaderErrorz Exception for truncated headers.N)rq rr rs rt r6 r6 r6 r7 rv 3 s rv c @ s e Zd ZdZdS )�EOFHeaderErrorz"Exception for end of file headers.N)rq rr rs rt r6 r6 r6 r7 rw 6 s rw c @ s e Zd ZdZdS )rH z Exception for invalid headers.N)rq rr rs rt r6 r6 r6 r7 rH 9 s rH c @ s e Zd ZdZdS )�SubsequentHeaderErrorz3Exception for missing and invalid extended headers.N)rq rr rs rt r6 r6 r6 r7 rx < s rx c @ s0 e Zd ZdZdd� Zdd� Zdd� Zdd � Zd S ) � _LowLevelFilez�Low-level file object. Supports reading and writing. It is used instead of a regular file object for streaming access. c C sF t jt jt jB t jB d�| }tt d�r2|t jO }t j||d�| _d S )N)�r�w�O_BINARYi� ) �os�O_RDONLY�O_WRONLY�O_CREAT�O_TRUNC�hasattrr| r �fd)�self�namerh r6 r6 r7 �__init__I s z_LowLevelFile.__init__c C s t j| j� d S )N)r} �closer� )r� r6 r6 r7 r� R s z_LowLevelFile.closec C s t j| j|�S )N)r} rZ r� )r� r' r6 r6 r7 rZ U s z_LowLevelFile.readc C s t j| j|� d S )N)r} r[ r� )r� r2 r6 r6 r7 r[ X s z_LowLevelFile.writeN)rq rr rs rt r� r� rZ r[ r6 r6 r6 r7 ry C s ry c @ st e Zd ZdZdd� Zdd� Zdd� Zdd � Zd d � Zd d � Z dd� Z dd� Z d dd�Z d dd�Z dd� Zdd� ZdS ) �_Streama� Class that serves as an adapter between TarFile and a stream-like object. The stream-like object only needs to have a read() or write() method and is accessed blockwise. Use of gzip or bzip2 compression is possible. A stream-like object could be for example: sys.stdin, sys.stdout, a socket, a tape device etc. _Stream is intended to be used only internally. c C s� d| _ |dkr t||�}d| _ |dkr6t|�}|j� }|p<d| _|| _|| _|| _|| _d| _ d| _ d| _ �yL|dkr�y ddl }W n t k r� td ��Y nX || _ |jd�| _|d kr�| j� |j| _n| j� n�|d k�r:y ddl}W n t k �r td ��Y nX |d k�r.d| _|j� | _t| _n |j� | _n||d k�r�y ddl}W n t k �rn td��Y nX |d k�r�d| _|j � | _|j | _n |j � | _n|dk�r�td| ��W n& | j �s�| jj � d| _ � Y nX dS )z$Construct a _Stream object. TNF�*� � r �gzz zlib module is not availablerz �bz2zbz2 module is not available�xzz lzma module is not available�tarzunknown compression type %r) � _extfileobjry � _StreamProxy� getcomptyper� rh �comptype�fileobjr_ rT �pos�closed�zlib� ImportErrorr �crc32�crc� _init_read_gz�errorr^ �_init_write_gzr� �dbufZBZ2Decompressor�cmp�OSErrorZ BZ2Compressor�lzmaZLZMADecompressor� LZMAErrorZLZMACompressorr� ) r� r� rh r� r� r_ r� r� r� r6 r6 r7 r� f sl z_Stream.__init__c C s t | d�r| j r| j� d S )Nr� )r� r� r� )r� r6 r6 r7 �__del__� s z_Stream.__del__c C s� | j jd| j j| j j | j jd�| _tjdtt j � ��}| j d| d � | j j d�rf| j dd � | _ | j | j j d d �t � dS ) z6Initialize for writing with gzip compression. � r z<Ls �s �z.gzN� z iso-8859-1�replace���)r� Z compressobjZDEFLATED� MAX_WBITSZ DEF_MEM_LEVELr� rS �packrF �time�_Stream__writer� �endswithr/ r1 )r� Z timestampr6 r6 r7 r� � s z_Stream._init_write_gzc C sR | j dkr | jj|| j�| _| jt|�7 _| j dkrD| jj|�}| j|� dS )z&Write string s to the stream. r� r� N) r� r� r� r� r� r0 r� �compressr� )r� r2 r6 r6 r7 r[ � s z _Stream.writec C sR | j |7 _ x>t| j �| jkrL| jj| j d| j� � | j | jd� | _ qW dS )z]Write string s to the stream if a whole new block is ready to be written. N)rT r0 r_ r� r[ )r� r2 r6 r6 r7 Z__write� s z_Stream.__writec C s� | j r dS d| _ z�| jdkr:| jdkr:| j| jj� 7 _| jdkr�| jr�| jj| j� d| _| jdkr�| jjtj d| j �� | jjtj d| j d@ �� W d| j s�| jj � X dS ) z[Close the _Stream object. No operation should be done on it afterwards. NTr{ r� r� r� z<Ll �� )r� rh r� rT r� �flushr� r[ rS r� r� r� r� r� )r� r6 r6 r7 r� � s z _Stream.closec C s� | j j| j j �| _d| _| jd�dkr0td��| jd�dkrFtd��t| jd��}| jd� |d @ r�t| jd��d t| jd�� }| j |� |d @ r�x | jd�}| s�|t kr�P q�W |d @ r�x | jd�}| s�|t kr�P q�W |d@ r�| jd� d S )z:Initialize for reading a gzip compressed fileobj. r� r$ s �znot a gzip filer# � z unsupported compression method� � rA r@ rV N) r� Z decompressobjr� r� r� � _Stream__readr r �ordrZ r1 )r� �flagZxlenr2 r6 r6 r7 r� � s. z_Stream._init_read_gzc C s | j S )z3Return the stream's file pointer position. )r� )r� r6 r6 r7 �tell s z _Stream.tellr c C s\ || j dkrNt|| j | j�\}}x t|�D ]}| j| j� q.W | j|� ntd��| j S )zXSet the stream's file pointer to pos. Negative seeking is forbidden. r z seeking backwards is not allowed)r� rY r_ rE rZ r )r� r� r` ra rJ r6 r6 r7 �seek s z _Stream.seekNc C sZ |dkr:g }x | j | j�}|s P |j|� qW dj|�}n | j |�}| jt|�7 _|S )z�Return the next size number of bytes from the stream. If size is not defined, return all bytes of the stream up to EOF. Nr� )�_readr_ �append�joinr� r0 )r� r' �trT r6 r6 r7 rZ s z _Stream.readc C s� | j dkr| j|�S t| j�}| jg}xd||k r�| j| j�}|sBP y| jj|�}W n | jk rp td��Y nX |j |� |t|�7 }q(W dj |�}||d� | _|d|� S )z+Return size bytes from the stream. r� zinvalid compressed datar� N) r� r� r0 r� r_ r� Z decompressr^ r r� r� )r� r' �cr� rT r6 r6 r7 r� * s" z _Stream._readc C sn t | j�}| jg}x6||k rH| jj| j�}|s0P |j|� |t |�7 }qW dj|�}||d� | _|d|� S )zsReturn size bytes from stream. If internal buffer is empty, read another block from the stream. r� N)r0 rT r� rZ r_ r� r� )r� r' r� r� rT r6 r6 r7 Z__read@ s z_Stream.__read)r )N)rq rr rs rt r� r� r� r[ r� r� r� r� r� rZ r� r� r6 r6 r6 r7 r� [ s F r� c @ s0 e Zd ZdZdd� Zdd� Zdd� Zdd � Zd S ) r� zsSmall proxy class that enables transparent compression detection for the Stream interface (mode 'r|*'). c C s || _ | j jt�| _d S )N)r� rZ � BLOCKSIZErT )r� r� r6 r6 r7 r� V s z_StreamProxy.__init__c C s | j j| _| jS )N)r� rZ rT )r� r' r6 r6 r7 rZ Z s z_StreamProxy.readc C sP | j jd�rdS | j dd� dkr8| j dd� dkr8d S | j jd�rHd S d S d S )Ns �r� r r� s BZhr� � s 1AY&SYr� � ] �� �7zXZr� r� )r� r� )rT � startswith)r� r6 r6 r7 r� ^ s $ z_StreamProxy.getcomptypec C s | j j� d S )N)r� r� )r� r6 r6 r7 r� h s z_StreamProxy.closeN)rq rr rs rt r� rZ r� r� r6 r6 r6 r7 r� Q s r� c @ sj e Zd ZdZddd�Zdd� Zdd� Zd d � Zd d � Zd d� Z e j fdd�Z ddd�Z dd� Zdd� ZdS )� _FileInFilezA thin wrapper around an existing file object that provides a part of its data as an individual file object. Nc C s� || _ || _|| _d| _t|dd �| _d| _|d kr>d|fg}d| _g | _d}| j}xT|D ]L\}}||kr~| jj d||d f� | jj d||| |f� ||7 }|| }qZW || jk r�| jj d|| jd f� d S )Nr r� FT) r� �offsetr' �positionrl r� r� � map_index�mapr� )r� r� r� r' Z blockinfoZlastposZrealposr6 r6 r7 r� u s( z_FileInFile.__init__c C s d S )Nr6 )r� r6 r6 r7 r� � s z_FileInFile.flushc C s dS )NTr6 )r� r6 r6 r7 �readable� s z_FileInFile.readablec C s dS )NFr6 )r� r6 r6 r7 �writable� s z_FileInFile.writablec C s | j j� S )N)r� �seekable)r� r6 r6 r7 r� � s z_FileInFile.seekablec C s | j S )z*Return the current file position. )r� )r� r6 r6 r7 r� � s z_FileInFile.tellc C s� |t jkr tt|d�| j�| _nj|t jkr\|dk rFt| j| d�| _q�t| j| | j�| _n.|t jkr�tt| j| | j�d�| _ntd��| jS )z(Seek to a position in the file. r zInvalid argument) �io�SEEK_SET�min�maxr' r� �SEEK_CUR�SEEK_ENDr. )r� r� �whencer6 r6 r7 r� � s z_FileInFile.seekc C s |dkr| j | j }nt|| j | j �}d}x�|dk�r xZ| j| j \}}}}|| j kob|k n rlP q:| jd7 _| jt| j�kr:d| _q:W t||| j �}|r�| jj|| j| � | jj|�}t|�|kr�t d��||7 }n |t | 7 }||8 }| j|7 _q.W |S )z!Read data from the file. Nr� r r# zunexpected end of data) r' r� r� r� r� r0 r� r� rZ r r1 ) r� r' rT �data�start�stopr� r3 rb r6 r6 r7 rZ � s. z_FileInFile.readc C s& | j t|��}||d t|��< t|�S )N)rZ r0 )r� rb rT r6 r6 r7 �readinto� s z_FileInFile.readintoc C s d| _ d S )NT)r� )r� r6 r6 r7 r� � s z_FileInFile.close)N)N)rq rr rs rt r� r� r� r� r� r� r� r� r� rZ r� r� r6 r6 r6 r7 r� o s r� c s e Zd Z� fdd�Z� ZS )� ExFileObjectc s& t |j|j|j|j�}t� j|� d S )N)r� r� � offset_datar' �sparse�superr� )r� �tarfile�tarinfor� )� __class__r6 r7 r� � s zExFileObject.__init__)rq rr rs r� � __classcell__r6 r6 )r� r7 r� � s r� c @ s e Zd ZdS )� FilterErrorN)rq rr rs r6 r6 r6 r7 r� � s r� c s e Zd Z� fdd�Z� ZS )�AbsolutePathErrorc s || _ t� jd|j�d�� d S )Nzmember z has an absolute path)r� r� r� r� )r� r� )r� r6 r7 r� � s zAbsolutePathError.__init__)rq rr rs r� r� r6 r6 )r� r7 r� � s r� c s e Zd Z� fdd�Z� ZS )�OutsideDestinationErrorc s. || _ || _t� j|j�d|�d�d � d S )Nz would be extracted to z, z which is outside the destination)r� �_pathr� r� r� )r� r� r% )r� r6 r7 r� � s z OutsideDestinationError.__init__)rq rr rs r� r� r6 r6 )r� r7 r� � s r� c s e Zd Z� fdd�Z� ZS )�SpecialFileErrorc s || _ t� j|j�d�� d S )Nz is a special file)r� r� r� r� )r� r� )r� r6 r7 r� � s zSpecialFileError.__init__)rq rr rs r� r� r6 r6 )r� r7 r� � s r� c s e Zd Z� fdd�Z� ZS )�AbsoluteLinkErrorc s || _ t� j|j�d�� d S )Nz! is a symlink to an absolute path)r� r� r� r� )r� r� )r� r6 r7 r� � s zAbsoluteLinkError.__init__)rq rr rs r� r� r6 r6 )r� r7 r� � s r� c s e Zd Z� fdd�Z� ZS )�LinkOutsideDestinationErrorc s. || _ || _t� j|j�d|�d�d � d S )Nz would link to z, z which is outside the destination)r� r� r� r� r� )r� r� r% )r� r6 r7 r� � s z$LinkOutsideDestinationError.__init__)rq rr rs r� r� r6 r6 )r� r7 r� � s r� c s e Zd Z� fdd�Z� ZS )�LinkFallbackErrorc s2 || _ || _t� jd|j�d�d|�d� � d S )Nzlink z would be extracted as a zcopy of z, which was rejected)r� r� r� r� r� )r� r� r% )r� r6 r7 r� s zLinkFallbackError.__init__)rq rr rs r� r� r6 r6 )r� r7 r� s r� c C s$ i }| j }tjj|tjjd�}|jdtjf�rH| jjdtj � }|d< tjj|�r\t | ��tjjtjj ||�tjjd�}tjj ||g�|kr�t | |��| j }|d k �r|d@ }|� r�| j� s�| j� r�|d@ s�|dM }|dO }n | j� s�| j� r�d }nt| ��|| j k�r||d< |�r | jd k �r,d |d < | jd k �r@d |d < | jd k �rTd |d < | jd k �rhd |d < | j� �s|| j� �r tjj| j��r�t| ��tjj| j�}|| jk�r�||d < | j� �r�tjj |tjj|�| j�}ntjj || j�}tjj|tjjd�}tjj ||g�|k�r t| |��|S )N)rC �/r� i� �@ �I i� rh r) r* r+ r, �linknamei����) r� r} r% �realpath� ALLOW_MISSINGr� �sep�lstrip�isabsr� r� � commonpathr� rh �isreg�islnk�isdir�issymr� r) r* r+ r, r� r� �normpath�dirnamer� )�member� dest_pathZfor_data� new_attrsr� Z target_pathrh Z normalizedr6 r6 r7 �_get_filtered_attrs sd r� c C s | S )Nr6 )r� r� r6 r6 r7 �fully_trusted_filterT s r� c C s( t | |d�}|r$| jf |ddi��S | S )NF�deep)r� r� )r� r� r� r6 r6 r7 � tar_filterW s r� c C s( t | |d�}|r$| jf |ddi��S | S )NTr� F)r� r� )r� r� r� r6 r6 r7 � data_filter] s r� )Z fully_trustedr� r� s ([0-9]{1,20}) c @ s� e Zd ZdZdmZdndd�Zdd� Zdd � Zeee�Z d d � Z d d � Z ee e �Z d!d"� Z eeeeeeeed#ed$� d%d&�Zd'd(� Zeed)fd*d+�Zd,d-� Zd.d/� Zd0d1� Zed2d3� �Zd4d5� Zed6d7� �Zed8d9� �Z ed:d;� �Z ed<d=� �Z ed>d?� �Z ed@dA� �Z dBdC� Z!dDdE� Z"dFdG� Z#dHdI� Z$dJdK� Z%dLdM� Z&dNdO� Z'dPdQ� Z(dRdS� Z)dTdU� Z*dVdW� Z+dXdY� Z,dZd[� Z-d\d]� Z.d^d_� Z/d`da� Z0dbdc� Z1ddde� Z2dfdg� Z3dhdi� Z4djdk� Z5dlS )or a Informational class which holds the details about an archive member given by a tar header block. TarInfo objects are returned by TarFile.getmember(), TarFile.getmembers() and TarFile.gettarinfo() and are usually created internally. r� rh r) r* r' r( �chksum�typer� r+ r, �devmajor�devminorr� r� � pax_headersr� r� �_sparse_structs� _link_targetr� c C sj || _ d| _d| _d| _d| _d| _d| _t| _d| _ d| _ d| _ d| _ d| _ d| _d| _d| _i | _dS )zXConstruct a TarInfo object. name is the optional name of the member. i� r r� N)r� rh r) r* r' r( r� �REGTYPEr� r� r+ r, r� r� r� r� r� r )r� r� r6 r6 r7 r� � s" zTarInfo.__init__c C s | j S )N)r� )r� r6 r6 r7 �_getpath� s zTarInfo._getpathc C s || _ d S )N)r� )r� r� r6 r6 r7 �_setpath� s zTarInfo._setpathc C s | j S )N)r� )r� r6 r6 r7 � _getlinkpath� s zTarInfo._getlinkpathc C s || _ d S )N)r� )r� r� r6 r6 r7 � _setlinkpath� s zTarInfo._setlinkpathc C s d| j j| jt| �f S )Nz<%s %r at %#x>)r� rq r� �id)r� r6 r6 r7 �__repr__� s zTarInfo.__repr__T) r� r( rh r� r) r* r+ r, r� �_KEEPc C s� | rt j| �} n t j | �} || k r(|| _|| k r6|| _|| k rD|| _|| k rR|| _|| k r`|| _|| k rn|| _|| k r||| _|| k r�|| _ | S )zGReturn a deep copy of self with the given attributes replaced. ) �copy�deepcopyr� r( rh r� r) r* r+ r, ) r� r� r( rh r� r) r* r+ r, r� r �resultr6 r6 r7 r� � s( zTarInfo.replacec C s� | j dkrd}n | j d@ }| j|| j| j| j| j| j| j| j| j | j | j | j d� }|d t kr~|d jd� r~|d d7 < |S )z9Return the TarInfo's attributes as a dictionary. Ni� ) r� rh r) r* r' r( r� r� r� r+ r, r� r� r� r� r� )rh r� r) r* r' r( r� r� r� r+ r, r� r� �DIRTYPEr� )r� rh �infor6 r6 r7 �get_info� s& zTarInfo.get_info�surrogateescapec C s~ | j � }x(|j� D ] \}}|dkrtd| ��qW |tkrH| j|||�S |tkr^| j|||�S |tkrr| j||�S td��dS )z<Return a tar header as a string of 512 byte blocks. Nz%s may not be Nonezinvalid format) r �itemsr. r �create_ustar_headerr �create_gnu_headerr �create_pax_header)r� rP r4 r5 r r� �valuer6 r6 r7 �tobuf� s z TarInfo.tobufc C sn t |d< t|d j||��tkr(td��t|d j||��tkr^| j|d ||�\|d< |d< | j|t||�S )z3Return the object as a ustar header block. �magicr� zlinkname is too longr� �prefix) � POSIX_MAGICr0 r/ � LENGTH_LINKr. � LENGTH_NAME�_posix_split_name�_create_headerr )r� r r4 r5 r6 r6 r7 r � s zTarInfo.create_ustar_headerc C s� t |d< d}t|d j||��tkr<|| j|d t||�7 }t|d j||��tkrl|| j|d t||�7 }|| j|t ||� S )z:Return the object as a GNU header block sequence. r r� r� r� ) � GNU_MAGICr0 r/ r �_create_gnu_long_header�GNUTYPE_LONGLINKr �GNUTYPE_LONGNAMEr r )r� r r4 r5 rT r6 r6 r7 r s zTarInfo.create_gnu_headerc C s4 t |d< | jj� }x�ddtfddtfddfD ]h\}}}||kr@q,y|| jd d � W n" tk rv || ||< w,Y nX t|| �|kr,|| ||< q,W xldD ]d\}}||kr�d||< q�|| }d| ko�d |d k n � s�t|t �r�t |�||< d||< q�W |�r | j |t |�} nd} | | j |td d� S ) z�Return the object as a ustar header block. If it cannot be represented this way, prepend a pax extended header sequence with supplement information. r r� r% r� r& r+ � r, rB rC r) r@ r* r' � r( r r# r� r� )r+ r+ r# )r, r, r# �r) r@ �r* r@ �r' r$ �r( r$ )r% r& r' r( )r r r r r r/ �UnicodeEncodeErrorr0 � isinstance�float�str�_create_pax_generic_header�XHDTYPEr r ) r� r r4 r r� Zhnamer3 rO �valrT r6 r6 r7 r s4 . zTarInfo.create_pax_headerc C s | j |td�S )zAReturn the object as a pax global header block sequence. zutf-8)r- �XGLTYPE)�clsr r6 r6 r7 �create_pax_global_header? s z TarInfo.create_pax_global_headerc C s� |j d�}xltdt|��D ]R}dj|d|� �}dj||d� �}t|j||��tkrt|j||��tkrP qW td��||fS )zUSplit a name longer than 100 chars into a prefix and a name part. r� r# Nzname is too long)�splitrE r0 r� r/ � LENGTH_PREFIXr r. )r� r� r4 r5 Z componentsrJ r r6 r6 r7 r E s zTarInfo._posix_split_namec C s� | j d�ttfk}|r@t| j dd�d|�}t| j dd�d|�}n tdd||�}tdd||�}| j dt�}|dkrxtd��t| j d d�d ||�t| j d d�d @ d|�t| j d d�d|�t| j dd�d|�t| j dd�d|�t| j dd�d|�d|t| j dd�d ||�| j dt�t| j dd�d||�t| j dd�d||�t| j dd�d|�t| j dd�d|�t| j dd�d||�g}tj dt dj |��} t | t d� �d } | dd � t d | d � | d!d� } | S )"z�Return a header block. info is a dictionary with file information, format must be one of the *_FORMAT constants. r� r� r r@ r� r� Nz TarInfo.type must not be Noner� r rh i� r) r* r' r$ r( s r� r r+ r# r, r r z%dsr� il z%06o rB ie i����i����)�get�CHRTYPE�BLKTYPErQ r8 r r. r rS r� r� r� rU rL ) r rP r4 r5 Zhas_device_fieldsr� r� Zfiletype�partsrT r� r6 r6 r7 r U s8 &zTarInfo._create_headerc C s. t t| �t�\}}|dkr*| t| t 7 } | S )zdReturn the string payload filled with zero bytes up to the next 512 byte border. r )rY r0 r� r1 )Zpayloadr` ra r6 r6 r7 �_create_payload s zTarInfo._create_payloadc C sR |j ||�t }i }d|d< ||d< t|�|d< t|d< | j|t||�| j|� S )zTReturn a GNUTYPE_LONGNAME or GNUTYPE_LONGLINK sequence for name. z ././@LongLinkr� r� r' r )r/ r1 r0 r r r r9 )r1 r� r� r4 r5 r r6 r6 r7 r � s z TarInfo._create_gnu_long_headerc C s: d}x@|j � D ]4\}}y|jdd� W q tk r@ d}P Y qX qW d}|rV|d7 }x�|j � D ]�\}}|jd�}|r�|j|d�}n |jd�}t|�t|� d }d } } x"|tt| �� } | | kr�P | } q�W |tt| �d �d | d | d 7 }q`W i } d| d< || d< t|�| d< t| d< | j| td d�| j |� S )z�Return a POSIX.1-2008 extended or global header sequence that contains a list of keyword, value pairs. The values must be strings. Fzutf-8rC Tr� s 21 hdrcharset=BINARY r r� r rB � � =� z././@PaxHeaderr� r� r' r r� ) r r/ r) r0 r, rL r r r r9 ) r1 r r� r4 Zbinary�keywordr Zrecords�lrI r< r r6 r6 r7 r- � s< * z"TarInfo._create_pax_generic_headerc C st t |�dkrtd��t |�tkr(td��|jt�tkr>td��t|dd� �}|t|�krbt d��| � }t |dd� ||�|_ t|dd � �|_ t|d d � �|_ t|d d � �|_t|d d � �|_t|d d� �|_||_|dd � |_t |d d� ||�|_t |dd� ||�|_t |dd� ||�|_t|dd� �|_t|dd� �|_t |dd� ||�}|jtk�r�|j jd��r�t|_|jtk�r6d}g }xrt d�D ]f} y0t|||d � �} t||d |d � �} W n t k �r� P Y nX |j | | f� |d7 }�q�W t |d �} t|dd � �} || | f|_ |j!� �rN|j j"d�|_ |�rp|jt#k�rp|d |j |_ |S ) zAConstruct a TarInfo object from a 512 byte bytes object. r z empty headerztruncated headerzend of file header� � z bad checksumr �l �t �| � � i i i) iI iQ iY i� r� i� r� r$ � i� i� i� )$r0 ru r� rv �countr1 rw rK rU rH r= r� rh r) r* r' r( r� r� r� r+ r, r� r� �AREGTYPEr� r �GNUTYPE_SPARSErE r. r� �boolr r� �rstrip� GNU_TYPES)r1 rT r4 r5 r� �objr r� �structsrJ r� �numbytes� isextended�origsizer6 r6 r7 �frombuf� sZ zTarInfo.frombufc C s8 |j jt�}| j||j|j�}|j j� t |_|j|�S )zOReturn the next TarInfo object from TarFile object tarfile. ) r� rZ r� rR r4 r5 r� r� � _proc_member)r1 r� rT rM r6 r6 r7 � fromtarfile s zTarInfo.fromtarfilec C sT | j ttfkr| j|�S | j tkr,| j|�S | j tttfkrF| j |�S | j |�S dS )zYChoose the right processing method depending on the type and call it. N) r� r" r! � _proc_gnulongrI � _proc_sparser. r0 �SOLARIS_XHDTYPE� _proc_pax� _proc_builtin)r� r� r6 r6 r7 rS ! s zTarInfo._proc_memberc C sR |j j� | _| j}| j� s$| jtkr4|| j| j�7 }||_| j |j |j |j � | S )zfProcess a builtin type or an unknown type which will be treated as a regular file. ) r� r� r� r� r� �SUPPORTED_TYPES�_blockr' r� �_apply_pax_infor r4 r5 )r� r� r� r6 r6 r7 rY . s zTarInfo._proc_builtinc C s� |j j| j| j��}y| j|�}W n tk r> td��Y nX | j|_| jt krft ||j |j �|_ n | jtkr�t ||j |j �|_|S )zSProcess the blocks that hold a GNU longname or longlink member. z missing or bad subsequent header)r� rZ r[ r' rT r rx r� r� r" r= r4 r5 r� r! r� )r� r� rT �nextr6 r6 r7 rU ? s zTarInfo._proc_gnulongc C s� | j \}}}| ` x�|r�|jjt�}d}xvtd�D ]j}y0t|||d � �}t||d |d � �} W n tk rz P Y nX |r�| r�|j|| f� |d7 }q0W t|d �}qW || _ |jj � | _ | j | j | j � |_|| _ | S )z8Process a GNU sparse header plus extra headers. r � r$ rF i� )r r� rZ r� rE rK r. r� rJ r� r� r� r[ r' r� ) r� r� rN rP rQ rT r� rJ r� rO r6 r6 r7 rV U s( zTarInfo._proc_sparsec C s� |j j| j| j��}| jtkr&|j}n |jj� }d}d}g }�x0t|�|koV|| dk�rnt j ||�}|srt d��yt |j d��}W n tk r� t d��Y nX |dk r�t d��|| t|�kr�t d��|jd�| d } ||jd�d | � } | jd�\} } } | �s"| dk�s"|| dk�r*t d��|j|| | f� | dk�rd|dk�rd| d k�r`|j}nd }||7 }q@W |dk�r~d }x`|D ]X\}} } | j| d d |j�}|tk�r�| j| ||j|j�}n| j| d d |j�}|||< �q�W y| j|�}W n tk �r td ��Y nX d |k�r&| j||� nFd |k�r>| j||� n.|j d�dk�rl|j d�dk�rl| j |||� | jt t fk�r�|j ||j|j� | j!|_!d|k�r�|j"}|j#� �s�|jt$k�r�||j|j�7 }||_!|S )zVProcess an extended or global header as described in POSIX.1-2008. r Nzinvalid headerr# � r; r� s hdrcharsets BINARYzutf-8z missing or bad subsequent headerzGNU.sparse.mapzGNU.sparse.sizezGNU.sparse.major�1zGNU.sparse.minorrD r' )%r� rZ r[ r' r� r0 r r r0 �_header_length_prefix_re�matchrH rF �groupr. r� rk � partitionr� r4 �_decode_pax_fieldr5 �PAX_NAME_FIELDSrT r rx �_proc_gnusparse_01�_proc_gnusparse_00r5 �_proc_gnusparse_10r. rW r\ r� r� r� rZ )r� r� rT r r� r4 � raw_headersrb r3 Zheader_value_end_offsetZkeyword_and_valueZ raw_keywordZequalsZ raw_valuer= r r] r� r6 r6 r7 rX q sx zTarInfo._proc_paxc C s� g }g }x�|D ]�\}}}|dkrVy|j t|j� �� W q� tk rR td��Y q�X q|dkry|j t|j� �� W q tk r� td��Y qX qW tt||��|_dS )z?Process a GNU tar extended sparse header, version 0.0. s GNU.sparse.offsetzinvalid headers GNU.sparse.numbytesN)r� rF r; r. rH �list�zipr� )r� r] rj ZoffsetsrO �_r= r r6 r6 r7 rh � s zTarInfo._proc_gnusparse_00c C s@ dd� |d j d�D �}tt|ddd� |ddd� ��|_dS )z?Process a GNU tar extended sparse header, version 0.1. c S s g | ] }t |��qS r6 )rF )�.0�xr6 r6 r7 � <listcomp> s z.TarInfo._proc_gnusparse_01.<locals>.<listcomp>zGNU.sparse.map�,Nr$ r# )r3 rk rl r� )r� r] r r� r6 r6 r7 rg � s zTarInfo._proc_gnusparse_01c C s� d}g }|j jt�}|jdd�\}}t|�}xJt|�|d k rvd|krV||j jt�7 }|jdd�\}}|jt|�� q.W |j j� |_t t |ddd� |ddd� ��|_ dS )z?Process a GNU tar extended sparse header, version 1.0. Nr< r# r$ ) r� rZ r� r3 rF r0 r� r� r� rk rl r� )r� r] r r� Zfieldsr� rT Znumberr6 r6 r7 ri s zTarInfo._proc_gnusparse_10c C s� x�|j � D ]�\}}|dkr(t| d|� q |dkrBt| dt|�� q |dkr\t| dt|�� q |tkr |tkr�yt| |�}W n tk r� d}Y nX |dkr�|jd�}t| ||� q W |j� | _dS ) zoReplace fields with supplemental information from a previous pax extended or global header. zGNU.sparse.namer% zGNU.sparse.sizer' zGNU.sparse.realsizer r� N) r �setattrrF � PAX_FIELDS�PAX_NUMBER_FIELDSr. rK r r )r� r r4 r5 r= r r6 r6 r7 r\ s" zTarInfo._apply_pax_infoc C s. y |j |d�S tk r( |j ||�S X dS )z1Decode a single field from a pax record. rC N)r; �UnicodeDecodeError)r� r r4 Zfallback_encodingZfallback_errorsr6 r6 r7 re , s zTarInfo._decode_pax_fieldc C s2 |dk rt d��t|t�\}}|r*|d7 }|t S )z_Round up a byte count by BLOCKSIZE and return it, e.g. _block(834) => 1024. r zinvalid offsetr# )rH rY r� )r� rG r` ra r6 r6 r7 r[ 4 s zTarInfo._blockc C s | j tkS )N)r� � REGULAR_TYPES)r� r6 r6 r7 r� @ s z TarInfo.isregc C s | j � S )N)r� )r� r6 r6 r7 �isfileB s zTarInfo.isfilec C s | j tkS )N)r� r )r� r6 r6 r7 r� D s z TarInfo.isdirc C s | j tkS )N)r� �SYMTYPE)r� r6 r6 r7 r� F s z TarInfo.issymc C s | j tkS )N)r� �LNKTYPE)r� r6 r6 r7 r� H s z TarInfo.islnkc C s | j tkS )N)r� r6 )r� r6 r6 r7 �ischrJ s z TarInfo.ischrc C s | j tkS )N)r� r7 )r� r6 r6 r7 �isblkL s z TarInfo.isblkc C s | j tkS )N)r� �FIFOTYPE)r� r6 r6 r7 �isfifoN s zTarInfo.isfifoc C s | j d k S )N)r� )r� r6 r6 r7 �issparseP s zTarInfo.issparsec C s | j tttfkS )N)r� r6 r7 r| )r� r6 r6 r7 �isdevR s z TarInfo.isdevN)r� rh r) r* r' r( r� r� r� r+ r, r� r� r� r� r r� r� r r )r� )6rq rr rs rt � __slots__r� r r �propertyr% r r r& r r r� r r r r r r r � classmethodr2 r � staticmethodr r9 r r- rR rT rS rY rU rV rX rh rg ri r\ re r[ r� rw r� r� r� rz r{ r} r~ r r6 r6 r6 r7 r s sf 1 * 3 ? z c @ s� e Zd ZdZdZdZdZdZeZ e Z dZ e ZeZdZdkdd �Zedddefd d ��Zedld d ��Zedmdd��Zedndd��Zedodd��Zddddd�Zdd� Zd d � Z d d � Z d d!� Z dpd"d#�Z dqdd%�d&d'�Z drdd(�d)d*�Z!dsd+d,�Z"d-d.� Z#dtddd0�d1d2�Z$d3d4� Z%duddd0�d6d7�Z&d8d9� Z'dvd:d;�Z(d<d=� Z)d>d?� Z*d@dA� Z+dwdddB�dCdD�Z,dEdF� Z-dGdH� Z.dIdJ� Z/dKdL� Z0dMdN� Z1dOdP� Z2dQdR� Z3dSdT� Z4dUdV� Z5dWdX� Z6dYdZ� Z7dxd[d\�Z8d]d^� Z9dyd_d`�Z:dadb� Z;dcdd� Z<dedf� Z=dgdh� Z>didj� Z?dS )zr z=The TarFile Class provides an interface to tar archives. r Fr# Nrz r c C s� ddddd�}||kr t d��|| _|| | _|sj| jdkrVtjj|� rVd| _d| _t|| j�}d | _n@|d kr�t|d �r�t |j t t f�r�|j }t|d �r�|j| _d | _|r�tjj |�nd | _ || _|d k r�|| _|d k r�|| _|d k r�|| _|d k �r || _|d k �r|| _| | _| d k �r4| jtk�r4| | _ni | _| d k �rJ| | _| d k �rZ| | _| | _d | _g | _d | _ | jj � | _ i | _ � y�| jdk�r�d | _ | j!� | _ | jdk�r8x�| jj"| j � y | jj#| �}| jj$|� W nT t%k �r | jj"| j � P Y n0 t&k �r0 } zt't |���W Y d d }~X nX �q�W | jdk�r�d | _ | j�r�| jj(| jj)� �}| jj*|� | j t+|�7 _ W n& | j�s�| jj,� d | _� Y nX d S )a� Open an (uncompressed) tar archive `name'. `mode' is either 'r' to read from an existing archive, 'a' to append data to an existing file or 'w' to create a new file overwriting an existing one. `mode' defaults to 'r'. If `fileobj' is given, it is used for reading or writing data. If it can be determined, `mode' is overridden by `fileobj's mode. `fileobj' is not closed, when TarFile is closed. �rbzr+b�wbZxb)rz �ar{ ro z!mode must be 'r', 'a', 'w' or 'x'r� r{ FNr� rh Trz ro )r� r{ ro )-r. rh �_moder} r% �exists� bltn_openr� r� r* r� r, rL �abspathr� rP r� � dereference� ignore_zerosr4 r5 r r �debug� errorlevel� copybufsizer� �members�_loadedr� r� �inodes� firstmemberr] r� rT r� rw r r r2 r r[ r0 r� )r� r� rh r� rP r� r� r� r4 r5 r r� r� r� Zmodes�erT r6 r6 r7 r� r s� $ zTarFile.__init__c s� | r| rt d��|dkr�� fdd�}xtt� j|d�D ]b}t� � j| �}|dk r\|j� } y||d|f|�S ttfk r� |dk r�|j| � w8Y q8X q8W td���nd |k�r |jd d �\} }| p�d} |p�d }|� jkr�t� � j| �}n td | ��||| |f|�S d |k�r�|jd d �\} }| �p.d} |�p8d }| dk�rLt d��t || |||�} y� || | f|�} W n | j � � Y nX d| _ | S |dk�r�� j |||f|�S t d��dS )a� Open a tar archive for reading, writing or appending. Return an appropriate TarFile class. mode: 'r' or 'r:*' open for reading with transparent compression 'r:' open for reading exclusively uncompressed 'r:gz' open for reading with gzip compression 'r:bz2' open for reading with bzip2 compression 'r:xz' open for reading with lzma compression 'a' or 'a:' open for appending, creating the file if necessary 'w' or 'w:' open for writing without compression 'w:gz' open for writing with gzip compression 'w:bz2' open for writing with bzip2 compression 'w:xz' open for writing with lzma compression 'x' or 'x:' create a tarfile exclusively without compression, raise an exception if the file is already created 'x:gz' create a gzip compressed tarfile, raise an exception if the file is already created 'x:bz2' create a bzip2 compressed tarfile, raise an exception if the file is already created 'x:xz' create an lzma compressed tarfile, raise an exception if the file is already created 'r|*' open a stream of tar blocks with transparent compression 'r|' open an uncompressed stream of tar blocks for reading 'r|gz' open a gzip compressed stream of tar blocks 'r|bz2' open a bzip2 compressed stream of tar blocks 'r|xz' open an lzma compressed stream of tar blocks 'w|' open an uncompressed stream for writing 'w|gz' open a gzip compressed stream for writing 'w|bz2' open a bzip2 compressed stream for writing 'w|xz' open an lzma compressed stream for writing znothing to openrz �r:*c s � j | dkS )N�taropen)� OPEN_METH)r� )r1 r6 r7 �not_compressed s z$TarFile.open.<locals>.not_compressed)�keyNz%file could not be opened successfully�:r# r� zunknown compression type %r�|r{ zmode must be 'r' or 'w'Fr� ro zundiscernible mode)rz r� )rz r{ )r� r{ ro ) r. �sortedr� rl r� r r r� r3 r� r� r� r� ) r1 r� rh r� r_ �kwargsr� r� �funcZ saved_posrg �streamr� r6 )r1 r7 r � sP % z TarFile.openc K s |dkrt d��| |||f|�S )zCOpen uncompressed tar archive name for reading or writing. rz r� r{ ro z!mode must be 'r', 'a', 'w' or 'x')rz r� r{ ro )r. )r1 r� rh r� r� r6 r6 r7 r� < s zTarFile.taropenr� c K s� |d krt d��yddl}|j W n ttfk rB td��Y nX y|j||d ||�}W n. tk r� |dk r�|dkr�td ��� Y nX y| j|||f|�}W nB tk r� |j � |dkr�td ��� Y n |j � � Y nX d |_ |S ) zkOpen gzip compressed tar archive name for reading or writing. Appending is not allowed. rz r{ ro z mode must be 'r', 'w' or 'x'r Nz gzip module is not availablerb znot a gzip fileF)rz r{ ro ) r. �gzipZGzipFiler� �AttributeErrorr r� r r� r� r� )r1 r� rh r� � compresslevelr� r� r� r6 r6 r7 �gzopenD s2 zTarFile.gzopenc K s� |d krt d��y ddl}W n tk r8 td��Y nX |j|pD|||d�}y| j|||f|�}W nF ttfk r� |j� |dkr�t d ��� Y n |j� � Y nX d |_ |S ) zlOpen bzip2 compressed tar archive name for reading or writing. Appending is not allowed. rz r{ ro z mode must be 'r', 'w' or 'x'r Nzbz2 module is not available)r� znot a bzip2 fileF)rz r{ ro ) r. r� r� r ZBZ2Filer� r� �EOFErrorr� r r� )r1 r� rh r� r� r� r� r� r6 r6 r7 �bz2openf s( zTarFile.bz2openc K s� |d krt d��y ddl}W n tk r8 td��Y nX |j|pD|||d�}y| j|||f|�}W nH |jtfk r� |j� |dkr�t d ��� Y n |j� � Y nX d |_ |S ) zkOpen lzma compressed tar archive name for reading or writing. Appending is not allowed. rz r{ ro z mode must be 'r', 'w' or 'x'r Nz lzma module is not available)�presetznot an lzma fileF)rz r{ ro ) r. r� r� r ZLZMAFiler� r� r� r� r r� )r1 r� rh r� r� r� r� r� r6 r6 r7 �xzopen� s& zTarFile.xzopenr� r� r� r� )r� r� r� r� c C s� | j r dS d| _ z`| jdkrn| jjttd � | jtd 7 _t| jt�\}}|dkrn| jjtt| � W d| j s�| jj � X dS ) zlClose the TarFile. In write-mode, two finishing zero blocks are appended to the archive. NTr� r{ ro r$ r )r� r{ ro ) r� rh r� r[ r1 r� r� rY � RECORDSIZEr� r� )r� r` ra r6 r6 r7 r� � s z TarFile.closec C s" | j |�}|dkr td| ��|S )a Return a TarInfo object for member `name'. If `name' can not be found in the archive, KeyError is raised. If a member occurs more than once in the archive, its last occurrence is assumed to be the most up-to-date version. Nzfilename %r not found)� _getmember�KeyError)r� r� r� r6 r6 r7 � getmember� s zTarFile.getmemberc C s | j � | js| j� | jS )z�Return the members of the archive as a list of TarInfo objects. The list has the same order as the members in the archive. )�_checkr� �_loadr� )r� r6 r6 r7 � getmembers� s zTarFile.getmembersc C s dd� | j � D �S )z�Return the members of the archive as a list of their names. It has the same order as the list returned by getmembers(). c S s g | ] }|j �qS r6 )r� )rn r� r6 r6 r7 rp � s z$TarFile.getnames.<locals>.<listcomp>)r� )r� r6 r6 r7 �getnames� s zTarFile.getnamesc C sp | j d� |dk r|j}|dkr$|}tjj|�\}}|jtjd�}|jd�}| j� }| |_ |dkr�t td�r�| j r�tj |�}q�tj |�}ntj|j� �}d}|j}t j|��r|j|jf} | j r�|jdkr�| | jkr�|| j| kr�t} | j| }nt} | d �rx|| j| < nht j|��r"t} nVt j|��r4t} nDt j |��rPt } tj |�}n(t j |��rbt } nt j!|��rtt"} ndS ||_||_#|j$|_%|j&|_'| tk�r�|j(|_)nd|_)|j*|_+| |_,||_-t.�r�yt.j/|j%�d |_0W n t1k �r� Y nX t2�r*yt2j3|j'�d |_4W n t1k �r( Y nX | t t"fk�rlt td��rlt td ��rltj5|j6�|_7tj8|j6�|_9|S ) a� Create a TarInfo object from the result of os.stat or equivalent on an existing file. The file is either named by `name', or specified as a file object `fileobj' with a file descriptor. If given, `arcname' specifies an alternative name for the file in the archive, otherwise, the name is taken from the 'name' attribute of 'fileobj', or the 'name' argument. The name should be a text string. �awxNr� �lstatr� r# r �major�minor):r� r� r} r% � splitdriver� r� r� r� r� r� r� r� rf �fstat�fileno�st_mode�S_ISREG�st_ino�st_dev�st_nlinkr� ry r �S_ISDIRr �S_ISFIFOr| �S_ISLNKrx �readlink�S_ISCHRr6 �S_ISBLKr7 rh �st_uidr) �st_gidr* �st_sizer' �st_mtimer( r� r� �pwd�getpwuidr+ r� �grpZgetgrgidr, r� �st_rdevr� r� r� ) r� r� �arcnamer� Zdrvr� Zstatresr� Zstmd�inoder� r6 r6 r7 � gettarinfo� s~ zTarFile.gettarinfoT)r� c C s0 | j � |dkr| }�x|D �] }|r�|jdkr:td� nttj|j�� td|jpX|j|jpb|jf � |j � sz|j � r�tdd|j |j f � ntd|j � |jdkr�td� n tdtj|j�dd � � t|j|j� r�d nd � |�r"|j� �r td |j � |j� �r"td |j � t� q W dS )a Print a table of contents to sys.stdout. If `verbose' is False, only the names of the members are printed. If it is True, an `ls -l'-like output is produced. `members' is optional and must be a subset of the list returned by getmembers(). Nz ??????????z%s/%sz%10sz%d,%dz%10dz????-??-?? ??:??:??z%d-%02d-%02d %02d:%02d:%02dr� r� r� z-> zlink to )r� rh rp rf rg r+ r) r, r* rz r{ r� r� r' r( r� Z localtimer� r� r� r� r� ro )r� �verboser� r� r6 r6 r7 rk > s2 z TarFile.list)�filterc C sv | j d� |dkr|}|dk rPddl}|jdtd� ||�rP| jdd| � dS | jdk r�tjj|�| jkr�| jdd| � dS | jd|� | j ||�}|dkr�| jdd | � dS |dk r�||�}|dkr�| jdd| � dS |j � �rt |d ��}| j ||� W dQ R X nd|j � �rh| j |� |�rrxHtj|�D ].}| jtjj||�tjj||�|||d � �q4W n | j |� dS ) a~ Add the file `name' to the archive. `name' may be any type of file (directory, fifo, symbolic link, etc.). If given, `arcname' specifies an alternative name for the file in the archive. Directories are added recursively by default. This can be avoided by setting `recursive' to False. `exclude' is a function that should return True for each filename to be excluded. `filter' is a function that expects a TarInfo object argument and returns the changed TarInfo object, if it returns None the TarInfo object will be excluded from the archive. r� Nr z use the filter argument insteadr$ ztarfile: Excluded %rztarfile: Skipped %rr# z tarfile: Unsupported type %rr� )r� )r� rc rd re �_dbgr� r} r% r� r� r� r� �addfiler� �listdir�addr� ) r� r� r� � recursiveZexcluder� rc r� �fr6 r6 r7 r� d sB z TarFile.addc C s� | j d� tj|�}|j| j| j| j�}| jj|� | jt |�7 _| j }|dk r�t || j|j |d� t |j t�\}}|dkr�| jjtt| � |d7 }| j|t 7 _| jj|� dS )a Add the TarInfo object `tarinfo' to the archive. If `fileobj' is given, it should be a binary file, and tarinfo.size bytes are read from it and added to the archive. You can create TarInfo objects directly, or by using gettarinfo(). r� N)r_ r r# )r� r r rP r4 r5 r� r[ r� r0 r� rX r' rY r� r1 r� r� )r� r� r� rT r_ r` ra r6 r6 r7 r� � s zTarFile.addfilec " C sH |d k�r| j }|d k� r�tjjd�}|d kr�y tt�}W n tk rN Y nBX dd l}|jd dd�}|� |j |� W d Q R X |jdddd�}|r�y t | }W n& t k r� t d|�d ��d �Y nX || _ |S t � r�tjdt� tS tS t|t��r td ��|S t|��r|S yt | S t k �rB t d|�d ��d �Y nX d S ) NZ PYTHON_TARFILE_EXTRACTION_FILTERr �#)Z interpolationZcomment_prefixesr� r� )Zfallbackzfilter z not foundz4The default behavior of tarfile extraction has been z$changed to disallow common exploits z(including CVE-2007-4559). z1By default, absolute/parent paths are disallowed z and some mode bits are cleared. z/See https://access.redhat.com/articles/7004769 zfor more details.z#String names are not supported for z2TarFile.extraction_filter. Use a function such as z tarfile.data_filter directly.)r� zXThe default behavior of tarfile extraction has been changed to disallow common exploits zsThe default behavior of tarfile extraction has been changed to disallow common exploits (including CVE-2007-4559). z�The default behavior of tarfile extraction has been changed to disallow common exploits (including CVE-2007-4559). By default, absolute/parent paths are disallowed z�The default behavior of tarfile extraction has been changed to disallow common exploits (including CVE-2007-4559). By default, absolute/parent paths are disallowed and some mode bits are cleared. z�The default behavior of tarfile extraction has been changed to disallow common exploits (including CVE-2007-4559). By default, absolute/parent paths are disallowed and some mode bits are cleared. See https://access.redhat.com/articles/7004769 a The default behavior of tarfile extraction has been changed to disallow common exploits (including CVE-2007-4559). By default, absolute/parent paths are disallowed and some mode bits are cleared. See https://access.redhat.com/articles/7004769 for more details.zUString names are not supported for TarFile.extraction_filter. Use a function such as zrString names are not supported for TarFile.extraction_filter. Use a function such as tarfile.data_filter directly.)�extraction_filterr} �environr5 r� �_CONFIG_FILENAME�FileNotFoundError� configparserZ ConfigParserZ read_file�_NAMED_FILTERSr� r. �_RH_SAFER_DEFAULTrc rd �RuntimeWarningr� r� r* r, � TypeError�callable)r� r� r� �filer� Zconfr6 r6 r7 �_get_filter_function� sR z TarFile._get_filter_function�.)� numeric_ownerr� c " C s� g }| j |�}|dkr| }xT|D ]L}| j|||�\}} |dkr@q |j� rR|j| � | j|||j� ||d� q W |jdd� dd� �x$|D �]} y�y|| |�}W n4 tk r� } z| j| t| �� w�W Y dd} ~ X nX |dkr�| j| d� w�t j j ||j �} yt j | �} W n$ tk �r. | j|d� w�Y nX tj| j��sL| j|d � w�| j|| |d � | j|| � | j|| � W q� tk �r� } z| j| � W Y dd} ~ X q�X q�W dS ) a� Extract all members from the archive to the current working directory and set owner, modification time and permissions on directories afterwards. `path' specifies a different directory to extract to. `members' is optional and must be a subset of the list returned by getmembers(). If `numeric_owner` is True, only the numbers for user/group names are used and not the names. The `filter` function will be called on each member just before extraction. It can return a changed TarInfo or None to skip the member. String names of common filters are accepted. N)� set_attrsr� �filter_functionc S s | j S )N)r� )r� r6 r6 r7 �<lambda> s z$TarFile.extractall.<locals>.<lambda>T)r� �reversezexcluded by filterZmissingznot a directory)r� )r� �_get_extract_tarinfor� r� � _extract_one�sort�_FILTER_ERRORS�_log_no_directory_fixup�reprr} r% r� r� r� r� rf r� r� �chown�utime�chmodr �_handle_nonfatal_error)r� r% r� r� r� Z directoriesr� r� r� � unfiltered�exc�dirpathr� r� r6 r6 r7 � extractall� sP zTarFile.extractallc C s | j dd|j|f � d S )Nr$ z(tarfile: Not fixing up directory %r (%s))r� r� )r� r� �reasonr6 r6 r7 r� 4 s z TarFile._log_no_directory_fixupr� c C s8 | j |�}| j|||�\}}|dk r4| j||||� dS )a� Extract a member from the archive to the current working directory, using its full name. Its file information is extracted as accurately as possible. `member' may be a filename or a TarInfo object. You can specify a different directory using `path'. File attributes (owner, mtime, mode) are set unless `set_attrs' is False. If `numeric_owner` is True, only the numbers for user/group names are used and not the names. The `filter` function will be called before extraction. It can return a changed TarInfo or None to skip the member. String names of common filters are accepted. N)r� r� r� ) r� r� r% r� r� r� r� r� r� r6 r6 r7 �extract8 s zTarFile.extractc C s� t |t�r| j|�}n|}d}y|||�}W nZ ttfk r\ } z| j|� W Y dd}~X n, tk r� } z| j|� W Y dd}~X nX |dkr�| jdd|j � dS |j � r�t j |�}t j j||j�|_||fS )z�Get (filtered, unfiltered) TarInfos from *member* *member* might be a string. Return (None, None) if not found. Nr$ ztarfile: Excluded %r)NN)r* r, r� r� r� �_handle_fatal_errorr r� r� r� r� r r} r% r� r� r )r� r� r� r% r� �filteredr� r6 r6 r7 r� L s" z TarFile._get_extract_tarinfoc C s� | j d� y&| j|tjj||j�||||d� W nV tk r\ } z| j|� W Y dd}~X n, tk r� } z| j |� W Y dd}~X nX dS )z�Extract from filtered tarinfo to disk. filter_function is only used when extracting a *different* member (e.g. as fallback to creating a symlink) rz )r� r� r� �extraction_rootN) r� �_extract_memberr} r% r� r� r� r� r r� )r� r� r% r� r� r� r� r6 r6 r7 r� j s zTarFile._extract_onec C s" | j dkr� n| jdd| � dS )z=Handle non-fatal error (ExtractError) according to errorlevelr# z tarfile: %sN)r� r� )r� r� r6 r6 r7 r� ~ s z TarFile._handle_nonfatal_errorc C sn | j dkr� n\t|t�rP|jdkr6| jdd|j � qj| jdd|j|jf � n| jddt|�j|f � dS )z1Handle "fatal" error according to self.errorlevelr Nr# z tarfile: %sztarfile: %s %rztarfile: %s %s)r� r* r� �filenamer� �strerrorr� rq )r� r� r6 r6 r7 r� � s zTarFile._handle_fatal_errorc C s� | j d� t|t�r | j|�}n|}|j� s6|jtkrB| j| |�S |j� sR|j � rzt| j t �rht d��q~| j | j|��S ndS dS )z�Extract a member from the archive as a file object. `member' may be a filename or a TarInfo object. If `member' is a regular file or a link, an io.BufferedReader object is returned. Otherwise, None is returned. rz z'cannot extract (sym)link as file objectN)r� r* r, r� r� r� rZ � fileobjectr� r� r� r� r � extractfile�_find_link_target)r� r� r� r6 r6 r7 r� � s zTarFile.extractfile)r� r� c C s\ |j d�}|jdtj�}tjj|�}|r@tjj|� r@tj|� |j� sP|j � rj| j dd|j |j f � n| j d|j � |j � r�| j||� n�|j� r�| j||� n~|j� r�| j||� nh|j� s�|j� r�| j||� nJ|j� s�|j � r�| j||||d� n&|jtk�r| j||� n | j||� |�rX| j|||� |j � �sX| j||� | j ||� dS )z�Extract the filtered TarInfo object tarinfo to a physical file called targetpath. filter_function is only used when extracting a *different* member (e.g. as fallback to creating a symlink) r� r# z%s -> %s)r� r� N) rK r� r} r� r% r� r� �makedirsr� r� r� r� r� r� �makefiler� �makedirr} �makefiforz r{ �makedev�makelink_with_filterr� rZ � makeunknownr� r� r� )r� r� � targetpathr� r� r� r� Z upperdirsr6 r6 r7 r� � s: zTarFile._extract_memberc C s@ y&|j dkrtj|� n tj|d� W n tk r: Y nX dS )z,Make a directory called targetpath. Ni� )rh r} �mkdir�FileExistsError)r� r� r r6 r6 r7 r � s zTarFile.makedirc C s� | j }|j|j� | j}t|d��f}|jdk rrx,|jD ]"\}}|j|� t|||t|� q6W |j|j� |j � nt|||jt|� W dQ R X dS )z'Make a file called targetpath. r� N) r� r� r� r� r� r� rX r r' �truncate)r� r� r �sourcer_ �targetr� r' r6 r6 r7 r � s zTarFile.makefilec C s" | j ||� | jdd|j � dS )zYMake a file from a TarInfo object with an unknown type at targetpath. r# z9tarfile: Unknown file type %r, extracted as regular file.N)r r� r� )r� r� r r6 r6 r7 r s zTarFile.makeunknownc C s" t td�rtj|� ntd��dS )z'Make a fifo called targetpath. �mkfifoz fifo not supported by systemN)r� r} r r )r� r� r r6 r6 r7 r s zTarFile.makefifoc C sn t td� st td� r td��|j}|dkr2d}|j� rF|tjO }n |tjO }tj||tj |j |j �� dS )z<Make a character or block device called targetpath. �mknodr z'special devices not supported by systemNi� ) r� r} r rh r{ rf �S_IFBLK�S_IFCHRr r r� r� )r� r� r rh r6 r6 r7 r s zTarFile.makedevc C s | j ||d d �S )N)r )r� r� r r6 r6 r7 �makelink( s zTarFile.makelinkc $ C s& d}yT|j � r6tjj|�r$tj|� tj|j|� dS tjj|j�rVtj |j|� dS W n t k rp d}Y nX y| j |�}W n$ t k r� |r�t d��n� Y nX |dkr�|}nR|dkr�t d��y|||�}W n2 tk �r } zt||j�|�W Y dd}~X nX |dk �r"| j||||d� dS ) a3 Make a (symbolic) link called targetpath. If it cannot be created (platform limitation), we try to make a copy of the referenced file instead of a link. filter_function is only used when extracting a *different* member (e.g. as fallback to creating a link). FNTz%unable to resolve link inside archivez6makelink_with_filter: if filter_function is not None, z%extraction_root must also not be None)r� r� z[makelink_with_filter: if filter_function is not None, extraction_root must also not be None)r� r} r% �lexists�unlink�symlinkr� r� r �link�symlink_exceptionr r� r r� r� r� r� ) r� r� r r� r� Zkeyerror_to_extracterrorr� r� �causer6 r6 r7 r + sB z TarFile.makelink_with_filterc C s� t td�r�tj� dkr�|j}|j}|s�y trB|jrBtj|j�d }W n tk rX Y nX y t rv|j rvt j |j �d }W n tk r� Y nX |dkr�d}|dkr�d }y4|j � r�t td�r�tj |||� ntj|||� W n tk r� td��Y nX dS ) z�Set owner of targetpath according to tarinfo. If numeric_owner is True, use .gid/.uid instead of .gname/.uname. If numeric_owner is False, fall back to .gid/.uid when the search based on name fails. �geteuidr r$ Nr# �lchownzcould not change ownerr9 r9 )r� r} r r* r) r� r, Zgetgrnamr� r� r+ �getpwnamr� r r� r� r )r� r� r r� �g�ur6 r6 r7 r� ] s0 z TarFile.chownc C sL |j dkrdS ttd�rHytj||j � W n tk rF td��Y nX dS )zASet file permissions of targetpath according to tarinfo. Nr� zcould not change mode)rh r� r} r� r� r )r� r� r r6 r6 r7 r� ~ s z TarFile.chmodc C sV |j }|dkrdS ttd�s dS ytj|||f� W n tk rP td��Y nX dS )zBSet modification time of targetpath according to tarinfo. Nr� z"could not change modification time)r( r� r} r� r� r )r� r� r r( r6 r6 r7 r� � s z TarFile.utimec C s� | j d� | jdk r$| j}d| _|S | j| jj� krZ| jj| jd � | jjd�sZtd��d}�xby| jj | �}W �nH t k r� } z2| j r�| j dd| j|f � | jt 7 _wbW Y dd}~X n� tk �r, } zN| j �r| j dd| j|f � | jt 7 _wbn| jdk�r tt|���W Y dd}~X n� tk �rT | jdk�rPtd��Y nj tk �r� } z | jdk�r~tt|���W Y dd}~X n0 tk �r� } ztt|���W Y dd}~X nX P qbW |dk �r�| jj|� nd | _|S ) z�Return the next member of the archive as a TarInfo object, when TarFile is opened for reading. Return None if there is no more available. ZraNr# zunexpected end of datar$ z0x%X: %sr z empty fileT)r� r� r� r� r� r� rZ r r� rT rw r� r� r� rH r, ru rv rx r� r� r� )r� �mr� r� r6 r6 r7 r] � sL z TarFile.nextc C s� | j � }d}|dk rHy|j|�}W n tk r: d}Y nX |d|� }|rXtjj|�}xLt|�D ]@}|r||j|jkrbd}qb|r�tjj|j�}n|j}||krb|S qbW |r�t|��dS )z}Find an archive member by name from bottom to top. If tarinfo is given, it is used as the starting point. FNT) r� �indexr. r} r% r� �reversedr� r� ) r� r� r� � normalizer� Zskippingr r� � member_namer6 r6 r7 r� � s, zTarFile._getmemberc C s" x| j � }|dkrP qW d| _dS )zWRead through the entire archive file and look for readable members. NT)r] r� )r� r� r6 r6 r7 r� � s z TarFile._loadc C s: | j rtd| jj ��|dk r6| j|kr6td| j ��dS )znCheck if TarFile is still open, and if the operation's mode corresponds to TarFile's mode. z %s is closedNzbad operation for mode %r)r� r� r� rq rh )r� rh r6 r6 r7 r� � s zTarFile._checkc C s` |j � r.djtdtjj|j�|jf��}d}n |j}|}| j||dd�}|dkr\t d| ��|S )zZFind the target member of a symlink or hardlink member in the archive. r� NT)r� r! zlinkname %r not found) r� r� r� r} r% r� r� r� r� r� )r� r� r� �limitr� r6 r6 r7 r s zTarFile._find_link_targetc c s� | j r| jE dH dS d}| jdk r:| j� }|d7 }|V xN|t| j�k rV| j| }n"| j st| j� }|sxd| _ dS ndS |d7 }|V q<W dS )z$Provide an iterator object. Nr r# T)r� r� r� r] r0 )r� r r� r6 r6 r7 �__iter__ s& zTarFile.__iter__c C s || j krt|tjd� dS )z.Write debugging output to sys.stderr. )r� N)r� ro rm �stderr)r� �level�msgr6 r6 r7 r� : s z TarFile._dbgc C s | j � | S )N)r� )r� r6 r6 r7 � __enter__@ s zTarFile.__enter__c C s, |d kr| j � n| js"| jj � d| _d S )NT)r� r� r� r� )r� r� r � tracebackr6 r6 r7 �__exit__D s zTarFile.__exit__) Nrz NNNNNNr NNNN)rz N)rz Nr� )rz Nr� )rz NN)NNN)T)NTN)N)r� N)r� T)N)TF)NF)N)@rq rr rs rt r� r� r� r� r rP r r4 r5 r r� r� r� r� r� r� r� r r� r� r� r� r� r� r� r� r� r� rk r� r� r� r� r� r� r� r� r� r� r� r� r r r r r r r r� r� r� r] r� r� r� r r$ r� r( r* r6 r6 r6 r7 r V s� lZ ! d&= 5D 62! 6 ( c C s. yt | �}|j� dS tk r( dS X dS )zfReturn True if name points to a tar archive that we are able to handle, else return False. TFN)r r� r )r� r� r6 r6 r7 r R s c C s dd l } d}| j|d�}|jdddddd � |jd d td d � |j� }|jddddd� |jdddd5dd� |jdddd6d d� |jd d dd d� |j� }|jr�|j r�|jd!d"� |j �r*|j }t |��rt |d#�� }|j � t |j � tjd$� W d Q R X |j�r&t d%j|�� n|jd!d&j|�� �n�|j�r�|j}t |��rjtj |d'��}|j|jd(� W d Q R X n|jd!d&j|�� �n�|j�rPt|j�d!k�r�|jd }tj}n,t|j�d)k�r�|j\}}n|jd!|j� � t |��r<tj |d'��}|j||jd*� W d Q R X |j�rN|d+k�r&d,j|�} n d-j||�} t | � n|jd!d&j|�� n�|j�r�|jjd�} tjj | �\} } d.d.d/d/d0d0d0d0d1�} | | k�r�d2| | nd3}|j}tj | |�� }x|D ]}|j |� �q�W W d Q R X |j�rt d4j| �� n|jd!|j� � d S )7Nr z3A simple command line interface for tarfile module.)� descriptionz-vz --verbose� store_trueFzVerbose output)�action�default�helpz--filterz <filtername>zFilter for extraction)�metavar�choicesr/ z-lz--list� <tarfile>zShow listing of a tarfile)r0 r/ z-ez --extract�+� <output_dir>z Extract tarfile into target dir)�nargsr0 r/ z-cz--create�<name>�<file>zCreate tarfile from sourcesz-tz--testzTest if a tarfile is validr# z&--filter is only valid for extraction rz )r� z{!r} is a tar archive.z{!r} is not a tar archive. zr:*)r� r$ )r% r� r� z{!r} file is extracted.z+{!r} file is extracted into {!r} directory.r� r� r� )z.gzz.tgzz.xzz.txzz.bz2z.tbzz.tbz2z.tb2zw:r{ z{!r} file created.)r2 r4 )r6 r7 ) �argparse�ArgumentParser� add_argumentr� Z add_mutually_exclusive_group� parse_argsr� r� �exitZtestr r r� ro rm r% r� rP rk r r0 r} �curdirZ format_helpr� Zcreate�popr% �splitextr� )r8 r+ �parserrc �argsr\ r� Ztfr= r' Ztar_namerm ZextZ compressionsZtar_modeZ tar_files� file_namer6 r6 r7 �main` s� rC �__main__)r% r& r' r( r) r* r+ r, )T)trt �version� __author__Z__date__Z __cvsid__� __credits__�builtinsr r� rm r} r� rW rf r� rS r �rerc r� r� r� r� �NotImplementedErrorr r� � NameError�__all__r� r� r1 r� r� r r r r r4 r rH ry rx r6 r7 r r| ZCONTTYPEr" r! rI r. r0 rW r r r r rZ rv rL rs rf r+ rF rt r� r �getfilesystemencodingr8 r= rK rQ rU rX rg rp � Exceptionr r r r r r ru rv rw rH rx ry r� �objectr� r� �BufferedReaderr� r� r� r� r� r� r� r� r� r� r� r� r� r� r �compilera r r r rC rq r6 r6 r6 r7 �<module> s& w h D h b
Return