| Server IP : 80.87.202.40 / Your IP : 216.73.216.169 Web Server : Apache System : Linux rospirotorg.ru 5.14.0-539.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Dec 5 22:26:13 UTC 2024 x86_64 User : bitrix ( 600) PHP Version : 8.2.27 Disable Function : NONE MySQL : OFF | cURL : ON | WGET : ON | Perl : ON | Python : OFF | Sudo : ON | Pkexec : ON Directory : /usr/lib64/python3.9/site-packages/mercurial/__pycache__/ |
Upload File : |
a
�+�b�z � @ s� d dl mZ d dlZd dlZd dlZd dlZddlmZ ddlm Z ddl
m Z ddl m
Z
mZmZmZmZmZmZmZmZmZ ddlmZ dd lmZ d
d � Zd d
� Z dDdd�Z dd� Z dd� Z dEdd�Z dd� Z!dd� Z"dFd d �Z#d d � Z$d d!� Z%d"d#� Z&G d$d%� d%e'�Z(d Z)dZ*d&Z+d'Z,d(d)� Z-d*d+� Z.ej/d,d-� �Z0d.d/� Z1d0d1� Z2d2d3� Z3d4d5� Z4d6d7� Z5d8d9� Z6ej/d:d;� �Z7d<d=� Z8d>d?� Z9d@dA� Z:dBdC� Z;dS )G� )�absolute_importN� )�_)�open)�
repository)
� bookmarks� cacheutil�error�
narrowspec�phases�pycompat� requirements�scmutil�store�util)�nodemap)�
stringutilc C s t | �}|tj8 }|�|� |S )a determine the final set of requirement for a new stream clone
this method combine the "default" requirements that a new repository would
use with the constaint we get from the stream clone content. We keep local
configuration choice when possible.
)�set�requirementsmod�STREAM_FIXED_REQUIREMENTS�update)Zdefault_requirements�streamed_requirementsr
� r �;/usr/lib64/python3.9/site-packages/mercurial/streamclone.py� new_stream_clone_requirements& s
r c C s | j tj@ }|S )z�the set of requirement the new clone will have to support
This is used for advertising the stream options and to generate the actual
stream content.)r
r r )�repoZrequiredformatsr r r r 3 s
�r Fc C s | j }| j}d}| jr,d| j�dg �v r,d}|r8|s8dS |rD|sDdS t|�rPdS | jrZdS | j}|du rr|�d�}|szdS t � }|�d�r�|�
t j � n||�d�}|s�| j j
�td �� dS t |�d
��}||j }|�r| j j
�td �d �t|�� � | j j
�td
�� dS |}d|fS )a� Whether it is possible to perform a streaming clone as part of pull.
``bundle2`` will cause the function to consider stream clone through
bundle2 and only through bundle2.
Returns a tuple of (supported, requirements). ``supported`` is True if
streaming clone is supported and False otherwise. ``requirements`` is
a set of repo requirements from the remote, or ``None`` if stream clone
isn't supported.
Fs v2s streamT)FNNs stream-preferreds
streamreqss= warning: stream clone requested but server has them disabled
� ,sG warning: stream clone requested but client is missing requirements: %s
� , sQ (see https://www.mercurial-scm.org/wiki/MissingRequirement for more information)
)r �remoteZ
canusebundle2Zremotebundle2caps�get�lenZheadsZstreamclonerequested�capabler �addr ZREVLOGV1_REQUIREMENT�ui�warnr �split� supported�join�sorted) �pullopZbundle2r r Zbundle2supportedZstreamrequestedr
Z
streamreqs� missingreqsr r r �canperformstreamclone> s`
��
� ����r+ c
C s ddl m} t| �\}}|s dS | j}| j}d}|�d�rr|�� � }|�di ��� }W d � n1 sh0 Y |j �
t d�� |�� � }|�di ��� }W d � n1 s�0 Y |� � } z t
| �}
W n" ty� t�t d�| ��Y n0 |
dk�r t�t d���n2|
d k�r&t�t d
���n|
d k�r>t�t d ���|� � } ztt
| �d
d��\} } W n( ttf�y� t�t d�| ��Y n0 |�� �t t||| | � t|j|�|_|�|j |j|j�|j_ t � |� t � |� |�r�|j!�"||� |�#� W d � n1 �s0 Y dS )z�Possibly perform a legacy stream clone operation.
Legacy stream clones are performed as part of pull but before all other
operations.
A legacy stream clone will not be performed if a bundle2 stream clone is
supported.
r �� localrepoNs branchmaps streaming all changes
s
stream_out�' unexpected response from remote server:s operation forbidden by server� s$ locking the remote repository failedr s% the server sent an unknown error code� )$� r- r+ r r r! ZcommandexecutorZ callcommand�resultr# �statusr �readline�int�
ValueErrorr �
ResponseError�Abort�mapr% � TypeError�lock� consumev1r r
�resolvestorevfsoptions�features�svfs�optionsr �writereporequirementsr �post_stream_cleanupZ
_branchcaches�replace�
invalidate)
r) r- r& r
r r Z
rbranchmap�e�fp�lZresp� filecount� bytecountr r r � maybeperformlegacystreamclone� s^
.
. �
�
� �
rJ c C sF t j| jvrdS | jjdddd�s&dS t�| �}|rB| j�dd�S dS )z5Whether streaming clones are allowed from the server.Fs servers uncompressedT)Z untrusteds uncompressedallowsecret)r ZREPO_FEATURE_STREAM_CLONEr> r# Z
configboolr Z hassecret)r Zsecretr r r �allowservergeneration� s
rK c C s | j �|�S �N)r �walk)r �matcherr r r �_walkstreamfiles� s rO c s� g �d}�� � �R �j�d� t��D ]$\}}}|r&��||f� ||7 }q&t�� W d � n1 sh0 Y t�� �j�dt��|f � �j��jj � � ���fdd�}t��||� fS )a� Emit content for version 1 of a streaming clone.
This returns a 3-tuple of (file count, byte size, data iterator).
The data iterator consists of N entries for each file being transferred.
Each file entry starts as a line with the file name and integer size
delimited by a null byte.
The raw file data follows. Following the raw file data is the next file
entry, or EOF.
When used on the wire protocol, an additional line indicating protocol
success will be prepended to the stream. This function is not responsible
for adding it.
This function will obtain a repository lock to ensure a consistent view of
the store is captured. It therefore may raise LockError.
r � scanning
Ns %d files, %d bytes to transfer
c 3 s� �D ]�\} }� r$�j �d| |f � dt�| �|f V �| ddd��@}|dkr^|�|�V ntj||d�D ]
}|V qlW d � q1 s�0 Y qd S )Ns sending %s (%d bytes)
s %s %d
� rbF)Z auditpath� ��limit)r# �debugr Z encodedir�readr �
filechunkiter)�name�sizerF �chunk�� debugflag�entriesr r? r r �emitrevlogdata" s z"generatev1.<locals>.emitrevlogdata)
r; r# rU rO �append�_test_sync_point_walk_1�_test_sync_point_walk_2r r? r\ )r Z total_bytesZ file_typerX rY r^ r r[ r �
generatev1� s"
&�rb c c sj t | �sdV dS zt| �\}}}W n tjy@ dV Y dS 0 dV d||f V |D ]
}|V qZdS )a� Emit content for version 1 of streaming clone suitable for the wire.
This is the data output from ``generatev1()`` with 2 header lines. The
first line indicates overall success. The 2nd contains the file count and
byte size of payload.
The success line contains "0" for success, "1" for stream generation not
allowed, and "2" for error locking the repository (possibly indicating
a permissions error for the server process).
s 1
Ns 2
s 0
s %d %d
)rK rb r Z LockError)r rH rI �itrZ r r r �generatev1wireproto4 s rd � UNc s@ � dkrt d��t��}d�t|���� ��fdd�}||� fS )a@ Emit content for version 1 of a stream clone bundle.
The first 4 bytes of the output ("HGS1") denote this as stream clone
bundle version 1.
The next 2 bytes indicate the compression type. Only "UN" is currently
supported.
The next 16 bytes are two 64-bit big endian unsigned integers indicating
file count and byte count, respectively.
The next 2 bytes is a 16-bit big endian unsigned short declaring the length
of the requirements string, including a trailing . The following N bytes
are the requirements string, which is ASCII containing a comma-delimited
list of repo requirements that are needed to support the data.
The remaining content is the output of ``generatev1()`` (which may be
compressed in the future).
Returns a tuple of (requirements, data generator).
re s. we do not support the compression argument yetr c 3 s� dV � V t ��\} }}�j�td�|| f � t�d| |�V t�dt��d �V �d V � dksnJ ��jjtd�|td �d
�}|�d � |D ]}|j t|�d � |V q�|�
� d S )
Ns HGS1s writing %d bytes for %d files
� >QQ� >Hr � re � bundle� bytes��total�unitr ��step) rb r# r3 r �struct�packr � makeprogressr � increment�complete)rH rI rc �progressrZ �� compressionr �requiresr r �genl s$ �
�
z generatebundlev1.<locals>.gen)r6 r r' r( )r rw r
ry r rv r �generatebundlev1P s rz c
C s | � � ��� | j�td�|t�|�f � | jjtd�|td�d�}|�d� t�� }| � d���: | j
j | j|d��� t �
|�D ]�}|�� }z |�dd�\}} t| �} W n& ttfy� t�td �|��Y n0 | jjr�| j�d
|t�| �f � t�|�}
| j
|
d d d
��@} tj|| d�D ] } |jt| �d� | � | � �q W d � q�1 �sV0 Y q�W d � n1 �sx0 Y | j d d� W d � n1 �s�0 Y t�� | }
|
dk�r�d}
|� � | j�td�t�|�|
t�||
�f � W d � n1 �s0 Y dS )a
Apply the contents from version 1 of a streaming clone file handle.
This takes the output from "stream_out" and applies it to the specified
repository.
Like "stream_out," the status line added by the wire protocol is not
handled by this function.
�! %d files to transfer, %s of data
� clonerj rk r )Z
expectedcountrh r r. s adding %s (%s)
� wT)ZbackgroundcloserS rn N�Zclearfilecache���MbP?�( transferred %s in %.1f seconds (%s/sec)
) r; r# r3 r r rI rr r �timer� transactionr? �backgroundclosingr Zxranger4 r% r5 r6 r: r r7 r\ rU r Z decodedirrW rs r �writerD rt )r rF rH rI ru �start�irG rX rY �path�ofprZ �elapsedr r r r< � sX ���
�
�
P,
���r< c C s� | � d�}|dkr$t�td�| ��t�d| � d��\}}t�d| � d��d }| � |�}|�d�srt�td ���t|�d�� d
��}|||fS ) Nr/ re s< only uncompressed stream clone bundles are supported; got %srf � rg r rh s@ malformed stream clone bundle: requirements not properly encodedr )
rV r r8 r rp �unpack�endswithr �rstripr% )rF rw rH rI Z requireslenrx r
r r r �readbundle1header� s(
���
��r� c C sj t | �rt�td���t|�\}}}|| j }|rNt�td�d�t|�� ��t| |||� t �
| � dS )z�Apply the content from a stream clone bundle version 1.
We assume the 4 byte header has been read and validated and the file handle
is at the 2 byte compression identifier.
s2 cannot apply stream clone bundle on non-empty repo�4 unable to apply stream clone: unsupported format: %sr N) r r r8 r r� r& r' r( r< r rB )r rF rH rI r
r* r r r �
applybundlev1� s �
��r� c @ s e Zd ZdZdd� Zdd� ZdS )�streamcloneapplierz�Class to manage applying streaming clone bundles.
We need to wrap ``applybundlev1()`` in a dedicated type to enable bundle
readers to perform bundle type-specific functionality.
c C s
|| _ d S rL )�_fh)�selfZfhr r r �__init__ s zstreamcloneapplier.__init__c C s t || j�S rL )r� r� )r� r r r r �apply s zstreamcloneapplier.applyN)�__name__�
__module__� __qualname__�__doc__r� r� r r r r r� s r� � s� cc C s g }| � � s|�d� |S )z!list snapshot file from the stores
phaseroots)Z
publishingr_ )r �fnamesr r r �_walkstreamfullstorefiles s
r� c C s2 | \}}}}|t kr| S |||||| �|��fS )z actually copy the snapshot files)� _filefullr' )�entry�copy�vfsmap�srcrX �ftype�datar r r � _filterfull' s r� c
# sJ g � z*� fdd�} | V W � D ]}t �|� q n� D ]}t �|� q40 dS )z(return a function to temporary copy filec s4 t �� \}}t�|� � �|� tj| |dd� |S )NT)�hardlink)r Zmkstemp�os�closer_ r Z copyfiles)r� �fd�dst��filesr r r� 5 s
z maketempcopies.<locals>.copyN)r Z tryunlink)r� �tmpr r� r �maketempcopies/ s �r� c C s& t | jt| ji}| j|�� vs"J �|S )z$make a (src -> vfs) map for the repo)� _srcstorer? � _srccache�cachevfs�vfs�values)r r� r r r �_makemapB s
�r� c # s� t | ��| j��� v r t�d��| jjtd�|td�d�}|�d� t � ��f� |��> � �fdd�|D �}dV d}|D �]\}}}}�| } |V t
� t |��V |t
kr�| |�}
|} n |tkr�t|d �}
t
�|
�j} d} z�t
� | �V |V | d
k�r|
�| �f}
nt
j|
| d �}
|
D ].}| t |�7 } |t |�7 }|�|� |V �q| | k�rlt�td �| || f ��W |
�� qx|
�� 0 qxW d � n1 �s�0 Y W d � n1 �s�0 Y dS )
z actually emit the stream bundle�9 repo.vfs must not be added to vfsmap for security reasonsri rj rk r c s g | ]}t |� ���qS r )r� )�.0rE �r� r� r r �
<listcomp>b � z_emit2.<locals>.<listcomp>NrQ rR rS s= clone could only read %d bytes from %s, but expected %d bytes)r� r� r� r �ProgrammingErrorr# rr r r r� r Z
uvarintencoder � _fileappendr� r �fstat�st_sizerV rW r8 r� )r r] �
totalfilesizeru Ztotalbytecountr� rX r� r� r� rF rY rI �chunksrZ r r� r �_emit2O sX ��
���r� c C s dS �z+a function for synchronisation during testsNr �r r r r r` � s r` c C s dS r� r r� r r r ra � s ra c C s8 | � | j�dusJ �g }d}d}|s(|r8t�| j||�}t| |�D ]:\}}} | rBt}
|tj@ rbt }
|�
t ||
| f� || 7 }qBt | �D ]4}| j
�|�r�|| j
�|�j7 }|�
t |t df� q�|r�| j
�d�r�|| j
�d�j7 }|�
t dt df� t�| �D ]4}| j�|�r�|| j�|�j7 }|�
t|t df� q�||fS )a� emit a seris of files information useful to clone a repo
return (entries, totalfilesize)
entries is a list of tuple (vfs-key, file-path, file-type, size)
- `vfs-key`: is a key to the right vfs to write the file (see _makemap)
- `name`: file path of the file to copy (to be feed to the vfss)
- `file-type`: do this file need to be copied with the source lock ?
- `size`: the size of the file (or None)
Nr s obsstore)Z _currentlockZ_lockrefr
�match�rootrO r� r ZFILEFLAGS_VOLATILEr� r_ r� r� r? �exists�lstatr� r Z cachetocopyr� r� ) r �includes�excludes�includeobsmarkersr] r� rN Zrl_typerX rY Zftr r r �_v2_walk� s2
r� c C s� | � � �X | j�d� t| |||d�\}}t| ||�}t|�}|du sJJ �t| � W d � n1 sf0 Y t| � t|�||fS )a� Emit content for version 2 of a streaming clone.
the data stream consists the following entries:
1) A char representing the file destination (eg: store or cache)
2) A varint containing the length of the filename
3) A varint containing the length of file data
4) N bytes containing the filename (the internal, store-agnostic form)
5) N bytes containing the file data
Returns a 3-tuple of (file count, file size, data iterator).
rP �r� r� r� N) r; r# rU r� r� �nextr` ra r )r r� r� r� r] r� r� �firstr r r �
generatev2� s
�
&r� c g sv | d }| dd � }|�J |rNt |� � d V W d � qT1 sB0 Y nd V W d � n1 sh0 Y d S )Nr r )�nested)�ctxs�this�restr r r r� � s
&r� c s( � � � �� � j�td�|t�|�f � t�� }� jjtd�|td�d�}|�d� t � �}� j
|� � v rvt �
d��� �d��� � fdd�|� � D �}t|� �� t|�D ]�}t�|d �} || }
t�|�} t�|�} t�|| �}
� jj�r
� j�d
| |
t�| �f � |
|
d ��@}tj|| d �D ] }|jt|�d
� |�|� �q$W d � q�1 �s\0 Y q�W d � n1 �s~0 Y � jdd� W d � n1 �s�0 Y t�� | }|dk�r�d}� j�td�t�|j�|t�|j| �f � |�� W d � n1 �s0 Y dS )z�Apply the contents from a version 2 streaming clone.
Data is read from an object that only needs to provide a ``read(size)``
method.
r{ r| rj rk r r� c 3 s | ]}|� � j�V qd S rL )r� r# )r� r� r� r r � <genexpr> r� z consumev2.<locals>.<genexpr>r s adding [%s] %s (%s)
r} rS rn NTr~ r r� ) r; r# r3 r r rI r� rr r r� r� r� r r� r� r� �rangeZ readexactlyZuvarintdecodestreamr\ rU rW rs r r� rD �posrt )r rF rH �filesizer� ru r� r� r� r� r� ZnamelenZdatalenrX r� rZ r� r r� r � consumev2� s` ���
�
�� P,
���r� c s� ddl m} � fdd�|D �}|r>t�td�d�t|�� ��t� |||� t� j |�� _ |�
� j � j � j �� j
_t�� � t�� � d S )Nr r, c s g | ]}|� j vr|�qS r )r& �r� �rr� r r r� 1 r� z!applybundlev2.<locals>.<listcomp>r� r )r1 r- r r8 r r' r( r� r r
r= r# r> r? r@ r rA r rB )r rF rH r� r
r- r* r r� r �
applybundlev2. s$ ��� �
r� c
s� dg� � �fdd�}|D ]z\}}}| | }|| } |� |�}
| � |�} tj�| �} tj�| �sht�| � | �|� tj|
| � d |dd� �� � q� d S )NTc s d� d< t d��_d S )NFr s copying)r �topicr �r� ru r r � copy_usedH s z _copy_files.<locals>.copy_usedr F)r� Zno_hardlink_cbZcheck_fs_hardlink)
r' r� r� �dirnamer� r �makedirsZ
register_file�copyfilers )
� src_vfs_mapZ dst_vfs_mapr] ru r� �kr� rY Zsrc_vfsZdst_vfsZsrc_pathZdst_pathr� r r� r � _copy_filesE s(
�
r� c C s> dd� | j D �}dd� |j D �}||ks,J �|�� ��� | �� �� t�| �}|�d�}d}tj�|�rjd}t| dddd �\}}t | �} t |�}
| j
j t d
�t
|�| t d �d �} d
d� |D �} t| |
| | �}
|r�t�|�}|�d�}t�||� W d � n1 �s0 Y | �� |
�r$d}nd}| j
�|t
|�| � |�d�� }|j�|� W d � n1 �sn0 Y |jdfg}|�|�� � |D ]�\}}z|�|� W nh t�y } zN|jtj k�r t d�}|�|�}t � |�}|||f; }|j
� |� W Y d}~n
d}~0 0 �q�W d � n1 �s00 Y dS )zYcopy all content from one local repository to another
This is useful for local clonec S s h | ]}|t jvr|�qS r �r ZWORKING_DIR_REQUIREMENTSr� r r r � <setcomp>g s
�z local_copy.<locals>.<setcomp>c S s h | ]}|t jvr|�qS r r� r� r r r r� l s
�s bookmarksr r NTr� s linkings files)r� rl rm c s s | ]\}}}}|||fV qd S rL r )r� r� r� r� rY r r r r� � r� z local_copy.<locals>.<genexpr>s linked %d files
s copied %d files
s
localclones undo.backupfiless error removing %s: %s
) r
r; r Z bookmarksvfsr' r� r� r� r� r� r# rr r r r� r r� rt rU r� r r� r? �extendZ undofiles�unlink�OSError�errno�ENOENTr Z forcebytestrr$ )Zsrc_repoZ dest_repoZsrc_store_requirementsZdest_store_requirementsZ src_book_vfsZ srcbookmarksZbm_countr] r� r� Z dest_vfs_mapru r� r� Z dst_book_vfsZ dstbookmarks�msg�trZ
undo_filesZundovfsZundofilerE r� Ze_msgr r r �
local_copyc sh ��
�
�
, ,
r� )F)N)re )<Z
__future__r �
contextlibr� r� rp Zi18nr r r Z
interfacesr r1 r r r r
r r
r r r r Z revlogutilsr Zutilsr r r r+ rJ rK rO rb rd rz r< r� r� �objectr� r� r� r� r� r� r� �contextmanagerr� r� r� r` ra r� r� r� r� r� r� r� r r r r �<module> sV 0
]K
8
:K
<)!
E