shell bypass 403
3
nf�\ev � ) @ s� d Z ddlmZ ddlZddlZddlZddlZddlZddl Z ddl
Z
ddl Z ddl Z ddl
mZ ddlmZmZmZ ddlmZmZmZmZ ydd l mZ W n$ ek
r� dZdd
lmZ Y nX d d gZ d
Z ej Z ej j Z!e j"� Z#e j$� Z%dZ&ej'ej(ej)ej*ej+ej,ej-ej.ej/ej0ej1ej2ej3ej4ej5ej6ej7ej8ej9ej:ej;ej<ej=ej>ej?ej@ejAejBejCejDejEejFejGg!ZHe
jIejJejKfiZLeMe
d��r�ejNejNfeLe
jO< eMe
d��r�ejPejPfeLe
jQ< eMe
d��r�ejJejJfeLe
jR< eMe
d��rejSejSfeLe
jT< eMe
d��r$ejKejKfeLe
jU< eMe
d��r@eLe
jI eLe
jV< dd � ZWdd � ZXdd� ZYdd� ZZej[eY�Z\ej]eZ�Z^G dd � d e_�Z`e�r�d$d d �Zan
d%d d �Zaeae`_aG d!d"� d"e_�ZbdS )&aU
SecureTranport support for urllib3 via ctypes.
This makes platform-native TLS available to urllib3 users on macOS without the
use of a compiler. This is an important feature because the Python Package
Index is moving to become a TLSv1.2-or-higher server, and the default OpenSSL
that ships with macOS is not capable of doing TLSv1.2. The only way to resolve
this is to give macOS users an alternative solution to the problem, and that
solution is to use SecureTransport.
We use ctypes here because this solution must not require a compiler. That's
because pip is not allowed to require a compiler either.
This is not intended to be a seriously long-term solution to this problem.
The hope is that PEP 543 will eventually solve this issue for us, at which
point we can retire this contrib module. But in the short term, we need to
solve the impending tire fire that is Python on Mac without this kind of
contrib module. So...here we are.
To use this module, simply import and inject it::
import urllib3.contrib.securetransport
urllib3.contrib.securetransport.inject_into_urllib3()
Happy TLSing!
� )�absolute_importN� )�util� )�Security�
SecurityConst�CoreFoundation)�_assert_no_error�_cert_array_from_pem�_temporary_keychain�_load_client_cert_chain)� _fileobject)�backport_makefile�inject_into_urllib3�extract_from_urllib3Ti @ �PROTOCOL_SSLv2�PROTOCOL_SSLv3�PROTOCOL_TLSv1�PROTOCOL_TLSv1_1�PROTOCOL_TLSv1_2� PROTOCOL_TLSc C s( t tj_tt_ttj_dt_dtj_dS )zG
Monkey-patch urllib3 with SecureTransport-backed SSL-support.
TN)�SecureTransportContextr �ssl_�
SSLContext�HAS_SNI�IS_SECURETRANSPORT� r r �%/usr/lib/python3.6/securetransport.pyr � s
c C s( t tj_tt_ttj_dt_dtj_dS )z>
Undo monkey-patching by :func:`inject_into_urllib3`.
FN)�orig_util_SSLContextr r r �orig_util_HAS_SNIr r r r r r r � s
c
C sx d}�y8t j| �}|dkr tjS |j}|d }|j� }d}d}y|xv||k r�|dksZ|dkrttj||�sttjt j
d��|| } t j | j
|| �}
|j|
| �} || 7 }| sB|s�tjS P qBW W nh tjk
�r" } zH| j }|dk o�|t j
k�r||d< |t jk�s
|t jk�rtjS � W Y dd} ~ X nX ||d< ||k�r<tjS dS tk
�rr } z|dk �rb| |_tjS d} ~ X nX dS )zs
SecureTransport read callback. This is called by ST to request that data
be returned from the socket.
Nr z timed out)�_connection_refs�getr �errSSLInternal�socket�
gettimeoutr Z
wait_for_read�error�errno�EAGAIN�ctypes�c_charZ from_address� recv_into�errSSLClosedGraceful�
ECONNRESET�EPIPE�errSSLClosedAbort�errSSLWouldBlock� Exception�
_exception)
�
connection_id� data_buffer�data_length_pointer�wrapped_socket� base_socketZrequested_length�timeoutr% Z
read_countZ remaining�bufferZ
chunk_size�er r r �_read_callback� sN
r: c C s\ d}�y t j| �}|dkr tjS |j}|d }tj||�}|j� }d}d} yZxT| |k r�|dksf|dkr�tj ||�s�tj
t j d��|j
|�}
| |
7 } ||
d� }qNW W nb tj
k
�r } zB| j }|dk r�|t j kr�| |d< |t jks�|t jkr�tjS � W Y dd} ~ X nX | |d< | |k�r tjS dS tk
�rV } z|dk �rF| |_tjS d} ~ X nX dS )zx
SecureTransport write callback. This is called by ST to request that data
actually be sent on the network.
Nr z timed out)r r! r r" r# r( � string_atr$ r Zwait_for_writer% r& r' �sendr, r- r. r/ r0 r1 ) r2 r3 r4 r5 r6 Zbytes_to_write�datar7 r% �sentZ
chunk_sentr9 r r r �_write_callback� sD
r? c @ s� e Zd ZdZdd� Zejdd� �Zdd� Zdd � Z d
d � Z
d d
� Z dd� Z dd� Z
d(dd�Zdd� Zdd� Zdd� Zdd � Zd d � Zd d � Zd)d"d#�Zd$d%� Zd&d'� ZdS )*�
WrappedSocketz�
API-compatibility wrapper for Python's OpenSSL wrapped socket object.
Note: _makefile_refs, _drop(), and _reuse() are needed for the garbage
collector of PyPy.
c C sL || _ d | _d| _d| _d | _d | _d | _d | _| j j� | _ | j j
d� d S )Nr F) r# �context�_makefile_refs�_closedr1 � _keychain�
_keychain_dir�_client_cert_chainr$ �_timeout�
settimeout)�selfr# r r r �__init__( s zWrappedSocket.__init__c c s4 d| _ dV | j dk r0| j d }| _ | j� |�dS )a]
A context manager that can be used to wrap calls that do I/O from
SecureTransport. If any of the I/O callbacks hit an exception, this
context manager will correctly propagate the exception after the fact.
This avoids silently swallowing those exceptions.
It also correctly forces the socket closed.
N)r1 �close)rI Z exceptionr r r �_raise_on_error: s
z WrappedSocket._raise_on_errorc C s2 t jtt� t� }t j| j|tt��}t|� dS )a4
Sets up the allowed ciphers. By default this matches the set in
util.ssl_.DEFAULT_CIPHERS, at least as supported by macOS. This is done
custom and doesn't allow changing at this time, mostly because parsing
OpenSSL cipher strings is going to be a freaking nightmare.
N)r ZSSLCipherSuite�len�
CIPHER_SUITESZSSLSetEnabledCiphersrA r )rI �ciphers�resultr r r � _set_ciphersO s zWrappedSocket._set_ciphersc C s |sdS t jj|�r2t|d��}|j� }W dQ R X d}tj� }z�t|�}tj| j t
j |��}t |� |srt
jd��tj||�}t |� tj|d�}t |� tj� }tj|t
j |��}t |� W d|r�tj|� |dk r�tj|� X tjtjf}|j|k�r
t
jd|j ��dS )z�
Called when we have set custom validation. We do this in two cases:
first, when cert validation is entirely disabled; and second, when
using a custom trust DB.
N�rbz Failed to copy trust referenceTz)certificate verify failed, error code: %d)�os�path�isfile�open�readr � SecTrustRefr
�SSLCopyPeerTrustrA r( �byrefr �sslZSSLErrorZ SecTrustSetAnchorCertificatesZ!SecTrustSetAnchorCertificatesOnlyZSecTrustResultTypeZSecTrustEvaluater � CFReleaser ZkSecTrustResultUnspecifiedZkSecTrustResultProceed�value) rI �verify� trust_bundle�fZ
cert_array�trustrP Z trust_resultZ successesr r r �_custom_validate\ s@
z WrappedSocket._custom_validatec C s� t jdtjtj�| _t j| jtt�} t | � t
�4 t | �d }
x|
t krV|
d d }
q@W | t |
< W dQ R X t j
| j|
�} t | � |r�t|t�s�|jd�}t j| j|t|��} t | � | j� t j| j|�} t | � t j| j|�} t | � | s�|dk �rt j| jtjd�} t | � |�rNt� \| _| _t| j||�| _ t j | j| j �} t | � xf| j � �R t j | j�} | tj k�r~t!j"d��n(| tj#k�r�| j$||� �wPn
t | � P W dQ R X �qPW dS )z�
Actually performs the TLS handshake. This is run automatically by
wrapped socket, and shouldn't be needed in user code.
Ni���r zutf-8Tzhandshake timed out)%r ZSSLCreateContextr ZkSSLClientSideZkSSLStreamTyperA Z
SSLSetIOFuncs�_read_callback_pointer�_write_callback_pointerr �_connection_ref_lock�idr ZSSLSetConnection�
isinstance�bytes�encodeZSSLSetPeerDomainNamerM rQ ZSSLSetProtocolVersionMinZSSLSetProtocolVersionMaxZSSLSetSessionOptionZ"kSSLSessionOptionBreakOnServerAuthr rD rE r rF ZSSLSetCertificaterL Z SSLHandshaker/ r# r7 ZerrSSLServerAuthCompletedrb ) rI �server_hostnamer^ r_ Z min_versionZ max_versionZ client_certZ
client_keyZclient_key_passphraserP Zhandler r r � handshake� s\
zWrappedSocket.handshakec C s
| j j� S )N)r# �fileno)rI r r r rl � s zWrappedSocket.filenoc C s* | j dkr| j d8 _ | jr&| j� d S )Nr r )rB rC rK )rI r r r �_decref_socketios� s
z WrappedSocket._decref_socketiosc C s& t j|�}| j||�}|d |� }|S )N)r( Zcreate_string_bufferr* )rI Zbufsizr8 Z
bytes_readr= r r r �recv� s
zWrappedSocket.recvNc
C s� | j r
dS |d krt|�}tj| j|�}tjd�}| j� � tj| j ||tj
|��}W d Q R X |t j kr�|j
dkr�tjd��n"|t jt jfkr�| j� nt|� |j
S )Nr zrecv timed out)rC rM r( r) Z from_buffer�c_size_trL r ZSSLReadrA rZ r r/ r] r# r7 r+ ZerrSSLClosedNoNotifyrK r )rI r8 �nbytes�processed_bytesrP r r r r* s
zWrappedSocket.recv_intoc C s
|| _ d S )N)rG )rI r7 r r r rH , s zWrappedSocket.settimeoutc C s | j S )N)rG )rI r r r r$ / s zWrappedSocket.gettimeoutc
C sh t jd�}| j� �" tj| j|t|�t j|��}W d Q R X |tj krZ|j
dkrZt j d��nt
|� |j
S )Nr zsend timed out)r( ro rL r ZSSLWriterA rM rZ r r/ r] r# r7 r )rI r= rq rP r r r r< 2 s
" zWrappedSocket.sendc C s8 d}x.|t |�k r2| j|||t � �}||7 }qW d S )Nr )rM r< �SSL_WRITE_BLOCKSIZE)rI r= Z
total_sentr> r r r �sendallC s zWrappedSocket.sendallc C s$ | j � � tj| j� W d Q R X d S )N)rL r ZSSLCloserA )rI r r r �shutdownI s
zWrappedSocket.shutdownc C s� | j dk r�d| _| jr(tj| j� d | _| jr@tj| j� d | _| jrvtj| j� tj| j� t j
| j � d | _| _ | j j
� S | j d8 _ d S )Nr T)rB rC rA r r\ rF rD r ZSecKeychainDelete�shutilZrmtreerE r# rK )rI r r r rK M s
zWrappedSocket.closeFc
C s� |s t d��tj� }d }d }zptj| jtj|��}t|� |sBd S tj|�}|sTd S tj |d�}tj
|�}t j |�}t j
|�} tj| |�}W d |r�t j|� |r�t j|� X |S )Nz2SecureTransport only supports dumping binary certsr )�
ValueErrorr rX rY rA r( rZ r ZSecTrustGetCertificateCountZ SecTrustGetCertificateAtIndexZSecCertificateCopyDatar ZCFDataGetLengthZCFDataGetBytePtrr; r\ )
rI Z binary_formra ZcertdataZ der_bytesrP Z
cert_countZleafZ data_lengthr3 r r r � getpeercert` s2
zWrappedSocket.getpeercertc C s | j d7 _ d S )Nr )rB )rI r r r �_reuse� s zWrappedSocket._reusec C s& | j dk r| j� n| j d8 _ d S )Nr )rB rK )rI r r r �_drop� s
zWrappedSocket._drop)N)F)�__name__�
__module__� __qualname__�__doc__rJ �
contextlib�contextmanagerrL rQ rb rk rl rm rn r* rH r$ r< rs rt rK rw rx ry r r r r r@ ! s&
>Z
(
>r@ c C s | j d7 _ t| ||dd�S )Nr T)rK )rB r
)rI �mode�bufsizer r r �makefile� s r� �rc O s d}t | ||f|�|�S )Nr )r )rI r� � buffering�args�kwargsr r r r� � s c @ s� e Zd ZdZdd� Zedd� �Zejdd� �Zedd� �Zejd d� �Zed
d � �Z e jd d � �Z d
d� Z
dd� Z dd� Z d dd�Z
d dd�Zd dd�ZdS ) r z�
I am a wrapper class for the SecureTransport library, to translate the
interface of the standard library ``SSLContext`` object to calls into
SecureTransport.
c C s8 t | \| _| _d| _d| _d | _d | _d | _d | _d S )Nr F) �_protocol_to_min_max� _min_version� _max_version�_options�_verify�
_trust_bundle� _client_cert� _client_key�_client_key_passphrase)rI Zprotocolr r r rJ � s z SecureTransportContext.__init__c C s dS )z�
SecureTransport cannot have its hostname checking disabled. For more,
see the comment on getpeercert() in this file.
Tr )rI r r r �check_hostname� s z%SecureTransportContext.check_hostnamec C s dS )z�
SecureTransport cannot have its hostname checking disabled. For more,
see the comment on getpeercert() in this file.
Nr )rI r] r r r r� � s c C s | j S )N)r� )rI r r r �options� s z SecureTransportContext.optionsc C s
|| _ d S )N)r� )rI r] r r r r� � s c C s | j r tjS tjS )N)r� r[ �
CERT_REQUIREDZ CERT_NONE)rI r r r � verify_mode� s z"SecureTransportContext.verify_modec C s |t jkrdnd| _d S )NTF)r[ r� r� )rI r] r r r r� � s c C s d S )Nr )rI r r r �set_default_verify_paths� s
z/SecureTransportContext.set_default_verify_pathsc C s | j � S )N)r� )rI r r r �load_default_certs� s z)SecureTransportContext.load_default_certsc C s |t jjkrtd��d S )Nz5SecureTransport doesn't support custom cipher strings)r r ZDEFAULT_CIPHERSrv )rI rO r r r � set_ciphers� s z"SecureTransportContext.set_ciphersNc C s |d k rt d��|p|| _d S )Nz1SecureTransport does not support cert directories)rv r� )rI ZcafileZcapathZcadatar r r �load_verify_locations s z,SecureTransportContext.load_verify_locationsc C s || _ || _|| _d S )N)r� r� Z_client_cert_passphrase)rI ZcertfileZkeyfileZpasswordr r r �load_cert_chain s z&SecureTransportContext.load_cert_chainFTc C s2 t |�}|j|| j| j| j| j| j| j| j� |S )N) r@ rk r� r� r� r� r� r� r� )rI ZsockZ server_sideZdo_handshake_on_connectZsuppress_ragged_eofsrj r5 r r r � wrap_socket s
z"SecureTransportContext.wrap_socket)NNN)NN)FTTN)rz r{ r| r} rJ �propertyr� �setterr� r� r� r� r� r� r� r� r r r r r � s
r ���)r� )r� N)cr} Z
__future__r r~ r( r& Zos.pathrS ru r# r[ Z threading�weakref� r Z_securetransport.bindingsr r r Z_securetransport.low_levelr r
r r r
� ImportErrorZpackages.backports.makefiler �__all__r r r r r �WeakValueDictionaryr ZLockre rr ZTLS_AES_256_GCM_SHA384Z TLS_CHACHA20_POLY1305_SHA256ZTLS_AES_128_GCM_SHA256Z'TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384Z%TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384Z'TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256Z%TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256Z#TLS_DHE_DSS_WITH_AES_256_GCM_SHA384Z#TLS_DHE_RSA_WITH_AES_256_GCM_SHA384Z#TLS_DHE_DSS_WITH_AES_128_GCM_SHA256Z#TLS_DHE_RSA_WITH_AES_128_GCM_SHA256Z'TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384Z%TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384Z$TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHAZ"TLS_ECDHE_RSA_WITH_AES_256_CBC_SHAZ#TLS_DHE_RSA_WITH_AES_256_CBC_SHA256Z#TLS_DHE_DSS_WITH_AES_256_CBC_SHA256Z TLS_DHE_RSA_WITH_AES_256_CBC_SHAZ TLS_DHE_DSS_WITH_AES_256_CBC_SHAZ'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256Z%TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256Z$TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHAZ"TLS_ECDHE_RSA_WITH_AES_128_CBC_SHAZ#TLS_DHE_RSA_WITH_AES_128_CBC_SHA256Z#TLS_DHE_DSS_WITH_AES_128_CBC_SHA256Z TLS_DHE_RSA_WITH_AES_128_CBC_SHAZ TLS_DHE_DSS_WITH_AES_128_CBC_SHAZ TLS_RSA_WITH_AES_256_GCM_SHA384Z TLS_RSA_WITH_AES_128_GCM_SHA256Z TLS_RSA_WITH_AES_256_CBC_SHA256Z TLS_RSA_WITH_AES_128_CBC_SHA256Z TLS_RSA_WITH_AES_256_CBC_SHAZ TLS_RSA_WITH_AES_128_CBC_SHArN ZPROTOCOL_SSLv23Z
kTLSProtocol1ZkTLSProtocol12r� �hasattrZ
kSSLProtocol2r Z
kSSLProtocol3r r ZkTLSProtocol11r r r r r r: r? Z SSLReadFuncrc Z SSLWriteFuncrd �objectr@ r� r r r r r �<module> s� 76