U beG*@sdZddlZddlZddlZddlZz ddlZWnek rHdZ YnXddl m Z m Z ddl Z dZdZeeZddiZd d Zd d Zd dddddefddZGdddejZGdddeZdS)z3Implements file-like objects for reading from http.NT) bytebuffer constantsi)httphttpszAccept-EncodingidentitycCsBtj|}|jtkst|j|j}d|d}t |j|dS)N/)schemeuri_path) urllibparseurlsplitrSCHEMESAssertionErrornetlocpathlstripdict)Z uri_as_stringZ split_urir rQ/var/www/html/services/stratfitenv/lib/python3.8/site-packages/smart_open/http.py parse_uri&s   rcCstjt|}t||f|SN) smart_openutilsZ check_kwargsopen)urimodeZtransport_paramskwargsrrropen_uri/srFc CsP|tjkr@t|||||||||d } tjtj|j| _ | St d|dS)uImplement streamed reader from a web site. Supports Kerberos and Basic HTTP authentication. Parameters ---------- url: str The URL to open. mode: str The mode to open using. kerberos: boolean, optional If True, will attempt to use the local Kerberos credentials user: str, optional The username for authenticating over HTTP password: str, optional The password for authenticating over HTTP cert: str/tuple, optional if String, path to ssl client cert file (.pem). If Tuple, (‘cert’, ‘key’) headers: dict, optional Any headers to send in the request. If ``None``, the default headers are sent: ``{'Accept-Encoding': 'identity'}``. To use no headers at all, set this variable to an empty dict, ``{}``. buffer_size: int, optional The buffer size to use when performing I/O. Note ---- If neither kerberos or (user, password) are set, will connect unauthenticated, unless set separately in headers. ) buffer_sizekerberosuserpasswordcertheaderstimeoutz(http support for mode %r not implementedN) rZ READ_BINARYSeekableBufferedInputBaseosrbasenamer r urlparsenameNotImplementedError) rrrr r!r"r#r$rZfobjrrrr4s! rc@sbeZdZdeddddddfddZddZdd Zd d Zd d ZdddZ dddZ ddZ dS)BufferedInputBaserFNc Cs|rddl} | } n|dk r0|dk r0||f} nd} ||_||_|dkrTt|_n||_| |_tj || |d|j|jd|_ |j j s|j |j |j|_t||_d|_d|_dS)NrT)authr"streamr#r$)requests_kerberosHTTPKerberosAuthrr_HEADERScopyr#r$requestsgetresponseokraise_for_status iter_content _read_iterr ByteBuffer _read_buffer _current_posraw) selfurlrrrr r!r"r#r$r/r-rrr__init__bs4      zBufferedInputBase.__init__cCstdd|_d|_dS)zFlush and close this stream.z close: calledN)loggerdebugr5r9r>rrrcloses zBufferedInputBase.closecCsdS)z+Return True if the stream can be read from.TrrCrrrreadableszBufferedInputBase.readablecCsdS)NFrrCrrrseekableszBufferedInputBase.seekablecCs tjdSz Unsupported.NioUnsupportedOperationrCrrrdetachszBufferedInputBase.detachcCstd||jdkrdS|dkr&dS|dkrJt|jdkrJ|jj}n|dkrj|j|jj}nbt|j|krtd|j||j|j }|dkrj|j}|jt|7_|Sqj|j|}|jt|7_|S)z> Mimics the read call to a filehandle object. zreading with size: %dNrz:http reading more content at current_pos: %d with size: %d) rArBr5lenr;r=readr<fillr9)r>sizeretvalZ bytes_readrrrrOs.    zBufferedInputBase.readcCs |j|dS)zThis is the same as read().)rQ)rOr>rQrrrread1szBufferedInputBase.read1cCs.|t|}|sdS||dt|<t|S)zLRead up to len(b) bytes into b, and return the number of bytes read.rN)rOrN)r>bdatarrrreadintos zBufferedInputBase.readinto)rL)rL) __name__ __module__ __qualname__DEFAULT_BUFFER_SIZEr@rDrErFrKrOrTrWrrrrr+as - # r+c@sXeZdZdZdeddddddfddZddd Zd d Zd d ZdddZ dddZ dS)r%z Implement seekable streamed reader from a web site. Supports Kerberos, client certificate and Basic HTTP authentication. r,FNc Cs||_|rddl} | |_n"|dk r:|dk r:||f|_nd|_|dkrTt|_n||_||_| |_||_ ||_ | |_ |j j s|j td|j |j jt|j jdd|_|j jdddk|_|j |j |_t||_d|_d|_dS) a. If Kerberos is True, will attempt to use the local Kerberos credentials. If cert is set, will try to use a client certificate Otherwise, will try to use "basic" HTTP authentication via username/password. If none of those are set, will connect unauthenticated. rNzself.response: %r, raw: %rzContent-LengthrLz Accept-Rangesnone)r?r/r0r-r1r2r#r"r$rr_partial_requestr5r6r7rArBr=intr4content_lengthlower _seekabler8r9rr:r;r<) r>r?rrrr r!r"r#r$r/rrrr@s0       z"SeekableBufferedInputBase.__init__rcCs&td|||tjkr&tdtj|s6td|tjkrF|}n*|tjkr\|j |}n|tj krp|j |}|j dkrt j j|dd}nt j j||j d}|j |kr|j Std|j |||_ ||j krd|_d|_|jn:||}|jr||_|j|j|_|jnd|_|j S)zSeek to the specified position. :param int offset: The offset in bytes. :param int whence: Where the offset is from. Returns the position after seeking.z seeking to offset: %r whence: %rz"invalid whence, expected one of %rzstream is not seekablerLN)maxvalz0http seeking from current_pos: %d to new_pos: %d)rArBrZWHENCE_CHOICES ValueErrorrFOSErrorZ WHENCE_STARTZWHENCE_CURRENTr<Z WHENCE_ENDr`rrclampr5r9r;emptyr^r6r8r)r>offsetwhencenew_posr5rrrseeks:            zSeekableBufferedInputBase.seekcCs|jSr)r<rCrrrtellAszSeekableBufferedInputBase.tellcOs|jSr)rb)r>argsrrrrrFDsz"SeekableBufferedInputBase.seekablecCs tjdSrGrHrSrrrtruncateGsz"SeekableBufferedInputBase.truncatecCsD|dk r |jdtj|itj|j|jd|j |j|j d}|S)NrangeT)r-r.r"r#r$) r#updaterrZmake_range_stringr3r4r?r-r"r$)r> start_posr5rrrr^Ksz*SeekableBufferedInputBase._partial_request)r)N)N) rXrYrZ__doc__r[r@rkrlrFrnr^rrrrr%s 7 0 r%)rrrIloggingos.pathr& urllib.parser r3 ImportErrorZ MISSING_DEPSrrrZsmart_open.utilsr[r getLoggerrXrAr1rrrBufferedIOBaser+r%rrrrs.      -s