U be> @sdZddlZddlZddlZddlZddlZddlmZddl Z ddl Z ddl Z ddl mZddlmZddlmZddlmZddlmZddlmZddlmZeeZejdd Z d d Z!d d Z"e"Z#e$Z%dddddddej&df ddZ$ddZ'd#ddZ(ddZ)d$ddZ*Gddde+Z,ddZ-d%d d!Zze.e$e/e"Wn8e0k rZ1ze2d"e3e1W5dZ1[1XYnXdS)&zuImplements the majority of smart_open's top-level API. The main functions are: * ``parse_uri()`` * ``open()`` N)doctools) transport)register_compressor) check_kwargs)inspect_kwargsF) do_setlocalecCs(tjdkrd|krd|}tj|jS)z0Returns the scheme of the URL only, as a string.ntz://zfile://)osnameurllibparseurlsplitscheme) uri_as_stringr[/var/www/html/services/stratfitenv/lib/python3.8/site-packages/smart_open/smart_open_lib.py _sniff_scheme2srcCs:t|}t|}||}tdt|}|f|S)a Parse the given URI from a string. Parameters ---------- uri_as_string: str The URI to parse. Returns ------- collections.namedtuple The parsed URI. Notes ----- smart_open/doctools.py magic goes here Uri)rr get_transport parse_uri collections namedtuplesortedkeys)rr submoduleas_dictrrrrr>s   rrTc  Csztdtt|ts td|tkr:td|| dkrFi} t |||||||d} | dk rh| S|dk rd|kr| dd}t|t j rt|}|} | r| nt }z t|} Wn0tk r} zt| jdW5d} ~ XYnXt|| | }t|| |}d|ks| dk r(t|||||d }n|}||krvd g}|D]4}zt||t||Wntk rpYnXq@|S) aOpen the URI object, returning a file-like object. The URI is usually a string in a variety of formats. For a full list of examples, see the :func:`parse_uri` function. The URI may also be one of: - an instance of the pathlib.Path class - a stream (anything that implements io.IOBase-like functionality) Parameters ---------- uri: str or object The object to open. mode: str, optional Mimicks built-in open parameter of the same name. buffering: int, optional Mimicks built-in open parameter of the same name. encoding: str, optional Mimicks built-in open parameter of the same name. errors: str, optional Mimicks built-in open parameter of the same name. newline: str, optional Mimicks built-in open parameter of the same name. closefd: boolean, optional Mimicks built-in open parameter of the same name. Ignored. opener: object, optional Mimicks built-in open parameter of the same name. Ignored. compression: str, optional (see smart_open.compression.get_supported_compression_types) Explicitly specify the compression/decompression behavior. transport_params: dict, optional Additional parameters for the transport layer (see notes below). Returns ------- A file-like object. Notes ----- smart_open has several implementations for its transport layer (e.g. S3, HTTP). Each transport layer has a different set of keyword arguments for overriding default behavior. If you specify a keyword argument that is *not* supported by the transport layer being used, smart_open will ignore that argument and log a warning message. smart_open/doctools.py magic goes here See Also -------- - `Standard library reference `__ - `smart_open README.rst `__ z%rzmode should be a stringzinvalid compression type: N) compression bufferingencodingerrorsnewlinebr)r r!r"Zto_boto3)loggerdebuglocals isinstancestr TypeErrorso_compressionZget_supported_compression_types ValueError_shortcut_openreplacepathlibPathDEFAULT_ENCODING_get_binary_modeNotImplementedErrorargs_open_binary_streamZcompression_wrapper_encoding_wrappersetattrgetattrAttributeError)urimoderr r!r"closefdopenerrtransport_paramsfobjZexplicit_encodingZ binary_modevebinary decompresseddecodedZpromoted_attrsattrrrropends^B            rEcst|gdkr$dkr$tdfdddD}t|dkrJtdfd d }d krj|d n,d kr||d nd kr|d ntddkr|dn.dkr̈ddn ddkr|drtd|dS)Ntr#z'can't have text and binary mode at oncecsg|]}|qSr)count).0x)r;rr sz$_get_binary_mode..Zrwaz6must have exactly one of create/read/write/append modecs|dSN)appendpopindex)charZbinmoder;rrtransfersz"_get_binary_mode..transferawrzKMust have exactly one of create/read/write/append mode and at most one plus+zinvalid mode: %rr$)listr,sumrNrOrMjoin)Zmode_strcountsrRrrQrr2s8        r2c Cst|tsdSt|}|tjtjfkr*dSt|}|tj kr^t |\} } | t krldSn|tj krldSi} |dk r|| d<|dd}|dk r|| d<|rd|kr|| d<t||fd|i| S)abTry to open the URI using the standard library io.open function. This can be much faster than the alternative of opening in binary mode and then decoding. This is only possible under the following conditions: 1. Opening a local file; and 2. Compression is disabled If it is not possible to use the built-in open for the specified URI, returns None. :param str uri: A string indicating what to open. :param str mode: The mode to pass to the open function. :param str compression: The compression type selected. :returns: The opened file :rtype: file Nr r#r$r"r!r)r(r)rrZ NO_SCHEMEso_fileZSCHEMEZextract_local_pathr+INFER_FROM_EXTENSIONPsplitextZget_supported_extensionsNO_COMPRESSIONr. _builtin_open) r:r;rrr r!r"rZ local_path_ extensionZ open_kwargsrrrr-4s*       r-cCs~|dkrtd|t|tr0t||dd}|St|tsJtdt|t|}t |}| |||}t |dsz||_ |S)aOpen an arbitrary URI in the specified binary mode. Not all modes are supported for all protocols. :arg uri: The URI to open. May be a string, or something else. :arg str mode: The mode to open with. Must be rb, wb or ab. :arg transport_params: Keyword argumens for the transport layer. :returns: A named file object :rtype: file-like object with a .name attribute )rbzrb+wbzwb+abzab+zunsupported mode: %rF)r<zdon't know how to handle uri %sr ) r3r(intr_r)r*reprrrrZopen_urihasattrr )r:r;r>r?rrrrrr5ns      r5cCsFtdtd|kr"|dkr"|S|dkr.t}tj||||dd}|S)aDecode bytes into text, if necessary. If mode specifies binary access, does nothing, unless the encoding is specified. A non-null encoding implies text mode. :arg fileobj: must quack like a filehandle object. :arg str mode: is the mode which was originally requested by the user. :arg str encoding: The text encoding to use. If mode is binary, overrides mode. :arg str errors: The method to use when handling encoding/decoding errors. :returns: a file object zencoding_wrapper: %rr#NT)r r!r" write_through)r%r&r'r1io TextIOWrapper)fileobjr;r r!r"rrrr6s  r6c@s(eZdZdZddZddZddZdS) patch_pathlibz*Replace `Path.open` with `smart_open.open`cCstt|_dSrL)_patch_pathlibrEold_implselfrrr__init__szpatch_pathlib.__init__cCs|SrLrrorrr __enter__szpatch_pathlib.__enter__cCst|jdSrL)rmrn)rpexc_typeexc_valexc_tbrrr__exit__szpatch_pathlib.__exit__N)__name__ __module__ __qualname____doc__rqrrrvrrrrrlsrlcCstjj}|tj_|S)zReplace `Path.open` with `func`)r/r0rE)funcrnrrrrmsrmrbc KsXd} | rtdt| | fd| } tj| td|r>tj} ntj} ~ ~ ~ ~tftS)Nz^https://github.com/RaRe-Technologies/smart_open/blob/develop/MIGRATING_FROM_OLDER_VERSIONS.rstzUThe following keyword parameters are not supported: %r. See %s for more information.z9This function is deprecated. See %s for more information)category) DeprecationWarningrwarningswarnr+r^r[rEr') r:r;rr r!r"r<r=Zignore_extensionkwargsurlmessagerrrr smart_opens rzEncountered a non-fatal error while building docstrings (see below). help(smart_open) will provide incomplete information as a result. For full help text, see .)rNNN)NNN)rbrNNNTNF)4rzrrilocaleloggingr os.pathpathr\r/ urllib.parser r~Zsmart_open.local_file local_filerZZsmart_open.compressionrr+rrrrZsmart_open.utilsrZ _check_kwargsrZ_inspect_kwargs getLoggerrwr%getpreferredencodingr1rrZ _parse_urirEr_r[r2r-r5r6objectrlrmZtweak_open_docstringZtweak_parse_uri_docstring Exceptionexerror exceptionrrrr sx            ! : :) '   -