o vh] @s<dZddlZddlZddlmZddlmZmZmZddl Z ddl Z ddl m Z ddl Z ddlZddlZddlZddlmZddlmZddlmmZddlZddlmZddlmm Z!ej"#dZ$Gd d d Z%e&e%e gZ'z dd l(m)Z*e'+e*Wn e,yYnwe j-.e j-/e0Z1Gd d d Z2ej3ddZ4GdddZ5ddZ6ej"7dddgej"7dddgddZ8ddZ9ej"7deddfed d!fgd"d#Z:ej"7d$gd%ej"7dddgd&d'Z;d(d)Zd.d/Z?ej"7d0ej@ejAejBejCejDejEejFejGejHg d1d2ZIdS)3z0 Tests for the pandas.io.common functionalities N)partial)BytesIOStringIOUnsupportedOperation)Path)is_platform_windows)pa_version_under19p0z=ignore:Passing a BlockManager to DataFrame:DeprecationWarningc@s"eZdZdZdddZddZdS) CustomFSPathz%For testing fspath on unknown objectsreturnNcCs ||_dSNpath)selfr rY/var/www/html/hyperkenya/venv/lib/python3.10/site-packages/pandas/tests/io/test_common.py__init__&s zCustomFSPath.__init__cCs|jSr r rrrr __fspath__)szCustomFSPath.__fspath__)r N)__name__ __module__ __qualname____doc__rrrrrrr #s  r )localc@s,eZdZdZddZddZddZedd d Z d d Z d dZ e j deddZe j deeegddZddZddZddZddZe j dejdedfejdedfejd ed!fejd"ed#fej d$ed%fej!ded&fej"ded'fej#ded(fej$ded)fg d*d+Z%e j d,ej&j'dedfej&j(ded-fej&j)d ed!fej&j*d"ed#fej&j+d"ed.fej&j,ded&fej&j-ded(fej&j.ded)fgd/d0Z/e j dejdedfej0dedfejdedfejd ed!fejd"ed#fej d$ed%fej!ded&fej"ded'fej#ded(fej$ded)fg d1d2Z1e j d3ejdd4fej0dd4fejdd5fejd d6fejd"d7fe j2ej d$d8e j j3d9d:d;d<ej!dd=fej"dd>fej#dd?fej$dd@fg dAdBZ4e j dCdDidfdEdFdGidGfdHid"fdIidfdJidfdKidfdLidfdMdNe5dOidfgdPdQZ6dRdSZ7dTS)UTestCommonIOCapabilitiesziindex,A,B,C,D foo,2,3,4,5 bar,7,8,9,10 baz,12,13,14,15 qux,12,13,14,15 foo2,12,13,14,15 bar2,12,13,14,15 cCsBd}t|}||ks Jtj|sJtj||ksJdS)Nz ~/sometest)icom _expand_userosr isabs expanduserrfilename expanded_namerrrtest_expand_userEs   z)TestCommonIOCapabilities.test_expand_usercCs2d}t|}||ks Jtj||ksJdS)Nz/somefolder/sometest)rrrr rrrrrtest_expand_user_normal_pathMs  z5TestCommonIOCapabilities.test_expand_user_normal_pathcCsBttd}|dks Jttd}|tjddksJdS)N.zfoo//barfoobar)rstringify_pathrrr join)rrel_pathredundant_pathrrrtest_stringify_path_pathlibTs z4TestCommonIOCapabilities.test_stringify_path_pathlibzpy.pathcCs8tjdd}tj|}t|}t||ksJdS)Nr%r&)rr r(abspath LocalPathrr')rr abs_pathlpathrrrtest_stringify_path_localpathZs z6TestCommonIOCapabilities.test_stringify_path_localpathcCs"td}t|}|dksJdS)N foo/bar.csv)r rr')rpresultrrrtest_stringify_path_fspathas z3TestCommonIOCapabilities.test_stringify_path_fspathc Cstd}t4}|jd|dd}|t|ksJWdn1s(wYWddSWddS1s@wYdS)Nfsspeczfile://wbmode)pytest importorskiptm ensure_cleanopenrr')rr5r fsspec_objrrr!test_stringify_file_and_path_likefs  "z:TestCommonIOCapabilities.test_stringify_file_and_path_like path_typecCs2|\}}|d|}tj|dd}||ksJdS)Nr1infer) compression)rinfer_compression)rcompression_formatr@ extensionexpectedr rBrrr test_infer_compression_from_pathms z9TestCommonIOCapabilities.test_infer_compression_from_pathc CstjtdH}|dt|jd}t|d}t|jjs%Jt j ||jjks1JWdn1s;wYWddSWddS1sSwYdS)N)dirz~/z /sometestw) tempfileTemporaryDirectoryrhomenamer get_handlehandle is_absoluterr r)rr@tmpr handlesrrrtest_get_handle_with_pathts"z2TestCommonIOCapabilities.test_get_handle_with_pathc Csxt*}t|d}|j|ksJWdn1swY|jr&JWdn1s0wY|js:JdS)Nr)rrrNrOclosed)r input_bufferrRrrrtest_get_handle_with_buffer}s z4TestCommonIOCapabilities.test_get_handle_with_buffercCsd}tjt|ddd@}d}d} |j|}t||ks Jt||kr6t|jdks1J||7}n||7}q||d ksDJWddS1sOwYdS) N&a,b,c 1,2,3 ©,®,® Look,a snake,🐍rbFis_textTrutf-8)rrNrrOreadlenencode)rdatarRr3 chunksizechunkrrr)test_bytesiowrapper_returns_correct_bytess   "zBTestCommonIOCapabilities.test_bytesiowrapper_returns_correct_bytescCstd}d}tgdgdgdd}t|}tj|ddd #}||j }t r2| d }t |||jr=JWddS1sHwYdS) Nz pyarrow.csvrX)1©Look)2®za snake)3rju🐍abcrYFrZobject)r9r:pd DataFramerrrNread_csvrO to_pandasrastyper;assert_frame_equalrU)rpa_csvrbrFsrRdfrrrtest_get_handle_pyarrow_compats    "z7TestCommonIOCapabilities.test_get_handle_pyarrow_compatcCstjt|jdd}tj|dd}Wdn1swYtt|j}t||tjt|jdd%}t|}t||jdgtt||jddWddS1sawYdS)N)rcT) ignore_indexr) rqrsrdata1concatr;rvnextiloc)rreaderr3rFitfirstrrr test_iterators "z&TestCommonIOCapabilities.test_iteratorz#reader, module, error_class, fn_extrcsvtxtxlrdxlsxpyarrowfeathertablesh5dtasas7bdatjsonpicklecCst|tjtdd|}d|d}d|d}d}d} d |d |d} d |d} d |d} d |} tj|d|d|d|d| d| d| d| d| dd ||WddS1siwYdS)Nrbdoes_not_exist.File (b')?.+does_not_exist\.'? does not exist:\[Errno 2\] No such file or directory: '.+does_not_exist\.'zExpected object or value7path_or_buf needs to be a string file path or file-like#\[Errno 2\] File .+does_not_exist\.$ does not exist: '.+does_not_exist\.<\[Errno 2\] 没有那个文件或目录: '.+does_not_exist\.?\[Errno 2\] File o directory non esistente: '.+does_not_exist\.+Failed to open local file.+does_not_exist\.(|)match)r9r:rr r(HEREraises)rrmodule error_classfn_extr msg1msg2msg3msg4msg5msg6msg7msg8rrrtest_read_non_existents(      4 "z/TestCommonIOCapabilities.test_read_non_existentz#method, module, error_class, fn_exthtmlparquetcCs|t|tgdgdgdd}tjtddd|}tj|dd |||WddS1s7wYdS) N)r{)rr)rrr]rlrbmissing_folderrz@Cannot save file into a non-existent directory: .*missing_folderr) r9r:rqrrrr r(rr)rmethodrrr dummy_framer rrr#test_write_missing_parent_directorys  "zszJTestCommonIOCapabilities.test_read_expands_user_home_dir..rrrrz0Unexpected character found when decoding 'false'rrrrrrrrrr)r9r:rr r(setattrrr)rrrrr monkeypatchr rrrrrrrrrrrtest_read_expands_user_home_dirs*      4 "z8TestCommonIOCapabilities.test_read_expands_user_home_dirzreader, module, path)iorbrziris.csv)rrb fixed_widthzfixed_width_format.txt)rrbexcelz test1.xlsx)rrbrzfeather-0_3_1.feather)rrb legacy_hdfzdatetimetz_object.h5zTODO(infer_string)F)reasonstrict)marks)rrbstatazstata10_115.dta)rsasrbztest1.sas7bdat)rrrbztsframe_v012.json)rrbrzcategorical.0.25.0.picklecCsTt|||}t|}||}||}|dr"t||dSt||dS)Nz.pickle)r9r:r endswithr;assert_categorical_equalrv)rrrr datapathmypathr3rFrrrtest_read_fspath_all's " z-TestCommonIOCapabilities.test_read_fspath_allz"writer_name, writer_kwargs, moduleto_csvto_excelengineopenpyxl to_featherto_htmlto_jsonto_latex to_pickleto_stata time_stampz2019-01-01 00:00c Cs||dvr tdtd}td}tdddgi}|}|{}t|t|} t||} | |fi|| | fi|t|dH} t|d3} |d kritj | fi|} tj | fi|}t | |n| } | }| |kswJWdn1swYWdn1swYWdn1swYWddSWddS1swYdS) N)rjinja2stringfspathAr{rrYr) r9r:r;r<rqrrr getattrr= read_excelrvr_)r writer_name writer_kwargsrp1p2ryrrrwriterf_strf_pathr3rFrrrtest_write_fspath_allVs2       Pz.TestCommonIOCapabilities.test_write_fspath_allc Cstdtdddgi}td}td}|:}|(}t|}|j|dd|j|ddtj|dd}tj|dd}Wdn1sHwYWdn1sWwYt ||dS) Nrrr{rrrr&)key) r9r:rqrrr;r<r to_hdfread_hdfrv) rryrrrrrr3rFrrrtest_write_fspath_hdf5}s    z/TestCommonIOCapabilities.test_write_fspath_hdf5N)8rrrr}r"r#r+td skip_if_nor0r4r?r9mark parametrize path_typesrGstrr rrSrWrerzrrqrsFileNotFoundErrorread_fwfr read_featherOSErrorr read_stataread_sas read_json read_picklerrrrrrr to_parquetrrrr read_tablerparamxfailr to_datetimerrrrrrr;s                                    !  rcCs|ddddS)Nrrbrz test_mmap.csvr)rrrr mmap_filesrc@sXeZdZddZddZddZddZej d d d gej d d dgddZ dS)TestMMapWrappercCstd}dd|_trd}t}nd}tj}tj||dt |dWdn1s.wYt |dd }Wdn1sDwYd }tjt |dt |dWddS1sdwYdS) NzI am not a filecSsdS)Nrrrrrrsz;TestMMapWrapper.test_constructor_bad_file..zThe parameter is incorrectz [Errno 22]rTr^encodingzI/O operation on closed file) rfilenorrmmaperrorr9rr_maybe_memory_mapr= ValueError)rrnon_filemsgerrtargetrrrtest_constructor_bad_files" "z)TestMMapWrapper.test_constructor_bad_filec Cst|ddi}|}tj|ddddC}|j}t|jjtjs"J|D]}t|}| | ks4Jq$t j t dd t|Wdn1sKwYWdn1sZwYWddSWddS1srwYdS)Nr^rrTT)r[ memory_mapz^$r) r= readlinesrrNrO isinstancebufferrrstripr9r StopIteration)rrr lineswrapperswrapperline next_linerrr test_nexts& "zTestMMapWrapper.test_nextc CstS}tjdtddttdtddt dDd}| |t j t d d tj|d d Wdn1sBwYWddSWddS1sZwYdS) N皙?xrABCDcSg|]}d|qSzi-r.0irrr z7TestMMapWrapper.test_unknown_engine..rcolumnsindexzUnknown enginerpyt)r)r;r<rqrrnparangereshapeIndexlistrangerr9rrrsrr ryrrrtest_unknown_engines   "z#TestMMapWrapper.test_unknown_enginec Cst:}tjdtddttdtddt dDd}|j |d d t |tj |d d Wd d S1sAwYd S)z\ 'encoding' shouldn't be passed to 'open' in binary mode. GH 35058 rrrrcSrrrrrrrr!r"z4TestMMapWrapper.test_binary_mode..rr#zw+br7r index_colN) r;r<rqrrr'r(r)r*r+r,rrvrsr-rrrtest_binary_modes  "z TestMMapWrapper.test_binary_moderzutf-16zutf-32 compression_bz2xzc CstjdtddttdtddtdDd}t O}t t |j |||d Wd n1s.rr#)rBrNzHUTF-\d+ stream does not start with BOM|'utf-\d+' codec can't decode byter)rqrrr'r(r)r*r+r,r;r<assert_produces_warningUnicodeWarningrr9r UnicodeErrorrs)rrr2ryr rrrrtest_warning_missing_utf_boms"     "z,TestMMapWrapper.test_warning_missing_utf_bomN) rrrr rr.r1r9rrr8rrrrrs rcCstdsJtdsJtdrJtdrJtdr#Jtdr*Jtdr1Jtdr8Jtd s?JdS) Nzgcs://pandas/somethingelse.comzgs://pandas/somethingelse.comzhttp://pandas/somethingelse.comzrandom:pandas/somethingelse.comz /local/pathzrelative/local/pathzthis is not fsspec://urlz({'url': 'gs://pandas/somethingelse.com'}z#RFC-3986+compliant.spec://something)r is_fsspec_urlrrrrtest_is_fsspec_urlsr:rr^formatrrc Cs tjdtddttdtddtdDd}t S}t j |d |d }t |d ||Wdn1sAwYt j |d |d }|d kr[tj |dd}nt|}Wdn1sjwYWdn1sywYt||dS)NrrrrcSrrrrrrrr! r"z(test_codecs_encoding..rr#rI)r8rto_rTrrr/)rqrrr'r(r)r*r+r,r;r<codecsr=rrsrrv)rr;rFr rOryrrrtest_codecs_encodings$   r>c Cs>tjdtddttdtddtdDd}t l}t |d $}t d | }| |Wdn1sAwYWdn1sPwYt |d &}t d |}tj|d d }Wdn1stwYWdn1swYWdn1swYt||dS)NrrrrcSrrrrrrrr!r"z1test_codecs_get_writer_reader..rr#r6r^rYrr/)rqrrr'r(r)r*r+r,r;r<r=r= getwriterr getreaderrsrv)rFr rOencodedryrrrtest_codecs_get_writer_readers*     rBzio_class,mode,msgtz*a bytes-like object is required, not 'str'rnz%string argument expected, got 'bytes'c CstjdtddttdtddtdDd}|2}tj t |d |j |d |d Wdn1s?wYWddSWddS1sWwYdS) NrrrrcSrrrrrrrr!7r"z*test_explicit_encoding..rr#rrIr7) rqrrr'r(r)r*r+r,r9r TypeErrorr)io_classr8rrFrrrrtest_explicit_encoding)s  "rFencoding_errors)Nrreplacec Cs<d}d}|dkrd|d|dd|}ttjdd}nd |dd |d |d }ttjd d}t[}t|}|||dkretj t |d|||dWdn1s_wYn'|||d}|j |d} tj | | gi| dgd} t || WddSWddS1swYdS)Nz'utf-8' codec can't decode byter, rrr/s{"s": {"s":"s"}}r%)orientrHr)rGerrors)r%)rrqrsrr;r<r write_bytesr9rUnicodeDecodeErrordecoderrrv) rGr;r bad_encodingcontentrr filerydecodedrFrrrtest_encoding_errors>sF    "rVc Cs|t0}tjtddtj|dddWdn1swYWddSWddS1s7wYdS)Nzunknown error handler namerrIbadrM)r;r<r9r LookupErrorrrNr rrrtest_bad_encdoing_errorsas "rYcCsNtjtdd}td|jtjksJWddS1s wYdS)Nz \[Errno 2\]r doesnt_exist)r9rrrqrserrnoENOENT)rrrrtest_errno_attributehs "r]c Csztjtdd,t}tj|dddWdn1swYWddSWddS1s6wYdS)NrrrYT)r )r9rrrrrN)rrrrtest_fail_mmapos"r^c CsGddd}tjtddAt%}t|d}|j|Wdn1s+wYWdn1s:wYWddSWddS1sRwYdS)Nc@seZdZddZdS)z&test_close_on_error..TestErrorcSstd)Ntest)rrrrrclosexsz,test_close_on_error..TestError.closeN)rrrr`rrrr TestErrorws rar_rrY)r9rrrrrNcreated_handlesappend)rarrRrrrtest_close_on_errorus"rdrcCs8t}t||WddS1swYdSr )rrdump)rrrrrtest_pickle_readers"rf)Jrr=r[ functoolsrrrrrrrpathlibrrrJnumpyr'r9 pandas.compatrpandas.compat.pyarrowrpandas.util._test_decoratorsutil_test_decoratorsrpandasrqpandas._testing_testingr;pandas.io.commoncommonrrfilterwarnings pytestmarkr rrpy.pathrr-rc ImportErrorr r,dirname__file__rrfixturerrr:rr>rBrFrVrYr]r^rdrsrrrrrrrrrfrrrrs        Y ^   !