OwgÄ^dZddlmZddlmZddlmZmZddlZ ddlm Z ddl m Z ddl mZdd lmZdd lmZmZmZmZmZdd lmZmZmZmZmZdd lmZdd lm Z m!Z!ddl"m#Z#m$Z%ddl&m'Z'ddl(m)Z)ddl*m+Z,m-Z-m.Z.m/Z/m0Z0ddl1m2Z2m3Z3m4Z4m5Z5m6Z6m7Z7m8Z8ddl9m:Z:m;Z;ddlZ>m?Z?m@Z@ddlAmBZBmCZCmDZDmEZEerddlFmGZGmHZHddlImJZJmKZKmLZLmMZMddddd d3dZN d4dZOd5d6dZP d7dZQ d8dZRdddd  d9d!ZS d:d"ZTd;d#ZUd5dd&ZXd?d'ZY d@d(ZZd?d)Z[ dAd*Z\d+Z] dB dCd,Z^dDd-Z_ dEd.Z` dFd/Za dGd0Zb dHd1Zc dI dJd2Zdy)Kz~ Functions for preparing various inputs passed to the DataFrame or Series constructors before passing them to a BlockManager. ) annotations)abc) TYPE_CHECKINGAnyN)ma)using_pyarrow_string_dtype)lib)astype_is_view)"construct_1d_arraylike_from_scalar dict_compatmaybe_cast_to_datetimemaybe_convert_platformmaybe_infer_to_datetimelike)is_1d_only_ea_dtypeis_integer_dtype is_list_likeis_named_tupleis_object_dtype)ExtensionDtype) ABCDataFrame ABCSeries) algorithmscommon)ExtensionArray) StringDtype)arrayensure_wrapped_if_datetimelike extract_arrayrange_to_ndarraysanitize_array) DatetimeIndexIndexTimedeltaIndex default_index ensure_indexget_objs_combined_axis union_indexes) ArrayManagerSingleArrayManager)BlockPlacementensure_block_shape new_block new_block_2d) BlockManagerSingleBlockManager create_block_manager_from_blocks'create_block_manager_from_column_arrays)HashableSequence) ArrayLikeDtypeObjManagernptT)dtypeverify_integritytyp consolidatecJ|r*| t|}n t|}t|||\}}nt|}|Dcgc]}t|d}}dgt |z}|D]S} t | t jtfr'| jdk7st | t |k7sJtdt|}t |t |k7r td||g} |dk(rt|| ||S|d k(rt|||gStd |d cc}w) zs Segregate Series based on type and coerce into matrices. Needs to handle a lot of exceptional cases. NT extract_numpyzYArrays must be 1-dimensional np.ndarray or ExtensionArray with length matching len(index)z#len(arrays) must match len(columns)block)r;refsr2'typ' needs to be one of {'block', 'array'}, got '') _extract_indexr% _homogenizerlen isinstancenpndarrayrndim ValueErrorr1r() arrayscolumnsindexr8r9r:r;rAxarraxess Y/var/www/horilla/myenv/lib/python3.12/site-packages/pandas/core/internals/construction.py arrays_to_mgrrS`sD ="6*E 'E#65%8 U#@FG1-6GGvF # CsRZZ$@A88q=s8s5z) 6 7#G 7|s6{">?? U D g~6 Dk   FUG$455OPSuTUVWW=HsD c,tj|}|tt|}n t |}| t |}t ||\}}t |||t|\}}||}t|||||} |r| j} | S)zA Extract from a masked rec array and create the manager. r8r:) rgetdatar$rFr% to_arraysreorder_arraysrScopy) datarNrMr8rYr:fdatarL arr_columnsmgrs rRrec_array_to_mgrr^s JJt E }c%j)U#w'#E73FK)gs5zRFK e EC hhj Jc |dk(rt|tr|}|S|jdk(r5t|j|j d|j dd}|St j|jd|j}|S|dk(rt|tr|}|S|jdk(rtt|j dDcgc]}|j|}}|r|Dcgc]}|j}}t||j d|j dg}|S|j}|r|j}t|g|jg}|St!d|dcc}wcc}w) z Convert to specific type of Manager. Does not copy if the type is already correct. Does not guarantee a copy otherwise. `copy` keyword only controls whether conversion from Block->ArrayManager copies the 1D arrays. r@rr?)r:rrBrC)rGr.rJrSrLrQr/ from_arrayrNr(rangerF iget_valuesrYinternal_valuesr)rK)r]r:rYnew_mgrirLrPrs rR mgr_to_mgrrhs| g~ c< (G0 N-xx1}'JJ SXXa[g* N#-77 1 syyQ" N!  c< (G Nxx1}6;C z!ndarray_to_mgr..psGdaqzGsra) placement)rurAU pyarrow_numpy)storage)rJ):rGrnamer"rNreindexrFrHemptyobjectgetattrrrIrrJrcshaper%rSrrrYreshaper r8 _references_values _ensure_2dr_prep_ndarrayliker _get_axes!_check_values_indices_shape_match issubclasstypestrrrrr is_np_dtyper(Tlistanyzipr+r-r*slicekindrr enumerater,construct_array_type_from_sequencer0)valuesrNrMr8rYr:copy_on_sanitizevdtyperAn_copyrgrLrP obj_columnsrOmaybe_datetimedval dvals_list block_valuesbpnbrZs rRndarray_to_mgrrs] &)$ ?{{& . =LLE^^E*F6{w2s7|XXfF3F!$wuD VWd +F D6"&9%&@ frzz>: ; av||A/q!t F XF ?E#f+./G"7+GVWe5cJJ FN +vT: [[]F ;;! ^^B*F FY. / M^FLL%@%%D ^^((*F^^FF# FRZZ8 9  e!D   &u-F# #60@A V\\U2  !   QawNE7&feW= g~ fll'' -XXfF3F =_V\\: v||A/ //q!t =Fv||T27?,1&,,q/,BCqfQTlCFC ,23Schhj3F3FUG$4uMM XXF  }66l BMNQ5a8NN Gc+~&FG GBPQ$,T15QJQs:/Z]nQ6GHL  c'l 34Bf>B4L 6<<,,38R8TO46l %[1  4 **,;;D;NuQA/   E#g,/ 0 &BT :t  7|q +w& ERD4OR s1?W"W 8WW+WW W#&A W(c0|jdt|k7s|jdt|k7r`|jddcxk(rt|kr td|j}t|t|f}td|d|y)z\ Check that the shape implied by our axes matches the actual shape of the data. r?rz)Empty data passed with indices specified.zShape of passed values is z, indices imply N)r~rFrK)rrNrMpassedimplieds rRrrs||A#g,&&,,q/SZ*G <<?a ,#e* ,HI I -u:s7|,5fX=MgYWXX+Hr_r@)r8r:rYc|Lddlm}|||t}|j}|t ||}n t |}|j rt|s|O|jjd} | D],} t|j| ||} | |j| <.ntjd} ttjt!|| } |j#}|r| g|z}n&t%|Dcgc]}| j'}}||j(|<t+|}t |}nVt+|j-}|r t/|n t1d}|Dcgc]}t3j4||}}|r|dk(rw|Dcgc]k}t7|t8r|j'nHt7|t.s%t7|t:r't=|jr|j'dn|m}}n+|Dcgc] }t?|d r|j'n|"}}tA|||||| Scc}wcc}wcc}wcc}w) z Segregate Series based on type and coerce into matrices. Needs to handle a lot of exceptional cases. Used in DataFrame.__init__ r)Series)rNr8rjr|r@T)deepr8)r8r:r;)!pandas.core.seriesrr|isnarDr%rrrnonzeror iatrHr8r nanrFsumrcrYlocrkeysr"r$commaybe_iterable_to_listrGrrrhasattrrS)rZrNrMr8r:rYrrLmissingmidxsrgrP nan_dtypevalnmissingrhs_rkrOs rR dict_to_mgrrsE"-G6:++- =#67(#34E 'E ;;=!1%!8  ..03(A(AUKC$'FJJqM( HHX. 8UYW";;=%(*C05X?!388:?C?&) 7#fw'DIIK !%%+=+;?CD!#,,T!W5DD '>  a0q%(!!Y/+AGG4 VVV&  F GMM'!W"5affh1<MFM %u#SW XX?@E NsI I%1A0I*(%I/ct|dr|t|dj}t|||\}}t|}|3t |dt r t |}ntt|}|||fS)zA Convert a single sequence of arrays to multiple arrays. rrj) rr%_fieldsrWrGr_get_names_from_indexr$rF)rZrMrNr8rLs rRnested_data_to_arraysrszd1g7?tAw/gU;OFG7#G } d1gy ))$/E!#d),E 7E !!r_ct|dkDxrGt|dxr7t|ddddk(xr"t|txr|j dk( S)z7 Check if we should use nested_data_to_arrays. rrJr?ra)rFrr}rGrrJ)rZs rRtreat_as_nestedrsc D A  F a ! F DGVQ '1 , FD.1Ddii1n E r_c>t|dk(rtjdtSt |t r t |}|dtjfSd}t|dr4tj|Dcgc] }|| c}}t|St |dtjrF|djdk(r4tj|Dcgc] }|| c}}t|S||}t|Scc}wcc}w)Nr)rrrj.cpt|rt|tr|St|d}t |}|S)NTr=)rrGrrr)vress rRconvertz"_prep_ndarraylike..convert/s4A*Q "=H !4 0$Q' r_) rFrHr{r|rGrcrnewaxisrrrIrJr)rrYrPrrs rRrr#s 6{axxf-- FE "v&3 ?##F1Iv6!71:67 f  F1Irzz *vay~~/Bv6!71:67 f  f 77s >D!Dc|jdk(r"|j|jddf}|S|jdk7rtd|j|S)zB Reshape 1D values, raise on anything else other than 2D. r?rrazMust pass 2-d input. shape=)rJrr~rK)rs rRrrIs\{{aa! 45 M  6v||nEFF Mr_cd}g}g}|D]N}t|ttfrn||j|d}t|tr!|j|ur|j |d}|j |j|j}nt|trp||jd}t|ttfr t|}n t|}tj||jtj }t#|||d}t%j&|||j d|j |Q||fS)NFrlO)defaultr8rY)rGrr"astyperNrzappendrrdictr!r#r r fast_multigetrHrr rrequire_length_match)rZrNr8oindex homogenizedrArs rRrErETs1FKD  cIu- . jjUj3#y)ciiu.Dkk%ek4 KK (++C#t$>"\\#.Fem^%DE%c*Cs)C''V^^RVVL e5uEC  $ $S% 0 KK 3; >  r_cht|dk(r tdSg}g}d}d}d}|D]}t|trd}|j |j 1t|t r+d}|j t|jlt|r-t|dddk(rd}|j t|t|tjs|jdkDstd|s |s td|r t|}n|r t|d}|rztt!|}t|dkDr td |r td |r0|dtk7r-d |dd t|} t| t|d}t#S) zR Try to infer an Index from the passed data, raise ValueError on failure. rFTrJr?z,Per-column arrays must each be 1-dimensionalz2If using all scalar values, you must pass an indexsortz%All arrays must be of the same lengthz.sK640<KsrryzUnnamed r?)rr$rFrrcrr}r")rZ has_some_namerNcountrgrrs rRrrsKdKKM SY'' s4y!12E E$1 Avt $ =E!H!%)E!H QJE  <r_ct| t|}n t|}|t|}||fSt|}||fSrp)r$r%)NKrNrMs rRrrsN  }a U#" '>w' '>r_c8ddlm}tt||S)a Converts a list of dataclass instances to a list of dictionaries. Parameters ---------- data : List[Type[dataclass]] Returns -------- list_dict : List[dict] Examples -------- >>> from dataclasses import dataclass >>> @dataclass ... class Point: ... x: int ... y: int >>> dataclasses_to_dicts([Point(1, 2), Point(2, 3)]) [{'x': 1, 'y': 2}, {'x': 2, 'y': 3}] r)asdict) dataclassesrrmap)rZrs rRdataclasses_to_dictsrs0# FD! ""r_ct|st|tjr|jj rt |jj }|Dcgc]}|| }}t|dk(r/t|D]!\}}|jdk(s|dddf||<#||fSgt gfSt|tjrT|jj >tt|jj }|Dcgc]}|| }}||fSt|dttfr t|}nst|dtjrt||\}}nFt|dt rt#||\}}n#|Dcgc] }t|}}t|}t%|||\} }| |fScc}wcc}wcc}w)a  Return list of arrays, columns. Returns ------- list[ArrayLike] These will become columns in a DataFrame. Index This will become frame.columns. Notes ----- Ensures that len(result_arrays) == len(result_index). Nrra)rFrGrHrIr8namesr%rrJr"rtuple_list_to_arraysrMapping_list_of_dict_to_arraysr_list_of_series_to_arrays_finalize_columns_and_data) rZrMr8ryrLrgrPrrOcontents rRrWrWs$ t9 dBJJ 'zz+&tzz'7'78189$t*99t9>#,F"32388q=(+AqD F1I2w&<### D"** %$***:*:*FTZZ--./#*+a$q'++w$q'D%=)d# DGS[[ ).tW= W DGY '0w? W#''Qa''d#1#wFGW G =:,(s G G"Gct|dtrtj|}|Stj|}|S)Nr)rGrr to_object_array_tuplesto_object_array)rZrs rRrrQs@$q'5!,,T2 N%%d+ Nr_c|3|Dcgc]}t|ttfs|}}t|d}i}g}|D]}t |dd}|t t |}t||vr|t|}n|j|x}|t|<t|d} |jtj| |tj|} | |fScc}w)NFrrNTr=)rGrrr&r}r$rFidrrrrtake_ndrHvstack) rZrMrO pass_data indexer_cachealigned_valuesrrNrrrs rRrr\s  $Q1 1y,6O(PQQ Q(?+-MN  C7D) =!#a&)E e9 %#BuI.G161B1B71K KGmBuI.q5j00AB Cii'G G )Rs C*C*c(|>d|D}td|D }tj||}t|}|Dcgc] }t |t ur|n t |"}}tj |t|}||fScc}w)a Convert list of dicts to numpy arrays if `columns` is not passed, column names are inferred from the records - for OrderedDict and dicts, the column names match the key insertion-order from the first record to the last. - For other kinds of dict-likes, the keys are lexically sorted. Parameters ---------- data : iterable collection of records (OrderedDict, dict) columns: iterables or None Returns ------- content : np.ndarray[object, ndim=2] columns : Index c3NK|]}t|jywrp)rr)rrrOs rRrtz*_list_of_dict_to_arrays..s,!tAFFH~,s#%c3<K|]}t|tywrp)rGr)rrds rRrtz*_list_of_dict_to_arrays..s9qz!T*9r)rr fast_unique_multiple_list_genr%rrdicts_to_arrayr)rZrMgenrpre_colsrrs rRrr{s.,t,9D99944StDx(8<  W  'o3&'s A A9( A44A9c|tt|}|St|txrt d|D}|s:t|t|k7r#t t|dt|d|rrt|Dchc] }t|c}dkDr t d|r@t|dt|k7r&t t|ddt|d|Scc}w)a If columns is None, make numbers as column names; Otherwise, validate that columns have valid length. Parameters ---------- content : list of np.ndarrays columns : Index or None Returns ------- Index If columns is None, assign positional column index value as columns. Raises ------ 1. AssertionError when content is not composed of list of lists, and if length of columns is not equal to length of content. 2. ValueError when content is list of lists, but length of each sub-list is not equal 3. ValueError when content is list of lists, but length of sub-list is not equal to length of content c3<K|]}t|tywrp)rGr)rrcols rRrtz0_validate_or_indexify_columns..s7 &)JsD !7 rz! columns passed, passed data had z columnsr?z.converts7 BHHSM !++&*77*BC}99 -5c:C$/CII#4N$/M "+"@"@"B%44S 4J& %#g-*S"**2Myy~~/&s7  E>2002((E(F t# -S%8 r_rq)rr8r%r$rrPrLs ``` rRrrs,,(T'. .sgcl .F . M/s") rMr"r8DtypeObj | Noner9boolr:z str | Noner;r'returnr6) rZznp.rec.recarray | np.ndarrayr8r&rYr'r:rr(r6)T)r:rrYr'r(r6)r8r&rYr'r:rr(r6)r np.ndarrayrNr"rMr"r(None) rZrr8r&r:rrYr'r(r6) rZr3rM Index | NonerNr+r8r&r(z$tuple[list[ArrayLike], Index, Index])r(r')rYr'r(r))rr)r(r))rNr"r8r&r(z!tuple[list[ArrayLike], list[Any]])r(r") rLlist[ArrayLike]r\r"rMr+rintr(tuple[list[ArrayLike], Index]) rr-rr-rNr+rMr+r(ztuple[Index, Index]rp)rMr+r8r&r(r.)rZzlist[tuple | list]r(r))rZrrMr+r(tuple[np.ndarray, Index])rZz list[dict]rMr+r(r/)rr)rMr+r8r&r(r.)rzlist[np.ndarray]rMr+r(r")rF) rzlist[npt.NDArray[np.object_]]r8r&r%rr$r'r(r,)e__doc__ __future__r collectionsrtypingrrrrHrpandas._configr pandas._libsr pandas.core.dtypes.astyper pandas.core.dtypes.castr r r rrpandas.core.dtypes.commonrrrrrpandas.core.dtypes.dtypesrpandas.core.dtypes.genericrr pandas.corerrrpandas.core.arraysrpandas.core.arrays.string_rpandas.core.constructionrr rrrr pandas.core.indexes.apir!r"r#r$r%r&r'#pandas.core.internals.array_managerr(r)pandas.core.internals.blocksr*r+r,r-pandas.core.internals.managersr.r/r0r1collections.abcr2r3pandas._typingr4r5r6r7rSr^rhrrrrrrrrErDrXrrrrWrrrrrrrqr_rRrEs# 545 .2  "!>X >X  >X  >X >X>X >XB  &        F"Re#2e:>eEHe ePY Y$Y/4Y Y."PY PY  PY PY PY PYf" " " "  " * "4 #L''.'&'T8v */:FPS"6$ '2>$#D;?55(75"5p  >" " ""J   # ,5 5(45 5v! B *B BB B  Br_