+ NjUa0t$^RIHt^RIt^RIHt^RIHt^RIH t ^RI H t H t H t Ht^RIHtHtHtHtHt^RIHt^R IHtHt^R IHtHtHtHtHtH t ]PB!R 4t"]PF!4t$]$PK]PL!R 44]'!]R R7t(R])R&RRRllt*RRRllt+RRRllt,RRRllt-R#)) annotationsN) lru_cache)PathLike)BinaryIO)coherence_ratioencoding_languagesmb_encoding_languagesmerge_coherence_ratios)IANA_SUPPORTEDIANA_SUPPORTED_SIMILARTOO_BIG_SEQUENCETOO_SMALL_SEQUENCETRACE) mess_ratio) CharsetMatchCharsetMatches)any_specified_encodingcut_sequence_chunks iana_nameidentify_sig_or_bomis_multi_byte_encodingshould_strip_sig_or_bomcharset_normalizerz)%(asctime)s | %(levelname)s | %(message)sc"\V4'*#N)rencodings&X/data/cameron/venvs/serve_omidlab/lib/python3.14/site-packages/charset_normalizer/api.pyr.s -CH-M)M)keyz list[str]IANA_SUPPORTED_MB_FIRSTcDV^8dQhRRRRRRRRRR R R R R R R RRRR RR/ #) sequenceszbytes | bytearraystepsint chunk_size thresholdfloat cp_isolationlist[str] | None cp_exclusionpreemptive_behaviourboolexplainlanguage_thresholdenable_fallbackreturnr)formats"r __annotate__r62sx x  x  x x  x  # x  # x x x x x x r c &\V\\34'g$\RP \ V444hV'dC\ Pp \ P\4\ P\4\V4p V ^8Xdf\ PR4V'd/\ P\4\ PX 4\\!VRRR.R4.4#VeG\ P#\RR P%V44VU u.uFp \'V R4NK pp M.pVeG\ P#\R R P%V44VU u.uFp \'V R4NK pp M.pWV,8:d"\ P#\R VVV 4^pT pV^8dW, V8d\)W, 4p\V4\*8p \V4\,8pV 'd+\ P#\R P V 44M1V'd*\ P#\R P V 44.pV'd \/V4MRpVe-VP1V4\ P#\RV4\34p.p.p\34p\34p/p\5RR7!\64p\5RR7!\84pRp\34p^p^pRpRpRpRp \4p!\4p"\;V4wp#p$V#e7VP1V#4\ P#\R\V$4V#4VP1R4RV9dVP1R4V\<,E Fp%V'd V%V9dKV'd V%V9dK&V%V9dK/VP?V%4Rp&V#V%8Hp'T';'d \AV%4p(V%RC9d&V''g\ P#\RV%4KV%RD9d&V''g\ P#\RV%4KV%V9d\ P#\RV%4KV%V9d\ P#\RV%4K\CV%4p)T'diT)'g\3\IT%44p*M\3\KT%44p*T*PMT4'g!\ P#\RT%T*T4EKxT'd0T)'g(TT8d!\ P#\RT%TT4EKT'd'T)'g\ P#\RT%4EKT)'*;'dT'*p+T'dBT)'g:\OT('gTR\)R4MT\T$4\)R4T%R7MgT+'g`T%R8Xd6T''d.\OTT%R7p&T&'dT&^,R8Xd T&R ,p&M#\OT('gTM T\T$4RT%R7p&\UT''g^M \T$4T \)Y, 44p-T);'dT&RJ;'d\T&4T 8p.T.'d\ P#\R"T%4\)\T-4^, 4p/\WT/^4p/^p0Rp1.p2.p3\YTT%T-TT'T(T$T)T&T+4 Fp4T2P1T44T3P1T!T4TT;'d ^\T4u;8*;'d^8*Mu44T3RE,T8d T0^, p0T0T/8gT''gK|T('dKM T1'g1T'd)T)'g!T\)R%4RP[T%R&R'7T3'd\]T34\T34, MRp5T5T8g T0T/8Ed TP1T%4T%\^9dTPa\^T%,4T&e'T)'gTPc\eT&4T5.R34\ P#\R)T%T0\gT5^d,^R*74T 'doT%RRTRR39dcT1'g[T&f/\OT('gTM T\T$4RT%R7p&T'dRp&\!TT%TT'.T&TR,7p6T%T8XdT6p M T%R8XdT6pMT6pEK_T+'d%\OT('gTM T\T$4RT%R7p&T&EeIT)'Eg@\eT&4p7TPiT74p8T8EeT8wp9p:p;T;'Ed\!TT%T9T'T:T'd T%TRR39dT&MRTR,7pM \KT%4p>T>'d4\ P#\R2P T%\OT>444.p?T%R8wd@T>'dR3P%T>4MRp@T2Fp4T!T4TX@4pAT?P1TA4K \oT?4pBTB'd+\ P#\R4P XBT%44\!TT%T5T'XBT'd T%TRR39dT&MRTR,7pCT!P1TC4T&e'T)'gTPc\eT&4T5XBR$34T'dT)'gT5R58d T^, pT%TRR39dT5R.8d}T5R8Xde\ PR/XCPj4T'd/\ P\4\ PX 4\XC.4u#T"P1XC4\T"4'dTeTT9dRT9d|RT9duT"Pm4p=\ PR/T=Pj4T'd/\ P\4\ PX 4\T=.4u#T'glT)'gdXB'd\WR6XB4RR77MRpDTDR88d?RT9d8RT9d1R$pTPaT>4\ P#\R9T%T5XD4T'gT)'dzT.'drT&en\T&4T R:,8dWT%RF9dPRT9dIRT9dBR$p\ P#\R;T%T5\T&4T \T&4T , ^d,4T%T#8XgE K\ PRV Pj4V!P1V 4MV'dVe0V'd$V'dVPpVPp8wgVe(\ PR?4V!P1V4M.V'd'\ PR@4V!P1V4V!'dA\ PRAV!Pm4Pj\V!4^, 4M\ PRB4V'd/\ P\4\ PX 4V!#uup iuup i \D\F3d!\ P#\RT%4E Ki;i \P\R3dYp,\T,\R4'g&\ P#\R!T%\OT,44TP1T%4Rp,?,EK=Rp,?,ii;i \P\R3dzp,T+'d>\ P#\R!T%\OT,44TP1T%4Rp,?,EK\ P#\R#T%\OT,44T/p0R$p1Rp,?,E LRp,?,ii;i \PdCp,\ P#\R(T%\OT,44TP1T%4Rp,?,EKRp,?,ii;i \P\R3d!\ P#\R+T%4EKRi;i \P\R3dCp,\ P#\R!T%\OT,44TP1T%4Rp,?,EKRp,?,ii;i)Ga2 Given a raw bytes sequence, return the best possibles charset usable to render str objects. If there is no results, it is a strong indicator that the source is binary/not text. By default, the process will extract 5 blocks of 512o each to assess the mess and coherence of a given sequence. And will give up a particular code page after 20% of measured mess. Those criteria are customizable at will. The preemptive behavior DOES NOT replace the traditional detection workflow, it prioritize a particular code page but never take it for granted. Can improve the performance. You may want to focus your attention to some code page or/and not others, use cp_isolation and cp_exclusion for that purpose. This function will strip the SIG in the payload/sequence every time except on UTF-16, UTF-32. By default the library does not setup any handler other than the NullHandler, if you choose to set the 'explain' toggle to True it will alter the logger configuration to add a StreamHandler that is suitable for debugging. Custom logging format and handler can be set manually. z3Expected object of type bytes or bytearray, got: {}zTrying to detect encoding from a tiny portion of ({}) byte(s).zIUsing lazy str decoding because the payload is quite large, ({}) byte(s).z@Detected declarative mark in sequence. Priority +1 given for %s.)maxsizezIDetected a SIG or BOM mark on first %i byte(s). Priority +1 given for %s.asciiutf_16utf_32z\Encoding %s won't be tested as-is because it require a BOM. Will try some sub-encoder LE/BE.utf_7zREncoding %s won't be tested as-is because detection is unreliable without BOM/SIG.zY%s is deemed too similar to a code page that was already considered unsuited. Continuing!zESkipping %s: already fast-tracked from a similar successful encoding.z2Encoding %s does not provide an IncrementalDecoderzbSkipping %s: definitive match already found, this encoding targets different languages (%s vs %s).zXSkipping %s: already accumulated %d same-family results after definitive match (cap=%d).zCSkipping single-byte %s: multi-byte definitive match already found.gAru:NNz9Code page %s does not fit given bytes sequence at ALL. %szpCode page %s is a multi byte encoding table and it appear that at least one character was encoded using n-bytes.zaLazyStr Loading: After MD chunk decode, code page %s does not fit given bytes sequence at ALL. %sTgj@strict)errorsz^LazyStr Loading: After final lookup, code page %s does not fit given bytes sequence at ALL. %szc%s was excluded because of initial chaos probing. Gave up %i time(s). Computed mean chaos is %f %%.)ndigitsz>%s does not decode the whole payload: fallback entry withheld.)preemptive_declarationzM%s fast-tracked (identical decoded payload to a prior encoding, chaos=%f %%).皙?z.Encoding detection: %s is most likely the one.zZ%s fast-skipped (identical decoded payload to a prior encoding that failed chaos probing).z=%s passed initial chaos probing. Mean measured chaos is %f %%z&{} should target any language(s) of {},z We detected language {} using {}g{Gz?c3*"TF wrVxK R#5irr4).0_vs& r from_bytes..Cs4#341Q#3s)defaultg?zyDefinitive match found: %s (chaos=%.3f, coherence=%.2f). Encodings targeting different language families will be skipped.g\(\?zjMulti-byte definitive match: %s (chaos=%.3f, decoded=%d/%d=%.1f%%). Single-byte encodings will be skipped.zoEncoding detection: %s is most likely the one as we detected a BOM or SIG within the beginning of the sequence.zONothing got out of the detection process. Using ASCII/UTF-8/Specified fallback.z7Encoding detection: %s will be used as a fallback matchz:Encoding detection: utf_8 will be used as a fallback matchz:Encoding detection: ascii will be used as a fallback matchz]Encoding detection: Found %s as plausible (best-candidate) for content. With %i alternatives.z=Encoding detection: Unable to determine any suitable charset.>r<r=>r>> r>r8r<r= utf_16_be utf_16_le utf_32_be utf_32_le utf_8_sig)9 isinstance bytearraybytes TypeErrorr5typeloggerlevel addHandlerexplain_handlersetLevelrlendebug removeHandlerrrlogjoinrr'rr rappendsetrrrrr"addrrModuleNotFoundError ImportErrorrr intersectionstrUnicodeDecodeError LookupErrorrangemaxrdecodesumr update setdefaulthashroundgetrbestr fingerprint)Er%r&r(r)r+r-r.r0r1r2previous_logger_levellengthcpis_too_small_sequenceis_too_large_sequenceprioritized_encodingsspecified_encodingtestedtested_but_hard_failuretested_but_soft_failuresoft_failure_skipsuccess_fast_trackedpayload_result_cachecached_mess_ratiocached_coherence_ratiodefinitive_match_founddefinitive_target_languages post_definitive_sb_success_countPOST_DEFINITIVE_SB_CAPmb_definitive_match_foundfallback_ascii fallback_u8fallback_specifiedresultsearly_stop_results sig_encoding sig_payload encoding_ianadecoded_payloadbom_or_sig_availablestrip_sig_or_bomis_multi_byte_decoder enc_languagesdeferred_decodinger_multi_byte_bonusmax_chunk_gave_upearly_stop_countlazy_str_hard_failure md_chunks md_ratioschunkmean_mess_ratiofallback_entry payload_hashcached cached_mess cached_cd cached_passed fast_matchprobable_resulttarget_languages cd_ratios lg_inclusionchunk_languagescd_ratios_merged current_matchbest_coherencesE&&&&&&&&&& r from_bytesr2s< i)U!3 4 4 A H HY   %+\\/*i.F { ST    1 OO1 2|IwUBPRSTUU  5 IIl #  8DD| "e,| D    6 IIl #  8DD| "e,| D   u$%  l       qyV^j0( "%i.3E"E"%i.4D"D  L S S    W ^ ^  (*.By)t%$$%78  N  uF)+)+"%%%(U TV "$/ ;&t4_E$),/E -.$"#',*.N'+K.2,.G)7)9 3I >L+$$\2  W       )++$$W-.1HHH M=  M\9  F "  =!&*%1]%B!5" " :Q ;  0 09M JJn   I %.B JJd   - - JJk   0 0 JJW   *@*O ! "( #$6}$E F #$9-$H I  --.IJJ x!!/  #)04JJ JJj0&    %-B JJU  & % C C.C*C * $-B 0"+CI.&s;'7#d)D* '!G+0D&)!!.'O'?1+=+I*9"*=&)$4&!*3{+;+=!>!. 'O&)As;/?     " . .t+ . .O$v-   JJ-  "%SWq[!1 115 ! %!  5 ),$ %!   '  %!??A\):$?$?a$?R=I-$)$$(99((1A1A9 r&%) #d)+&--mH-MENY#i.!@SV i '+;?P+P # * *= 9 66!(()? )NO*3H$//)OR+G JJ0 o+Q7   !W&8(HMN- #*!*-(8!*%.s;/?/A%B%2 +-*.!-!(#+="!$66)7&"g-%3N"0K   "% 0"&s;'7'9:* #,  &/D/D $_ 5L)--l;F!8>5 Y  =!-!%#,!%:#0$6#I$J, "&/A"J"NN:.(,,];JJg%kC/; &*>1?.*g5-;N*8K  K  /C' 3  %*<]*K 4]C   JJ8??!3'7#8   G #/?)*D #"8& #   1#2)<  JJ299$m %    .$);Wg(NN #5 " }%  &/D + +_% "2D9  #)$& , 1 , 0'7C C#%#% D!**((9OO$9:%}o66  % %m 4 " # ##+/AV/K6!6!0557O LL@(( $$_5 56!?"34 4&.C$4#34cB  $F):w&?P)-&+223CD P!#" *% +O$v}4  6!6!(, % JJ|O$O$v-3  L ( LL1  $$_5 56!7=#9":; ;cIf 7|q .,> JJa   LLI"++  NN- . ^3"++~/I/II' LLU V NN; '  LLU V NN> * k LLN # # L1   TU_--. N}EEZ$[1  JJD    H#K0 a-- O!F  $ * *= 9  N    )! O!F  (..}= JJsA   1 $( !/ )D&  t!F  (..}= d/ <! !\) ! !P' 4  O!F  (..}= s3AE?AE1 AE(AF 0AF 88AF 1AF 9AF ,AF 5#AF >?AG9>A AG9AG9AG9AG96AJ;#AK#AL E,AF F AF F AG6FA AG1G1AG6G9AJH >AI>I)AI>I>AJJ AKJ6AKKAKK,ALLALL AML6AMMAMcDV^8dQhRRRRRRRRRR R R R R R R RRRR RR/ #)r$fprr&r'r(r)r*r+r,r-r.r/r0r1r2r3rr4)r5s"rr6r6sv   #  # r c F\VP4VVVVVVVVV 4 #)zz Same thing than the function from_bytes but using a file pointer that is already ready. Will not close the file pointer. )rread) rr&r(r)r+r-r.r0r1r2s &&&&&&&&&&rfrom_fprs5      r cDV^8dQhRRRRRRRRRR R R R R R R RRRR RR/ #)r$pathzstr | bytes | PathLiker&r'r(r)r*r+r,r-r.r/r0r1r2r3rr4)r5s"rr6r6sv       #  #       r c \VR4;_uu_4p \V VVVVVVVVV 4 uuRRR4# +'giR#;i)z Same thing than the function from_bytes but with one extra step. Opening and reading given file path in binary mode. Can raise IOError. rbN)openr) rr&r(r)r+r-r.r0r1r2rs &&&&&&&&&& r from_pathrsH dD  R               s 4 A cDV^8dQhRRRRRRRRRR R R R R R R RRRR RR / #)r$fp_or_path_or_payloadz!PathLike | str | BinaryIO | bytesr&r'r(r)r*r+r,r-r.r/r0r1r2r3r4)r5s"rr6r6sv??<? ?? ? # ? # ????? ?r c \V\\34'd\VVVVVVVVVV R7 p V '*#\V\\ 34'd\ VVVVVVVVVV R7 p V '*#\VVVVVVVVVV R7 p V '*#)a Detect if the given input (file, bytes, or path) points to a binary file. aka. not a string. Based on the same main heuristic algorithms and default kwargs at the sole exception that fallbacks match are disabled to be stricter around ASCII-compatible but unlikely to be a string. ) r&r(r)r+r-r.r0r1r2)rSrhrrrUrTrr) rr&r(r)r+r-r.r0r1r2guessess &&&&&&&&&& r is_binaryrs"'#x99 !!%%!51+  Z;C       !!%%!51+  4; !!%%!51+  ;r ) 皙?NNTFrDT) rrrNNTFrDF).__conditional_annotations__ __future__rlogging functoolsrosrtypingrcdrrr r constantr r r rrmdrmodelsrrutilsrrrrrr getLoggerrX StreamHandlerr[ setFormatter Formattersortedr"__annotations__rrrr)rs@rrs"" 0   / 0'') AB&,M& x v< >??r