+
nDj:1 ^ RI Ht ^ RIt^ RIHt ^ RIHt ^ RIHt ! R R4 t Rt
! R R 4 t R"R
lt R ] n
R R
RRRR#RRRRRRRRRRRRR RR R / R ltR ]
R!2]n
R# )$ )IntegralN)Table) _resolve_filesystem_and_pathc X a ] tR t^t o RtR t]R 4 t]R 4 t]R 4 t ]R 4 t
]R 4 t ]R 4 t ]R 4 t
]R
4 t]R 4 t]R 4 t]R
4 t]R 4 t]R 4 t]R 4 t]R 4 t]R 4 t]R 4 tRR ltRR ltRR ltRtV t R# )ORCFilez
Reader interface for a single ORC file
Parameters
----------
source : str or pyarrow.NativeFile
Readable source. For passing Python file objects or byte buffers,
see pyarrow.io.PythonFileInterface or pyarrow.io.BufferReader.
c p \ P ! 4 V n V P P V4 R # N)_orc ORCReaderreaderopen)selfsources &&E/data/cameron/venvs/s3viz/lib/python3.14/site-packages/pyarrow/orc.py__init__ORCFile.__init__& s" nn& c 6 V P P 4 # )z/The file metadata, as an arrow KeyValueMetadata)r metadatar s &r r ORCFile.metadata* {{##%%r c 6 V P P 4 # )z#The file schema, as an arrow schema)r schemar s &r r ORCFile.schema/ s {{!!##r c 6 V P P 4 # )z The number of rows in the file)r nrowsr s &r r
ORCFile.nrows4 s {{ ""r c 6 V P P 4 # )z!The number of stripes in the file)r nstripesr s &r r ORCFile.nstripes9 r r c 6 V P P 4 # )z4Format version of the ORC file, must be 0.11 or 0.12)r file_versionr s &r r# ORCFile.file_version> s {{''))r c 6 V P P 4 # )z2Software instance and version that wrote this file)r software_versionr s &r r& ORCFile.software_versionC {{++--r c 6 V P P 4 # )z Compression codec of the file)r compressionr s &r r* ORCFile.compressionH {{&&((r c 6 V P P 4 # )z?Number of bytes to buffer for the compression codec in the file)r compression_sizer s &r r. ORCFile.compression_sizeM r( r c 6 V P P 4 # )zkName of the writer that wrote this file.
If the writer is unknown then its Writer ID
(a number) is returned)r writerr s &r r1 ORCFile.writerR s
{{!!##r c 6 V P P 4 # )zVersion of the writer)r writer_versionr s &r r4 ORCFile.writer_versionY {{))++r c 6 V P P 4 # )zJNumber of rows per an entry in the row index or 0
if there is no row index)r row_index_strider s &r r8 ORCFile.row_index_stride^ s {{++--r c 6 V P P 4 # )zNumber of stripe statistics)r nstripe_statisticsr s &r r; ORCFile.nstripe_statisticsd {{--//r c 6 V P P 4 # )z/Length of the data stripes in the file in bytes)r content_lengthr s &r r? ORCFile.content_lengthi r6 r c 6 V P P 4 # )z`_
is the older version
while `Hive 0.12 / ORC v1 `_
is the newer one.
batch_size : int, default 1024
Number of rows the ORC writer writes at a time.
stripe_size : int, default 64 * 1024 * 1024
Size of each ORC stripe in bytes.
compression : string, default 'uncompressed'
The compression codec.
Valid values: {'UNCOMPRESSED', 'SNAPPY', 'ZLIB', 'LZ4', 'ZSTD'}
Note that LZ0 is currently not supported.
compression_block_size : int, default 64 * 1024
Size of each compression block in bytes.
compression_strategy : string, default 'speed'
The compression strategy i.e. speed vs size reduction.
Valid values: {'SPEED', 'COMPRESSION'}
row_index_stride : int, default 10000
The row index stride i.e. the number of rows per
an entry in the row index.
padding_tolerance : double, default 0.0
The padding tolerance.
dictionary_key_size_threshold : double, default 0.0
The dictionary key size threshold. 0 to disable dictionary encoding.
1 to always enable dictionary encoding.
bloom_filter_columns : None, set-like or list-like, default None
Columns that use the bloom filter.
bloom_filter_fpp : double, default 0.05
Upper limit of the false-positive rate of the bloom filter.
c a ] tR t^t o R] R2tRtRRRRRR R R
R R R
RRRRRRRRRRR/ R ltR tR t R t
R t R t R t
V tR# ) ORCWritera
Writer interface for a single ORC file
Parameters
----------
where : str or pyarrow.io.NativeFile
Writable target. For passing Python file objects or byte buffers,
see pyarrow.io.PythonFileInterface, pyarrow.io.BufferOutputStream
or pyarrow.io.FixedSizeBufferWriter.
Fr# 0.12
batch_size stripe_sizer* uncompressedcompression_block_size compression_strategyspeedr8 ' padding_tolerance dictionary_key_size_thresholdbloom_filter_columnsNbloom_filter_fpp皙?c \ P ! 4 V n V P P VVVVVVVVV V
V V R 7 RV n R# ) r# ro rq r* rs ru r8 rx rz r{ r| TN)r
rl r1 r
is_open)
r wherer# ro rq r* rs ru r8 rx rz r{ r| s
&&$$$$$$$$$$$r r ORCWriter.__init__ sV nn& %!###9!5 - /*G!5 -
r c & V P 4 R # r closer s &r __del__ORCWriter.__del__
r c V # r r s &r __enter__ORCWriter.__enter__ s r c & V P 4 R # r r )r argskwargss &*,r __exit__ORCWriter.__exit__ r r c d V P ' g Q hV P P V4 R# )z
Write the table into an ORC file. The schema of the table must
be equal to the schema used when opening the ORC file.
Parameters
----------
table : pyarrow.Table
The table to be written into the ORC file
N)r r1 write)r tables &&r r ORCWriter.write s$ |||| % r c p V P ' d$ V P P 4 RV n R# R# )z
Close the ORC file
FN)r r1 r r s &r r ORCWriter.close# s) <<< KK DL r )r r1 )ra rb rc rd _orc_writer_args_docsre r r r r r r r rg rh ri s @r rl rl s
G G $ . ,
). '.
#( $' 03 '+ #' < !! !r rl c \ W4 w r#Ve VP V4 p Ve; \ V4 ^ 8X d+ \ V 4 P 4 P V4 pV# \ V 4 P VR7 pV# )NrZ )r open_input_filerP r r_ select)r rT
filesystempathresults &&& r
read_tabler , sx 3FGJ ++D1s7|q 0 %%'..w7 M %%g%6 Mr a
Read a Table from an ORC file.
Parameters
----------
source : str, pyarrow.NativeFile, or file-like object
If a string passed, can be a single file name. For file-like objects,
only read a single file. Use pyarrow.BufferReader to read a file
contained in a bytes or buffer-like object.
columns : list
If not None, only these columns will be read from the file. A column
name may be a prefix of a nested field, e.g. 'a' will select 'a.b',
'a.c', and 'a.d.e'. Output always follows the ordering of the file and
not the `columns` list. If empty, no columns will be read. Note
that the table will still have the correct num_rows set despite having
no columns.
filesystem : FileSystem, default None
If nothing passed, will be inferred based on path.
Path will try to be found in the local on-disk filesystem otherwise
it will be parsed as an URI to determine the filesystem.
r# rn ro rp rq r* rr rs rt ru rv r8 rw rx ry rz r{ r| r} c
\ V\ 4 ' d \ P ! R \ ^R7 Yr\ VVVVVVVVV V
V V R7 ;_uu_ 4 p
V
P
V 4 RRR4 R# + ' g i R# ; i)zThe order of the arguments has changed. Pass as 'write_table(table, where)' instead. The old order will raise an error in the future.)
stacklevelr N)rN r warningswarn
FutureWarningrl r )r r r# ro rq r* rs ru r8 rx rz r{ r| r1 s &&$$$$$$$$$$$ r write_tabler P s %
&'4
u
! 5 1)+&C 1)
U
s A11 B aZ
Write a table into an ORC file.
Parameters
----------
table : pyarrow.lib.Table
The table to be written into the ORC file
where : str or pyarrow.io.NativeFile
Writable target. For passing Python file objects or byte buffers,
see pyarrow.io.PythonFileInterface, pyarrow.io.BufferOutputStream
or pyarrow.io.FixedSizeBufferWriter.
rm )NNr )numbersr r pyarrow.libr pyarrow._orcr
pyarrow.fsr r r rl r re r r r r r s & 3`1 `1F DI! I!X
.! #! ! -! + !
(- ! &-
! "'! #&! /2! &*! "&! H r