Package | Description |
---|---|
parquet.bytes | |
parquet.column.page | |
parquet.column.values | |
parquet.column.values.bitpacking | |
parquet.column.values.boundedint | |
parquet.column.values.delta | |
parquet.column.values.deltalengthbytearray | |
parquet.column.values.deltastrings | |
parquet.column.values.dictionary | |
parquet.column.values.plain | |
parquet.column.values.rle | |
parquet.hadoop |
Provides classes to store use Parquet files in Hadoop
In a map reduce job:
|
Modifier and Type | Method and Description |
---|---|
static BytesInput |
BytesInput.concat(BytesInput... inputs)
logically concatenate the provided inputs
|
static BytesInput |
BytesInput.concat(List<BytesInput> inputs)
logically concatenate the provided inputs
|
static BytesInput |
BytesInput.copy(BytesInput bytesInput)
copies the input into a new byte array
|
static BytesInput |
BytesInput.empty() |
static BytesInput |
BytesInput.from(byte[] in) |
static BytesInput |
BytesInput.from(byte[] in,
int offset,
int length) |
static BytesInput |
BytesInput.from(ByteArrayOutputStream baos) |
static BytesInput |
BytesInput.from(CapacityByteArrayOutputStream arrayOut) |
static BytesInput |
BytesInput.from(InputStream in,
int bytes) |
static BytesInput |
BytesInput.fromInt(int intValue) |
static BytesInput |
BytesInput.fromUnsignedVarInt(int intValue) |
static BytesInput |
BytesInput.fromZigZagVarInt(int intValue) |
Modifier and Type | Method and Description |
---|---|
static BytesInput |
BytesInput.concat(BytesInput... inputs)
logically concatenate the provided inputs
|
static BytesInput |
BytesInput.copy(BytesInput bytesInput)
copies the input into a new byte array
|
Modifier and Type | Method and Description |
---|---|
static BytesInput |
BytesInput.concat(List<BytesInput> inputs)
logically concatenate the provided inputs
|
Modifier and Type | Method and Description |
---|---|
BytesInput |
DictionaryPage.getBytes() |
BytesInput |
Page.getBytes() |
Modifier and Type | Method and Description |
---|---|
void |
PageWriter.writePage(BytesInput bytesInput,
int valueCount,
Encoding rlEncoding,
Encoding dlEncoding,
Encoding valuesEncoding)
Deprecated.
|
void |
PageWriter.writePage(BytesInput bytesInput,
int valueCount,
Statistics statistics,
Encoding rlEncoding,
Encoding dlEncoding,
Encoding valuesEncoding)
writes a single page
|
Constructor and Description |
---|
DictionaryPage(BytesInput bytes,
int dictionarySize,
Encoding encoding)
creates an uncompressed page
|
DictionaryPage(BytesInput bytes,
int uncompressedSize,
int dictionarySize,
Encoding encoding)
creates a dictionary page
|
Page(BytesInput bytes,
int valueCount,
int uncompressedSize,
Encoding rlEncoding,
Encoding dlEncoding,
Encoding valuesEncoding)
Deprecated.
|
Page(BytesInput bytes,
int valueCount,
int uncompressedSize,
Statistics stats,
Encoding rlEncoding,
Encoding dlEncoding,
Encoding valuesEncoding) |
Modifier and Type | Method and Description |
---|---|
abstract BytesInput |
ValuesWriter.getBytes() |
Modifier and Type | Method and Description |
---|---|
BytesInput |
BitPackingValuesWriter.getBytes() |
BytesInput |
ByteBitPackingValuesWriter.getBytes() |
BytesInput |
ByteBasedBitPackingEncoder.toBytes() |
Modifier and Type | Method and Description |
---|---|
BytesInput |
DevNullValuesWriter.getBytes() |
Modifier and Type | Method and Description |
---|---|
BytesInput |
DeltaBinaryPackingValuesWriter.getBytes()
getBytes will trigger flushing block buffer, DO NOT write after getBytes() is called without calling reset()
|
Modifier and Type | Method and Description |
---|---|
BytesInput |
DeltaLengthByteArrayValuesWriter.getBytes() |
Modifier and Type | Method and Description |
---|---|
BytesInput |
DeltaByteArrayWriter.getBytes() |
Modifier and Type | Method and Description |
---|---|
BytesInput |
DictionaryValuesWriter.getBytes() |
Modifier and Type | Method and Description |
---|---|
BytesInput |
FixedLenByteArrayPlainValuesWriter.getBytes() |
BytesInput |
BooleanPlainValuesWriter.getBytes() |
BytesInput |
PlainValuesWriter.getBytes() |
Modifier and Type | Method and Description |
---|---|
BytesInput |
RunLengthBitPackingHybridValuesWriter.getBytes() |
BytesInput |
RunLengthBitPackingHybridEncoder.toBytes() |
Modifier and Type | Method and Description |
---|---|
void |
ParquetFileWriter.writeDataPage(int valueCount,
int uncompressedPageSize,
BytesInput bytes,
Encoding rlEncoding,
Encoding dlEncoding,
Encoding valuesEncoding)
Deprecated.
|
void |
ParquetFileWriter.writeDataPage(int valueCount,
int uncompressedPageSize,
BytesInput bytes,
Statistics statistics,
Encoding rlEncoding,
Encoding dlEncoding,
Encoding valuesEncoding)
writes a single page
|
Copyright © 2015. All rights reserved.