Top | ![]() |
![]() |
![]() |
![]() |
GArrowFileSystem * | file-system | Read / Write / Construct Only |
GADatasetFileFormat * | format | Read / Write / Construct Only |
GADatasetPartitioning * | partitioning | Read / Write / Construct Only |
char * | base-dir | Read / Write |
char * | base-name-template | Read / Write |
GArrowFileSystem * | file-system | Read / Write |
GADatasetFileWriteOptions * | file-write-options | Read / Write |
guint | max-partitions | Read / Write |
GADatasetPartitioning * | partitioning | Read / Write |
GObject ├── GADatasetDataset │ ╰── GADatasetFileSystemDataset ╰── GADatasetFileSystemDatasetWriteOptions
GADatasetDataset is a base class for datasets.
GADatasetFileSystemDataset is a class for file system dataset.
GADatasetFileSystemDatasetWriteOptions is a class for options to write a dataset to file system dataset.
GADatasetScannerBuilder * gadataset_dataset_begin_scan (GADatasetDataset *dataset
,GError **error
);
A newly created GADatasetScannerBuilder on success, NULL
on error.
[transfer full][nullable]
Since: 5.0.0
GArrowTable * gadataset_dataset_to_table (GADatasetDataset *dataset
,GError **error
);
Since: 5.0.0
gchar *
gadataset_dataset_get_type_name (GADatasetDataset *dataset
);
Since: 5.0.0
GADatasetFileSystemDatasetWriteOptions *
gadataset_file_system_dataset_write_options_new
(void
);
Since: 6.0.0
gboolean gadataset_file_system_dataset_write_scanner (GADatasetScanner *scanner
,GADatasetFileSystemDatasetWriteOptions *options
,GError **error
);
scanner |
A GADatasetScanner that produces data to be written. |
|
options |
||
error |
Return location for a GError or |
[nullable] |
Since: 6.0.0
#define GADATASET_TYPE_FILE_SYSTEM_DATASET_WRITE_OPTIONS
struct GADatasetFileSystemDatasetWriteOptionsClass { GObjectClass parent_class; };
struct GADatasetFileSystemDatasetClass { GADatasetDatasetClass parent_class; };
“file-system”
property “file-system” GArrowFileSystem *
File system of the dataset.
Owner: GADatasetFileSystemDataset
Flags: Read / Write / Construct Only
Since: 5.0.0
“format”
property“format” GADatasetFileFormat *
Format of the dataset.
Owner: GADatasetFileSystemDataset
Flags: Read / Write / Construct Only
Since: 5.0.0
“partitioning”
property“partitioning” GADatasetPartitioning *
Partitioning of the dataset.
Owner: GADatasetFileSystemDataset
Flags: Read / Write / Construct Only
Since: 6.0.0
“base-dir”
property “base-dir” char *
Root directory into which the dataset will be written.
Owner: GADatasetFileSystemDatasetWriteOptions
Flags: Read / Write
Default value: NULL
“base-name-template”
property “base-name-template” char *
Template string used to generate fragment base names. {i} will be replaced by an auto incremented integer.
Owner: GADatasetFileSystemDatasetWriteOptions
Flags: Read / Write
Default value: NULL
Since: 6.0.0
“file-system”
property “file-system” GArrowFileSystem *
GArrowFileSystem into which a dataset will be written.
Owner: GADatasetFileSystemDatasetWriteOptions
Flags: Read / Write
“file-write-options”
property“file-write-options” GADatasetFileWriteOptions *
Options for individual fragment writing.
Owner: GADatasetFileSystemDatasetWriteOptions
Flags: Read / Write
“max-partitions”
property “max-partitions” guint
Maximum number of partitions any batch may be written into.
Owner: GADatasetFileSystemDatasetWriteOptions
Flags: Read / Write
Allowed values: <= G_MAXINT
Default value: 1024
Since: 6.0.0
“partitioning”
property“partitioning” GADatasetPartitioning *
GADatasetPartitioning used to generate fragment paths.
Owner: GADatasetFileSystemDatasetWriteOptions
Flags: Read / Write
Since: 6.0.0