read_delim_chunked {readr} | R Documentation |
Read a delimited file by chunks
read_delim_chunked(
file,
callback,
chunk_size = 10000,
delim,
quote = "\"",
escape_backslash = FALSE,
escape_double = TRUE,
col_names = TRUE,
col_types = NULL,
locale = default_locale(),
na = c("", "NA"),
quoted_na = TRUE,
comment = "",
trim_ws = FALSE,
skip = 0,
guess_max = min(1000, chunk_size),
progress = show_progress(),
skip_empty_rows = TRUE
)
read_csv_chunked(
file,
callback,
chunk_size = 10000,
col_names = TRUE,
col_types = NULL,
locale = default_locale(),
na = c("", "NA"),
quoted_na = TRUE,
quote = "\"",
comment = "",
trim_ws = TRUE,
skip = 0,
guess_max = min(1000, chunk_size),
progress = show_progress(),
skip_empty_rows = TRUE
)
read_csv2_chunked(
file,
callback,
chunk_size = 10000,
col_names = TRUE,
col_types = NULL,
locale = default_locale(),
na = c("", "NA"),
quoted_na = TRUE,
quote = "\"",
comment = "",
trim_ws = TRUE,
skip = 0,
guess_max = min(1000, chunk_size),
progress = show_progress(),
skip_empty_rows = TRUE
)
read_tsv_chunked(
file,
callback,
chunk_size = 10000,
col_names = TRUE,
col_types = NULL,
locale = default_locale(),
na = c("", "NA"),
quoted_na = TRUE,
quote = "\"",
comment = "",
trim_ws = TRUE,
skip = 0,
guess_max = min(1000, chunk_size),
progress = show_progress(),
skip_empty_rows = TRUE
)
file |
Either a path to a file, a connection, or literal data (either a single string or a raw vector). Files ending in Literal data is most useful for examples and tests. It must contain at least one new line to be recognised as data (instead of a path) or be a vector of greater than length 1. Using a value of |
callback |
A callback function to call on each chunk |
chunk_size |
The number of rows to include in each chunk |
delim |
Single character used to separate fields within a record. |
quote |
Single character used to quote strings. |
escape_backslash |
Does the file use backslashes to escape special
characters? This is more general than |
escape_double |
Does the file escape quotes by doubling them?
i.e. If this option is |
col_names |
Either If If Missing ( |
col_types |
One of If If a column specification created by Alternatively, you can use a compact string representation where each character represents one column:
|
locale |
The locale controls defaults that vary from place to place.
The default locale is US-centric (like R), but you can use
|
na |
Character vector of strings to interpret as missing values. Set this
option to |
quoted_na |
Should missing values inside quotes be treated as missing values (the default) or strings. |
comment |
A string used to identify comments. Any text after the comment characters will be silently ignored. |
trim_ws |
Should leading and trailing whitespace be trimmed from each field before parsing it? |
skip |
Number of lines to skip before reading data. |
guess_max |
Maximum number of records to use for guessing column types. |
progress |
Display a progress bar? By default it will only display
in an interactive session and not while knitting a document. The display
is updated every 50,000 values and will only display if estimated reading
time is 5 seconds or more. The automatic progress bar can be disabled by
setting option |
skip_empty_rows |
Should blank rows be ignored altogether? i.e. If this
option is |
Other chunked:
callback
,
melt_delim_chunked()
,
read_lines_chunked()
# Cars with 3 gears
f <- function(x, pos) subset(x, gear == 3)
read_csv_chunked(readr_example("mtcars.csv"), DataFrameCallback$new(f), chunk_size = 5)