r - Read data from multiple CSV files into single ffdf object -
Is it possible to load the data of multiple files once in the FF data frame (FFDF)? I think I can load each CSV file on a different FFDF object and then FFDFBIDID
big_file_part2.csv big_file_part3.csv < P> Fill them together. But it seems in an inefficient way, the stuff is loading twice. Is there any more direct route?
How did I do this (note that my source data is not any headers).
The first step - to make sure that all your files are in the same folder, set up your working directory in the folder. # Load a #ffbase library library (ffbase) # create a vector of # files that I want to load temp = list.files (pattern = "* .css") # I = To create the first FFDF object for 1, it is necessary that the FF dataframe is left in mydata (1 in) & lt; - read.csv.ffdf (file = temp [i], header = FALSE, VERBOSE = TRUE, first.rows = 100000, next.rows = 100000, colClasses = NA) through the remaining objects in #loop (i 2: length (temp) mydata & lt; - read.csv.ffdf (X = mydata, file = temp [i], header = FALSE, VERBOSE = TRUE, first.rows = 100000, next.rows = 100000)
Comments
Post a Comment