plot - Plotting of very large data sets in R -
how can plot large data set in r?
i'd use boxplot, or violin plot, or similar. data cannot fit in memory. can incrementally read in , calculate summaries needed make these plots? if how?
in supplement comment dmitri answer, function calculate quantiles using ff big-data handling package:
ffquantile<-function(ffv,qs=c(0,0.25,0.5,0.75,1),...){ stopifnot(all(qs<=1 & qs>=0)) ffsort(ffv,...)->ffvs j<-(qs*(length(ffv)-1))+1 jf<-floor(j);ceiling(j)->jc rowsums(matrix(ffvs[c(jf,jc)],length(qs),2))/2 } this exact algorithm, uses sorting -- , may take lot of time.
Comments
Post a Comment