R Studio session runs out when reading big DF about datadigest HOT 1 OPEN

Was hoping that this was an issue with too many marks being drawn on the page, but the fixes in progress for web-codebook v1.7 (also available in R via install_github('rhoinc/datadigest', ref="v1.1.0-dev")) don't seem to help much.

My comp (16 gb RAM) managed to load a codebook for a 200000x150 labs data set (~200mb), but it was definitely slow ... RStudio crashed when I tried to run the codebook on a df that was 450000x150 (~400 mb). 

Honestly, this should be doable. If the data set is loaded in to memory (which took a second, but worked ok) we should be able to summarize it. My new best guess is that there is some inefficient data handling happening in javascript that is causing the problem. I'll see if I can do some profiling and figure out where exactly the problem is occurring and will keep you posted on possible fixes. 

If javascript debugging fails, then a more thorough refactor where data summaries are calculated in R and then passed to javascript for visualization (in a shiny app?) could be considered, but that would be a big chunk of work that may not happen soon.

from datadigest.