RAM

  • Basically short term memory. When a process ends, it is destroyed (like when you quit RStudio)

  • Get a computer with lots of RAM, probably

\(\textrm{Necessary RAM} = \textrm{max amount of data} \times 3\)

  • If it’s too big, move to disk (e.g. database, Arrow, dask, HDF5)
Big data in R
Big data in R