RAM

  • Basically short term memory. When a process ends, it is destroyed (like when you quit RStudio)

  • Get a computer with lots of RAM, probably

Necessary RAM=max amount of data×3

  • If it’s too big, move to disk (e.g. database, Arrow, dask, HDF5)
Big data in R
Big data in R