Benchmarks
Measured results
Time to first operation, cold start against restore, as measured by the project — with the conditions they were measured under.
CRaC support was implemented in a few frameworks with the following results. The source code can be found in the frameworks with CRaC support .
The environment
- laptop with Intel i7-5500U, 16Gb RAM and SSD.
- Linux kernel 5.7.4-arch1-1
- data was collected in container running
ubuntu:18.04based image - host operating system: archlinux
How to reproduce
To reproduce you need to create a workspace directory and clone along next repositories:
You need to build examples according to the frameworks with CRaC support .
Then run
host$ docker build -t full-bench -f Dockerfile.full-bench utils
host$ docker run -it --privileged -v $HOME:$HOME -v $PWD:$PWD -w $PWD full-bench
cont# JDK=<path/to/jdk> bash ./utils/full-bench.sh collect
...
cont# exit
host$ bash ./utils/full-bench.sh parse
host$ cp *.data docs
host$ make -C docs
Last command regenerates graphs in the docs.
Time to first operation
Throughput while warming up
Requests completed against time, cold start against restore.
