Historical Throughput

Raw Data

<Client: 'tcp://127.0.0.1:44589' processes=10 threads=10, memory=540.94 GB>
Distributed Version: 2.31.0.dev0+93.g997157aa
simple
5.568e-01 +/- 3.972e-02
shuffle
2.192e+01 +/- 8.184e-01
rand_access
9.330e-03 +/- 2.706e-03
anom_mean
9.977e+01 +/- 1.126e+00

Raw Values

simple
[0.58457732 0.53798223 0.53934216 0.56860733 0.53080273 0.62986851
0.54856706 0.58331561 0.4721806 0.57300425]
shuffle
[20.88524246 21.48666 21.38820171 20.97553229 21.89661932 21.72500539
22.17030573 23.77210212 22.1609633 22.74121404]
rand_access
[0.00762415 0.01075149 0.01181793 0.01014018 0.01083684 0.01109505
0.0042882 0.00463843 0.01221418 0.00989771]
anom_mean
[ 99.24389291 98.97223043 97.85002375 99.50107884 98.36659908
100.993783 100.84478521 99.75757003 101.18812919 100.94548392]

Dask Profiles

• Shuffle
  Profile
• Random Access
  Profile
• Simple
  Profile
• Anom
  Mean

Scheduler Execution Graph