ATM benchmark phase report — ao2

Phase ao2. Charts use immutable campaign values; times default to Pacific and localize in the viewer.

TCP

170008794mac-arm64-01mac-arm64-01mac-arm64-01mac-arm64-01mac-arm64-01mac-arm64-01mac-arm64-01mac-arm64-01mac-arm64-01mac-arm64-01m5-arm64-01m5-arm64-01m5-arm64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01m5-arm64-01m5-arm64-01m5-arm64-01m5-arm64-01m5-arm64-01m5-arm64-01locallocallocallocallocallocalwindows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01m5-atmbenchm5-atmbenchm5-atmbenchm5-atmbenchwindows-x64-01windows-x64-01m5-atmbenchm5-atmbenchwindows-x64-01windows-x64-01m5-atmbenchm5-atmbenchwindows-x64-01m5-atmbenchm5-atmbenchm5-atmbenchm5-atmbench

Range 84–31542 msg/sec. ● local ● m5-arm64-01 ● m5-atmbench ● mac-arm64-01 ● windows-x64-01

  1. · mac-arm64-01
  2. · mac-arm64-01
  3. · mac-arm64-01
  4. · mac-arm64-01
  5. · mac-arm64-01
  6. · mac-arm64-01
  7. · mac-arm64-01
  8. · mac-arm64-01
  9. · mac-arm64-01
  10. · mac-arm64-01
  11. · m5-arm64-01
  12. · m5-arm64-01
  13. · m5-arm64-01
  14. · windows-x64-01
  15. · windows-x64-01
  16. · windows-x64-01
  17. · windows-x64-01
  18. · windows-x64-01
  19. · windows-x64-01
  20. · windows-x64-01
  21. · windows-x64-01
  22. · windows-x64-01
  23. · windows-x64-01
  24. · windows-x64-01
  25. · windows-x64-01
  26. · windows-x64-01
  27. · windows-x64-01
  28. · windows-x64-01
  29. · windows-x64-01
  30. · windows-x64-01
  31. · windows-x64-01
  32. · windows-x64-01
  33. · windows-x64-01
  34. · windows-x64-01
  35. · windows-x64-01
  36. · windows-x64-01
  37. · windows-x64-01
  38. · windows-x64-01
  39. · windows-x64-01
  40. · windows-x64-01
  41. · m5-arm64-01
  42. · m5-arm64-01
  43. · m5-arm64-01
  44. · m5-arm64-01
  45. · m5-arm64-01
  46. · m5-arm64-01
  47. · local
  48. · local
  49. · local
  50. · local
  51. · local
  52. · local
  53. · windows-x64-01
  54. · windows-x64-01
  55. · windows-x64-01
  56. · windows-x64-01
  57. · windows-x64-01
  58. · windows-x64-01
  59. · m5-atmbench
  60. · m5-atmbench
  61. · m5-atmbench
  62. · m5-atmbench
  63. · windows-x64-01
  64. · windows-x64-01
  65. · m5-atmbench
  66. · m5-atmbench
  67. · windows-x64-01
  68. · windows-x64-01
  69. · m5-atmbench
  70. · m5-atmbench
  71. · windows-x64-01
  72. · m5-atmbench
  73. · m5-atmbench
  74. · m5-atmbench
  75. · m5-atmbench

TCP + TLS

135006892windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01windows-x64-01m5-atmbenchm5-atmbenchm5-atmbenchm5-atmbenchwindows-x64-01windows-x64-01m5-atmbenchm5-atmbenchwindows-x64-01windows-x64-01m5-atmbenchm5-atmbenchwindows-x64-01m5-atmbenchm5-atmbenchm5-atmbenchm5-atmbench

Range 70–17484 msg/sec. ● m5-atmbench ● windows-x64-01

  1. · windows-x64-01
  2. · windows-x64-01
  3. · windows-x64-01
  4. · windows-x64-01
  5. · windows-x64-01
  6. · windows-x64-01
  7. · windows-x64-01
  8. · windows-x64-01
  9. · windows-x64-01
  10. · windows-x64-01
  11. · windows-x64-01
  12. · windows-x64-01
  13. · m5-atmbench
  14. · m5-atmbench
  15. · m5-atmbench
  16. · m5-atmbench
  17. · windows-x64-01
  18. · windows-x64-01
  19. · m5-atmbench
  20. · m5-atmbench
  21. · windows-x64-01
  22. · windows-x64-01
  23. · m5-atmbench
  24. · m5-atmbench
  25. · windows-x64-01
  26. · m5-atmbench
  27. · m5-atmbench
  28. · m5-atmbench
  29. · m5-atmbench

UDS

18000mac-arm64-01mac-arm64-01mac-arm64-01mac-arm64-01mac-arm64-01mac-arm64-01mac-arm64-01mac-arm64-01mac-arm64-01mac-arm64-01mac-arm64-01mac-arm64-01m5-arm64-01m5-arm64-01m5-arm64-01m5-arm64-01m5-arm64-01m5-arm64-01m5-arm64-01m5-arm64-01m5-arm64-01m5-arm64-01m5-arm64-01m5-arm64-01m5-atmbenchm5-atmbenchm5-atmbenchm5-atmbenchm5-atmbenchm5-atmbenchm5-atmbenchm5-atmbenchm5-atmbenchm5-atmbenchm5-atmbenchm5-atmbench

Range 181–32066 msg/sec. ● m5-arm64-01 ● m5-atmbench ● mac-arm64-01

  1. · mac-arm64-01
  2. · mac-arm64-01
  3. · mac-arm64-01
  4. · mac-arm64-01
  5. · mac-arm64-01
  6. · mac-arm64-01
  7. · mac-arm64-01
  8. · mac-arm64-01
  9. · mac-arm64-01
  10. · mac-arm64-01
  11. · mac-arm64-01
  12. · mac-arm64-01
  13. · m5-arm64-01
  14. · m5-arm64-01
  15. · m5-arm64-01
  16. · m5-arm64-01
  17. · m5-arm64-01
  18. · m5-arm64-01
  19. · m5-arm64-01
  20. · m5-arm64-01
  21. · m5-arm64-01
  22. · m5-arm64-01
  23. · m5-arm64-01
  24. · m5-arm64-01
  25. · m5-atmbench
  26. · m5-atmbench
  27. · m5-atmbench
  28. · m5-atmbench
  29. · m5-atmbench
  30. · m5-atmbench
  31. · m5-atmbench
  32. · m5-atmbench
  33. · m5-atmbench
  34. · m5-atmbench
  35. · m5-atmbench
  36. · m5-atmbench

SQLite

3500016035m5-atmbenchm5-atmbenchm5-atmbenchm5-atmbenchwindows-x64-01windows-x64-01m5-atmbenchm5-atmbenchwindows-x64-01windows-x64-01m5-atmbenchm5-atmbenchwindows-x64-01m5-atmbenchm5-atmbenchm5-atmbenchm5-atmbench

Range 5627–58437 msg/sec. ● m5-atmbench ● windows-x64-01

  1. · m5-atmbench
  2. · m5-atmbench
  3. · m5-atmbench
  4. · m5-atmbench
  5. · windows-x64-01
  6. · windows-x64-01
  7. · m5-atmbench
  8. · m5-atmbench
  9. · windows-x64-01
  10. · windows-x64-01
  11. · m5-atmbench
  12. · m5-atmbench
  13. · windows-x64-01
  14. · m5-atmbench
  15. · m5-atmbench
  16. · m5-atmbench
  17. · m5-atmbench

m5-atmbench · af09279cead66c2821bb520842d0894d6fa2f253

· FAIL

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP16331.3417088.6417456.58325000 / 325000 after restart17000.00-668.66FAIL
TCP + TLS14561.4715193.8115473.91290000 / 290000 after restart13500.00+1061.47PASS
UDS18987.6019878.8520300.21376000 / 376000 after restart18000.00+987.60PASS
SQLite44438.2751091.8852880.09887000 / 887000 after restart35000.00+9438.27PASS

m5-atmbench · a527e8ded55f89db9f75ec70b049ab4c180aaff3

· INCOMPLETE

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP16227.3916988.7117198.94323000 / 323000 after restart17000.00-772.61FAIL
TCP + TLS14440.0715157.0915608.25284000 / 284000 after restart13500.00+940.07PASS
UDS18853.2819660.0419992.97375000 / 375000 after restart18000.00+853.28PASS
SQLite45254.9651198.5852916.12not captured35000.00+10254.96INCOMPLETE

m5-atmbench · 2aea45d021572c0bac60afdc787df2e9056c1b3c

· FAIL

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP16564.4617354.4217685.60327000 / 327000 after restart17000.00-435.54FAIL
TCP + TLS14851.9115508.7615712.34296000 / 296000 after restart13500.00+1351.91PASS
UDS19077.3519955.2320515.42378000 / 378000 after restart18000.00+1077.35PASS
SQLite45867.8452142.4054202.75900000 / 900000 after restart35000.00+10867.84PASS

m5-atmbench · d53715bd547bf24f0fbadb933f12c997467c1911

· PASS

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP18694.4219432.0719743.29370000 / 370000 after restart17000.00+1694.42PASS
TCP + TLS16144.1616783.2616972.43321000 / 321000 after restart13500.00+2644.16PASS
UDS21753.4022833.6423324.98432000 / 432000 after restart18000.00+3753.40PASS
SQLite48362.6254741.6556667.79947000 / 947000 after restart35000.00+13362.62PASS

m5-atmbench · f1494adbf165fc35beabf9e83e469c70977162b0

· INCOMPLETE

Testp50p95p99Durable write proofBaselineMarginVerdict
TCPn/an/an/anot captured17000.00n/aINCOMPLETE
TCP + TLSn/an/an/anot captured13500.00n/aINCOMPLETE
UDSn/an/an/anot captured18000.00n/aINCOMPLETE
SQLiten/an/an/anot captured35000.00n/aINCOMPLETE

m5-atmbench · 46e9044cfb4664faaadcb0e0e5e204d0d7f614cb

· INCOMPLETE

Testp50p95p99Durable write proofBaselineMarginVerdict
TCPn/an/an/anot captured17000.00n/aINCOMPLETE
TCP + TLSn/an/an/anot captured13500.00n/aINCOMPLETE
UDSn/an/an/anot captured18000.00n/aINCOMPLETE
SQLiten/an/an/anot captured35000.00n/aINCOMPLETE

m5-atmbench · cc9c4f2a6440e117057c8712e6d8f0d0d686372d

· INCOMPLETE

Testp50p95p99Durable write proofBaselineMarginVerdict
TCPn/an/an/anot captured17000.00n/aINCOMPLETE
TCP + TLSn/an/an/anot captured13500.00n/aINCOMPLETE
UDSn/an/an/anot captured18000.00n/aINCOMPLETE
SQLiten/an/an/anot captured35000.00n/aINCOMPLETE

m5-atmbench · 02b0fbbced7b205766a1a1c38a67649c4019c202

· PASS

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP18248.9519289.9719665.76350000 / 350000 after restart17000.00+1248.95PASS
TCP + TLS16060.3916935.6517211.56314000 / 314000 after restart13500.00+2560.39PASS
UDS21277.6922639.6923245.57397000 / 397000 after restart18000.00+3277.69PASS
SQLite43757.4552082.8853719.40851000 / 851000 after restart35000.00+8757.45PASS

windows-x64-01 · f39c2236477a891abf5c8b99f1611a9b453bc714

· FAIL

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP7564.129490.1510120.99154000 / 154000 after restart8793.91-1229.79FAIL
TCP + TLS7381.789026.599471.90139000 / 139000 after restart6891.68+490.10PASS
UDSn/an/an/anot capturedn/an/aINCOMPLETE
SQLite26976.6530358.6931083.80493000 / 493000 after restart16035.35+10941.30PASS

m5-atmbench · 46d34a93316f652dd1726fcbf6e084004c50c3a1

· PASS

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP18671.1619406.8019821.38369000 / 369000 after restart17000.00+1671.16PASS
TCP + TLS16361.6416975.8817242.47325000 / 325000 after restart13500.00+2861.64PASS
UDS21832.4222863.4423281.58434000 / 434000 after restart18000.00+3832.42PASS
SQLite49605.6454895.7956751.81953000 / 953000 after restart35000.00+14605.64PASS

m5-atmbench · f5de135513ed2607fadc3f69a9188b1fdad5f043

· FAIL

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP5523.526583.657280.49108000 / 108000 after restart17000.00-11476.48FAIL
TCP + TLS7371.048262.828615.35145000 / 145000 after restart13500.00-6128.96FAIL
UDS6105.667144.787417.98117000 / 117000 after restart18000.00-11894.34FAIL
SQLite48238.3652882.4254370.73924000 / 924000 after restart35000.00+13238.36PASS

m5-atmbench · 863ee20139cf6ffaf0647601c4b9dfae4a37ab51

· INCOMPLETE

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP422.18422.18422.18600 / 600 after restart17000.00-16577.82FAIL
TCP + TLSn/an/an/anot captured13500.00n/aINCOMPLETE
UDSn/an/an/anot captured18000.00n/aINCOMPLETE
SQLiten/an/an/anot captured35000.00n/aINCOMPLETE

windows-x64-01 · ad20f3a66f9bca72153346590eb838ac9dbba490

· FAIL

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP83.9983.9983.99999 / 999 after restart8793.91-8709.93FAIL
TCP + TLS102.98122.16122.168998 / 8998 after restart6891.68-6788.70FAIL
UDSn/an/an/anot capturedn/an/aINCOMPLETE
SQLite27639.5030611.0931420.46509000 / 509000 after restart16035.35+11604.16PASS

windows-x64-01 · ad20f3a66f9bca72153346590eb838ac9dbba490

· FAIL

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP109.69125.87125.874996 / 4996 after restart8793.91-8684.22FAIL
TCP + TLS112.17121.77121.774998 / 4998 after restart6891.68-6779.51FAIL
UDSn/an/an/anot capturedn/an/aINCOMPLETE
SQLite26790.1930496.5431414.34509000 / 509000 after restart16035.35+10754.84PASS

m5-atmbench · 93aff0f9953ea0b4baedbab866192da719e2e386

· PASS

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP17318.8818347.4918605.20345000 / 345000 after restart17000.00+318.88PASS
TCP + TLS14352.5915186.1115544.06286000 / 286000 after restart13500.00+852.59PASS
UDS20310.3021685.9422383.61404000 / 404000 after restart18000.00+2310.30PASS
SQLite42012.9848604.9450108.99831000 / 831000 after restart35000.00+7012.98PASS

m5-atmbench · fa385f6ccada8b23f6d3fddb3f943fc1be6013f0

· PASS

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP17984.8718781.5319026.78357000 / 357000 after restart17000.00+984.87PASS
TCP + TLS14950.1815701.3416023.19297000 / 297000 after restart13500.00+1450.18PASS
UDS20517.3321747.1122349.99409000 / 409000 after restart18000.00+2517.33PASS
SQLite43115.9949505.0550444.86844000 / 844000 after restart35000.00+8115.99PASS

windows-x64-01 · c387a45d1e6740fae28649fca6d60dd951c70653

· FAIL

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP6012.476722.616859.28118000 / 118000 after restart8793.91-2781.45FAIL
TCP + TLS5614.016211.826251.00114000 / 114000 after restart6891.68-1277.67FAIL
UDSn/an/an/anot capturedn/an/aINCOMPLETE
SQLite16022.8820019.1820699.82318000 / 318000 after restart16035.35-12.46FAIL

windows-x64-01 · 098bd7afa0e1c04ad195f11274abef7a7da0bdca

· FAIL

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP5802.796643.446814.98116000 / 116000 after restart8793.91-2991.12FAIL
TCP + TLS5589.186114.326162.00113000 / 113000 after restart6891.68-1302.50FAIL
UDSn/an/an/anot capturedn/an/aINCOMPLETE
SQLite15989.7419906.6020260.10316000 / 316000 after restart16035.35-45.60FAIL

m5-atmbench · c89644c7b8341dafa4975ef34241ed349fef5da9

· FAIL

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP17566.3418537.3018997.68349000 / 349000 after restart17500.00+66.34PASS
TCP + TLS14486.5415370.8115601.01289000 / 289000 after restart17500.00-3013.46FAIL
UDS19832.0921052.8921672.29394000 / 394000 after restart18000.00+1832.09PASS
SQLite42384.8948999.3949766.72832000 / 832000 after restart35000.00+7384.89PASS

m5-atmbench · 14f0a032e906b4a1ca2cca3267d37d99a03df9e2

· FAIL

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP17373.4118445.4118707.18345000 / 345000 after restart17500.00-126.59FAIL
TCP + TLS14572.7615453.6015893.67289000 / 289000 after restart17500.00-2927.24FAIL
UDS19840.4021159.9021571.04394000 / 394000 after restart18000.00+1840.40PASS
SQLite41930.4448454.6049249.96826000 / 826000 after restart35000.00+6930.44PASS

m5-atmbench · 9542f41cc7fe1d1d38639767226ab4f5ec6133fa

· FAIL

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP17180.4118186.8318606.60342000 / 342000 after restart17500.00-319.59FAIL
TCP + TLS13666.7814478.2614812.43272000 / 272000 after restart17500.00-3833.22FAIL
UDS19649.0620880.0621557.53392000 / 392000 after restart18000.00+1649.06PASS
SQLite40754.7146202.1848879.34803000 / 803000 after restart35000.00+5754.71PASS

m5-atmbench · d4e2d6df8bd5197e6c8d98fb0c3de51f80d6578f

· FAIL

Testp50p95p99Durable write proofBaselineMarginVerdict
TCP17371.1618292.2118855.30345000 / 345000 after restart17500.00-128.84FAIL
TCP + TLS13642.5014402.3914847.72272000 / 272000 after restart17500.00-3857.50FAIL
UDS19757.0921087.6921709.36393000 / 393000 after restart18000.00+1757.09PASS
SQLite41686.7548609.4749569.06816000 / 816000 after restart35000.00+6686.75PASS