Draft
Conversation
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 1 performance regressions! Performance is the same for 58 metrics, 12 unstable metrics.
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~690427a062, baseline=1.61.0-SNAPSHOT~3ff081cd4b
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1059715
Total [baseline] (8.875 s) : 0, 8874796
Agent [candidate] (1.058 s) : 0, 1058450
Total [candidate] (8.852 s) : 0, 8851555
section iast
Agent [baseline] (1.235 s) : 0, 1235303
Total [baseline] (9.55 s) : 0, 9550052
Agent [candidate] (1.223 s) : 0, 1223346
Total [candidate] (9.588 s) : 0, 9587840
gantt
title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~690427a062, baseline=1.61.0-SNAPSHOT~3ff081cd4b
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (627.055 ms) : 0, 627055
BytebuddyAgent [candidate] (627.867 ms) : 0, 627867
AgentMeter [baseline] (29.056 ms) : 0, 29056
AgentMeter [candidate] (28.786 ms) : 0, 28786
GlobalTracer [baseline] (256.95 ms) : 0, 256950
GlobalTracer [candidate] (256.235 ms) : 0, 256235
AppSec [baseline] (31.761 ms) : 0, 31761
AppSec [candidate] (31.606 ms) : 0, 31606
Debugger [baseline] (59.409 ms) : 0, 59409
Debugger [candidate] (58.966 ms) : 0, 58966
Remote Config [baseline] (589.089 µs) : 0, 589
Remote Config [candidate] (624.429 µs) : 0, 624
Telemetry [baseline] (8.051 ms) : 0, 8051
Telemetry [candidate] (8.259 ms) : 0, 8259
Flare Poller [baseline] (9.577 ms) : 0, 9577
Flare Poller [candidate] (8.858 ms) : 0, 8858
section iast
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (802.145 ms) : 0, 802145
BytebuddyAgent [candidate] (794.083 ms) : 0, 794083
AgentMeter [baseline] (11.627 ms) : 0, 11627
AgentMeter [candidate] (11.249 ms) : 0, 11249
GlobalTracer [baseline] (248.702 ms) : 0, 248702
GlobalTracer [candidate] (246.237 ms) : 0, 246237
AppSec [baseline] (27.763 ms) : 0, 27763
AppSec [candidate] (26.317 ms) : 0, 26317
Debugger [baseline] (68.984 ms) : 0, 68984
Debugger [candidate] (68.575 ms) : 0, 68575
Remote Config [baseline] (533.394 µs) : 0, 533
Remote Config [candidate] (540.016 µs) : 0, 540
Telemetry [baseline] (9.212 ms) : 0, 9212
Telemetry [candidate] (10.184 ms) : 0, 10184
Flare Poller [baseline] (3.307 ms) : 0, 3307
Flare Poller [candidate] (3.698 ms) : 0, 3698
IAST [baseline] (25.554 ms) : 0, 25554
IAST [candidate] (25.219 ms) : 0, 25219
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~690427a062, baseline=1.61.0-SNAPSHOT~3ff081cd4b
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1060204
Total [baseline] (11.047 s) : 0, 11046517
Agent [candidate] (1.059 s) : 0, 1058740
Total [candidate] (10.999 s) : 0, 10999181
section appsec
Agent [baseline] (1.248 s) : 0, 1248071
Total [baseline] (11.189 s) : 0, 11188775
Agent [candidate] (1.248 s) : 0, 1247820
Total [candidate] (11.175 s) : 0, 11175046
section iast
Agent [baseline] (1.237 s) : 0, 1236559
Total [baseline] (11.356 s) : 0, 11355982
Agent [candidate] (1.239 s) : 0, 1239114
Total [candidate] (11.383 s) : 0, 11383265
section profiling
Agent [baseline] (1.182 s) : 0, 1181925
Total [baseline] (11.094 s) : 0, 11093531
Agent [candidate] (1.186 s) : 0, 1186176
Total [candidate] (11.098 s) : 0, 11097661
gantt
title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~690427a062, baseline=1.61.0-SNAPSHOT~3ff081cd4b
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (627.658 ms) : 0, 627658
BytebuddyAgent [candidate] (626.409 ms) : 0, 626409
AgentMeter [baseline] (29.091 ms) : 0, 29091
AgentMeter [candidate] (28.939 ms) : 0, 28939
GlobalTracer [baseline] (256.785 ms) : 0, 256785
GlobalTracer [candidate] (256.275 ms) : 0, 256275
AppSec [baseline] (31.689 ms) : 0, 31689
AppSec [candidate] (31.517 ms) : 0, 31517
Debugger [baseline] (60.176 ms) : 0, 60176
Debugger [candidate] (60.09 ms) : 0, 60090
Remote Config [baseline] (597.676 µs) : 0, 598
Remote Config [candidate] (615.561 µs) : 0, 616
Telemetry [baseline] (8.129 ms) : 0, 8129
Telemetry [candidate] (8.152 ms) : 0, 8152
Flare Poller [baseline] (8.827 ms) : 0, 8827
Flare Poller [candidate] (9.589 ms) : 0, 9589
section appsec
crashtracking [baseline] (1.208 ms) : 0, 1208
crashtracking [candidate] (1.209 ms) : 0, 1209
BytebuddyAgent [baseline] (657.244 ms) : 0, 657244
BytebuddyAgent [candidate] (660.017 ms) : 0, 660017
AgentMeter [baseline] (12.118 ms) : 0, 12118
AgentMeter [candidate] (12.043 ms) : 0, 12043
GlobalTracer [baseline] (258.892 ms) : 0, 258892
GlobalTracer [candidate] (258.039 ms) : 0, 258039
AppSec [baseline] (178.472 ms) : 0, 178472
AppSec [candidate] (177.39 ms) : 0, 177390
Debugger [baseline] (66.663 ms) : 0, 66663
Debugger [candidate] (66.111 ms) : 0, 66111
Remote Config [baseline] (621.331 µs) : 0, 621
Remote Config [candidate] (613.479 µs) : 0, 613
Telemetry [baseline] (8.354 ms) : 0, 8354
Telemetry [candidate] (8.311 ms) : 0, 8311
Flare Poller [baseline] (3.634 ms) : 0, 3634
Flare Poller [candidate] (3.56 ms) : 0, 3560
IAST [baseline] (24.346 ms) : 0, 24346
IAST [candidate] (24.135 ms) : 0, 24135
section iast
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (800.866 ms) : 0, 800866
BytebuddyAgent [candidate] (803.946 ms) : 0, 803946
AgentMeter [baseline] (11.653 ms) : 0, 11653
AgentMeter [candidate] (11.614 ms) : 0, 11614
GlobalTracer [baseline] (249.826 ms) : 0, 249826
GlobalTracer [candidate] (249.101 ms) : 0, 249101
AppSec [baseline] (26.94 ms) : 0, 26940
AppSec [candidate] (28.551 ms) : 0, 28551
Debugger [baseline] (71.06 ms) : 0, 71060
Debugger [candidate] (68.28 ms) : 0, 68280
Remote Config [baseline] (528.261 µs) : 0, 528
Remote Config [candidate] (535.481 µs) : 0, 535
Telemetry [baseline] (9.11 ms) : 0, 9110
Telemetry [candidate] (10.246 ms) : 0, 10246
Flare Poller [baseline] (3.333 ms) : 0, 3333
Flare Poller [candidate] (3.574 ms) : 0, 3574
IAST [baseline] (25.719 ms) : 0, 25719
IAST [candidate] (25.737 ms) : 0, 25737
section profiling
crashtracking [baseline] (1.165 ms) : 0, 1165
crashtracking [candidate] (1.173 ms) : 0, 1173
BytebuddyAgent [baseline] (682.367 ms) : 0, 682367
BytebuddyAgent [candidate] (685.664 ms) : 0, 685664
AgentMeter [baseline] (8.608 ms) : 0, 8608
AgentMeter [candidate] (8.671 ms) : 0, 8671
GlobalTracer [baseline] (215.397 ms) : 0, 215397
GlobalTracer [candidate] (216.202 ms) : 0, 216202
AppSec [baseline] (32.229 ms) : 0, 32229
AppSec [candidate] (32.227 ms) : 0, 32227
Debugger [baseline] (63.585 ms) : 0, 63585
Debugger [candidate] (63.293 ms) : 0, 63293
Remote Config [baseline] (585.818 µs) : 0, 586
Remote Config [candidate] (579.577 µs) : 0, 580
Telemetry [baseline] (10.084 ms) : 0, 10084
Telemetry [candidate] (9.976 ms) : 0, 9976
Flare Poller [baseline] (3.473 ms) : 0, 3473
Flare Poller [candidate] (4.243 ms) : 0, 4243
ProfilingAgent [baseline] (93.709 ms) : 0, 93709
ProfilingAgent [candidate] (93.004 ms) : 0, 93004
Profiling [baseline] (94.277 ms) : 0, 94277
Profiling [candidate] (93.564 ms) : 0, 93564
LoadParameters
See matching parameters
SummaryFound 1 performance improvements and 6 performance regressions! Performance is the same for 12 metrics, 17 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~690427a062, baseline=1.61.0-SNAPSHOT~3ff081cd4b
dateFormat X
axisFormat %s
section baseline
no_agent (17.036 ms) : 16869, 17203
. : milestone, 17036,
appsec (18.644 ms) : 18454, 18833
. : milestone, 18644,
code_origins (17.913 ms) : 17735, 18092
. : milestone, 17913,
iast (18.356 ms) : 18172, 18540
. : milestone, 18356,
profiling (19.595 ms) : 19394, 19796
. : milestone, 19595,
tracing (17.985 ms) : 17806, 18165
. : milestone, 17985,
section candidate
no_agent (18.004 ms) : 17817, 18192
. : milestone, 18004,
appsec (19.931 ms) : 19727, 20134
. : milestone, 19931,
code_origins (17.924 ms) : 17747, 18101
. : milestone, 17924,
iast (17.676 ms) : 17500, 17853
. : milestone, 17676,
profiling (21.202 ms) : 20991, 21414
. : milestone, 21202,
tracing (18.035 ms) : 17854, 18216
. : milestone, 18035,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~690427a062, baseline=1.61.0-SNAPSHOT~3ff081cd4b
dateFormat X
axisFormat %s
section baseline
no_agent (1.176 ms) : 1165, 1188
. : milestone, 1176,
iast (3.065 ms) : 3025, 3104
. : milestone, 3065,
iast_FULL (5.98 ms) : 5918, 6042
. : milestone, 5980,
iast_GLOBAL (3.437 ms) : 3384, 3490
. : milestone, 3437,
profiling (2.111 ms) : 2090, 2132
. : milestone, 2111,
tracing (1.817 ms) : 1801, 1833
. : milestone, 1817,
section candidate
no_agent (1.268 ms) : 1254, 1282
. : milestone, 1268,
iast (3.188 ms) : 3141, 3235
. : milestone, 3188,
iast_FULL (5.992 ms) : 5931, 6054
. : milestone, 5992,
iast_GLOBAL (3.557 ms) : 3503, 3610
. : milestone, 3557,
profiling (2.195 ms) : 2175, 2215
. : milestone, 2195,
tracing (1.799 ms) : 1782, 1815
. : milestone, 1799,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~690427a062, baseline=1.61.0-SNAPSHOT~3ff081cd4b
dateFormat X
axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
. : milestone, 1474,
appsec (3.806 ms) : 3583, 4029
. : milestone, 3806,
iast (2.272 ms) : 2203, 2342
. : milestone, 2272,
iast_GLOBAL (2.306 ms) : 2236, 2377
. : milestone, 2306,
profiling (2.124 ms) : 2067, 2182
. : milestone, 2124,
tracing (2.088 ms) : 2033, 2142
. : milestone, 2088,
section candidate
no_agent (1.477 ms) : 1465, 1489
. : milestone, 1477,
appsec (3.841 ms) : 3616, 4066
. : milestone, 3841,
iast (2.268 ms) : 2198, 2338
. : milestone, 2268,
iast_GLOBAL (2.31 ms) : 2240, 2380
. : milestone, 2310,
profiling (2.122 ms) : 2065, 2180
. : milestone, 2122,
tracing (2.081 ms) : 2026, 2136
. : milestone, 2081,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~690427a062, baseline=1.61.0-SNAPSHOT~3ff081cd4b
dateFormat X
axisFormat %s
section baseline
no_agent (14.719 s) : 14719000, 14719000
. : milestone, 14719000,
appsec (14.674 s) : 14674000, 14674000
. : milestone, 14674000,
iast (18.041 s) : 18041000, 18041000
. : milestone, 18041000,
iast_GLOBAL (17.875 s) : 17875000, 17875000
. : milestone, 17875000,
profiling (14.954 s) : 14954000, 14954000
. : milestone, 14954000,
tracing (14.894 s) : 14894000, 14894000
. : milestone, 14894000,
section candidate
no_agent (15.498 s) : 15498000, 15498000
. : milestone, 15498000,
appsec (14.794 s) : 14794000, 14794000
. : milestone, 14794000,
iast (18.161 s) : 18161000, 18161000
. : milestone, 18161000,
iast_GLOBAL (18.031 s) : 18031000, 18031000
. : milestone, 18031000,
profiling (14.903 s) : 14903000, 14903000
. : milestone, 14903000,
tracing (14.977 s) : 14977000, 14977000
. : milestone, 14977000,
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
Java implementation for protocol v1.
Motivation
Additional Notes
DO NOT MERGE, WIP.