Skip to content

Add error tag for library configuration request#10856

Open
daniel-mohedano wants to merge 2 commits intomasterfrom
daniel.mohedano/configuration-failures-tag
Open

Add error tag for library configuration request#10856
daniel-mohedano wants to merge 2 commits intomasterfrom
daniel.mohedano/configuration-failures-tag

Conversation

@daniel-mohedano
Copy link
Contributor

@daniel-mohedano daniel-mohedano commented Mar 16, 2026 •
edited by atlassian bot
Loading

What Does This Do

  • Adds a hidden _dd.ci.library_configuration_error tag, set whenever requests to the /api/v2/libraries/tests/services/setting endpoint fail.

Motivation

Let users know that there was a communication error between the library and DD's backend and advanced features will not work.

Contributor Checklist

Jira ticket: SDTEST-3521

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@daniel-mohedano daniel-mohedano requested review from a team as code owners March 16, 2026 14:57
@daniel-mohedano daniel-mohedano requested a review from mhlidd March 16, 2026 14:57
@daniel-mohedano daniel-mohedano added type: enhancement Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Mar 16, 2026
@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Mar 16, 2026 •
edited
Loading

Test Environment - sbt-scalatest

Job Status: failed

Scenario Overhead (%)
agent 49.42
agentEvpProxy 49.96

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Mar 16, 2026 •
edited
Loading

Test Environment - netflix-zuul

Job Status: success

Scenario Overhead (%)
agent 87.62
agentless 81.46
agentlessCodeCoverage 98.27
agentlessLineCoverage 116.58

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Mar 16, 2026 •
edited
Loading

Test Environment - nebula-release-plugin

Job Status: success

Scenario Overhead (%)
agent 35.91
agentless 35.60
agentlessCodeCoverage 43.77
agentlessLineCoverage 76.02

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Mar 16, 2026 •
edited
Loading

Test Environment - pass4s

Job Status: success

Scenario Overhead (%)
agent 13.47
agentless 13.60
agentlessCodeCoverage 20.78

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Mar 16, 2026 •
edited
Loading

Test Environment - reactive-streams-jvm

Job Status: success

Scenario Overhead (%)
agent 21.56
agentless 18.51
agentlessCodeCoverage 20.42
agentlessLineCoverage 31.11

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Mar 16, 2026 •
edited
Loading

Test Environment - sonar-kotlin

Job Status: success

Scenario Overhead (%)
agent 14.13
agentless 12.28
agentlessCodeCoverage 16.48
agentlessLineCoverage 21.27

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Mar 16, 2026 •
edited
Loading

Test Environment - jolokia

Job Status: success

Scenario Overhead (%)
agent 92.71
agentless 86.69
agentlessCodeCoverage 96.63
agentlessLineCoverage 97.22

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Mar 16, 2026 •
edited
Loading

Test Environment - okhttp

Job Status: success

Scenario Overhead (%)
agent 20.69
agentless 20.07
agentlessCodeCoverage 23.48
agentlessLineCoverage 40.56

@pr-commenter
Copy link

pr-commenter bot commented Mar 16, 2026 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/configuration-failures-tag
git_commit_date 1773664921 1773676104
git_commit_sha 31dc270 f7616d8
release_version 1.61.0-SNAPSHOT~31dc27084c 1.61.0-SNAPSHOT~f7616d86cd
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773677909 1773677909
ci_job_id 1509185098 1509185098
ci_pipeline_id 102702960 102702960
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-c3v4ikc1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-c3v4ikc1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 65 metrics, 6 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~f7616d86cd, baseline=1.61.0-SNAPSHOT~31dc27084c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1059570
Total [baseline] (11.074 s) : 0, 11074438
Agent [candidate] (1.062 s) : 0, 1061767
Total [candidate] (11.104 s) : 0, 11103581
section appsec
Agent [baseline] (1.246 s) : 0, 1245786
Total [baseline] (11.242 s) : 0, 11241988
Agent [candidate] (1.253 s) : 0, 1252672
Total [candidate] (11.15 s) : 0, 11150092
section iast
Agent [baseline] (1.229 s) : 0, 1228822
Total [baseline] (11.323 s) : 0, 11323260
Agent [candidate] (1.229 s) : 0, 1229257
Total [candidate] (11.322 s) : 0, 11322152
section profiling
Agent [baseline] (1.189 s) : 0, 1189442
Total [baseline] (11.084 s) : 0, 11083923
Agent [candidate] (1.182 s) : 0, 1181622
Total [candidate] (10.961 s) : 0, 10960659
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent appsec 1.246 s 186.217 ms (17.6%)
Agent iast 1.229 s 169.252 ms (16.0%)
Agent profiling 1.189 s 129.873 ms (12.3%)
Total tracing 11.074 s -
Total appsec 11.242 s 167.55 ms (1.5%)
Total iast 11.323 s 248.822 ms (2.2%)
Total profiling 11.084 s 9.485 ms (0.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent appsec 1.253 s 190.905 ms (18.0%)
Agent iast 1.229 s 167.49 ms (15.8%)
Agent profiling 1.182 s 119.854 ms (11.3%)
Total tracing 11.104 s -
Total appsec 11.15 s 46.511 ms (0.4%)
Total iast 11.322 s 218.571 ms (2.0%)
Total profiling 10.961 s -142.922 ms (-1.3%) 
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~f7616d86cd, baseline=1.61.0-SNAPSHOT~31dc27084c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (628.956 ms) : 0, 628956
BytebuddyAgent [candidate] (630.84 ms) : 0, 630840
AgentMeter [baseline] (29.233 ms) : 0, 29233
AgentMeter [candidate] (29.046 ms) : 0, 29046
GlobalTracer [baseline] (257.532 ms) : 0, 257532
GlobalTracer [candidate] (256.663 ms) : 0, 256663
AppSec [baseline] (31.515 ms) : 0, 31515
AppSec [candidate] (31.396 ms) : 0, 31396
Debugger [baseline] (59.353 ms) : 0, 59353
Debugger [candidate] (59.283 ms) : 0, 59283
Remote Config [baseline] (614.507 µs) : 0, 615
Remote Config [candidate] (612.513 µs) : 0, 613
Telemetry [baseline] (8.681 ms) : 0, 8681
Telemetry [candidate] (8.648 ms) : 0, 8648
Flare Poller [baseline] (6.522 ms) : 0, 6522
Flare Poller [candidate] (8.024 ms) : 0, 8024
section appsec
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (658.089 ms) : 0, 658089
BytebuddyAgent [candidate] (662.388 ms) : 0, 662388
AgentMeter [baseline] (12.112 ms) : 0, 12112
AgentMeter [candidate] (12.145 ms) : 0, 12145
GlobalTracer [baseline] (257.892 ms) : 0, 257892
GlobalTracer [candidate] (259.676 ms) : 0, 259676
AppSec [baseline] (176.957 ms) : 0, 176957
AppSec [candidate] (177.632 ms) : 0, 177632
Debugger [baseline] (66.028 ms) : 0, 66028
Debugger [candidate] (66.015 ms) : 0, 66015
Remote Config [baseline] (575.957 µs) : 0, 576
Remote Config [candidate] (560.466 µs) : 0, 560
Telemetry [baseline] (9.084 ms) : 0, 9084
Telemetry [candidate] (8.983 ms) : 0, 8983
Flare Poller [baseline] (3.682 ms) : 0, 3682
Flare Poller [candidate] (3.657 ms) : 0, 3657
IAST [baseline] (23.969 ms) : 0, 23969
IAST [candidate] (24.191 ms) : 0, 24191
section iast
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (796.796 ms) : 0, 796796
BytebuddyAgent [candidate] (797.442 ms) : 0, 797442
AgentMeter [baseline] (11.359 ms) : 0, 11359
AgentMeter [candidate] (11.342 ms) : 0, 11342
GlobalTracer [baseline] (247.84 ms) : 0, 247840
GlobalTracer [candidate] (247.942 ms) : 0, 247942
AppSec [baseline] (26.539 ms) : 0, 26539
AppSec [candidate] (26.511 ms) : 0, 26511
Debugger [baseline] (63.748 ms) : 0, 63748
Debugger [candidate] (64.591 ms) : 0, 64591
Remote Config [baseline] (510.438 µs) : 0, 510
Remote Config [candidate] (520.772 µs) : 0, 521
Telemetry [baseline] (14.824 ms) : 0, 14824
Telemetry [candidate] (13.938 ms) : 0, 13938
Flare Poller [baseline] (4.865 ms) : 0, 4865
Flare Poller [candidate] (4.576 ms) : 0, 4576
IAST [baseline] (25.211 ms) : 0, 25211
IAST [candidate] (25.178 ms) : 0, 25178
section profiling
ProfilingAgent [baseline] (93.626 ms) : 0, 93626
ProfilingAgent [candidate] (93.872 ms) : 0, 93872
crashtracking [baseline] (1.168 ms) : 0, 1168
crashtracking [candidate] (1.163 ms) : 0, 1163
BytebuddyAgent [baseline] (687.819 ms) : 0, 687819
BytebuddyAgent [candidate] (682.102 ms) : 0, 682102
AgentMeter [baseline] (8.709 ms) : 0, 8709
AgentMeter [candidate] (8.693 ms) : 0, 8693
GlobalTracer [baseline] (216.618 ms) : 0, 216618
GlobalTracer [candidate] (215.57 ms) : 0, 215570
AppSec [baseline] (32.307 ms) : 0, 32307
AppSec [candidate] (31.886 ms) : 0, 31886
Debugger [baseline] (64.426 ms) : 0, 64426
Debugger [candidate] (64.623 ms) : 0, 64623
Remote Config [baseline] (594.375 µs) : 0, 594
Remote Config [candidate] (582.225 µs) : 0, 582
Telemetry [baseline] (9.672 ms) : 0, 9672
Telemetry [candidate] (8.89 ms) : 0, 8890
Flare Poller [baseline] (3.453 ms) : 0, 3453
Flare Poller [candidate] (3.523 ms) : 0, 3523
Profiling [baseline] (94.203 ms) : 0, 94203
Profiling [candidate] (94.436 ms) : 0, 94436
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~f7616d86cd, baseline=1.61.0-SNAPSHOT~31dc27084c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058812
Total [baseline] (8.865 s) : 0, 8864887
Agent [candidate] (1.083 s) : 0, 1083437
Total [candidate] (8.88 s) : 0, 8879871
section iast
Agent [baseline] (1.227 s) : 0, 1227115
Total [baseline] (9.614 s) : 0, 9613850
Agent [candidate] (1.245 s) : 0, 1245051
Total [candidate] (9.613 s) : 0, 9613291
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent iast 1.227 s 168.303 ms (15.9%)
Total tracing 8.865 s -
Total iast 9.614 s 748.962 ms (8.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent iast 1.245 s 161.615 ms (14.9%)
Total tracing 8.88 s -
Total iast 9.613 s 733.42 ms (8.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~f7616d86cd, baseline=1.61.0-SNAPSHOT~31dc27084c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.214 ms) : 0, 1214
BytebuddyAgent [baseline] (627.721 ms) : 0, 627721
BytebuddyAgent [candidate] (643.096 ms) : 0, 643096
AgentMeter [baseline] (29.194 ms) : 0, 29194
AgentMeter [candidate] (29.911 ms) : 0, 29911
GlobalTracer [baseline] (257.073 ms) : 0, 257073
GlobalTracer [candidate] (262.891 ms) : 0, 262891
AppSec [baseline] (31.601 ms) : 0, 31601
AppSec [candidate] (32.54 ms) : 0, 32540
Debugger [baseline] (58.712 ms) : 0, 58712
Debugger [candidate] (60.479 ms) : 0, 60479
Remote Config [baseline] (619.943 µs) : 0, 620
Remote Config [candidate] (637.214 µs) : 0, 637
Telemetry [baseline] (8.646 ms) : 0, 8646
Telemetry [candidate] (8.925 ms) : 0, 8925
Flare Poller [baseline] (8.002 ms) : 0, 8002
Flare Poller [candidate] (7.26 ms) : 0, 7260
section iast
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.232 ms) : 0, 1232
BytebuddyAgent [baseline] (796.36 ms) : 0, 796360
BytebuddyAgent [candidate] (809.936 ms) : 0, 809936
AgentMeter [baseline] (11.349 ms) : 0, 11349
AgentMeter [candidate] (11.857 ms) : 0, 11857
GlobalTracer [baseline] (247.513 ms) : 0, 247513
GlobalTracer [candidate] (250.254 ms) : 0, 250254
AppSec [baseline] (26.299 ms) : 0, 26299
AppSec [candidate] (26.748 ms) : 0, 26748
Debugger [baseline] (62.934 ms) : 0, 62934
Debugger [candidate] (62.865 ms) : 0, 62865
Remote Config [baseline] (514.565 µs) : 0, 515
Remote Config [candidate] (506.766 µs) : 0, 507
Telemetry [baseline] (14.814 ms) : 0, 14814
Telemetry [candidate] (14.86 ms) : 0, 14860
Flare Poller [baseline] (4.934 ms) : 0, 4934
Flare Poller [candidate] (4.881 ms) : 0, 4881
IAST [baseline] (25.137 ms) : 0, 25137
IAST [candidate] (25.573 ms) : 0, 25573
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/configuration-failures-tag
git_commit_date 1773664921 1773676104
git_commit_sha 31dc270 f7616d8
release_version 1.61.0-SNAPSHOT~31dc27084c 1.61.0-SNAPSHOT~f7616d86cd
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773678480 1773678480
ci_job_id 1509185099 1509185099
ci_pipeline_id 102702960 102702960
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-iuleenge 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-iuleenge 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+80.754µs; +185.679µs] or [+3.395%; +7.807%]		 same
[-175.141µs; +356.504µs] or [-2.468%; +5.023%]		 unstable
[-219.150op/s; +125.588op/s] or [-14.824%; +8.495%]		 2.512ms 7.188ms 1431.562op/s 2.378ms 7.097ms 1478.344op/s
scenario:load:petclinic:code_origins:high_load better
[-1.641ms; -0.816ms] or [-8.410%; -4.185%]		 unsure
[-1.888ms; -0.226ms] or [-6.107%; -0.731%]		 unstable
[-8.978op/s; +41.916op/s] or [-3.806%; +17.770%]		 18.281ms 29.868ms 252.344op/s 19.510ms 30.925ms 235.875op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~f7616d86cd, baseline=1.61.0-SNAPSHOT~31dc27084c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.181 ms) : 1169, 1192
.   : milestone, 1181,
iast (3.092 ms) : 3051, 3133
.   : milestone, 3092,
iast_FULL (5.898 ms) : 5839, 5956
.   : milestone, 5898,
iast_GLOBAL (3.603 ms) : 3543, 3662
.   : milestone, 3603,
profiling (2.12 ms) : 2098, 2142
.   : milestone, 2120,
tracing (1.778 ms) : 1763, 1794
.   : milestone, 1778,
section candidate
no_agent (1.179 ms) : 1167, 1190
.   : milestone, 1179,
iast (3.196 ms) : 3153, 3240
.   : milestone, 3196,
iast_FULL (5.764 ms) : 5707, 5820
.   : milestone, 5764,
iast_GLOBAL (3.6 ms) : 3537, 3663
.   : milestone, 3600,
profiling (2.248 ms) : 2225, 2271
.   : milestone, 2248,
tracing (1.787 ms) : 1771, 1802
.   : milestone, 1787,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.181 ms [1.169 ms, 1.192 ms] -
iast 3.092 ms [3.051 ms, 3.133 ms] 1.911 ms (161.9%)
iast_FULL 5.898 ms [5.839 ms, 5.956 ms] 4.717 ms (399.5%)
iast_GLOBAL 3.603 ms [3.543 ms, 3.662 ms] 2.422 ms (205.1%)
profiling 2.12 ms [2.098 ms, 2.142 ms] 938.991 µs (79.5%)
tracing 1.778 ms [1.763 ms, 1.794 ms] 597.889 µs (50.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.179 ms [1.167 ms, 1.19 ms] -
iast 3.196 ms [3.153 ms, 3.24 ms] 2.017 ms (171.2%)
iast_FULL 5.764 ms [5.707 ms, 5.82 ms] 4.585 ms (389.0%)
iast_GLOBAL 3.6 ms [3.537 ms, 3.663 ms] 2.421 ms (205.4%)
profiling 2.248 ms [2.225 ms, 2.271 ms] 1.069 ms (90.7%)
tracing 1.787 ms [1.771 ms, 1.802 ms] 607.911 µs (51.6%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~f7616d86cd, baseline=1.61.0-SNAPSHOT~31dc27084c
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.858 ms) : 17674, 18041
.   : milestone, 17858,
appsec (18.315 ms) : 18132, 18499
.   : milestone, 18315,
code_origins (19.789 ms) : 19594, 19985
.   : milestone, 19789,
iast (17.693 ms) : 17517, 17869
.   : milestone, 17693,
profiling (18.637 ms) : 18450, 18824
.   : milestone, 18637,
tracing (17.854 ms) : 17678, 18030
.   : milestone, 17854,
section candidate
no_agent (18.074 ms) : 17888, 18260
.   : milestone, 18074,
appsec (18.455 ms) : 18269, 18642
.   : milestone, 18455,
code_origins (18.495 ms) : 18309, 18681
.   : milestone, 18495,
iast (17.535 ms) : 17361, 17710
.   : milestone, 17535,
profiling (18.729 ms) : 18542, 18916
.   : milestone, 18729,
tracing (17.638 ms) : 17461, 17816
.   : milestone, 17638,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.858 ms [17.674 ms, 18.041 ms] -
appsec 18.315 ms [18.132 ms, 18.499 ms] 457.455 µs (2.6%)
code_origins 19.789 ms [19.594 ms, 19.985 ms] 1.932 ms (10.8%)
iast 17.693 ms [17.517 ms, 17.869 ms] -164.726 µs (-0.9%)
profiling 18.637 ms [18.45 ms, 18.824 ms] 779.284 µs (4.4%)
tracing 17.854 ms [17.678 ms, 18.03 ms] -3.557 µs (-0.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.074 ms [17.888 ms, 18.26 ms] -
appsec 18.455 ms [18.269 ms, 18.642 ms] 381.579 µs (2.1%)
code_origins 18.495 ms [18.309 ms, 18.681 ms] 421.551 µs (2.3%)
iast 17.535 ms [17.361 ms, 17.71 ms] -538.414 µs (-3.0%)
profiling 18.729 ms [18.542 ms, 18.916 ms] 655.068 µs (3.6%)
tracing 17.638 ms [17.461 ms, 17.816 ms] -435.389 µs (-2.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/configuration-failures-tag
git_commit_date 1773664921 1773676104
git_commit_sha 31dc270 f7616d8
release_version 1.61.0-SNAPSHOT~31dc27084c 1.61.0-SNAPSHOT~f7616d86cd
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1773678134 1773678134
ci_job_id 1509185100 1509185100
ci_pipeline_id 102702960 102702960
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-pg2rx63n 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-pg2rx63n 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~f7616d86cd, baseline=1.61.0-SNAPSHOT~31dc27084c
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.588 s) : 15588000, 15588000
.   : milestone, 15588000,
appsec (15.068 s) : 15068000, 15068000
.   : milestone, 15068000,
iast (18.267 s) : 18267000, 18267000
.   : milestone, 18267000,
iast_GLOBAL (17.764 s) : 17764000, 17764000
.   : milestone, 17764000,
profiling (14.817 s) : 14817000, 14817000
.   : milestone, 14817000,
tracing (14.862 s) : 14862000, 14862000
.   : milestone, 14862000,
section candidate
no_agent (15.672 s) : 15672000, 15672000
.   : milestone, 15672000,
appsec (14.762 s) : 14762000, 14762000
.   : milestone, 14762000,
iast (18.364 s) : 18364000, 18364000
.   : milestone, 18364000,
iast_GLOBAL (17.898 s) : 17898000, 17898000
.   : milestone, 17898000,
profiling (14.597 s) : 14597000, 14597000
.   : milestone, 14597000,
tracing (15.259 s) : 15259000, 15259000
.   : milestone, 15259000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.588 s [15.588 s, 15.588 s] -
appsec 15.068 s [15.068 s, 15.068 s] -520.0 ms (-3.3%)
iast 18.267 s [18.267 s, 18.267 s] 2.679 s (17.2%)
iast_GLOBAL 17.764 s [17.764 s, 17.764 s] 2.176 s (14.0%)
profiling 14.817 s [14.817 s, 14.817 s] -771.0 ms (-4.9%)
tracing 14.862 s [14.862 s, 14.862 s] -726.0 ms (-4.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.672 s [15.672 s, 15.672 s] -
appsec 14.762 s [14.762 s, 14.762 s] -910.0 ms (-5.8%)
iast 18.364 s [18.364 s, 18.364 s] 2.692 s (17.2%)
iast_GLOBAL 17.898 s [17.898 s, 17.898 s] 2.226 s (14.2%)
profiling 14.597 s [14.597 s, 14.597 s] -1.075 s (-6.9%)
tracing 15.259 s [15.259 s, 15.259 s] -413.0 ms (-2.6%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~f7616d86cd, baseline=1.61.0-SNAPSHOT~31dc27084c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (2.532 ms) : 2476, 2587
.   : milestone, 2532,
iast (2.266 ms) : 2197, 2336
.   : milestone, 2266,
iast_GLOBAL (2.313 ms) : 2244, 2383
.   : milestone, 2313,
profiling (2.107 ms) : 2052, 2162
.   : milestone, 2107,
tracing (2.075 ms) : 2021, 2128
.   : milestone, 2075,
section candidate
no_agent (1.477 ms) : 1466, 1489
.   : milestone, 1477,
appsec (3.817 ms) : 3593, 4040
.   : milestone, 3817,
iast (2.27 ms) : 2201, 2338
.   : milestone, 2270,
iast_GLOBAL (2.32 ms) : 2250, 2389
.   : milestone, 2320,
profiling (2.102 ms) : 2045, 2158
.   : milestone, 2102,
tracing (2.085 ms) : 2031, 2138
.   : milestone, 2085,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.489 ms] -
appsec 2.532 ms [2.476 ms, 2.587 ms] 1.054 ms (71.3%)
iast 2.266 ms [2.197 ms, 2.336 ms] 788.374 µs (53.3%)
iast_GLOBAL 2.313 ms [2.244 ms, 2.383 ms] 835.538 µs (56.5%)
profiling 2.107 ms [2.052 ms, 2.162 ms] 628.902 µs (42.6%)
tracing 2.075 ms [2.021 ms, 2.128 ms] 597.099 µs (40.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.466 ms, 1.489 ms] -
appsec 3.817 ms [3.593 ms, 4.04 ms] 2.34 ms (158.4%)
iast 2.27 ms [2.201 ms, 2.338 ms] 792.612 µs (53.7%)
iast_GLOBAL 2.32 ms [2.25 ms, 2.389 ms] 842.458 µs (57.0%)
profiling 2.102 ms [2.045 ms, 2.158 ms] 624.576 µs (42.3%)
tracing 2.085 ms [2.031 ms, 2.138 ms] 607.589 µs (41.1%)

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Mar 16, 2026 •
edited
Loading

Test Environment - spring_boot

Job Status: success

Scenario Overhead (%)
agent 16.31
agentless 9.49
agentlessCodeCoverage 13.71
agentlessLineCoverage 32.89

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Mar 16, 2026 •
edited
Loading

Test Environment - sonar-java

Job Status: success

Scenario Overhead (%)
agent 22.50
agentless 56.15
agentlessCodeCoverage 99.69
agentlessLineCoverage 153.87

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mhlidd mhlidd Awaiting requested review from mhlidd mhlidd is a code owner automatically assigned from DataDog/apm-java

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility type: enhancement Enhancements and improvements

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@daniel-mohedano