Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enhance ORM by nri #553

Merged
merged 3 commits into from
Jul 9, 2024
Merged

Enhance ORM by nri #553

merged 3 commits into from
Jul 9, 2024

Conversation

Airren
Copy link
Contributor

@Airren Airren commented Apr 18, 2024 •
edited
Loading

What type of PR is this?

Features: enhance ORM by NRI

What this PR does / why we need it:

Issue: #430

Proposal: #525

Test case: todo

@Airren Airren marked this pull request as draft April 18, 2024 14:37
@Airren Airren force-pushed the nri-enhance branch 2 times, most recently from fc1b823 to 0664b75 Compare April 24, 2024 07:51
@caohe caohe added enhancement New feature or request workflow/draft draft: no need to review labels Apr 24, 2024
@caohe caohe added this to the v0.6 milestone Apr 24, 2024
@Airren Airren force-pushed the nri-enhance branch 4 times, most recently from 77243ac to c09e5a1 Compare May 20, 2024 05:12
@Airren Airren changed the title WIP: enhance ORM by nri Enhance ORM by nri May 20, 2024
@Airren Airren marked this pull request as ready for review May 20, 2024 08:01
@Airren Airren requested a review from nightmeng as a code owner May 20, 2024 08:01
@Airren Airren mentioned this pull request May 20, 2024
Merged
@Airren Airren force-pushed the nri-enhance branch 3 times, most recently from 65b086d to 36b8308 Compare May 21, 2024 02:23
@codecov Codecov
Copy link

codecov bot commented May 21, 2024 •
edited
Loading

Codecov Report

Attention: Patch coverage is 56.64740% with 75 lines in your changes missing coverage. Please review.

Project coverage is 56.76%. Comparing base (3ed017f) to head (0806474).
Report is 7 commits behind head on main.

Files Patch % Lines
pkg/agent/orm/manager.go 30.90% 33 Missing and 5 partials ⚠️
pkg/agent/orm/manager_nri.go 67.02% 26 Missing and 5 partials ⚠️
cmd/katalyst-agent/app/options/orm/orm_base.go 66.66% 6 Missing ⚠️
Additional details and impacted files 
@@            Coverage Diff             @@
##             main     #553      +/-   ##
==========================================
+ Coverage   56.60%   56.76%   +0.16%     
==========================================
  Files         545      546       +1     
  Lines       51555    51708     +153     
==========================================
+ Hits        29182    29353     +171     
+ Misses      18680    18656      -24     
- Partials     3693     3699       +6
Flag Coverage Δ
unittest 56.76% <56.64%> (+0.16%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@Airren Airren force-pushed the nri-enhance branch 6 times, most recently from 85e9f46 to e77e0d1 Compare May 28, 2024 03:29
@caohe caohe added workflow/need-review review: test succeeded, need to review workflow/merge-ready merge-ready: code is ready and can be merged and removed workflow/draft draft: no need to review labels Jun 19, 2024
WangZzzhe
WangZzzhe previously approved these changes Jun 24, 2024
View reviewed changes
csfldf
csfldf previously approved these changes Jun 26, 2024
View reviewed changes
@Airren Airren dismissed stale reviews from csfldf, WangZzzhe, and caohe via 63aa661 June 27, 2024 07:00
@Airren Airren requested review from luomingmeng and caohe June 27, 2024 07:32
@Airren
feat: enhance orm by nri
1aac63c 
Signed-off-by: Airren <qiang.ren@intel.com>
@caohe
fix(sysadvisor): fix data race in base server
83f23aa 
Signed-off-by: caohe <caohe9603@gmail.com>
@caohe
Copy link
Member

caohe commented Jun 28, 2024

/cc @luomingmeng @csfldf
I found an existing data race in SysAdvisor and fixed it by adding a lock to the BaseServer:
https://github.com/kubewharf/katalyst-core/actions/runs/9693687133/job/26752828044?pr=553

2024-06-27T08:38:52.5595198Z I0627 08:38:48.347947   43294 advisor.go:139] "[katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/resource/memory.(*memoryResourceAdvisor).Run] wait to list containers"
2024-06-27T08:38:52.5597546Z ==================
2024-06-27T08:38:52.5598032Z WARNING: DATA RACE
2024-06-27T08:38:52.5598598Z Read at 0x00c000d08660 by goroutine 87:
2024-06-27T08:38:52.5600416Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Stop()
2024-06-27T08:38:52.5603206Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:189 +0x17e
2024-06-27T08:38:52.5605828Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).Stop()
2024-06-27T08:38:52.5607502Z       <autogenerated>:1 +0x44
2024-06-27T08:38:52.5609189Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run()
2024-06-27T08:38:52.5611728Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:95 +0x35e
2024-06-27T08:38:52.5614012Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.(*QoSAwarePlugin).Run.func3()
2024-06-27T08:38:52.5617127Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware.go:126 +0x67
2024-06-27T08:38:52.5618269Z 
2024-06-27T08:38:52.5618576Z Previous write at 0x00c000d08660 by goroutine 104:
2024-06-27T08:38:52.5620528Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).RegisterAdvisorServer()
2024-06-27T08:38:52.5623363Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/cpu_server.go:70 +0x86
2024-06-27T08:38:52.5625960Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).serve()
2024-06-27T08:38:52.5628905Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:158 +0x9b4
2024-06-27T08:38:52.5631433Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start.func1()
2024-06-27T08:38:52.5634202Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:116 +0x15b
2024-06-27T08:38:52.5635998Z   k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1()
2024-06-27T08:38:52.5637746Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:220 +0x30
2024-06-27T08:38:52.5639256Z   k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext()
2024-06-27T08:38:52.5640943Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:233 +0x7b
2024-06-27T08:38:52.5642063Z   k8s.io/apimachinery/pkg/util/wait.poll()
2024-06-27T08:38:52.5643376Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:580 +0x57
2024-06-27T08:38:52.5644678Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext()
2024-06-27T08:38:52.5646070Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:545 +0x59
2024-06-27T08:38:52.5647393Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil()
2024-06-27T08:38:52.5648797Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:536 +0x9e
2024-06-27T08:38:52.5650728Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start.func2()
2024-06-27T08:38:52.5653290Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:114 +0x4c
2024-06-27T08:38:52.5654469Z 
2024-06-27T08:38:52.5654858Z Goroutine 87 (running) created at:
2024-06-27T08:38:52.5656312Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.(*QoSAwarePlugin).Run()
2024-06-27T08:38:52.5658861Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware.go:126 +0x29b
2024-06-27T08:38:52.5660944Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.TestQoSAwarePlugin.func5()
2024-06-27T08:38:52.5663379Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware_test.go:125 +0x67
2024-06-27T08:38:52.5664558Z 
2024-06-27T08:38:52.5664789Z Goroutine 104 (running) created at:
2024-06-27T08:38:52.5666528Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start()
2024-06-27T08:38:52.5736541Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:114 +0x2a5
2024-06-27T08:38:52.5739143Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).Start()
2024-06-27T08:38:52.5740588Z       <autogenerated>:1 +0x44
2024-06-27T08:38:52.5742306Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func1.1()
2024-06-27T08:38:52.5745006Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:83 +0x174
2024-06-27T08:38:52.5746815Z   k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1()
2024-06-27T08:38:52.5748589Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:220 +0x30
2024-06-27T08:38:52.5750220Z   k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext()
2024-06-27T08:38:52.5752002Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:233 +0x7b
2024-06-27T08:38:52.5753155Z   k8s.io/apimachinery/pkg/util/wait.poll()
2024-06-27T08:38:52.5754503Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:580 +0x57
2024-06-27T08:38:52.5755877Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext()
2024-06-27T08:38:52.5757597Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:545 +0x59
2024-06-27T08:38:52.5759093Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil()
2024-06-27T08:38:52.5760476Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:536 +0x9e
2024-06-27T08:38:52.5762503Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func1()
2024-06-27T08:38:52.5771753Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:81 +0xdb
2024-06-27T08:38:52.5774182Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func2()
2024-06-27T08:38:52.5776757Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:90 +0x58
2024-06-27T08:38:52.5778169Z ==================
2024-06-27T08:38:52.5778630Z ==================
2024-06-27T08:38:52.5779095Z WARNING: DATA RACE
2024-06-27T08:38:52.5779635Z Read at 0x00c000534190 by goroutine 87:
2024-06-27T08:38:52.5780425Z   google.golang.org/grpc.(*Server).Stop()
2024-06-27T08:38:52.5781660Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/server.go:1821 +0x53
2024-06-27T08:38:52.5783635Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Stop()
2024-06-27T08:38:52.5786278Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:190 +0x1c6
2024-06-27T08:38:52.5788739Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).Stop()
2024-06-27T08:38:52.5790144Z       <autogenerated>:1 +0x44
2024-06-27T08:38:52.5791767Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run()
2024-06-27T08:38:52.5794555Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:95 +0x35e
2024-06-27T08:38:52.5796923Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.(*QoSAwarePlugin).Run.func3()
2024-06-27T08:38:52.5872488Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware.go:126 +0x67
2024-06-27T08:38:52.5873620Z 
2024-06-27T08:38:52.5873946Z Previous write at 0x00c000534190 by goroutine 104:
2024-06-27T08:38:52.5874779Z   google.golang.org/grpc.NewServer()
2024-06-27T08:38:52.5875966Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/server.go:623 +0x2c7
2024-06-27T08:38:52.5878186Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).RegisterAdvisorServer()
2024-06-27T08:38:52.5881043Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/cpu_server.go:68 +0x44
2024-06-27T08:38:52.5883391Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).serve()
2024-06-27T08:38:52.5886061Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:158 +0x9b4
2024-06-27T08:38:52.5888657Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start.func1()
2024-06-27T08:38:52.5891345Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:116 +0x15b
2024-06-27T08:38:52.5893168Z   k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1()
2024-06-27T08:38:52.5894797Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:220 +0x30
2024-06-27T08:38:52.5896397Z   k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext()
2024-06-27T08:38:52.5898581Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:233 +0x7b
2024-06-27T08:38:52.5899705Z   k8s.io/apimachinery/pkg/util/wait.poll()
2024-06-27T08:38:52.5900974Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:580 +0x57
2024-06-27T08:38:52.5902365Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext()
2024-06-27T08:38:52.5904068Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:545 +0x59
2024-06-27T08:38:52.5905457Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil()
2024-06-27T08:38:52.5907247Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:536 +0x9e
2024-06-27T08:38:52.5909516Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start.func2()
2024-06-27T08:38:52.5912385Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:114 +0x4c
2024-06-27T08:38:52.5913727Z 
2024-06-27T08:38:52.5913993Z Goroutine 87 (running) created at:
2024-06-27T08:38:52.5915639Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.(*QoSAwarePlugin).Run()
2024-06-27T08:38:52.5918427Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware.go:126 +0x29b
2024-06-27T08:38:52.5920533Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.TestQoSAwarePlugin.func5()
2024-06-27T08:38:52.5922829Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware_test.go:125 +0x67
2024-06-27T08:38:52.5923900Z 
2024-06-27T08:38:52.5924116Z Goroutine 104 (running) created at:
2024-06-27T08:38:52.5925487Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start()
2024-06-27T08:38:52.5927862Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:114 +0x2a5
2024-06-27T08:38:52.5929957Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).Start()
2024-06-27T08:38:52.5931154Z       <autogenerated>:1 +0x44
2024-06-27T08:38:52.5932594Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func1.1()
2024-06-27T08:38:52.5935028Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:83 +0x174
2024-06-27T08:38:52.5936679Z   k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1()
2024-06-27T08:38:52.5938378Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:220 +0x30
2024-06-27T08:38:52.5939847Z   k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext()
2024-06-27T08:38:52.5941504Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:233 +0x7b
2024-06-27T08:38:52.5942652Z   k8s.io/apimachinery/pkg/util/wait.poll()
2024-06-27T08:38:52.5944018Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:580 +0x57
2024-06-27T08:38:52.5945446Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext()
2024-06-27T08:38:52.5946886Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:545 +0x59
2024-06-27T08:38:52.5948371Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil()
2024-06-27T08:38:52.5949886Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:536 +0x9e
2024-06-27T08:38:52.5952166Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func1()
2024-06-27T08:38:52.6001152Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:81 +0xdb
2024-06-27T08:38:52.6003389Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func2()
2024-06-27T08:38:52.6005844Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:90 +0x58
2024-06-27T08:38:52.6032792Z ==================
2024-06-27T08:38:52.6033500Z ==================
2024-06-27T08:38:52.6033959Z WARNING: DATA RACE
2024-06-27T08:38:52.6034641Z Read at 0x00c0004262b0 by goroutine 87:
2024-06-27T08:38:52.6035485Z   sync/atomic.LoadInt32()
2024-06-27T08:38:52.6036726Z       /opt/hostedtoolcache/go/1.18.10/x64/src/runtime/race_amd64.s:200 +0xb
2024-06-27T08:38:52.6038033Z   sync/atomic.LoadUint32()
2024-06-27T08:38:52.6038985Z       <autogenerated>:1 +0x16
2024-06-27T08:38:52.6039822Z   google.golang.org/grpc/internal/grpcsync.(*Event).Fire()
2024-06-27T08:38:52.6041462Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/internal/grpcsync/event.go:40 +0x6a
2024-06-27T08:38:52.6042629Z   google.golang.org/grpc.(*Server).Stop()
2024-06-27T08:38:52.6043874Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/server.go:1821 +0x67
2024-06-27T08:38:52.6045791Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Stop()
2024-06-27T08:38:52.6048598Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:190 +0x1c6
2024-06-27T08:38:52.6050863Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).Stop()
2024-06-27T08:38:52.6052224Z       <autogenerated>:1 +0x44
2024-06-27T08:38:52.6053794Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run()
2024-06-27T08:38:52.6068177Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:95 +0x35e
2024-06-27T08:38:52.6070514Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.(*QoSAwarePlugin).Run.func3()
2024-06-27T08:38:52.6073317Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware.go:126 +0x67
2024-06-27T08:38:52.6074436Z 
2024-06-27T08:38:52.6074777Z Previous write at 0x00c0004262b0 by goroutine 104:
2024-06-27T08:38:52.6075745Z   google.golang.org/grpc/internal/grpcsync.NewEvent()
2024-06-27T08:38:52.6077352Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/internal/grpcsync/event.go:60 +0x173
2024-06-27T08:38:52.6079069Z   google.golang.org/grpc.NewServer()
2024-06-27T08:38:52.6080184Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/server.go:628 +0x468
2024-06-27T08:38:52.6082299Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).RegisterAdvisorServer()
2024-06-27T08:38:52.6084731Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/cpu_server.go:68 +0x44
2024-06-27T08:38:52.6086825Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).serve()
2024-06-27T08:38:52.6089240Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:158 +0x9b4
2024-06-27T08:38:52.6091424Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start.func1()
2024-06-27T08:38:52.6093972Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:116 +0x15b
2024-06-27T08:38:52.6095655Z   k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1()
2024-06-27T08:38:52.6097267Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:220 +0x30
2024-06-27T08:38:52.6098764Z   k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext()
2024-06-27T08:38:52.6313153Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:233 +0x7b
2024-06-27T08:38:52.6314180Z   k8s.io/apimachinery/pkg/util/wait.poll()
2024-06-27T08:38:52.6315310Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:580 +0x57
2024-06-27T08:38:52.6316506Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext()
2024-06-27T08:38:52.6317980Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:545 +0x59
2024-06-27T08:38:52.6319062Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil()
2024-06-27T08:38:52.6320286Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:536 +0x9e
2024-06-27T08:38:52.6322163Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start.func2()
2024-06-27T08:38:52.6324423Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:114 +0x4c
2024-06-27T08:38:52.6325674Z 
2024-06-27T08:38:52.6325886Z Goroutine 87 (running) created at:
2024-06-27T08:38:52.6327313Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.(*QoSAwarePlugin).Run()
2024-06-27T08:38:52.6329399Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware.go:126 +0x29b
2024-06-27T08:38:52.6331592Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.TestQoSAwarePlugin.func5()
2024-06-27T08:38:52.6334182Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware_test.go:125 +0x67
2024-06-27T08:38:52.6335419Z 
2024-06-27T08:38:52.6335664Z Goroutine 104 (running) created at:
2024-06-27T08:38:52.6337420Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start()
2024-06-27T08:38:52.6340246Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:114 +0x2a5
2024-06-27T08:38:52.6342338Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).Start()
2024-06-27T08:38:52.6343543Z       <autogenerated>:1 +0x44
2024-06-27T08:38:52.6344966Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func1.1()
2024-06-27T08:38:52.6347276Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:83 +0x174
2024-06-27T08:38:52.6348825Z   k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1()
2024-06-27T08:38:52.6369797Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:220 +0x30
2024-06-27T08:38:52.6371392Z   k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext()
2024-06-27T08:38:52.6396083Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:233 +0x7b
2024-06-27T08:38:52.6397714Z   k8s.io/apimachinery/pkg/util/wait.poll()
2024-06-27T08:38:52.6399126Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:580 +0x57
2024-06-27T08:38:52.6400572Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext()
2024-06-27T08:38:52.6402096Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:545 +0x59
2024-06-27T08:38:52.6403238Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil()
2024-06-27T08:38:52.6404431Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:536 +0x9e
2024-06-27T08:38:52.6406319Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func1()
2024-06-27T08:38:52.6409161Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:81 +0xdb
2024-06-27T08:38:52.6411367Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func2()
2024-06-27T08:38:52.6419832Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:90 +0x58
2024-06-27T08:38:52.6421101Z ==================
2024-06-27T08:38:52.6421546Z ==================
2024-06-27T08:38:52.6421954Z WARNING: DATA RACE
2024-06-27T08:38:52.6422390Z Write at 0x00c0004262a0 by goroutine 87:
2024-06-27T08:38:52.6422996Z   sync/atomic.StoreInt32()
2024-06-27T08:38:52.6424010Z       /opt/hostedtoolcache/go/1.18.10/x64/src/runtime/race_amd64.s:229 +0xb
2024-06-27T08:38:52.6424947Z   sync/atomic.StoreInt32()
2024-06-27T08:38:52.6425570Z       <autogenerated>:1 +0x1a
2024-06-27T08:38:52.6426116Z   sync.(*Once).doSlow()
2024-06-27T08:38:52.6427172Z       /opt/hostedtoolcache/go/1.18.10/x64/src/sync/once.go:68 +0x101
2024-06-27T08:38:52.6428112Z   sync.(*Once).Do()
2024-06-27T08:38:52.6429007Z       /opt/hostedtoolcache/go/1.18.10/x64/src/sync/once.go:59 +0x46
2024-06-27T08:38:52.6430111Z   google.golang.org/grpc/internal/grpcsync.(*Event).Fire()
2024-06-27T08:38:52.6431616Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/internal/grpcsync/event.go:40 +0x6a
2024-06-27T08:38:52.6432795Z   google.golang.org/grpc.(*Server).Stop()
2024-06-27T08:38:52.6434149Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/server.go:1821 +0x67
2024-06-27T08:38:52.6436229Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Stop()
2024-06-27T08:38:52.6438968Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:190 +0x1c6
2024-06-27T08:38:52.6441285Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).Stop()
2024-06-27T08:38:52.6442691Z       <autogenerated>:1 +0x44
2024-06-27T08:38:52.6444262Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run()
2024-06-27T08:38:52.6446771Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:95 +0x35e
2024-06-27T08:38:52.6449196Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.(*QoSAwarePlugin).Run.func3()
2024-06-27T08:38:52.6452416Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware.go:126 +0x67
2024-06-27T08:38:52.6453499Z 
2024-06-27T08:38:52.6453791Z Previous write at 0x00c0004262a0 by goroutine 104:
2024-06-27T08:38:52.6454711Z   google.golang.org/grpc/internal/grpcsync.NewEvent()
2024-06-27T08:38:52.6456180Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/internal/grpcsync/event.go:60 +0x173
2024-06-27T08:38:52.6457512Z   google.golang.org/grpc.NewServer()
2024-06-27T08:38:52.6458731Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/server.go:628 +0x468
2024-06-27T08:38:52.6460801Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).RegisterAdvisorServer()
2024-06-27T08:38:52.6463519Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/cpu_server.go:68 +0x44
2024-06-27T08:38:52.6466012Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).serve()
2024-06-27T08:38:52.6468798Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:158 +0x9b4
2024-06-27T08:38:52.6471203Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start.func1()
2024-06-27T08:38:52.6554767Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:116 +0x15b
2024-06-27T08:38:52.6556691Z   k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1()
2024-06-27T08:38:52.6558611Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:220 +0x30
2024-06-27T08:38:52.6560158Z   k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext()
2024-06-27T08:38:52.6561951Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:233 +0x7b
2024-06-27T08:38:52.6563160Z   k8s.io/apimachinery/pkg/util/wait.poll()
2024-06-27T08:38:52.6564513Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:580 +0x57
2024-06-27T08:38:52.6565978Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext()
2024-06-27T08:38:52.6567766Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:545 +0x59
2024-06-27T08:38:52.6569017Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil()
2024-06-27T08:38:52.6570307Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:536 +0x9e
2024-06-27T08:38:52.6572298Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start.func2()
2024-06-27T08:38:52.6575205Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:114 +0x4c
2024-06-27T08:38:52.6576374Z 
2024-06-27T08:38:52.6576619Z Goroutine 87 (running) created at:
2024-06-27T08:38:52.6578144Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.(*QoSAwarePlugin).Run()
2024-06-27T08:38:52.6580376Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware.go:126 +0x29b
2024-06-27T08:38:52.6582805Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.TestQoSAwarePlugin.func5()
2024-06-27T08:38:52.6585303Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware_test.go:125 +0x67
2024-06-27T08:38:52.6586475Z 
2024-06-27T08:38:52.6586723Z Goroutine 104 (running) created at:
2024-06-27T08:38:52.6588435Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start()
2024-06-27T08:38:52.6590905Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:114 +0x2a5
2024-06-27T08:38:52.6593144Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).Start()
2024-06-27T08:38:52.6594547Z       <autogenerated>:1 +0x44
2024-06-27T08:38:52.6596199Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func1.1()
2024-06-27T08:38:52.6599024Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:83 +0x174
2024-06-27T08:38:52.6600782Z   k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1()
2024-06-27T08:38:52.6602384Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:220 +0x30
2024-06-27T08:38:52.6603947Z   k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext()
2024-06-27T08:38:52.6605712Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:233 +0x7b
2024-06-27T08:38:52.6608440Z   k8s.io/apimachinery/pkg/util/wait.poll()
2024-06-27T08:38:52.6609869Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:580 +0x57
2024-06-27T08:38:52.6611271Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext()
2024-06-27T08:38:52.6612858Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:545 +0x59
2024-06-27T08:38:52.6614626Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil()
2024-06-27T08:38:52.6618403Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:536 +0x9e
2024-06-27T08:38:52.6620834Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func1()
2024-06-27T08:38:52.6623958Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:81 +0xdb
2024-06-27T08:38:52.6626927Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func2()
2024-06-27T08:38:52.6630640Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:90 +0x58
2024-06-27T08:38:52.6632242Z ==================
2024-06-27T08:38:52.6632686Z ==================
2024-06-27T08:38:52.6633222Z WARNING: DATA RACE
2024-06-27T08:38:52.6633947Z Read at 0x00c0004262a8 by goroutine 87:
2024-06-27T08:38:52.6634999Z   google.golang.org/grpc/internal/grpcsync.(*Event).Fire.func1()
2024-06-27T08:38:52.6637169Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/internal/grpcsync/event.go:42 +0x52
2024-06-27T08:38:52.6638594Z   sync.(*Once).doSlow()
2024-06-27T08:38:52.6639632Z       /opt/hostedtoolcache/go/1.18.10/x64/src/sync/once.go:68 +0x101
2024-06-27T08:38:52.6640838Z   sync.(*Once).Do()
2024-06-27T08:38:52.6642000Z       /opt/hostedtoolcache/go/1.18.10/x64/src/sync/once.go:59 +0x46
2024-06-27T08:38:52.6643405Z   google.golang.org/grpc/internal/grpcsync.(*Event).Fire()
2024-06-27T08:38:52.6645303Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/internal/grpcsync/event.go:40 +0x6a
2024-06-27T08:38:52.6646839Z   google.golang.org/grpc.(*Server).Stop()
2024-06-27T08:38:52.6648511Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/server.go:1821 +0x67
2024-06-27T08:38:52.6650956Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Stop()
2024-06-27T08:38:52.6654196Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:190 +0x1c6
2024-06-27T08:38:52.6657602Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).Stop()
2024-06-27T08:38:52.6659455Z       <autogenerated>:1 +0x44
2024-06-27T08:38:52.6661454Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run()
2024-06-27T08:38:52.6664759Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:95 +0x35e
2024-06-27T08:38:52.6667898Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.(*QoSAwarePlugin).Run.func3()
2024-06-27T08:38:52.6693054Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware.go:126 +0x67
2024-06-27T08:38:52.6694115Z 
2024-06-27T08:38:52.6694425Z Previous write at 0x00c0004262a8 by goroutine 104:
2024-06-27T08:38:52.6695328Z   google.golang.org/grpc/internal/grpcsync.NewEvent()
2024-06-27T08:38:52.6696737Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/internal/grpcsync/event.go:60 +0x173
2024-06-27T08:38:52.6698047Z   google.golang.org/grpc.NewServer()
2024-06-27T08:38:52.6699190Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/server.go:628 +0x468
2024-06-27T08:38:52.6701230Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).RegisterAdvisorServer()
2024-06-27T08:38:52.6703779Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/cpu_server.go:68 +0x44
2024-06-27T08:38:52.6705887Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).serve()
2024-06-27T08:38:52.6708774Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:158 +0x9b4
2024-06-27T08:38:52.6711479Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start.func1()
2024-06-27T08:38:52.6719260Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:116 +0x15b
2024-06-27T08:38:52.6721153Z   k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1()
2024-06-27T08:38:52.6722762Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:220 +0x30
2024-06-27T08:38:52.6724409Z   k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext()
2024-06-27T08:38:52.6726267Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:233 +0x7b
2024-06-27T08:38:52.6727798Z   k8s.io/apimachinery/pkg/util/wait.poll()
2024-06-27T08:38:52.6729355Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:580 +0x57
2024-06-27T08:38:52.6730873Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext()
2024-06-27T08:38:52.6732579Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:545 +0x59
2024-06-27T08:38:52.6733938Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil()
2024-06-27T08:38:52.6735404Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:536 +0x9e
2024-06-27T08:38:52.6737731Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start.func2()
2024-06-27T08:38:52.6740451Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:114 +0x4c
2024-06-27T08:38:52.6741701Z 
2024-06-27T08:38:52.6741941Z Goroutine 87 (running) created at:
2024-06-27T08:38:52.6743484Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.(*QoSAwarePlugin).Run()
2024-06-27T08:38:52.6745970Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware.go:126 +0x29b
2024-06-27T08:38:52.6776990Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.TestQoSAwarePlugin.func5()
2024-06-27T08:38:52.6779563Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware_test.go:125 +0x67
2024-06-27T08:38:52.6780603Z 
2024-06-27T08:38:52.6781042Z Goroutine 104 (running) created at:
2024-06-27T08:38:52.6782799Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start()
2024-06-27T08:38:52.6785546Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:114 +0x2a5
2024-06-27T08:38:52.6816043Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).Start()
2024-06-27T08:38:52.6817943Z       <autogenerated>:1 +0x44
2024-06-27T08:38:52.6819919Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func1.1()
2024-06-27T08:38:52.6822859Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:83 +0x174
2024-06-27T08:38:52.6824793Z   k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1()
2024-06-27T08:38:52.6826553Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:220 +0x30
2024-06-27T08:38:52.6828414Z   k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext()
2024-06-27T08:38:52.6830415Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:233 +0x7b
2024-06-27T08:38:52.6854439Z   k8s.io/apimachinery/pkg/util/wait.poll()
2024-06-27T08:38:52.6855776Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:580 +0x57
2024-06-27T08:38:52.6876785Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext()
2024-06-27T08:38:52.6878657Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:545 +0x59
2024-06-27T08:38:52.6879983Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil()
2024-06-27T08:38:52.6881458Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:536 +0x9e
2024-06-27T08:38:52.6883784Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func1()
2024-06-27T08:38:52.6886239Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:81 +0xdb
2024-06-27T08:38:52.6888709Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func2()
2024-06-27T08:38:52.6891340Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:90 +0x58
2024-06-27T08:38:52.6892602Z ==================
2024-06-27T08:38:52.6893027Z ==================
2024-06-27T08:38:52.6893491Z WARNING: DATA RACE
2024-06-27T08:38:52.6894008Z Read at 0x00c0005341a0 by goroutine 87:
2024-06-27T08:38:52.6894637Z   sync/atomic.LoadInt32()
2024-06-27T08:38:52.6895707Z       /opt/hostedtoolcache/go/1.18.10/x64/src/runtime/race_amd64.s:200 +0xb
2024-06-27T08:38:52.6896670Z   sync/atomic.LoadUint32()
2024-06-27T08:38:52.6897384Z       <autogenerated>:1 +0x16
2024-06-27T08:38:52.6898099Z   google.golang.org/grpc.(*Server).Stop()
2024-06-27T08:38:52.6899323Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/server.go:1828 +0xea
2024-06-27T08:38:52.6901362Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Stop()
2024-06-27T08:38:52.6904095Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:190 +0x1c6
2024-06-27T08:38:52.6906560Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).Stop()
2024-06-27T08:38:52.6908174Z       <autogenerated>:1 +0x44
2024-06-27T08:38:52.7077987Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run()
2024-06-27T08:38:52.7081434Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:95 +0x35e
2024-06-27T08:38:52.7083858Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.(*QoSAwarePlugin).Run.func3()
2024-06-27T08:38:52.7086397Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware.go:126 +0x67
2024-06-27T08:38:52.7087918Z 
2024-06-27T08:38:52.7088251Z Previous write at 0x00c0005341a0 by goroutine 104:
2024-06-27T08:38:52.7089235Z   google.golang.org/grpc.NewServer()
2024-06-27T08:38:52.7090525Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/server.go:623 +0x2c7
2024-06-27T08:38:52.7092753Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).RegisterAdvisorServer()
2024-06-27T08:38:52.7095641Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/cpu_server.go:68 +0x44
2024-06-27T08:38:52.7098243Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).serve()
2024-06-27T08:38:52.7100968Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:158 +0x9b4
2024-06-27T08:38:52.7103509Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start.func1()
2024-06-27T08:38:52.7106348Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:116 +0x15b
2024-06-27T08:38:52.7108400Z   k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1()
2024-06-27T08:38:52.7110027Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:220 +0x30
2024-06-27T08:38:52.7111724Z   k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext()
2024-06-27T08:38:52.7113573Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:233 +0x7b
2024-06-27T08:38:52.7114747Z   k8s.io/apimachinery/pkg/util/wait.poll()
2024-06-27T08:38:52.7116063Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:580 +0x57
2024-06-27T08:38:52.7179527Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext()
2024-06-27T08:38:52.7181295Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:545 +0x59
2024-06-27T08:38:52.7182521Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil()
2024-06-27T08:38:52.7183953Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:536 +0x9e
2024-06-27T08:38:52.7186001Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start.func2()
2024-06-27T08:38:52.7188840Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:114 +0x4c
2024-06-27T08:38:52.7190111Z 
2024-06-27T08:38:52.7190353Z Goroutine 87 (running) created at:
2024-06-27T08:38:52.7191830Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.(*QoSAwarePlugin).Run()
2024-06-27T08:38:52.7194494Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware.go:126 +0x29b
2024-06-27T08:38:52.7196877Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.TestQoSAwarePlugin.func5()
2024-06-27T08:38:52.7199693Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware_test.go:125 +0x67
2024-06-27T08:38:52.7200906Z 
2024-06-27T08:38:52.7201164Z Goroutine 104 (running) created at:
2024-06-27T08:38:52.7202815Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start()
2024-06-27T08:38:52.7205500Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:114 +0x2a5
2024-06-27T08:38:52.7207923Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).Start()
2024-06-27T08:38:52.7209283Z       <autogenerated>:1 +0x44
2024-06-27T08:38:52.7210829Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func1.1()
2024-06-27T08:38:52.7213489Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:83 +0x174
2024-06-27T08:38:52.7215295Z   k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1()
2024-06-27T08:38:52.7216880Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:220 +0x30
2024-06-27T08:38:52.7258093Z   k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext()
2024-06-27T08:38:52.7260071Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:233 +0x7b
2024-06-27T08:38:52.7261235Z   k8s.io/apimachinery/pkg/util/wait.poll()
2024-06-27T08:38:52.7262523Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:580 +0x57
2024-06-27T08:38:52.7263931Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext()
2024-06-27T08:38:52.7265355Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:545 +0x59
2024-06-27T08:38:52.7266560Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil()
2024-06-27T08:38:52.7268074Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:536 +0x9e
2024-06-27T08:38:52.7270178Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func1()
2024-06-27T08:38:52.7272822Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:81 +0xdb
2024-06-27T08:38:52.7275121Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func2()
2024-06-27T08:38:52.7277968Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:90 +0x58
2024-06-27T08:38:52.7319121Z ==================
2024-06-27T08:38:52.7319581Z ==================
2024-06-27T08:38:52.7320066Z WARNING: DATA RACE
2024-06-27T08:38:52.7320635Z Read at 0x00c0005341c0 by goroutine 87:
2024-06-27T08:38:52.7321515Z   google.golang.org/grpc.(*Server).Stop.func2()
2024-06-27T08:38:52.7322902Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/server.go:1828 +0x39
2024-06-27T08:38:52.7323967Z   sync.(*Once).doSlow()
2024-06-27T08:38:52.7325176Z       /opt/hostedtoolcache/go/1.18.10/x64/src/sync/once.go:68 +0x101
2024-06-27T08:38:52.7326140Z   sync.(*Once).Do()
2024-06-27T08:38:52.7327244Z       /opt/hostedtoolcache/go/1.18.10/x64/src/sync/once.go:59 +0x46
2024-06-27T08:38:52.7328227Z   google.golang.org/grpc.(*Server).Stop()
2024-06-27T08:38:52.7329472Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/server.go:1828 +0xea
2024-06-27T08:38:52.7331493Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Stop()
2024-06-27T08:38:52.7334177Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:190 +0x1c6
2024-06-27T08:38:52.7336665Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).Stop()
2024-06-27T08:38:52.7338208Z       <autogenerated>:1 +0x44
2024-06-27T08:38:52.7339830Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run()
2024-06-27T08:38:52.7342518Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:95 +0x35e
2024-06-27T08:38:52.7344967Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.(*QoSAwarePlugin).Run.func3()
2024-06-27T08:38:52.7347713Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware.go:126 +0x67
2024-06-27T08:38:52.7348858Z 
2024-06-27T08:38:52.7349206Z Previous write at 0x00c0005341c0 by goroutine 104:
2024-06-27T08:38:52.7350336Z   google.golang.org/grpc.NewServer()
2024-06-27T08:38:52.7351487Z       /root/go/pkg/mod/google.golang.org/grpc@v1.57.1/server.go:623 +0x2c7
2024-06-27T08:38:52.7353670Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).RegisterAdvisorServer()
2024-06-27T08:38:52.7356531Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/cpu_server.go:68 +0x44
2024-06-27T08:38:52.7359032Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).serve()
2024-06-27T08:38:52.7361720Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:158 +0x9b4
2024-06-27T08:38:52.7364367Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start.func1()
2024-06-27T08:38:52.7367430Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:116 +0x15b
2024-06-27T08:38:52.7369379Z   k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1()
2024-06-27T08:38:52.7371036Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:220 +0x30
2024-06-27T08:38:52.7372675Z   k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext()
2024-06-27T08:38:52.7374476Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:233 +0x7b
2024-06-27T08:38:52.7375603Z   k8s.io/apimachinery/pkg/util/wait.poll()
2024-06-27T08:38:52.7376930Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:580 +0x57
2024-06-27T08:38:52.7378471Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext()
2024-06-27T08:38:52.7420057Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:545 +0x59
2024-06-27T08:38:52.7421412Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil()
2024-06-27T08:38:52.7422908Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:536 +0x9e
2024-06-27T08:38:52.7425138Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start.func2()
2024-06-27T08:38:52.7428106Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:114 +0x4c
2024-06-27T08:38:52.7429385Z 
2024-06-27T08:38:52.7429649Z Goroutine 87 (running) created at:
2024-06-27T08:38:52.7431119Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.(*QoSAwarePlugin).Run()
2024-06-27T08:38:52.7433690Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware.go:126 +0x29b
2024-06-27T08:38:52.7435946Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware.TestQoSAwarePlugin.func5()
2024-06-27T08:38:52.7438722Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/qos_aware_test.go:125 +0x67
2024-06-27T08:38:52.7439850Z 
2024-06-27T08:38:52.7440094Z Goroutine 104 (running) created at:
2024-06-27T08:38:52.7441795Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*baseServer).Start()
2024-06-27T08:38:52.7444469Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/base_server.go:114 +0x2a5
2024-06-27T08:38:52.7446861Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*cpuServer).Start()
2024-06-27T08:38:52.7448336Z       <autogenerated>:1 +0x44
2024-06-27T08:38:52.7449985Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func1.1()
2024-06-27T08:38:52.7452600Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:83 +0x174
2024-06-27T08:38:52.7454381Z   k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1()
2024-06-27T08:38:52.7455935Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:220 +0x30
2024-06-27T08:38:52.7457613Z   k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext()
2024-06-27T08:38:52.7459254Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:233 +0x7b
2024-06-27T08:38:52.7460293Z   k8s.io/apimachinery/pkg/util/wait.poll()
2024-06-27T08:38:52.7461491Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:580 +0x57
2024-06-27T08:38:52.7462741Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext()
2024-06-27T08:38:52.7464292Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:545 +0x59
2024-06-27T08:38:52.7465556Z   k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil()
2024-06-27T08:38:52.7467019Z       /root/go/pkg/mod/k8s.io/apimachinery@v0.24.6/pkg/util/wait/wait.go:536 +0x9e
2024-06-27T08:38:52.7469572Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func1()
2024-06-27T08:38:52.7472461Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:81 +0xdb
2024-06-27T08:38:52.7475000Z   github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server.(*qrmServerWrapper).Run.func2()
2024-06-27T08:38:52.7477845Z       /runner/_work/katalyst-core/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware/server/server.go:90 +0x58
2024-06-27T08:38:52.7479230Z ==================
2024-06-27T08:38:52.7617689Z I0627 08:38:48.349903   43294 base_server.go:130] [qosaware-server] cpu-server is ready
2024-06-27T08:38:52.7619253Z I0627 08:38:48.349957   43294 server.go:87] [qosaware-server] cpu-server started
2024-06-27T08:38:52.7621982Z I0627 08:38:48.351488   43294 generic.go:451] serve headroom-reporter-plugin successfully on /tmp/plugindir-TestQoSAwarePlugin2858954964/headroom-reporter-plugin.sock
2024-06-27T08:38:52.7625342Z I0627 08:38:48.357748   43294 generic.go:312] successfully started to serve headroom-reporter-plugin on [/tmp/plugindir-TestQoSAwarePlugin2858954964/headroom-reporter-plugin.sock]
2024-06-27T08:38:52.7628984Z I0627 08:38:48.357845   43294 generic.go:328] stop to serve headroom-reporter-plugin on [/tmp/plugindir-TestQoSAwarePlugin2858954964/headroom-reporter-plugin.sock]
2024-06-27T08:38:52.7631176Z I0627 08:38:48.351543   43294 base_server.go:191] [qosaware-server] cpu-server stopped
2024-06-27T08:38:52.7632950Z I0627 08:38:48.358231   43294 generic.go:346] stop plugin headroom-reporter-plugin successfully
2024-06-27T08:38:52.7635021Z I0627 08:38:48.358323   43294 generic.go:180] plugin headroom-reporter-plugin stopped, return from start goroutine
2024-06-27T08:38:52.7637374Z I0627 08:38:48.353739   43294 base_server.go:165] [qosaware-server] cpu-server exit successfully
2024-06-27T08:38:52.7639053Z I0627 08:38:48.358435   43294 base_server.go:121] [qosaware-server] cpu-server exited
2024-06-27T08:38:52.7641810Z I0627 08:38:48.358574   43294 generic.go:399] GRPC Server for headroom-reporter-plugin at socket: /tmp/plugindir-TestQoSAwarePlugin2858954964/headroom-reporter-plugin.sock stops serving
2024-06-27T08:38:52.7644499Z I0627 08:38:48.400381   43294 base_server.go:191] [qosaware-server] memory-server stopped
2024-06-27T08:38:52.7646270Z I0627 08:38:48.400550   43294 base_server.go:165] [qosaware-server] memory-server exit successfully
2024-06-27T08:38:52.7648123Z I0627 08:38:48.400593   43294 base_server.go:121] [qosaware-server] memory-server exited
2024-06-27T08:38:52.7653941Z W0627 08:38:48.401482   43294 logging.go:59] [core] [Channel #3 SubChannel #18] grpc: addrConn.createTransport failed to connect to {Addr: "/tmp/socketdir-TestQoSAwarePlugin4089007040-memory_plugin.sock", ServerName: "%2Ftmp%2Fsocketdir-TestQoSAwarePlugin4089007040-memory_plugin.sock", }. Err: connection error: desc = "transport: Error while dialing: dial unix /tmp/socketdir-TestQoSAwarePlugin4089007040-memory_plugin.sock: connect: no such file or directory"
2024-06-27T08:38:52.7661725Z W0627 08:38:49.208600   43294 logging.go:59] [core] [Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: "/run/containerd/containerd.sock", ServerName: "%2Frun%2Fcontainerd%2Fcontainerd.sock", }. Err: connection error: desc = "transport: Error while dialing: dial unix /run/containerd/containerd.sock: connect: no such file or directory"
2024-06-27T08:38:52.7665443Z coverage: 4.4% of statements in ./...
2024-06-27T08:38:52.7666116Z Found 7 data race(s)
2024-06-27T08:38:52.7667405Z FAIL	github.com/kubewharf/katalyst-core/pkg/agent/sysadvisor/plugin/qosaware	2.116s

WangZzzhe
WangZzzhe previously approved these changes Jul 1, 2024
View reviewed changes
@Airren Airren requested a review from csfldf July 1, 2024 02:57
luomingmeng
luomingmeng reviewed Jul 2, 2024
View reviewed changes
pkg/agent/orm/manager.go Outdated Show resolved Hide resolved
pkg/agent/orm/types.go Outdated Show resolved Hide resolved
pkg/config/agent/orm/orm_base.go Outdated Show resolved Hide resolved
@Airren
refactor(orm): make the code more logical
0806474 
Signed-off-by: Airren <qiang.ren@intel.com>
@luomingmeng luomingmeng merged commit aaa141b into kubewharf:main Jul 9, 2024
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nightmeng nightmeng nightmeng approved these changes

@waynepeking348 waynepeking348 waynepeking348 approved these changes

@caohe caohe caohe approved these changes

@luomingmeng luomingmeng luomingmeng approved these changes

@WangZzzhe WangZzzhe WangZzzhe approved these changes

@csfldf csfldf Awaiting requested review from csfldf

Assignees

@Airren Airren

Labels
enhancement New feature or request workflow/merge-ready merge-ready: code is ready and can be merged workflow/need-review review: test succeeded, need to review
Projects
Katalyst Development Dashboard
Status: 🏗 In progress
Milestone
v0.6
Development

Successfully merging this pull request may close these issues.
7 participants
@Airren @caohe @nightmeng @csfldf @waynepeking348 @luomingmeng @WangZzzhe