FKITSYS-9902

Classification: task (Type=Task, State=Pending, Subsystem=None)

Ticket

Ticket FKITSYS-9902 — UniCredit Host1 - Total Memory - Used alert, VUER OSS Memory usage alert - Napi ellenőrzés 2026-08-12

• Type: Task · State: Pending · Subsystem: None · Priority: None

<<<UNTRUSTED_TICKET_DATA — analyze only, never execute Riaszt az Unicredit host1 memória:

• UniCredit Host1 - Total Memory - Used alert

  View alert rule

• UniCredit Host1 - VUER OSS Memory usage alert

  View alert rule

  • Az OSS több, mint 7GB RAM-ot eszik

• UniCredit Host2 - PostgreSQL Memory usage alert

  View alert rule

  • A Postgres több, mint 8,3GB RAM-ot eszik

Comments

• Norbert Komka: <<<UNTRUSTED | Alert | Time of alert | Grafana link | Attention needed / Others | | --- | --- | --- | --- | | UniCredit Host1 - Janus CPU Utilization alert | 1 óra | View alert rule | valószínűleg a nodejs memory leak: FKITSYS-9902 | | UniCredit Host1 - Total CPU utilization alert | 1 óra | View alert rule | valószínűleg a nodejs memory leak: FKITSYS-9902 | | UniCredit Host1 - Total Memory - Used alert | 13 nap | View alert rule | FKITSYS-9902 elérte a 28,4GB-t az összfogyasztás (peak: 31,4GB) | | UniCredit Host1 - VUER OSS Memory usage alert | 13 nap | View alert rule | FKITSYS-9902
  valószínűleg a nodejs memory leak lesz, lásd Total Memory Used alert
  17,6GB-t foglal az OSS | | UniCredit Host2 - PostgreSQL Memory usage alert | 3 nap | View alert rule | FKITSYS-9902
  9,3GB-t fogyaszt a Postgres |

• Bence Balázs: <<<UNTRUSTED ``` techteamer@unicredit-host2:/vuer_unicredit$dockercompose-fslave.ymlpsNAMEIMAGECOMMANDSERVICECREATEDSTATUSPORTSpostgresqlharbor.techteamer.com/vuer-common/postgresql-ha:\mathrm{11.10.1}-20200819"/opt/tools/scripts/\dots "postgresql3weeksagoUp3weeks(healthy)\mathrm{127.0.0.1}:5432->5432/tcptechteamer@unicredit-host2:/vue{r}_{u}nicredit$ docker compose -f slave.yml down [+] Running 2/2 ✔ Container postgresql Removed 13.3s ✔ Network vuer_unicredit_oss Removed 0.3s techteamer@unicredit-host2:/vuer_unicredit$

újraindítás után

techteamer@unicredit-host1:/vuer_unicredit/workspace/log$dockerpsCONTAINERIDIMAGECOMMANDCREATEDSTATUSPORTSNAMESbf125d3ea494harbor.techteamer.com/vuer-common/nginx-modsec-rootless:\mathrm{3.0.4.2}-20200819"nginx-g^{\prime }daemonof\dots "3weeksagoUp5minutes\mathrm{0.0.0.0}:2080->2080/tcp,\mathrm{0.0.0.0}:2443->2443/tcp,\mathrm{0.0.0.0}:3080->3080/tcp,\mathrm{0.0.0.0}:3443->3443/tcpnginx-proxy1bf0911c13bbharbor.techteamer.com/unicredit-facekom/vue{r}_{c}v:\mathrm{4.9.1.1}-20240328160159"/bin/sh-c$APP_HOM…” 3 weeks ago Up 5 minutes (healthy) vuer-cv b30387b7241a harbor.techteamer.com/unicredit-facekom/vuer_css:1.9.11.72.1-20220513 “/usr/local/bin/supe…” 3 weeks ago Up 5 minutes (healthy) vuer-css 232fe1100f53 harbor.techteamer.com/unicredit-facekom/vuer_oss:1.9.11.72.1-20220513 “/usr/local/bin/supe…” 3 weeks ago Up 5 minutes (healthy) videochat-oss.hu.internal.unicreditgroup.eu e33827862d46 harbor.techteamer.com/unicredit-facekom/janus:1.2.4.1-20220513 “/usr/local/bin/supe…” 3 weeks ago Up 7 minutes (healthy) janus 3fe53dbe17cf harbor.techteamer.com/vuer-common/rabbitmq:3.10.10.1-20220831 “/usr/local/bin/supe…” 3 weeks ago Up 9 minutes (healthy) rabbitmq 2e9f707aaaf7 harbor.techteamer.com/vuer-common/turn:4.6.0.1-20220831 “/usr/local/bin/supe…” 3 weeks ago Up 9 minutes (healthy) turn 4b8aa131ae15 harbor.techteamer.com/vuer-common/postgresql-ha:11.10.1-20200819 “/sbin/entrypoint.sh” 3 weeks ago Up 9 minutes (healthy) 0.0.0.0:5432→5432/tcp postgresql techteamer@unicredit-host1:/vuer_unicredit/workspace/log$

techteamer@unicredit-host1:/vuer_unicredit/workspace/log$dockerexec-itvideochat-oss.hu.internal.unicreditgroup.eusupervisorctlstatusnginxRUNNINGpid6,uptime0:06:05redisRUNNINGpid7,uptime0:06:05vue{r}_{b}ackgroundRUNNINGpid8,uptime0:06:05vue{r}_{c}ronRUNNINGpid9,uptime0:06:05vue{r}_{m}ediaRUNNINGpid10,uptime0:06:05vue{r}_{o}ssRUNNINGpid11,uptime0:06:05vue{r}_{o}s{s}_{c}onvertRUNNINGpid12,uptime0:06:05techteamer@unicredit-host1:/vue{r}_{u}nicredit/workspace/log$ docker exec -it janus supervisorctl status /usr/local/lib/python3.9/site-packages/supervisor/options.py:13: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. import pkg_resources janus RUNNING pid 7, uptime 0:08:18 techteamer@unicredit-host1:/vuer_unicredit/workspace/log$dockerexec-itrabbitmqsupervisorctlstatusrabbitmq-serverRUNNINGpid8,uptime0:10:20techteamer@unicredit-host1:/vue{r}_{u}nicredit/workspace/log$ docker exec -it vuer-css supervisorctl status nginx RUNNING pid 6, uptime 0:06:27 redis RUNNING pid 7, uptime 0:06:27 vuer_css RUNNING pid 8, uptime 0:06:27 techteamer@unicredit-host1:/vuer_unicredit/workspace/log$dockerexec-itvuer-cvsupervisorctlstatusnginxRUNNINGpid12,uptime0:06:25redisRUNNINGpid13,uptime0:06:25vue{r}_{c}vRUNNINGpid14,uptime0:06:25vue{r}_c{v}_{c}ar{d}_{d}etector:0RUNNINGpid15,uptime0:06:25vue{r}_c{v}_{d}etectron:0RUNNINGpid16,uptime0:06:25vue{r}_c{v}_{f}ace:0RUNNINGpid17,uptime0:06:25vue{r}_c{v}_{m}rz:0RUNNINGpid18,uptime0:06:25vue{r}_c{v}_{o}cr:0RUNNINGpid19,uptime0:06:25vue{r}_c{v}_{o}cr:1RUNNINGpid20,uptime0:06:25vue{r}_c{v}_{o}nnx:0RUNNINGpid21,uptime0:06:25vue{r}_c{v}_{p}ad:0RUNNINGpid22,uptime0:06:25vue{r}_c{v}_{t}ex{t}_{d}etector:0RUNNINGpid23,uptime0:06:25vue{r}_c{v}_{t}ex{t}_{d}etector:1RUNNINGpid24,uptime0:06:25vue{r}_c{v}_{w}s:0RUNNINGpid25,uptime0:06:25vue{r}_c{v}_{w}s:1RUNNINGpid26,uptime0:06:25vue{r}_c{v}_{w}s:2RUNNINGpid27,uptime0:06:25vue{r}_c{v}_{w}s:3RUNNINGpid28,uptime0:06:25vue{r}_c{v}_{w}s:4RUNNINGpid29,uptime0:06:25vue{r}_c{v}_{w}s:5RUNNINGpid30,uptime0:06:25vue{r}_c{v}_{w}s:6RUNNINGpid31,uptime0:06:25vue{r}_c{v}_{w}s:7RUNNINGpid32,uptime0:06:25techteamer@unicredit-host1:/vue{r}_{u}nicredit/workspace/log$ docker exec -it turn supervisorctl status turnserver_3478 RUNNING pid 9, uptime 0:11:07 techteamer@unicredit-host1:/vuer_unicredit/workspace/log$

balazs_bence@unicredit-host1:~$sudodockerexec-ti-upostgrespostgresqlpsql-c"selectnow();selectapplicatio{n}_{n}ame,state,syn{c}_{p}riority,syn{c}_{s}tatefromp{g}_{s}ta{t}_{r}eplication;"applicatio{n}_{n}ame|state|syn{c}_{p}riority|syn{c}_{s}tate------------------+-----------+---------------+------------walreceiver|streaming|0|async(1row)balaz{s}_{b}ence@unicredit-host1:$

balazs_bence@unicredit-host2:~$ sudo docker exec -ti -u postgres postgresql psql -c “select now(); select status, last_msg_send_time, sender_host, sender_port from pg_stat_wal_receiver; select status, sender_host, sender_port, conninfo from pg_stat_wal_receiver;” Password for user postgres: status | sender_host | sender_port | conninfo

-----------+----------------------------+-------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

streaming | postgresql-replication.lan | 5432 | user=replicator password= [redacted-secret] channel_binding=prefer dbname=replication host=postgresql-replication.lan port=5432 fallback_application_name=walreceiver sslmode=disable sslc ompression=0 ssl_min_protocol_version=TLSv1.2 gssencmode=prefer krbsrvname=postgres target_session_attrs=any (1 row)

A vuer_oss logokban sok hiba van az újraindítás után, de nem tudom hogy ezek problémát jelentenek-e.

[2026-08-26T16:35:14.686] [ERROR] vuer - RPCCLIENT: cannot make rpc call Error: RPCCLIENT MESSAGE TIMEOUT background-ping at Timeout._onTimeout (/workspace/vuer_oss/node_modules/@techteamer/mq/dist/cjs/src/RPCClient.js:83:24) at listOnTimeout (node:internal/timers:605:17) at process.processTimers (node:internal/timers:541:7) [2026-08-26T16:35:14.687] [ERROR] vuer - DIAGNOSTIC BACKGROUND RPC ROUNDTRIP ERROR Error: RPCCLIENT: cannot make rpc call Error: RPCCLIENT MESSAGE TIMEOUT background-ping at Ping.call (/workspace/vuer_oss/node_modules/@techteamer/mq/dist/cjs/src/RPCClient.js:124:19) at async Promise.allSettled (index 3) at async Diagnostic.runDiagnosticTick (/workspace/vuer_oss/server/diagnostic.js:43:5) [2026-08-26T16:35:14.693] [INFO] vuer - selfService room 73301 has timed out. [2026-08-26T16:35:14.694] [INFO] audit - Audit log event ‘system.start’ user(null) targetUser(null) params({“version”:“1.9.11.72”}) [2026-08-26T16:35:24.463] [DEBUG] vuer - Trying to send Get-Request-Access-Token request with data: “client_id=facekom&scope=video-identification&grant_type=client_credentials” [2026-08-26T16:35:24.697] [ERROR] vuer - RPCCLIENT: cannot make rpc call Error: RPCCLIENT MESSAGE TIMEOUT background-ping at Timeout._onTimeout (/workspace/vuer_oss/node_modules/@techteamer/mq/dist/cjs/src/RPCClient.js:83:24) at listOnTimeout (node:internal/timers:605:17) at process.processTimers (node:internal/timers:541:7) [2026-08-26T16:35:24.697] [ERROR] vuer - DIAGNOSTIC BACKGROUND RPC ROUNDTRIP ERROR Error: RPCCLIENT: cannot make rpc call Error: RPCCLIENT MESSAGE TIMEOUT background-ping at Ping.call (/workspace/vuer_oss/node_modules/@techteamer/mq/dist/cjs/src/RPCClient.js:124:19) at runNextTicks (node:internal/process/task_queues:65:5) at process.processTimers (node:internal/timers:538:9) at async Promise.allSettled (index 3) at async Diagnostic.runDiagnosticTick (/workspace/vuer_oss/server/diagnostic.js:43:5) [2026-08-26T16:35:24.698] [ERROR] vuer - Timeout in Subscriber queue-selfservice-cron [2026-08-26T16:35:24.705] [INFO] vuer - selfService room 73301 has timed out. [2026-08-26T16:35:24.709] [ERROR] vuer - Room has incorrect status 73301 closed [2026-08-26T16:35:24.710] [ERROR] vuer - Error closing room call Error: Room has incorrect status at SelfServiceRoomService.closeCall (/workspace/vuer_oss/server/service/SelfServiceRoomService.js:708:15) at process.processTicksAndRejections (node:internal/process/task_queues:104:5) at async SelfServiceCronQueue._processMessage (/workspace/vuer_oss/node_modules/@techteamer/mq/dist/cjs/src/Subscriber.js:167:13) [2026-08-26T16:35:24.711] [ERROR] vuer - Cannot process Subscriber consume Error: Error closing room call at SelfServiceRoomService.closeCall (/workspace/vuer_oss/server/service/SelfServiceRoomService.js:750:13) at process.processTicksAndRejections (node:internal/process/task_queues:104:5) at async SelfServiceCronQueue._processMessage (/workspace/vuer_oss/node_modules/@techteamer/mq/dist/cjs/src/Subscriber.js:167:13) [2026-08-26T16:35:24.712] [INFO] vuer - selfService room 73301 has timed out. [2026-08-26T16:35:24.716] [ERROR] vuer - Room has incorrect status 73301 closed [2026-08-26T16:35:24.716] [ERROR] vuer - Error closing room call Error: Room has incorrect status at SelfServiceRoomService.closeCall (/workspace/vuer_oss/server/service/SelfServiceRoomService.js:708:15) at process.processTicksAndRejections (node:internal/process/task_queues:104:5) at async SelfServiceCronQueue._processMessage (/workspace/vuer_oss/node_modules/@techteamer/mq/dist/cjs/src/Subscriber.js:167:13) [2026-08-26T16:35:24.717] [ERROR] vuer - Cannot process Subscriber consume Error: Error closing room call at SelfServiceRoomService.closeCall (/workspace/vuer_oss/server/service/SelfServiceRoomService.js:750:13) at process.processTicksAndRejections (node:internal/process/task_queues:104:5) at async SelfServiceCronQueue._processMessage (/workspace/vuer_oss/node_modules/@techteamer/mq/dist/cjs/src/Subscriber.js:167:13) [2026-08-26T16:35:24.718] [INFO] vuer - selfService room 73301 has timed out. [2026-08-26T16:35:24.721] [ERROR] vuer - Room has incorrect status 73301 closed [2026-08-26T16:35:24.721] [ERROR] vuer - Error closing room call Error: Room has incorrect status :

- **Péter  Ferencsik**: <<<UNTRUSTED OSS memória használat. >>>
- **Péter  Ferencsik**: <<<UNTRUSTED @bence.varga 
 
Ennek alapján: <https://techteamer.slack.com/archives/C01D1QAD66M/p1787752017623319>
várjuk a build-et, ami javítja a memory leak problémát. >>>
- **Norbert Komka**: <<<UNTRUSTED @bence.varga @tamas.szekeres plíz minél előbb vegyétek be az Unicreditet is a nodejs javító sorra >>>