Tvheadend - Bug #2309 Another memory leak?

Transcription

1 Tvheadend - Bug #2309 Another memory leak? :12 - Thomas Knoll Status: Fixed Start date: Priority: Normal Due date: Assignee: % Done: 0% Category: Estimated time: 0.00 hour Target version: Found in version: ~g4bce3dc Affected Versions: Description TVHeadend Build: ~g4bce3dc Intel NUC i5, two sundtek DVB-C usb sticks, Arch Linux running , 8GB Ram, Samsung Evo 256GB 2,5" SSD. Partitions: Number Start (sector) End (sector) Size Code Name MiB EF00 EFI System GiB 8300 Linux filesystem GiB 8300 Linux filesystem GiB 8200 Linux swap root@tvserver ~ > lslkb -f NAME FSTYPE LABEL UUID MOUNTPOINT sda sda1 vfat EFI 31D8-D2FA /boot sda2 btrfs arch 8a168fb7-b e cf7e844ab /run/btrfs-root sda3 ext4 video 7002a830-ddba ec-2a472d011d0d /home sda4 swap swap a-ff7e-48e8-a337-28a705881e72 [SWAP] sda2 is root running btrfs and sda3 is mounted on home for recordings. 200GB left. Harddisk is a 2,5 SSD Samsung Evo 256GB. root@tvserver /home/hts/.hts/tvheadend/dvr/config > cat /etc/fstab # # /etc/fstab: static file system information # # <file system> <dir> <type> <options> <dump> <pass> # /dev/sdb2 LABEL=arch UUID=8a168fb7-b e cf7e844ab / btrfs rw,nodev,relatime,ssd,space_cache,subvol=root 0 0 # mount BTRFS root UUID=8a168fb7-b e cf7e844ab /run/btrfs-root btrfs nodev,nosuid,noexec 0 0 # /dev/sdb1 LABEL=EFI UUID=31D8-D2FA /boot vfat rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro 0 2 # /dev/sdb3 LABEL=video UUID=7002a830-ddba ec-2a472d011d0d /home ext4 rw,relatime,data=ordered /7

2 I have TVH running for about 2 months now and its getting more and more perfect for my needs. But one thing makes me wonder quite a bit... I never really used recordings in the past, but now I wanted to give it a try. After a night of three (scrambled) records of HD channels my memory consumption looks like this: root@tvserver ~ > free -m total used free shared buffers cached Mem: /+ buffers/cache: Swap: top - 07:44:44 up 9:15, 1 user, load average: 0,05, 0,11, 0,16 Tasks: 105 total, 1 running, 104 sleeping, 0 stopped, 0 zombie %Cpu(s): 1,3 us, 1,2 sy, 0,0 ni, 97,5 id, 0,0 wa, 0,0 hi, 0,0 si, 0,0 st KiB Mem: total, used, free, 2600 buffers KiB Swap: total, used, free cached Mem PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 390 hts ,192g 7576 S 6,6 93,0 13:55.05 tvheadend 388 ntp S 0,0 0,2 0:02.08 ntpd 144 root S 0,0 0,2 0:03.00 systemd-journal 412 root S 4,7 0,2 13:48.41 mediasrv 1090 root S 0,0 0,1 0:00.05 sshd root@tvserver ~ > cat/proc/meminfo MemTotal: kb MemFree: kb MemAvailable: kb Buffers: 2600 kb Cached: kb SwapCached: kb Active: kb Inactive: kb Active(anon): kb Inactive(anon): kb Active(file): kb Inactive(file): kb Unevictable: kb Mlocked: kb SwapTotal: kb SwapFree: kb Dirty: 0 kb Writeback: 0 kb AnonPages: kb Mapped: kb Shmem: 8964 kb Slab: kb SReclaimable: kb SUnreclaim: kb KernelStack: 2400 kb PageTables: kb /7

3 NFS_Unstable: 0 kb Bounce: 0 kb WritebackTmp: 0 kb CommitLimit: kb Committed_AS: kb VmallocTotal: kb VmallocUsed: kb VmallocChunk: kb HardwareCorrupted: 0 kb AnonHugePages: kb HugePages_Total: 0 HugePages_Free: 0 HugePages_Rsvd: 0 HugePages_Surp: 0 Hugepagesize: 2048 kb DirectMap4k: kb DirectMap2M: kb DirectMap1G: kb So this is no disk cache in my opinion. TVH grabs an incredible amount of 7GB RAM without freeing it. Records are written on disk. My default recording profile looks like this: root@tvserver /home/hts/.hts/tvheadend/dvr/config > cat 984b43e397babcd498718a714df6fad5 { "enabled": true, "name": "", "container": 1, "cache": 1, "retention-days": 31, "pre-extra-time": 1, "post-extra-time": 4, "episode-duplicate-detection": true, "epg-update-window": 86400, "storage": "/home/hts/video", "file-permissions": "0664", "charset": "UTF-8", "rewrite-pat": false, "rewrite-pmt": false, "tag-files": false, "skip-commercials": false, "directory-permissions": "0775", "day-dir": false, "channel-dir": false, "title-dir": false, "channel-in-title": true, "date-in-title": true, "time-in-title": true, "episode-in-title": false, "episode-before-date": false, "subtitle-in-title": false, "omit-title": false, "clean-title": false, /7

4 } "whitespace-in-title": false Playing around with cache settings in my recording profile doesn't seem to change anything. When looking at the memory consumption during recording the system uses disk cache correctly assigned as cached mem but TVH also assigns memory without freeing it. Let me start a record... Sep 19 07:58:37 TVServer tvheadend[390]: dvr: "Guten Morgen Deutschland" on "RTL HD" recorder starting Sep 19 07:58:37 TVServer tvheadend[390]: subscription: "DVR: Guten Morgen Deutschland" subscribing on "RTL HD", weight: 300, adapter: "Sundtek DVB-C : DVB-C #0", network: "Kabel Deutschland", mux: "346", provider: "Digital Free", service: "RTL HD" Sep 19 07:58:38 TVServer tvheadend[390]: dvr: /home/hts/video/rtl HD-Guten Morgen Deutschland mkv from adapter: "Sundtek DVB-C : DVB-C #0", network: "Kabel Deutschland", mux: "346", provider: "Digital Free", service: "RTL HD" Sep 19 07:58:38 TVServer tvheadend[390]: dvr: # type lang resolution aspect ratio sample rate channels Sep 19 07:58:38 TVServer tvheadend[390]: dvr: 1 DVBSUB ger Sep 19 07:58:38 TVServer tvheadend[390]: dvr: 2 H x :9 Sep 19 07:58:38 TVServer tvheadend[390]: dvr: 3 AC3 ger Sep 19 07:58:38 TVServer tvheadend[390]: dvr: 4 TELETEXT <disabled, no valid input> Sep 19 07:58:38 TVServer tvheadend[390]: dvr: 5 CA Sep 19 07:58:38 TVServer tvheadend[390]: dvr: 6 CA root@tvserver /home/hts/.hts/tvheadend/dvr/config > iostat 1 Linux ARCH (TVServer) _x86_64_ (4 CPU) 0,57 0,00 0,50 0,07 0,00 98,86 sda 5,87 469,99 837, ,03 0,00 1,52 0,00 0,00 95,45 3,30 0,00 1,27 0,25 0,00 95,18 sda 2,00 0,00 12, ,05 0,00 1,27 0,00 0,00 95, /7

5 2,79 0,00 1,02 0,00 0,00 96,19 3,05 0,00 0,76 0,00 0,00 96,19 3,30 0,00 1,02 0,00 0,00 95,69 3,54 0,00 1,27 0,00 0,00 95,19 2,54 0,00 1,27 0,00 0,00 96,18 sda 37,00 0, , ,02 0,00 1,26 0,00 0,00 95,72 procs memory swap io---- -system cpu----- r b swpd free buff cache si so bi bo in cs us sy id wa st /7

6 After some minutes: top - 08:01:33 up 9:32, 2 users, load average: 0,21, 0,22, 0,17 Tasks: 119 total, 1 running, 118 sleeping, 0 stopped, 0 zombie %Cpu(s): 2,7 us, 1,3 sy, 0,0 ni, 96,0 id, 0,0 wa, 0,0 hi, 0,1 si, 0,0 st KiB Mem: total, used, free, 384 buffers KiB Swap: total, used, free cached Mem PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 390 hts ,1m 7,379g 7216 S 13,0 95,4 15:05.31 tvheadend 412 root S 3,7 0,2 14:27.79 mediasrv 1090 root S 0,3 0,1 0:00.13 sshd 1 root S 0,0 0,1 0:01.33 systemd 2 root S 0,0 0,0 0:00.00 kthreadd 3 root S 0,0 0,0 0:00.52 ksoftirqd/0 5 root S 0,0 0,0 0:00.00 kworker/0:0h 7 root S 0,0 0,0 0:01.10 rcu_preempt Aborting now as the swapout is rising. Soon the process will be killed. I must admit I never really watched memory consumption before I raised memory from 4GB to 8GB and thinking about a ramdisk for my TVH. I played around with it and it worked pretty well but then I saw that memory consumption during a record in combination with timeshift is noticably too high so I started to sort things out. It wasn't the tmpfs for TS, it was the recording itself. Right now the ramdisk and TS itself is disabled cause its hard to find the best amout of assigned memory right in this situation. So actually I have no clue. Do you have any idea what is going on here? History # :30 - Jaroslav Kysela Confirmed. Fixed in v gd38f /7

7 # :31 - Jaroslav Kysela - Status changed from New to Fixed /7