Faster kernel builds in the OBS
The kernel compile and link itself is only a fraction of the OBS kernel-default package build. Several other passes take significant time: - Post build checks, especially the clamav scan - Debuginfo extractioon, which is single-threaded - Writing the RPMs
The post build checks and clamav are disabled in the KOTD projects, but they are still annoying when doing official builds. Clamav is suspiciously slow and should be investigated. The RPM write speed has been improved by switching to bzip2 compression, at the expense of their increased size. There is still room for improvement by writing the RPMs in parallel. Debuginfo extraction is a major pain.
Looking for hackers with the skills:
Nothing? Add some keywords!
This project is part of:
Hack Week 14
Activity
Comments
-
over 8 years ago by michal-m | Reply
I started looking into the clamav scan, because it seemed like low-hanging fruit. I have a patch to the clamscan utility to scan the files in parallel, I just need to polish it and submit upstream. I also fixed some issues in the post-build-checks-malwarescan package. I'll test this and submit. Let's see if I can do something about the debuginfo extraction. I tried a few years ago had to give up. But I was young back then :-P.
-
-
-
over 8 years ago by michal-m | Reply
In home:michal-m:branches:SUSE:SLE-12:Update in the IBS, during kernel-default build, the clamav scan takes 99 + 154 seconds. That's a considerable improvement, since it normally takes something like 6 + 7 minutes. There is still the issue that we run all the post-build checks twice if module signing is enabled. These numbers are with the patched clamav, which is not yet submitted.
-
-
over 8 years ago by michal-m | Reply
Upstream submission of the find-debuginfo.sh patches. I also uploaded the patched rpm to home:michal-m:branches:SUSE:SLE-12:Update in the IBS, let's see how fast is the kernel going to build.
-
over 8 years ago by michal-m | Reply
Bummer. I found a race in the find-debuginfo.sh patch. Testing a new version.
-
over 8 years ago by michal-m | Reply
v2 of the patch series is here: http://lists.rpm.org/pipermail/rpm-maint/2016-July/thread.html#4373. The builds in home:michal-m:branches:SUSE:SLE-12:Update are really fast! :)
-
Similar Projects
This project is one of its kind!