Well it did not break them directly. It was rather the fact that some packages depended on freetype-devel and I did not find any source code to build a “freetype-devel”. The freetype-devel package in the repos is 2.8.1, while the freetype I built from source was 2.8.
So a few applications like sddm did not work because they were probably expecting a freetype-devel package, which I removed.
Building from xbps-src. Well, currently it builds 2.8.1 of course. I honestly didn’t get too much into that, it just seemed easier to download the tar ball and build it myself.