Compile armhf kernel and packages

Has anyone thought or tried to recompile the kernel as armhf instead of armel (soft float)? (My cloud gen2 with the Marvell Armada 375 chip)

It seems that utilizing the CPU floating point processor would increase performance – although I have not put much thought into how much web server / samba / ftp / etc uses floating point math so maybe there would not be much gain.

I only ask because the included toolchain says softfp which I assume is what compiled the kernel and all of the packages. Buildroot is pretty quick to configure and make sdk nicely zips up the toolchain for exporting into such projects.