Fix build failure with fast_unaligned and non-gcc-compatible compilers