chore: build.rs cleanup #6363

Job	Run time
debug x86_64-apple-darwin	17m 5s
release x86_64-apple-darwin	12m 13s
asan aarch64-apple-darwin	52m 32s
debug aarch64-apple-darwin	10m 27s
release aarch64-apple-darwin	8m 59s
debug x86_64-unknown-linux-gnu	11m 2s
release x86_64-unknown-linux-gnu	7m 13s
release x86_64-pc-windows-msvc	12m 34s
debug aarch64-unknown-linux-gnu	23m 29s
release aarch64-unknown-linux-gnu	12m 2s
publish	0s
	2h 47m 36s

Provide feedback