buildpkg: unset CONFIG_SITE while building packages #1032

Job	Run time
build-minimal-sysroots (x86_64)	1m 7s
build-minimal-sysroots (riscv64)	1m 20s
build-minimal-sysroots (arm64)	52s
build-toolchains (ubuntu-latest, x86_64, gnu)	34s
build-toolchains (ubuntu-latest, riscv64, gnu)	37s
build-toolchains (ubuntu-latest, arm64, gnu)	32s
build-toolchains (ubuntu-20.04, x86_64, gnu)	34s
build-toolchains (ubuntu-20.04, riscv64, gnu)	38s
build-toolchains (ubuntu-20.04, arm64, gnu)	25s
build-toolchains (macos-latest, x86_64, gnu)	1m 1s
build-toolchains (macos-latest, riscv64, gnu)	1m 6s
build-toolchains (macos-latest, arm64, gnu)	43s
build-toolchains (ubuntu-latest, llvm, all)	1m 31s
build-llvm	2m 51s
build	3m 10s
build-arm64	2m 52s
build-llvm-riscv64	2m 54s
build-riscv	2m 28s
build-llvm-arm64	2m 49s
run-x86_64	0s
run-x86_64-llvm	0s
run-riscv	0s
run-riscv64-llvm	0s
	28m 4s

Provide feedback