Cleanup custom lints #5200

Job	Run time
msrv	1m 31s
rustfmt-clippy	1m 32s
wasi	1m 36s
build-windows (cargo-build, x86_64-pc-windows-msvc)	4m 6s
build-windows (cargo-test, x86_64-pc-windows-msvc)	6m 47s
build-macos (Cargo build (x64), cargo-build, x86_64-apple-darwin)	2m 51s
build-windows (cargo-c, x86_64-pc-windows-gnu)	7m 20s
build-unix (beta-build)	2m 47s
build-macos (Cargo test (x64), cargo-test, x86_64-apple-darwin)	3m 24s
build-unix (1.70.0-tests)	5m 13s
build-macos (Cargo C-build (x64), cargo-c, x86_64-apple-darwin)	4m 47s
build-unix (aom-tests)	4m 59s
build-macos (Cargo build (Arm64), cargo-build, aarch64-apple-darwin)	2m 47s
build-unix (dav1d-tests)	5m 30s
build-macos (Cargo C-build (Arm64), cargo-c, aarch64-apple-darwin)	4m 44s
build-unix (no-asm-tests)	8m 16s
build-unix (grcov-codecov)	14m 0s
build-unix (bench)	3m 37s
build-unix (doc)	3m 48s
build-unix (cargo-c)	5m 15s
build-unix (check-no-default)	1m 21s
build-unix (check-extra-feats)	2m 36s
build-unix (check-unstable-feats)	2m 21s
build-unix (fuzz)	5m 43s
build-unix (dav1d-tests-arm64, stable)	6m 0s
	1h 52m 51s

Provide feedback