Drop package manager CI for yarn and pnpm, add Node v20 to CI

Drop package manager CI for yarn and pnpm, add Node v20 to CI #478