perf(transport): remove Server::timers #2177

Job	Run time
Build & test (ubuntu-latest, 1.74.0, debug)	10m 44s
Build & test (ubuntu-latest, stable, debug)	8m 17s
Build & test (ubuntu-latest, nightly, debug)	8m 44s
Build & test (macos-14, 1.74.0, debug)	11m 7s
Build & test (macos-14, stable, debug)	7m 34s
Build & test (macos-14, nightly, debug)	6m 3s
Build & test (windows-latest, 1.74.0, debug)	20m 31s
Build & test (windows-latest, stable, debug)	21m 1s
Build & test (windows-latest, nightly, debug)	17m 6s
Build & test (ubuntu-latest, stable, release)	14m 17s
Benchmark	0s
	2h 5m 24s

Provide feedback