ForwardDiff over anything - prepare inner gradient for HVP #557

Job	Run time
1 - DIT (Formalities)	2m 22s
1 - DIT (Zero)	10m 59s
1 - DI (Formalities)	1m 41s
1 - DIT (ForwardDiff)	3m 40s
1 - DI (Internals)	5m 29s
1 - DIT (Weird)	6m 55s
1 - DI (Back/Diffractor)	2m 21s
lts - DIT (Zero)	20m 49s
1 - DI (Back/Enzyme)	15m 49s
lts - DIT (ForwardDiff)	4m 10s
1 - DI (Back/FastDifferentiation)	3m 30s
pre - DIT (Formalities)	3m 16s
1 - DI (Back/FiniteDiff)	2m 20s
pre - DIT (Zero)	14m 4s
1 - DI (Back/FiniteDifferences)	2m 11s
pre - DIT (ForwardDiff)	5m 18s
1 - DI (Back/ForwardDiff)	8m 41s
pre - DIT (Weird)	8m 47s
1 - DI (Back/PolyesterForwardDiff)	2m 52s
1 - DI (Back/ReverseDiff)	4m 50s
1 - DI (Back/SecondOrder)	5m 16s
1 - DI (Back/Symbolics)	3m 14s
1 - DI (Back/Tapir)	6m 51s
1 - DI (Back/Tracker)	2m 10s
1 - DI (Back/Zygote)	5m 8s
1 - DI (Down/Detector)	2m 35s
1 - DI (Down/DifferentiateWith)	2m 49s
1 - DI (Down/Flux)	4m 3s
lts - DI (Internals)	5m 31s
lts - DI (Back/FiniteDifferences)	2m 40s
lts - DI (Back/ForwardDiff)	9m 39s
lts - DI (Back/ReverseDiff)	5m 32s
lts - DI (Back/Tracker)	2m 27s
lts - DI (Back/Zygote)	5m 19s
lts - DI (Down/DifferentiateWith)	3m 37s
pre - DI (Internals)	8m 25s
pre - DI (Back/Diffractor)	3m 40s
pre - DI (Back/FastDifferentiation)	5m 26s
pre - DI (Back/FiniteDiff)	3m 56s
pre - DI (Back/FiniteDifferences)	3m 54s
pre - DI (Back/ForwardDiff)	14m 7s
pre - DI (Back/PolyesterForwardDiff)	4m 21s
pre - DI (Back/ReverseDiff)	7m 15s
pre - DI (Back/Symbolics)	5m 7s
pre - DI (Back/Tracker)	3m 24s
pre - DI (Back/Zygote)	7m 5s
pre - DI (Down/DifferentiateWith)	4m 1s
pre - DI (Down/Flux)	5m 40s
	4h 33m 16s

Provide feedback