Move to pydantic v2

[DominicOram]

We should make sure that all our dependencies etc. work on pydantic v2

Acceptance Criteria

• We pin pydantic>2
• Unpin zocalo < 1.0.0
• We remove all the ignores around pydantic in filterwarnings
• Dependencies are happy to install on pip install
• Unit tests work

[DominicOram]

Currently blocked on:

• Move to pydantic 2 bluesky/scanspec#122
• Update pydantic to v2 python-zocalo#247

[dperl-dls]

Once we can, we should then update some of the way we use pydantic features, e.g.:

dodal/src/dodal/devices/detector/detector.py

Line 59 in fe3f48c

) # should be replaced with model_validator once move to pydantic 2 is complete

[dperl-dls]

We are now blocked by scanspec requiring numpy>=2.0 and p4p requiring numpy<2.0

blueapi and nexgen also still pinned to pydantic<2 (so we can't pin to >2 and have a working environment)

additionally some changes are needed to get dodal in sync with ophyd_async 0.5+

• upgrade pydantic to v2 nexgen#276
• p4p incompatible with NumPy 2.0 epics-base/p4p#145
• Update to Pydantic2 blueapi#273

[DominicOram]

Waiting for another release of p4p

[DiamondJoseph]

I believe we're currently not blocked by p4p- only Numpy 2 support is. I'm going to make the required changes and check

[dperl-dls]

@DiamondJoseph yes, but unfortunately the version of scanspec which supports pydantic 2 also requires numpy 2, so we are indirectly still blocked by that

[DiamondJoseph]

Not since ScanSpec 0.7.2