Build Pydantic wheels with old Cython

[joostlek]

Proposed change

Build Pydantic wheels with old Cython.

Type of change

• Dependency upgrade
• Bugfix (non-breaking change which fixes an issue)
• New integration (thank you!)
• New feature (which adds functionality to an existing integration)
• Deprecation (breaking change to happen in the future)
• Breaking change (fix/feature causing existing functionality to break)
• Code quality improvements to existing code or addition of tests

Additional information

• This PR fixes or closes issue: fixes #
• This PR is related to issue:
• Link to documentation pull request:

Checklist

• The code change is tested and works locally.
• Local tests pass. Your PR cannot be merged unless tests pass
• There is no commented out code in this PR.
• I have followed the development checklist
• I have followed the perfect PR recommendations
• The code has been formatted using Black (black --fast homeassistant tests)
• Tests have been added to verify that the new code works.

If user exposed functionality or configuration variables are added/changed:

• Documentation added/updated for www.home-assistant.io

If the code communicates with devices, web services, or third-party tools:

• The manifest file has all fields filled out correctly.
  Updated and included derived files by running: python3 -m script.hassfest.
• New or updated dependencies have been added to requirements_all.txt.
  Updated by running python3 -m script.gen_requirements_all.
• For the updated dependencies - a link to the changelog, or at minimum a diff between library versions is added to the PR description.
• Untested files have been added to .coveragerc.

To help with the load of incoming pull requests:

• I have reviewed two other open pull requests in this repository.

[bdraco]

We should get a comment above like we have for grpcio referencing the issue

[bdraco]

We should merge this, but this won't actually fix it because we have wheels for 1.10.13 up on wheels already that were built with the wrong cython.

After this merges we need to:

• wipe the wheels for 1.10.13 from wheels.home-assistant.io
• change the package constraint to 1.10.13 in new pr (pushed to this repo as branch), and manually trigger a wheel build
• than we can merge the constraint change pr

[frenck]

Why would we do that? As in, we can't bump pydantic, as we have to take into account Core installation methods?

../Frenck

[bdraco]

Why would we do that? As in, we can't bump pydantic, as we have to take into account Core installation methods?

../Frenck

This change would get v1 updates unblocked for all the other install methods. core remains broken for new installs (see below for more details and limitations) and still has to wait for either pydantic issue 7689 to get fixed or for us to switch to pydantic 2.x when all the libraries are ready.

Backstory:

• pydantic does not use an isolated environment to build wheels and will use the system installed cython even though their code does not work with cython 3

• core install is currently broken for anyone who compiles it manually, and this PR will not fix it because the pydantic v1 does not work with cython >= 3.x. Even worse, some of the vendors are distributing the broken cython 3 compiled wheels as well (see more details in the pydantic issue)

• The issue that joostlek opened is a bit stuck Argument 'bases' has incorrect type pydantic/pydantic#7689

• The ideal solution would be to upgrade core to use pydantic 2.x as the problem just goes away. Unfortunately that means every library that was built on pydantic 1.x needs to add the import shims (tracked via Pydantic v2 migration issue #99218) ala

try:
    from pydantic.v1 import ValidationError
except ImportError:
    from pydantic import ValidationError  # type: ignore

[frenck]

Thanks, @joostlek 👍

../Frenck