Update supported protobuf versions

[tday]

OS Platform and Distribution

macOS 14.3

Compiler version

No response

Programming Language and version

Python 3.12.7

Installed using virtualenv? pip? Conda?(if python)

Yes, virtualenv + pip

MediaPipe version

0.10.20

Bazel version

No response

XCode and Tulsi versions (if iOS)

No response

Android SDK and NDK versions (if android)

No response

Android AAR (if android)

None

OpenCV version (if running on desktop)

No response

Describe the problem

The current protobuf dependencies are constrainted to protobuf < 5. However, many newer packages like opentelemetry are using > 5.0. This causes an unresolvable conflict.

Complete Logs

Because no versions of opentelemetry-exporter-otlp-proto-http match >1.28.2,<1.29.0 || >1.29.0,<2
 and opentelemetry-exporter-otlp-proto-http (1.28.2) depends on opentelemetry-proto (1.28.2), opentelemetry-exporter-otlp-proto-http (>=1.28.2,<1.29.0 || >1.29.0,<2) requires opentelemetry-proto (1.28.2).
    And because opentelemetry-proto (1.28.2) depends on protobuf (>=5.0,<6.0), opentelemetry-exporter-otlp-proto-http (>=1.28.2,<1.29.0 || >1.29.0,<2) requires protobuf (>=5.0,<6.0).
    And because opentelemetry-exporter-otlp-proto-http (1.29.0) depends on opentelemetry-proto (1.29.0)
 and opentelemetry-proto (1.29.0) depends on protobuf (>=5.0,<6.0), opentelemetry-exporter-otlp-proto-http (>=1.28.2,<2) requires protobuf (>=5.0,<6.0).
    Because no versions of dagster-cloud match >1.9.6,<2.0.0
 and dagster-cloud (1.9.6) depends on opentelemetry-exporter-otlp-proto-http (>=1.28.2,<2), dagster-cloud (>=1.9.6,<2.0.0) requires opentelemetry-exporter-otlp-proto-http (>=1.28.2,<2).
(1) Thus, dagster-cloud (>=1.9.6,<2.0.0) requires protobuf (>=5.0,<6.0).

    Because mediapipe (0.10.20) depends on protobuf (>=4.25.3,<5)
 and no versions of mediapipe match >0.10.18,<0.10.20 || >0.10.20,<0.11.0, mediapipe (>0.10.18,<0.11.0) requires protobuf (>=4.25.3,<5).
    And because mediapipe (0.10.18) depends on protobuf (>=4.25.3,<5), mediapipe (>=0.10.18,<0.11.0) requires protobuf (>=4.25.3,<5).
    And because dagster-cloud (>=1.9.6,<2.0.0) requires protobuf (>=5.0,<6.0) (1), dagster-cloud (>=1.9.6,<2.0.0) is incompatible with mediapipe (>=0.10.18,<0.11.0)
    So, because rep-counter depends on both mediapipe (^0.10.18) and dagster-cloud (^1.9.6), version solving failed.

[kuaashish]

Hi @tday,

It appears that the versions of Mediapipe (0.10.20) and OpenTelemetry you are trying to install have conflicting dependencies due to different protobuf versions. This may be causing the issues you are encountering. Please allow us some time to consult with our team about the possibility of upgrading the protobuf version or identifying any potential workarounds.

Thank you!!

[tday]

Thanks, @kuaashish. FWIW, I tested mediapipe 0.10.20 + protobuf 5.29.2 for my use case. It worked without any issues.

[YanWenKun]

I have similar issue, though it's on Linux. I believe this is caused by protobuf version conflict, as runtime_version is a 5.x thing.
Please update protobuf version, thanks!

from insightface.app import FaceAnalysis
File "/usr/local/lib64/python3.12/site-packages/insightface/init.py", line 16, in
from . import model_zoo
File "/usr/local/lib64/python3.12/site-packages/insightface/model_zoo/init.py", line 1, in
from .model_zoo import get_model
File "/usr/local/lib64/python3.12/site-packages/insightface/model_zoo/model_zoo.py", line 11, in
from .arcface_onnx import *
File "/usr/local/lib64/python3.12/site-packages/insightface/model_zoo/arcface_onnx.py", line 10, in
import onnx
File "/usr/lib64/python3.12/site-packages/onnx/init.py", line 78, in
from onnx.external_data_helper import (
File "/usr/lib64/python3.12/site-packages/onnx/external_data_helper.py", line 14, in
from onnx.onnx_pb import (
File "/usr/lib64/python3.12/site-packages/onnx/onnx_pb.py", line 4, in
from .onnx_ml_pb2 import * # noqa
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib64/python3.12/site-packages/onnx/onnx_ml_pb2.py", line 9, in
from google.protobuf import runtime_version as _runtime_version
ImportError: cannot import name 'runtime_version' from 'google.protobuf' (/usr/local/lib64/python3.12/site-packages/google/protobuf/init.py)

Cannot import /root/ComfyUI/custom_nodes/ComfyUI_InstantID module for custom nodes: cannot import name 'runtime_version' from 'google.protobuf' (/usr/local/lib64/python3.12/site-packages/google/protobuf/init.py)

[azmke]

Hey together,

I also have problems because mediapipe requires an outdated version of protobuf. The current protobuf version is 5.29.3, the latest version of protobuf supported by mediapipe is 4.25.6 (mediapipe/requirement.txt: protobuf>=4.25.3,<5).

Problem in my example: The library onnx (18k stars), which is used by insightface (24k stars), which in turn is used by many ComfyUI nodes, requires google.protobuf.runtime_version, which was added in protobuf 5.26.0. (See issues Gourieff/ComfyUI-ReActor/issues/29 and onnx/onnx/issues/6660 for more info.)

What are the reasons for keeping the limitation of protobuf<5 in the mediapipe requirement? Can you please also allow protobuf>=5 for mediapipe?

@kuaashish Is there already news from the consultation with your team?

[kuaashish]

Hi @schmidt-sebastian,

Could you please look into this issue?

Thank you!!