5.17.1: pytest runs forever in tests/spec/Spec/deref_flattened_spec_test.py::test_build_spec_object_with_recursive_specs_and_fully_dereference unit
#395
Comments
|
Looks like it it second unit which runs forever and it is After add those two units to --deselect list I found that another unit is failing. + PYTHONPATH=/home/tkloczko/rpmbuild/BUILDROOT/python-bravado-core-5.17.1-2.fc35.x86_64/usr/lib64/python3.8/site-packages:/home/tkloczko/rpmbuild/BUILDROOT/python-bravado-core-5.17.1-2.fc35.x86_64/usr/lib/python3.8/site-packages
+ /usr/bin/pytest -ra -m 'not network' --deselect tests/spec/Spec/deref_flattened_spec_test.py::test_build_spec_object_with_recursive_specs_and_fully_dereference --deselect 'tests/spec/Spec/equality_test.py::test_equality_of_specs_with_recursive_definition[True]'
==================================================================================== test session starts ====================================================================================
platform linux -- Python 3.8.17, pytest-7.3.1, pluggy-1.0.0
benchmark: 4.0.0 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /home/tkloczko/rpmbuild/BUILD/bravado-core-5.17.1
configfile: tox.ini
plugins: benchmark-4.0.0
collected 912 items / 2 deselected / 910 selected
tests/_decorators_test.py ......... [ 0%]
tests/security_test.py ...... [ 1%]
tests/util_test.py .......................... [ 4%]
tests/docstring/create_operation_docstring_test.py ....... [ 5%]
tests/docstring/create_param_docstring_test.py ...... [ 5%]
tests/docstring/formatted_type_test.py ..... [ 6%]
tests/exception/wrap_exception_test.py .. [ 6%]
tests/formatter/to_python_test.py ............... [ 8%]
tests/formatter/to_wire_test.py .................. [ 10%]
tests/marshal/marshal_array_test.py ........... [ 11%]
tests/marshal/marshal_model_test.py ........ [ 12%]
tests/marshal/marshal_object_test.py ...................... [ 14%]
tests/marshal/marshal_primitive_test.py ....... [ 15%]
tests/marshal/marshal_schema_object_test.py ....... [ 16%]
tests/model/bless_models_test.py ....... [ 17%]
tests/model/collect_models_test.py .... [ 17%]
tests/model/compare_test.py ... [ 17%]
tests/model/create_model_docstring_test.py .. [ 18%]
tests/model/create_model_repr_test.py ..s. [ 18%]
tests/model/create_model_type_test.py ......... [ 19%]
tests/model/get_model_name_test.py .... [ 20%]
tests/model/is_model_test.py .... [ 20%]
tests/model/is_object_test.py ...... [ 21%]
tests/model/model_constructor_test.py ....... [ 21%]
tests/model/model_discovery_test.py ... [ 22%]
tests/model/model_test.py .................................. [ 25%]
tests/model/pickling_test.py .. [ 26%]
tests/model/post_process_spec_test.py ... [ 26%]
tests/model/tag_models_test.py ....... [ 27%]
tests/operation/build_params_test.py ....... [ 28%]
tests/operation/consumes_test.py .... [ 28%]
tests/operation/equality_test.py ....... [ 29%]
tests/operation/operation_id_test.py ............ [ 30%]
tests/operation/produces_test.py .... [ 30%]
tests/operation/security_object_test.py ................................. [ 34%]
tests/param/add_file_test.py .... [ 35%]
tests/param/cast_request_param_test.py ........... [ 36%]
tests/param/get_param_type_spec_test.py .... [ 36%]
tests/param/marshal_collection_format_test.py .... [ 37%]
tests/param/marshal_param_test.py ................................ [ 40%]
tests/param/string_to_boolean_test.py ... [ 40%]
tests/param/stringify_body_test.py .. [ 41%]
tests/param/unmarshal_collection_format_test.py ........... [ 42%]
tests/param/unmarshal_param_test.py ........................ [ 45%]
tests/profiling/marshal_profiler_test.py ............ [ 46%]
tests/profiling/unmarshal_profiler_test.py ............ [ 47%]
tests/profiling/unmarshal_response_profiler_test.py ........................ [ 50%]
tests/request/IncomingRequest_test.py ... [ 50%]
tests/request/unmarshal_request_test.py .... [ 51%]
tests/resource/build_resources_test.py ............ [ 52%]
tests/resource/convert_path_to_resource_test.py ... [ 52%]
tests/resource/deepcopy_test.py . [ 52%]
tests/resource/equality_test.py ...... [ 53%]
tests/response/IncomingResponse_test.py .... [ 53%]
tests/response/get_response_spec_test.py ... [ 54%]
tests/response/unmarshal_response_test.py ......... [ 55%]
tests/response/validate_response_body_test.py ....... [ 56%]
tests/response/validate_response_headers_test.py .... [ 56%]
tests/response/validate_response_test.py .. [ 56%]
tests/schema/collapsed_properties_test.py .. [ 56%]
tests/schema/collapsed_required_test.py . [ 57%]
tests/schema/get_format_test.py .... [ 57%]
tests/schema/get_spec_for_prop_test.py .......... [ 58%]
tests/schema/handle_null_value_test.py ... [ 58%]
tests/schema/has_format_test.py .... [ 59%]
tests/schema/is_param_spec_test.py .... [ 59%]
tests/schema/is_prop_nullable_test.py ..... [ 60%]
tests/schema/is_required_test.py ...... [ 60%]
tests/spec/build_api_serving_url_test.py ................. [ 62%]
tests/spec/build_http_handlers_test.py ........ [ 63%]
tests/spec/from_dict_test.py ......... [ 64%]
tests/spec/pickling_test.py ..... [ 65%]
tests/spec/Spec/build_test.py ................ [ 67%]
tests/spec/Spec/deepcopy_test.py . [ 67%]
tests/spec/Spec/deref_flattened_spec_test.py .. [ 67%]
tests/spec/Spec/deref_test.py ..... [ 67%]
tests/spec/Spec/equality_test.py ............. [ 69%]
tests/spec/Spec/flattened_spec_test.py .................................... [ 73%]
tests/spec/Spec/get_op_for_request_test.py ..... [ 73%]
tests/swagger20_validator/enum_validator_test.py ...... [ 74%]
tests/swagger20_validator/format_validator_test.py ......... [ 75%]
tests/swagger20_validator/ref_validator_test.py .. [ 75%]
tests/swagger20_validator/required_validator_test.py ... [ 76%]
tests/swagger20_validator/type_validator_test.py ..... [ 76%]
tests/unmarshal/unmarshal_array_test.py ........ [ 77%]
tests/unmarshal/unmarshal_model_test.py ................... [ 79%]
tests/unmarshal/unmarshal_object_test.py ......................................................... [ 85%]
tests/unmarshal/unmarshal_primitive_test.py .............. [ 87%]
tests/unmarshal/unmarshal_schema_object_test.py ........ [ 88%]
tests/validate/validate_array_test.py ........... [ 89%]
tests/validate/validate_object_test.py ....................................... [ 93%]
tests/validate/validate_primitive_test.py ..............................F........ [ 98%]
tests/validate/validate_schema_object_test.py .... [ 98%]
tests/validate/validate_security_object_test.py .............. [100%]
========================================================================================= FAILURES ==========================================================================================
__________________________________________________________________________ test_string_datetime_invalid_exception ___________________________________________________________________________
minimal_swagger_spec = <bravado_core.spec.Spec object at 0x7fae44410790>, string_spec = {'format': 'date-time', 'type': 'string'}
def test_string_datetime_invalid_exception(minimal_swagger_spec, string_spec):
string_spec['format'] = 'date-time'
datestring = "nope nope nope"
with pytest.raises(ValidationError) as excinfo:
> validate_primitive(minimal_swagger_spec, string_spec, datestring)
E Failed: DID NOT RAISE <class 'jsonschema.exceptions.ValidationError'>
tests/validate/validate_primitive_test.py:221: Failed
===================================================================================== warnings summary ======================================================================================
../../../../../usr/lib/python3.8/site-packages/pkg_resources/__init__.py:121
/usr/lib/python3.8/site-packages/pkg_resources/__init__.py:121: DeprecationWarning: pkg_resources is deprecated as an API
warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning)
../../../../../usr/lib/python3.8/site-packages/pkg_resources/__init__.py:2870
../../../../../usr/lib/python3.8/site-packages/pkg_resources/__init__.py:2870
../../../../../usr/lib/python3.8/site-packages/pkg_resources/__init__.py:2870
../../../../../usr/lib/python3.8/site-packages/pkg_resources/__init__.py:2870
../../../../../usr/lib/python3.8/site-packages/pkg_resources/__init__.py:2870
/usr/lib/python3.8/site-packages/pkg_resources/__init__.py:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('sphinxcontrib')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
tests/_decorators_test.py: 112 warnings
tests/security_test.py: 102 warnings
tests/util_test.py: 16 warnings
tests/formatter/to_python_test.py: 243 warnings
tests/formatter/to_wire_test.py: 291 warnings
tests/marshal/marshal_array_test.py: 17 warnings
tests/marshal/marshal_model_test.py: 150 warnings
tests/marshal/marshal_object_test.py: 136 warnings
tests/marshal/marshal_primitive_test.py: 64 warnings
tests/marshal/marshal_schema_object_test.py: 68 warnings
tests/model/create_model_docstring_test.py: 32 warnings
tests/model/create_model_repr_test.py: 17 warnings
tests/model/create_model_type_test.py: 32 warnings
tests/model/is_model_test.py: 32 warnings
tests/model/is_object_test.py: 97 warnings
tests/model/model_constructor_test.py: 17 warnings
tests/model/model_discovery_test.py: 83 warnings
tests/model/model_test.py: 563 warnings
tests/model/pickling_test.py: 34 warnings
tests/operation/consumes_test.py: 68 warnings
tests/operation/equality_test.py: 160 warnings
tests/operation/produces_test.py: 68 warnings
tests/operation/security_object_test.py: 287 warnings
tests/param/marshal_param_test.py: 66 warnings
tests/param/unmarshal_param_test.py: 34 warnings
tests/profiling/marshal_profiler_test.py: 582 warnings
tests/profiling/unmarshal_profiler_test.py: 582 warnings
tests/profiling/unmarshal_response_profiler_test.py: 1164 warnings
tests/request/unmarshal_request_test.py: 64 warnings
tests/resource/deepcopy_test.py: 16 warnings
tests/resource/equality_test.py: 144 warnings
tests/response/unmarshal_response_test.py: 51 warnings
tests/response/validate_response_body_test.py: 112 warnings
tests/response/validate_response_headers_test.py: 64 warnings
tests/schema/collapsed_properties_test.py: 17 warnings
tests/schema/collapsed_required_test.py: 17 warnings
tests/schema/get_format_test.py: 66 warnings
tests/schema/get_spec_for_prop_test.py: 164 warnings
tests/schema/has_format_test.py: 66 warnings
tests/schema/is_param_spec_test.py: 66 warnings
tests/schema/is_prop_nullable_test.py: 82 warnings
tests/schema/is_required_test.py: 65 warnings
tests/spec/from_dict_test.py: 341 warnings
tests/spec/pickling_test.py: 146 warnings
tests/spec/Spec/build_test.py: 199 warnings
tests/spec/Spec/deepcopy_test.py: 16 warnings
tests/spec/Spec/deref_flattened_spec_test.py: 85 warnings
tests/spec/Spec/deref_test.py: 82 warnings
tests/spec/Spec/equality_test.py: 385 warnings
tests/spec/Spec/flattened_spec_test.py: 501 warnings
tests/spec/Spec/get_op_for_request_test.py: 83 warnings
tests/swagger20_validator/enum_validator_test.py: 48 warnings
tests/swagger20_validator/format_validator_test.py: 144 warnings
tests/swagger20_validator/required_validator_test.py: 48 warnings
tests/swagger20_validator/type_validator_test.py: 80 warnings
tests/unmarshal/unmarshal_array_test.py: 17 warnings
tests/unmarshal/unmarshal_model_test.py: 322 warnings
tests/unmarshal/unmarshal_object_test.py: 187 warnings
tests/unmarshal/unmarshal_primitive_test.py: 225 warnings
tests/unmarshal/unmarshal_schema_object_test.py: 136 warnings
tests/validate/validate_array_test.py: 176 warnings
tests/validate/validate_object_test.py: 396 warnings
tests/validate/validate_primitive_test.py: 624 warnings
tests/validate/validate_schema_object_test.py: 66 warnings
tests/validate/validate_security_object_test.py: 238 warnings
/home/tkloczko/rpmbuild/BUILD/bravado-core-5.17.1/bravado_core/model.py:888: DeprecationWarning: jsonschema.RefResolver.in_scope is deprecated and will be removed in a future release.
with spec.resolver.in_scope(additional_uri):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
-------------------------------------------------------------------------------------------------------------------- benchmark: 48 tests --------------------------------------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_small_objects[with-refs-100] 581.8238 (1.0) 649.4028 (1.0) 594.7219 (1.0) 8.2307 (1.0) 593.4569 (1.00) 7.0541 (1.08) 92;33 1,681.4581 (1.0) 987 1
test_small_objects[full-deref-100] 582.0203 (1.00) 1,063.1699 (1.64) 594.8336 (1.00) 17.4092 (2.12) 593.1358 (1.0) 6.5200 (1.0) 31;34 1,681.1425 (1.00) 992 1
test_small_objects[full-deref-100] 693.6779 (1.19) 1,410.3930 (2.17) 711.4820 (1.20) 31.0534 (3.77) 707.5781 (1.19) 9.0068 (1.38) 30;39 1,405.5170 (0.84) 892 1
test_small_objects[with-refs-100] 699.6752 (1.20) 1,416.5291 (2.18) 715.5538 (1.20) 25.4091 (3.09) 713.4019 (1.20) 8.3083 (1.27) 20;26 1,397.5191 (0.83) 873 1
test_small_objects[not_validate-full-deref-100] 700.4179 (1.20) 1,465.6107 (2.26) 717.7927 (1.21) 31.6534 (3.85) 715.0478 (1.21) 9.9686 (1.53) 19;24 1,393.1599 (0.83) 632 1
test_small_objects[not_validate-with-refs-100] 701.1979 (1.21) 772.6196 (1.19) 716.8453 (1.21) 9.8395 (1.20) 715.2001 (1.21) 9.5470 (1.46) 113;33 1,395.0011 (0.83) 858 1
test_large_objects[full-deref-100] 1,913.2816 (3.29) 2,602.9032 (4.01) 1,931.7512 (3.25) 38.7516 (4.71) 1,925.4675 (3.25) 7.3384 (1.13) 18;37 517.6650 (0.31) 410 1
test_large_objects[with-refs-100] 1,921.9802 (3.30) 2,055.6417 (3.17) 1,938.8796 (3.26) 19.4327 (2.36) 1,934.7114 (3.26) 7.8533 (1.20) 17;24 515.7618 (0.31) 345 1
test_large_objects[full-deref-100] 2,407.5550 (4.14) 3,167.3936 (4.88) 2,466.7142 (4.15) 50.6525 (6.15) 2,463.9461 (4.15) 34.1677 (5.24) 25;14 405.3976 (0.24) 359 1
test_large_objects[not_validate-full-deref-100] 2,415.1946 (4.15) 3,212.0338 (4.95) 2,463.4776 (4.14) 50.0307 (6.08) 2,458.8169 (4.15) 32.4192 (4.97) 21;20 405.9302 (0.24) 355 1
test_large_objects[with-refs-100] 2,431.1310 (4.18) 53,400.5617 (82.23) 2,623.3289 (4.41) 2,742.2170 (333.17) 2,474.3839 (4.17) 44.9931 (6.90) 1;10 381.1951 (0.23) 345 1
test_large_objects[not_validate-with-refs-100] 2,434.1010 (4.18) 3,323.1508 (5.12) 2,494.0634 (4.19) 55.3516 (6.73) 2,492.1093 (4.20) 41.7437 (6.40) 17;11 400.9521 (0.24) 350 1
test_small_objects[validate-full-deref-100] 4,426.6470 (7.61) 5,287.2188 (8.14) 4,504.0755 (7.57) 72.7461 (8.84) 4,490.0072 (7.57) 33.7452 (5.18) 12;14 222.0211 (0.13) 175 1
test_small_objects[validate-with-refs-100] 5,554.9340 (9.55) 6,615.7640 (10.19) 5,631.5496 (9.47) 96.9293 (11.78) 5,613.7647 (9.46) 36.6373 (5.62) 7;13 177.5710 (0.11) 149 1
test_small_objects[full-deref-1000] 5,903.0387 (10.15) 50,599.9681 (77.92) 6,325.9054 (10.64) 3,715.8912 (451.47) 6,005.5587 (10.13) 41.0008 (6.29) 1;12 158.0801 (0.09) 144 1
test_small_objects[with-refs-1000] 5,978.0860 (10.27) 48,094.3411 (74.06) 6,403.8454 (10.77) 3,427.8235 (416.47) 6,108.3473 (10.30) 53.1878 (8.16) 1;16 156.1562 (0.09) 150 1
test_small_objects[not_validate-full-deref-1000] 7,115.4973 (12.23) 62,812.4052 (96.72) 8,069.6357 (13.57) 6,505.9810 (790.45) 7,226.2352 (12.18) 119.5185 (18.33) 2;4 123.9213 (0.07) 131 1
test_small_objects[full-deref-1000] 7,144.3859 (12.28) 55,421.6881 (85.34) 7,940.6486 (13.35) 5,392.6391 (655.19) 7,270.7357 (12.26) 99.0434 (15.19) 2;7 125.9343 (0.07) 134 1
test_small_objects[with-refs-1000] 7,200.1643 (12.38) 53,752.6770 (82.77) 7,699.9616 (12.95) 4,170.3144 (506.68) 7,305.3464 (12.32) 87.6756 (13.45) 1;5 129.8708 (0.08) 124 1
test_small_objects[not_validate-with-refs-1000] 7,230.6120 (12.43) 64,086.2300 (98.68) 7,785.3562 (13.09) 4,957.8346 (602.36) 7,340.8829 (12.38) 99.7444 (15.30) 1;3 128.4463 (0.08) 131 1
test_large_objects[validate-full-deref-100] 17,365.6419 (29.85) 18,400.5187 (28.33) 17,593.0011 (29.58) 162.1932 (19.71) 17,573.8984 (29.63) 166.1829 (25.49) 9;2 56.8408 (0.03) 54 1
test_large_objects[full-deref-1000] 19,293.8093 (33.16) 60,312.4299 (92.87) 21,097.1470 (35.47) 7,903.7291 (960.27) 19,492.1037 (32.86) 171.6488 (26.33) 2;4 47.3998 (0.03) 50 1
test_large_objects[with-refs-1000] 19,428.5661 (33.39) 19,936.6142 (30.70) 19,654.6456 (33.05) 141.6553 (17.21) 19,679.9440 (33.18) 155.3362 (23.82) 5;0 50.8786 (0.03) 15 1
test_large_objects[validate-with-refs-100] 21,908.1570 (37.65) 22,878.3069 (35.23) 22,184.0055 (37.30) 149.8864 (18.21) 22,166.3630 (37.37) 129.5377 (19.87) 8;2 45.0775 (0.03) 43 1
test_large_objects[full-deref-1000] 24,480.3522 (42.08) 74,805.4292 (115.19) 29,510.2352 (49.62) 14,026.5788 (>1000.0) 24,888.2680 (41.96) 559.9449 (85.88) 4;4 33.8865 (0.02) 40 1
test_large_objects[with-refs-1000] 24,673.6282 (42.41) 74,394.1008 (114.56) 29,783.1363 (50.08) 14,331.1064 (>1000.0) 25,100.8389 (42.32) 418.6553 (64.21) 4;4 33.5760 (0.02) 40 1
test_large_objects[not_validate-full-deref-1000] 24,702.1830 (42.46) 89,071.5793 (137.16) 31,191.7457 (52.45) 18,501.3167 (>1000.0) 25,087.4988 (42.30) 537.7589 (82.48) 4;4 32.0598 (0.02) 40 1
test_large_objects[not_validate-with-refs-1000] 24,810.5288 (42.64) 91,063.5074 (140.23) 31,423.9906 (52.84) 18,898.0006 (>1000.0) 25,203.8052 (42.49) 458.6137 (70.34) 4;4 31.8228 (0.02) 40 1
test_small_objects[with-refs-5000] 29,825.4667 (51.26) 76,913.9300 (118.44) 34,973.5215 (58.81) 13,413.0050 (>1000.0) 30,705.6592 (51.77) 454.2490 (69.67) 3;3 28.5931 (0.02) 31 1
test_small_objects[full-deref-5000] 30,537.3818 (52.49) 74,711.9891 (115.05) 35,229.8384 (59.24) 13,026.5301 (>1000.0) 31,069.7593 (52.38) 371.0184 (56.91) 3;3 28.3850 (0.02) 31 1
test_small_objects[not_validate-full-deref-5000] 36,350.7527 (62.48) 96,565.3323 (148.70) 47,859.9288 (80.47) 23,128.4707 (>1000.0) 36,806.1918 (62.05) 771.9970 (118.41) 5;5 20.8943 (0.01) 26 1
test_small_objects[full-deref-5000] 36,418.8440 (62.59) 83,658.2687 (128.82) 40,655.3071 (68.36) 13,544.0257 (>1000.0) 36,712.5925 (61.90) 431.2936 (66.15) 1;1 24.5970 (0.01) 12 1
test_small_objects[not_validate-with-refs-5000] 36,438.7911 (62.63) 95,165.1339 (146.54) 42,281.1874 (71.09) 17,542.8812 (>1000.0) 37,188.2380 (62.70) 671.0289 (102.92) 1;1 23.6512 (0.01) 11 1
test_small_objects[with-refs-5000] 36,519.7412 (62.77) 85,153.0000 (131.13) 44,736.8529 (75.22) 18,575.7739 (>1000.0) 36,843.4412 (62.12) 502.2939 (77.04) 2;2 22.3529 (0.01) 12 1
test_small_objects[validate-full-deref-1000] 44,359.9271 (76.24) 45,704.3932 (70.38) 44,780.8543 (75.30) 319.0999 (38.77) 44,720.6311 (75.40) 297.2768 (45.59) 5;2 22.3310 (0.01) 22 1
test_small_objects[validate-with-refs-1000] 55,786.3321 (95.88) 57,386.2297 (88.37) 56,256.6146 (94.59) 397.3091 (48.27) 56,120.6064 (94.62) 392.8589 (60.25) 4;1 17.7757 (0.01) 18 1
test_large_objects[full-deref-5000] 101,134.5172 (173.82) 158,850.2699 (244.61) 118,572.4900 (199.37) 27,218.6821 (>1000.0) 101,976.0191 (171.93) 56,313.3559 (>1000.0) 3;0 8.4337 (0.01) 10 1
test_large_objects[with-refs-5000] 102,244.6160 (175.73) 161,594.1380 (248.83) 120,165.7443 (202.05) 27,938.1605 (>1000.0) 102,909.0895 (173.50) 56,815.4487 (>1000.0) 3;0 8.3218 (0.00) 10 1
test_large_objects[with-refs-5000] 130,446.5057 (224.20) 190,018.8518 (292.61) 166,664.4706 (280.24) 29,807.0422 (>1000.0) 186,564.4460 (314.54) 58,195.3218 (>1000.0) 3;0 6.0001 (0.00) 8 1
test_large_objects[full-deref-5000] 130,725.7582 (224.68) 189,438.8408 (291.71) 166,798.7160 (280.47) 29,748.1500 (>1000.0) 187,554.4495 (316.21) 57,628.0642 (>1000.0) 3;0 5.9952 (0.00) 8 1
test_large_objects[not_validate-with-refs-5000] 130,851.4033 (224.90) 202,297.6950 (311.51) 159,802.4525 (268.70) 38,476.8607 (>1000.0) 132,499.1630 (223.39) 70,230.0551 (>1000.0) 2;0 6.2577 (0.00) 5 1
test_large_objects[not_validate-full-deref-5000] 131,490.8084 (226.00) 203,610.5939 (313.54) 160,152.8675 (269.29) 39,063.8843 (>1000.0) 131,775.1883 (222.17) 71,024.0399 (>1000.0) 2;0 6.2440 (0.00) 5 1
test_large_objects[validate-full-deref-1000] 173,285.3819 (297.83) 233,355.0141 (359.34) 183,652.8932 (308.80) 24,352.3140 (>1000.0) 173,798.2135 (293.02) 940.9059 (144.31) 1;1 5.4451 (0.00) 6 1
test_large_objects[validate-with-refs-1000] 219,006.3042 (376.41) 221,282.8752 (340.75) 219,881.2041 (369.72) 920.6184 (111.85) 220,002.6331 (370.91) 1,268.8525 (194.61) 1;0 4.5479 (0.00) 5 1
test_small_objects[validate-full-deref-5000] 222,974.9397 (383.23) 277,891.5898 (427.92) 234,783.8971 (394.78) 24,110.0131 (>1000.0) 224,469.2789 (378.44) 14,728.8550 (>1000.0) 1;1 4.2592 (0.00) 5 1
test_small_objects[validate-with-refs-5000] 278,768.4030 (479.13) 281,359.2539 (433.26) 280,340.0196 (471.38) 960.5001 (116.70) 280,502.4502 (472.91) 945.8504 (145.07) 2;0 3.5671 (0.00) 5 1
test_large_objects[validate-full-deref-5000] 883,525.3632 (>1000.0) 962,045.9061 (>1000.0) 915,356.3936 (>1000.0) 39,978.7423 (>1000.0) 889,687.1167 (>1000.0) 72,479.6068 (>1000.0) 2;0 1.0925 (0.00) 5 1
test_large_objects[validate-with-refs-5000] 1,108,060.9299 (>1000.0) 1,170,446.8760 (>1000.0) 1,145,040.3069 (>1000.0) 33,677.8427 (>1000.0) 1,169,118.8840 (>1000.0) 61,412.1599 (>1000.0) 2;0 0.8733 (0.00) 5 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
================================================================================== short test summary info ==================================================================================
SKIPPED [1] tests/model/create_model_repr_test.py:16: py2 has ascii default strings
FAILED tests/validate/validate_primitive_test.py::test_string_datetime_invalid_exception - Failed: DID NOT RAISE <class 'jsonschema.exceptions.ValidationError'>
==================================================== 1 failed, 908 passed, 1 skipped, 2 deselected, 10662 warnings in 103.23s (0:01:43) =====================================================Here is list of installed modules in build env Package Version
----------------------------- -------
alabaster 0.7.13
asttokens 2.2.1
attrs 23.1.0
Babel 2.12.1
backcall 0.2.0
build 0.10.0
charset-normalizer 3.1.0
decorator 5.1.1
distro 1.8.0
docutils 0.19
exceptiongroup 1.1.1
executing 1.2.0
gpg 1.20.0
idna 3.4
imagesize 1.4.1
importlib-metadata 6.6.0
importlib-resources 5.12.0
iniconfig 2.0.0
installer 0.7.0
ipython 8.12.0
jedi 0.18.2
Jinja2 3.1.2
jsonref 1.1.0
jsonschema 4.17.3
libcomps 0.1.19
MarkupSafe 2.1.2
matplotlib-inline 0.1.6
msgpack 1.0.5
packaging 23.1
parso 0.8.3
pexpect 4.8.0
pickleshare 0.7.5
pkgutil_resolve_name 1.3.10
pluggy 1.0.0
prompt-toolkit 3.0.38
ptyprocess 0.7.0
pure-eval 0.2.2
py-cpuinfo 9.0.0
Pygments 2.15.1
pyproject_hooks 1.0.0
pyrsistent 0.19.3
pytest 7.3.1
pytest-benchmark 4.0.0
python-dateutil 2.8.2
pytz 2023.2
PyYAML 6.0
requests 2.31.0
setuptools 67.7.2
simplejson 3.19.1
six 1.16.0
snowballstemmer 2.2.0
Sphinx 6.2.1
sphinx-rtd-theme 1.2.1
sphinxcontrib-applehelp 1.0.4
sphinxcontrib-devhelp 1.0.2
sphinxcontrib-htmlhelp 2.0.0
sphinxcontrib-jquery 4.1
sphinxcontrib-jsmath 1.0.1
sphinxcontrib-qthelp 1.0.3
sphinxcontrib-serializinghtml 1.1.5
stack-data 0.6.2
swagger-spec-validator 3.0.3
tomli 2.0.1
traitlets 5.9.0
typing_extensions 4.5.0
urllib3 1.26.15
wcwidth 0.2.6
wheel 0.40.0
zipp 3.15.0 |
|
Is this issue still active? |
|
One sec. Let me check latest version. |
|
Something still is wrong. Here is pytest output with deselected those two units in which pytests runs forever. + PYTHONPATH=/home/tkloczko/rpmbuild/BUILDROOT/python-bravado-core-6.1.0-2.fc35.x86_64/usr/lib64/python3.8/site-packages:/home/tkloczko/rpmbuild/BUILDROOT/python-bravado-core-6.1.0-2.fc35.x86_64/usr/lib/python3.8/site-packages
+ /usr/bin/pytest -ra -m 'not network' --deselect tests/spec/Spec/deref_flattened_spec_test.py::test_build_spec_object_with_recursive_specs_and_fully_dereference --deselect 'tests/spec/Spec/equality_test.py::test_equality_of_specs_with_recursive_definition[True]'
============================= test session starts ==============================
platform linux -- Python 3.8.18, pytest-7.4.3, pluggy-1.3.0
benchmark: 4.0.0 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /home/tkloczko/rpmbuild/BUILD/bravado-core-6.1.0
configfile: tox.ini
plugins: benchmark-4.0.0
collected 911 items / 2 deselected / 909 selected
tests/_decorators_test.py ......... [ 0%]
tests/security_test.py ...... [ 1%]
tests/util_test.py .......................... [ 4%]
tests/docstring/create_operation_docstring_test.py ....... [ 5%]
tests/docstring/create_param_docstring_test.py ...... [ 5%]
tests/docstring/formatted_type_test.py ..... [ 6%]
tests/exception/wrap_exception_test.py .. [ 6%]
tests/formatter/to_python_test.py ............... [ 8%]
tests/formatter/to_wire_test.py .................. [ 10%]
tests/marshal/marshal_array_test.py ........... [ 11%]
tests/marshal/marshal_model_test.py ........ [ 12%]
tests/marshal/marshal_object_test.py ...................... [ 14%]
tests/marshal/marshal_primitive_test.py ....... [ 15%]
tests/marshal/marshal_schema_object_test.py ....... [ 16%]
tests/model/bless_models_test.py ....... [ 17%]
tests/model/collect_models_test.py .... [ 17%]
tests/model/compare_test.py ... [ 17%]
tests/model/create_model_docstring_test.py .. [ 18%]
tests/model/create_model_repr_test.py ... [ 18%]
tests/model/create_model_type_test.py ......... [ 19%]
tests/model/get_model_name_test.py .... [ 19%]
tests/model/is_model_test.py .... [ 20%]
tests/model/is_object_test.py ...... [ 21%]
tests/model/model_constructor_test.py ....... [ 21%]
tests/model/model_discovery_test.py ... [ 22%]
tests/model/model_test.py .................................. [ 25%]
tests/model/pickling_test.py .. [ 26%]
tests/model/post_process_spec_test.py ... [ 26%]
tests/model/tag_models_test.py ....... [ 27%]
tests/operation/build_params_test.py ....... [ 27%]
tests/operation/consumes_test.py .... [ 28%]
tests/operation/equality_test.py ....... [ 29%]
tests/operation/operation_id_test.py ............ [ 30%]
tests/operation/produces_test.py .... [ 30%]
tests/operation/security_object_test.py ................................ [ 34%]
. [ 34%]
tests/param/add_file_test.py .... [ 34%]
tests/param/cast_request_param_test.py ........... [ 36%]
tests/param/get_param_type_spec_test.py .... [ 36%]
tests/param/marshal_collection_format_test.py .... [ 37%]
tests/param/marshal_param_test.py ................................ [ 40%]
tests/param/string_to_boolean_test.py ... [ 40%]
tests/param/stringify_body_test.py .. [ 41%]
tests/param/unmarshal_collection_format_test.py ........... [ 42%]
tests/param/unmarshal_param_test.py ........................ [ 44%]
tests/profiling/marshal_profiler_test.py ............ [ 46%]
tests/profiling/unmarshal_profiler_test.py ............ [ 47%]
tests/profiling/unmarshal_response_profiler_test.py .................... [ 49%]
.... [ 50%]
tests/request/IncomingRequest_test.py ... [ 50%]
tests/request/unmarshal_request_test.py .... [ 51%]
tests/resource/build_resources_test.py ............ [ 52%]
tests/resource/convert_path_to_resource_test.py ... [ 52%]
tests/resource/deepcopy_test.py . [ 52%]
tests/resource/equality_test.py ...... [ 53%]
tests/response/IncomingResponse_test.py .... [ 53%]
tests/response/get_response_spec_test.py ... [ 54%]
tests/response/unmarshal_response_test.py ......... [ 55%]
tests/response/validate_response_body_test.py ....... [ 55%]
tests/response/validate_response_headers_test.py .... [ 56%]
tests/response/validate_response_test.py .. [ 56%]
tests/schema/collapsed_properties_test.py .. [ 56%]
tests/schema/collapsed_required_test.py . [ 56%]
tests/schema/get_format_test.py .... [ 57%]
tests/schema/get_spec_for_prop_test.py .......... [ 58%]
tests/schema/handle_null_value_test.py ... [ 58%]
tests/schema/has_format_test.py .... [ 59%]
tests/schema/is_param_spec_test.py .... [ 59%]
tests/schema/is_prop_nullable_test.py ..... [ 60%]
tests/schema/is_required_test.py ...... [ 60%]
tests/spec/build_api_serving_url_test.py ................. [ 62%]
tests/spec/build_http_handlers_test.py ........ [ 63%]
tests/spec/from_dict_test.py ......... [ 64%]
tests/spec/pickling_test.py ..... [ 65%]
tests/spec/Spec/build_test.py ................ [ 66%]
tests/spec/Spec/deepcopy_test.py . [ 67%]
tests/spec/Spec/deref_flattened_spec_test.py .. [ 67%]
tests/spec/Spec/deref_test.py ..... [ 67%]
tests/spec/Spec/equality_test.py ............. [ 69%]
tests/spec/Spec/flattened_spec_test.py ................................. [ 72%]
... [ 73%]
tests/spec/Spec/get_op_for_request_test.py ..... [ 73%]
tests/swagger20_validator/enum_validator_test.py ...... [ 74%]
tests/swagger20_validator/format_validator_test.py ......... [ 75%]
tests/swagger20_validator/ref_validator_test.py .. [ 75%]
tests/swagger20_validator/required_validator_test.py ... [ 76%]
tests/swagger20_validator/type_validator_test.py ..... [ 76%]
tests/unmarshal/unmarshal_array_test.py ........ [ 77%]
tests/unmarshal/unmarshal_model_test.py ................... [ 79%]
tests/unmarshal/unmarshal_object_test.py ............................... [ 82%]
.......................... [ 85%]
tests/unmarshal/unmarshal_primitive_test.py .............. [ 87%]
tests/unmarshal/unmarshal_schema_object_test.py ........ [ 88%]
tests/validate/validate_array_test.py ........... [ 89%]
tests/validate/validate_object_test.py ................................. [ 93%]
...... [ 93%]
tests/validate/validate_primitive_test.py .............................. [ 97%]
F........ [ 98%]
tests/validate/validate_schema_object_test.py .... [ 98%]
tests/validate/validate_security_object_test.py .............. [100%]
=================================== FAILURES ===================================
____________________ test_string_datetime_invalid_exception ____________________
minimal_swagger_spec = <bravado_core.spec.Spec object at 0x7f29f73323d0>
string_spec = {'format': 'date-time', 'type': 'string'}
def test_string_datetime_invalid_exception(minimal_swagger_spec, string_spec):
string_spec['format'] = 'date-time'
datestring = "nope nope nope"
with pytest.raises(ValidationError) as excinfo:
> validate_primitive(minimal_swagger_spec, string_spec, datestring)
E Failed: DID NOT RAISE <class 'jsonschema.exceptions.ValidationError'>
tests/validate/validate_primitive_test.py:221: Failed
=============================== warnings summary ===============================
../../../../../usr/lib/python3.8/site-packages/swagger_spec_validator/common.py:16
/usr/lib/python3.8/site-packages/swagger_spec_validator/common.py:16: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
from pkg_resources import resource_filename
../../../../../usr/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../../../../usr/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
/usr/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('sphinxcontrib')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../../../../usr/lib/python3.8/site-packages/swagger_spec_validator/validator12.py:18
../../../../../usr/lib/python3.8/site-packages/swagger_spec_validator/validator12.py:18
/usr/lib/python3.8/site-packages/swagger_spec_validator/validator12.py:18: DeprecationWarning: jsonschema.RefResolver is deprecated as of v4.18.0, in favor of the https://github.com/python-jsonschema/referencing library, which provides more compliant referencing behavior as well as more flexible APIs for customization. A future release will remove RefResolver. Please file a feature request (on referencing) if you are missing an API for the kind of customization you need.
from jsonschema import RefResolver
../../../../../usr/lib/python3.8/site-packages/swagger_spec_validator/ref_validators.py:14
/usr/lib/python3.8/site-packages/swagger_spec_validator/ref_validators.py:14: DeprecationWarning: jsonschema.RefResolver is deprecated as of v4.18.0, in favor of the https://github.com/python-jsonschema/referencing library, which provides more compliant referencing behavior as well as more flexible APIs for customization. A future release will remove RefResolver. Please file a feature request (on referencing) if you are missing an API for the kind of customization you need.
from jsonschema.validators import RefResolver
../../../../../usr/lib/python3.8/site-packages/swagger_spec_validator/validator20.py:18
/usr/lib/python3.8/site-packages/swagger_spec_validator/validator20.py:18: DeprecationWarning: jsonschema.RefResolver is deprecated as of v4.18.0, in favor of the https://github.com/python-jsonschema/referencing library, which provides more compliant referencing behavior as well as more flexible APIs for customization. A future release will remove RefResolver. Please file a feature request (on referencing) if you are missing an API for the kind of customization you need.
from jsonschema.validators import RefResolver
bravado_core/spec.py:14
/home/tkloczko/rpmbuild/BUILD/bravado-core-6.1.0/bravado_core/spec.py:14: DeprecationWarning: jsonschema.RefResolver is deprecated as of v4.18.0, in favor of the https://github.com/python-jsonschema/referencing library, which provides more compliant referencing behavior as well as more flexible APIs for customization. A future release will remove RefResolver. Please file a feature request (on referencing) if you are missing an API for the kind of customization you need.
from jsonschema.validators import RefResolver
bravado_core/swagger20_validator.py:6
bravado_core/swagger20_validator.py:6
/home/tkloczko/rpmbuild/BUILD/bravado-core-6.1.0/bravado_core/swagger20_validator.py:6: DeprecationWarning: jsonschema.RefResolver is deprecated as of v4.18.0, in favor of the https://github.com/python-jsonschema/referencing library, which provides more compliant referencing behavior as well as more flexible APIs for customization. A future release will remove RefResolver. Please file a feature request (on referencing) if you are missing an API for the kind of customization you need.
from jsonschema import RefResolver
tests/spec/Spec/deref_test.py:3
/home/tkloczko/rpmbuild/BUILD/bravado-core-6.1.0/tests/spec/Spec/deref_test.py:3: DeprecationWarning: jsonschema.exceptions.RefResolutionError is deprecated as of version 4.18.0. If you wish to catch potential reference resolution errors, directly catch referencing.exceptions.Unresolvable.
from jsonschema.exceptions import RefResolutionError
tests/swagger20_validator/ref_validator_test.py:3
/home/tkloczko/rpmbuild/BUILD/bravado-core-6.1.0/tests/swagger20_validator/ref_validator_test.py:3: DeprecationWarning: jsonschema.RefResolver is deprecated as of v4.18.0, in favor of the https://github.com/python-jsonschema/referencing library, which provides more compliant referencing behavior as well as more flexible APIs for customization. A future release will remove RefResolver. Please file a feature request (on referencing) if you are missing an API for the kind of customization you need.
from jsonschema.validators import RefResolver
tests/_decorators_test.py: 112 warnings
tests/security_test.py: 102 warnings
tests/util_test.py: 16 warnings
tests/formatter/to_python_test.py: 243 warnings
tests/formatter/to_wire_test.py: 291 warnings
tests/marshal/marshal_array_test.py: 17 warnings
tests/marshal/marshal_model_test.py: 150 warnings
tests/marshal/marshal_object_test.py: 136 warnings
tests/marshal/marshal_primitive_test.py: 64 warnings
tests/marshal/marshal_schema_object_test.py: 68 warnings
tests/model/create_model_docstring_test.py: 32 warnings
tests/model/create_model_repr_test.py: 17 warnings
tests/model/create_model_type_test.py: 32 warnings
tests/model/is_model_test.py: 32 warnings
tests/model/is_object_test.py: 97 warnings
tests/model/model_constructor_test.py: 17 warnings
tests/model/model_discovery_test.py: 83 warnings
tests/model/model_test.py: 563 warnings
tests/model/pickling_test.py: 34 warnings
tests/operation/consumes_test.py: 68 warnings
tests/operation/equality_test.py: 160 warnings
tests/operation/produces_test.py: 68 warnings
tests/operation/security_object_test.py: 287 warnings
tests/param/marshal_param_test.py: 66 warnings
tests/param/unmarshal_param_test.py: 34 warnings
tests/profiling/marshal_profiler_test.py: 582 warnings
tests/profiling/unmarshal_profiler_test.py: 582 warnings
tests/profiling/unmarshal_response_profiler_test.py: 1164 warnings
tests/request/unmarshal_request_test.py: 64 warnings
tests/resource/deepcopy_test.py: 16 warnings
tests/resource/equality_test.py: 144 warnings
tests/response/unmarshal_response_test.py: 51 warnings
tests/response/validate_response_body_test.py: 112 warnings
tests/response/validate_response_headers_test.py: 64 warnings
tests/schema/collapsed_properties_test.py: 17 warnings
tests/schema/collapsed_required_test.py: 17 warnings
tests/schema/get_format_test.py: 66 warnings
tests/schema/get_spec_for_prop_test.py: 164 warnings
tests/schema/has_format_test.py: 66 warnings
tests/schema/is_param_spec_test.py: 66 warnings
tests/schema/is_prop_nullable_test.py: 82 warnings
tests/schema/is_required_test.py: 65 warnings
tests/spec/from_dict_test.py: 341 warnings
tests/spec/pickling_test.py: 146 warnings
tests/spec/Spec/build_test.py: 199 warnings
tests/spec/Spec/deepcopy_test.py: 16 warnings
tests/spec/Spec/deref_flattened_spec_test.py: 85 warnings
tests/spec/Spec/deref_test.py: 82 warnings
tests/spec/Spec/equality_test.py: 385 warnings
tests/spec/Spec/flattened_spec_test.py: 501 warnings
tests/spec/Spec/get_op_for_request_test.py: 83 warnings
tests/swagger20_validator/enum_validator_test.py: 48 warnings
tests/swagger20_validator/format_validator_test.py: 144 warnings
tests/swagger20_validator/required_validator_test.py: 48 warnings
tests/swagger20_validator/type_validator_test.py: 80 warnings
tests/unmarshal/unmarshal_array_test.py: 17 warnings
tests/unmarshal/unmarshal_model_test.py: 322 warnings
tests/unmarshal/unmarshal_object_test.py: 187 warnings
tests/unmarshal/unmarshal_primitive_test.py: 225 warnings
tests/unmarshal/unmarshal_schema_object_test.py: 136 warnings
tests/validate/validate_array_test.py: 176 warnings
tests/validate/validate_object_test.py: 396 warnings
tests/validate/validate_primitive_test.py: 624 warnings
tests/validate/validate_schema_object_test.py: 66 warnings
tests/validate/validate_security_object_test.py: 238 warnings
/home/tkloczko/rpmbuild/BUILD/bravado-core-6.1.0/bravado_core/model.py:888: DeprecationWarning: jsonschema.RefResolver.in_scope is deprecated and will be removed in a future release.
with spec.resolver.in_scope(additional_uri):
tests/model/model_test.py: 2 warnings
tests/profiling/unmarshal_response_profiler_test.py: 239400 warnings
tests/response/unmarshal_response_test.py: 3 warnings
tests/validate/validate_object_test.py: 26 warnings
/home/tkloczko/rpmbuild/BUILD/bravado-core-6.1.0/bravado_core/swagger20_validator.py:288: DeprecationWarning: Accessing Validator.resolver is deprecated as of v4.18.0, in favor of the https://github.com/python-jsonschema/referencing library, which provides more compliant referencing behavior as well as more flexible APIs for customization.
resolve = getattr(validator.resolver, "resolve")
tests/model/model_test.py: 2 warnings
tests/profiling/unmarshal_response_profiler_test.py: 239400 warnings
tests/response/unmarshal_response_test.py: 3 warnings
tests/validate/validate_object_test.py: 26 warnings
/home/tkloczko/rpmbuild/BUILD/bravado-core-6.1.0/bravado_core/swagger20_validator.py:295: DeprecationWarning: Accessing Validator.resolver is deprecated as of v4.18.0, in favor of the https://github.com/python-jsonschema/referencing library, which provides more compliant referencing behavior as well as more flexible APIs for customization.
with in_scope(validator.resolver, schema):
tests/model/model_test.py: 2 warnings
tests/profiling/unmarshal_response_profiler_test.py: 239400 warnings
tests/response/unmarshal_response_test.py: 3 warnings
tests/validate/validate_object_test.py: 26 warnings
/home/tkloczko/rpmbuild/BUILD/bravado-core-6.1.0/bravado_core/swagger20_validator.py:296: DeprecationWarning: Accessing Validator.resolver is deprecated as of v4.18.0, in favor of the https://github.com/python-jsonschema/referencing library, which provides more compliant referencing behavior as well as more flexible APIs for customization.
scope, resolved = validator.resolver.resolve(ref)
tests/model/model_test.py: 2 warnings
tests/profiling/unmarshal_response_profiler_test.py: 239400 warnings
tests/response/unmarshal_response_test.py: 3 warnings
tests/validate/validate_object_test.py: 26 warnings
/home/tkloczko/rpmbuild/BUILD/bravado-core-6.1.0/bravado_core/swagger20_validator.py:297: DeprecationWarning: Accessing Validator.resolver is deprecated as of v4.18.0, in favor of the https://github.com/python-jsonschema/referencing library, which provides more compliant referencing behavior as well as more flexible APIs for customization.
validator.resolver.push_scope(scope)
tests/model/model_test.py: 2 warnings
tests/profiling/unmarshal_response_profiler_test.py: 239400 warnings
tests/response/unmarshal_response_test.py: 3 warnings
tests/validate/validate_object_test.py: 26 warnings
/home/tkloczko/rpmbuild/BUILD/bravado-core-6.1.0/bravado_core/swagger20_validator.py:303: DeprecationWarning: Accessing Validator.resolver is deprecated as of v4.18.0, in favor of the https://github.com/python-jsonschema/referencing library, which provides more compliant referencing behavior as well as more flexible APIs for customization.
validator.resolver.pop_scope()
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
--------------------------------------------------------------------------------------------------------------------- benchmark: 48 tests ---------------------------------------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_small_objects[full-deref-100] 592.6630 (1.0) 977.3730 (1.39) 608.1177 (1.00) 19.7870 (1.23) 601.6342 (1.00) 5.7348 (1.37) 145;159 1,644.4184 (1.00) 963 1
test_small_objects[with-refs-100] 593.2311 (1.00) 703.4880 (1.0) 607.2367 (1.0) 16.0968 (1.0) 601.1165 (1.0) 4.1999 (1.0) 151;161 1,646.8043 (1.0) 1004 1
test_small_objects[full-deref-100] 713.3821 (1.20) 1,106.2799 (1.57) 742.2277 (1.22) 32.9305 (2.05) 729.7189 (1.21) 12.7744 (3.04) 127;172 1,347.2954 (0.82) 813 1
test_small_objects[with-refs-100] 716.5391 (1.21) 838.5640 (1.19) 739.3786 (1.22) 22.1281 (1.37) 731.7439 (1.22) 14.9315 (3.56) 141;139 1,352.4870 (0.82) 915 1
test_small_objects[not_validate-with-refs-100] 719.5929 (1.21) 805.4909 (1.14) 742.8004 (1.22) 19.3610 (1.20) 736.2708 (1.22) 10.3782 (2.47) 136;137 1,346.2567 (0.82) 819 1
test_small_objects[not_validate-full-deref-100] 721.9850 (1.22) 847.1250 (1.20) 744.1137 (1.23) 22.7911 (1.42) 735.1581 (1.22) 13.2836 (3.16) 147;149 1,343.8806 (0.82) 784 1
test_large_objects[full-deref-100] 1,934.0802 (3.26) 2,306.9680 (3.28) 1,968.3582 (3.24) 49.6838 (3.09) 1,949.1690 (3.24) 11.9515 (2.85) 59;71 508.0376 (0.31) 416 1
test_large_objects[with-refs-100] 1,948.3711 (3.29) 2,183.7130 (3.10) 1,979.5724 (3.26) 47.3741 (2.94) 1,959.5381 (3.26) 11.0815 (2.64) 55;68 505.1596 (0.31) 400 1
test_large_objects[with-refs-100] 2,457.5940 (4.15) 2,732.7670 (3.88) 2,511.4180 (4.14) 65.3043 (4.06) 2,481.6355 (4.13) 40.2452 (9.58) 45;46 398.1814 (0.24) 286 1
test_large_objects[full-deref-100] 2,459.3780 (4.15) 51,207.5070 (72.79) 2,663.8242 (4.39) 2,701.8023 (167.85) 2,496.9100 (4.15) 32.3663 (7.71) 1;49 375.4002 (0.23) 325 1
test_large_objects[not_validate-full-deref-100] 2,465.9559 (4.16) 2,790.5691 (3.97) 2,529.4931 (4.17) 59.3208 (3.69) 2,516.5321 (4.19) 36.6048 (8.72) 43;44 395.3361 (0.24) 291 1
test_large_objects[not_validate-with-refs-100] 2,477.6231 (4.18) 3,011.1431 (4.28) 2,537.9472 (4.18) 67.4259 (4.19) 2,519.1166 (4.19) 52.3110 (12.46) 48;42 394.0192 (0.24) 334 1
test_small_objects[validate-full-deref-100] 3,953.7859 (6.67) 4,377.8960 (6.22) 4,036.3775 (6.65) 95.8118 (5.95) 3,989.9219 (6.64) 78.5505 (18.70) 33;26 247.7469 (0.15) 185 1
test_small_objects[with-refs-1000] 6,030.8289 (10.18) 6,537.7890 (9.29) 6,110.4467 (10.06) 116.5288 (7.24) 6,066.0216 (10.09) 42.6110 (10.15) 17;22 163.6542 (0.10) 138 1
test_small_objects[full-deref-1000] 6,154.0131 (10.38) 52,658.7209 (74.85) 6,805.6768 (11.21) 4,864.2625 (302.19) 6,199.2030 (10.31) 80.5727 (19.18) 2;18 146.9362 (0.09) 149 1
test_small_objects[not_validate-full-deref-1000] 7,253.8252 (12.24) 8,121.2381 (11.54) 7,548.4091 (12.43) 187.4461 (11.64) 7,508.8614 (12.49) 180.9639 (43.09) 32;10 132.4782 (0.08) 122 1
test_small_objects[not_validate-with-refs-1000] 7,318.7251 (12.35) 8,073.4501 (11.48) 7,518.5246 (12.38) 151.5699 (9.42) 7,467.3640 (12.42) 128.7053 (30.64) 26;10 133.0048 (0.08) 119 1
test_small_objects[with-refs-1000] 7,330.8549 (12.37) 56,483.5558 (80.29) 8,254.3953 (13.59) 5,857.6748 (363.90) 7,465.6769 (12.42) 134.4936 (32.02) 2;12 121.1476 (0.07) 123 1
test_small_objects[full-deref-1000] 7,331.4221 (12.37) 57,029.8191 (81.07) 8,246.9399 (13.58) 5,692.1505 (353.62) 7,479.3061 (12.44) 149.7119 (35.65) 2;13 121.2571 (0.07) 127 1
test_small_objects[validate-with-refs-100] 8,132.9821 (13.72) 84,255.8688 (119.77) 10,121.5522 (16.67) 10,103.9966 (627.70) 8,532.5789 (14.19) 443.1547 (105.52) 2;2 98.7991 (0.06) 98 1
test_large_objects[validate-full-deref-100] 15,320.6561 (25.85) 17,213.6629 (24.47) 15,649.0747 (25.77) 401.3390 (24.93) 15,492.2595 (25.77) 307.9484 (73.32) 8;7 63.9015 (0.04) 60 1
test_large_objects[with-refs-1000] 19,579.9640 (33.04) 70,711.1121 (100.52) 22,009.6273 (36.25) 9,714.1173 (603.48) 19,940.2191 (33.17) 403.6236 (96.10) 2;4 45.4347 (0.03) 48 1
test_large_objects[full-deref-1000] 19,583.8809 (33.04) 20,657.9862 (29.37) 20,024.2638 (32.98) 384.4384 (23.88) 19,847.4030 (33.02) 729.4396 (173.68) 7;0 49.9394 (0.03) 15 1
test_large_objects[with-refs-1000] 24,935.1670 (42.07) 74,556.7922 (105.98) 29,245.3782 (48.16) 13,621.3113 (846.21) 25,367.0702 (42.20) 806.6046 (192.05) 1;1 34.1934 (0.02) 13 1
test_large_objects[full-deref-1000] 25,065.0591 (42.29) 75,825.5210 (107.79) 30,677.5491 (50.52) 14,709.7197 (913.83) 25,738.7490 (42.82) 1,205.7342 (287.09) 4;4 32.5971 (0.02) 39 1
test_large_objects[not_validate-full-deref-1000] 25,489.3561 (43.01) 27,269.7350 (38.76) 26,172.8028 (43.10) 487.8274 (30.31) 26,008.1599 (43.27) 514.4929 (122.50) 10;3 38.2076 (0.02) 37 1
test_large_objects[not_validate-with-refs-1000] 25,589.4361 (43.18) 27,169.8709 (38.62) 26,229.7261 (43.20) 427.2562 (26.54) 26,071.1400 (43.37) 587.0174 (139.77) 8;0 38.1247 (0.02) 36 1
test_small_objects[full-deref-5000] 30,580.2091 (51.60) 79,231.1409 (112.63) 35,861.3383 (59.06) 13,604.0311 (845.14) 31,455.1299 (52.33) 911.7189 (217.08) 3;3 27.8852 (0.02) 31 1
test_small_objects[with-refs-5000] 30,965.8649 (52.25) 78,752.0688 (111.95) 36,099.5207 (59.45) 13,901.4049 (863.61) 31,581.9641 (52.54) 806.4650 (192.02) 3;3 27.7012 (0.02) 31 1
test_large_objects[validate-with-refs-100] 33,568.2551 (56.64) 35,233.7291 (50.08) 34,178.0845 (56.28) 490.7273 (30.49) 33,966.0479 (56.50) 869.6624 (207.07) 12;0 29.2585 (0.02) 29 1
test_small_objects[with-refs-5000] 36,936.9520 (62.32) 89,111.1051 (126.67) 45,237.1026 (74.50) 18,079.7190 (>1000.0) 37,719.2625 (62.75) 763.6489 (181.82) 4;4 22.1057 (0.01) 26 1
test_small_objects[full-deref-5000] 37,152.6110 (62.69) 91,440.0809 (129.98) 47,084.5396 (77.54) 19,105.7244 (>1000.0) 38,231.3451 (63.60) 1,474.0361 (350.97) 5;5 21.2384 (0.01) 27 1
test_small_objects[not_validate-full-deref-5000] 38,205.2909 (64.46) 432,092.6531 (614.21) 54,995.4783 (90.57) 78,568.2885 (>1000.0) 39,040.3471 (64.95) 1,381.6284 (328.97) 1;1 18.1833 (0.01) 25 1
test_small_objects[not_validate-with-refs-5000] 38,293.6711 (64.61) 41,065.2340 (58.37) 39,469.0130 (65.00) 685.7269 (42.60) 39,304.2320 (65.39) 987.5271 (235.13) 5;0 25.3363 (0.02) 25 1
test_small_objects[validate-full-deref-1000] 39,589.3371 (66.80) 41,502.9861 (59.00) 40,274.9619 (66.32) 550.0393 (34.17) 40,123.0429 (66.75) 968.4154 (230.58) 11;0 24.8293 (0.02) 25 1
test_small_objects[validate-with-refs-1000] 85,501.4790 (144.27) 221,073.3469 (314.25) 107,936.2056 (177.75) 50,684.7302 (>1000.0) 86,493.4644 (143.89) 881.7974 (209.96) 2;2 9.2647 (0.01) 12 1
test_large_objects[full-deref-5000] 102,149.5161 (172.36) 161,900.5739 (230.14) 120,661.0570 (198.71) 28,093.5056 (>1000.0) 103,784.3797 (172.65) 57,863.1230 (>1000.0) 3;0 8.2877 (0.01) 10 1
test_large_objects[with-refs-5000] 103,090.2560 (173.94) 163,717.0149 (232.72) 117,068.3635 (192.79) 26,025.4613 (>1000.0) 104,221.0101 (173.38) 15,260.7043 (>1000.0) 2;2 8.5420 (0.01) 9 1
test_large_objects[not_validate-with-refs-5000] 131,897.1070 (222.55) 1,531,842.8210 (>1000.0) 307,570.4640 (506.51) 494,681.0724 (>1000.0) 132,583.6669 (220.56) 1,204.4630 (286.78) 1;1 3.2513 (0.00) 8 1
test_large_objects[with-refs-5000] 132,333.6910 (223.29) 192,723.9550 (273.95) 162,441.7856 (267.51) 31,848.1627 (>1000.0) 162,226.3584 (269.88) 58,192.5251 (>1000.0) 0;0 6.1561 (0.00) 6 1
test_large_objects[full-deref-5000] 132,697.6561 (223.90) 192,402.0569 (273.50) 162,496.8246 (267.60) 31,133.6533 (>1000.0) 162,413.4629 (270.19) 58,196.1580 (>1000.0) 0;0 6.1540 (0.00) 8 1
test_large_objects[not_validate-full-deref-5000] 132,720.5610 (223.94) 135,093.1870 (192.03) 133,738.2731 (220.24) 860.3530 (53.45) 133,577.4520 (222.22) 1,409.9510 (335.71) 3;0 7.4773 (0.00) 8 1
test_large_objects[validate-full-deref-1000] 157,463.8661 (265.69) 538,681.6810 (765.73) 212,645.3200 (350.19) 143,769.5946 (>1000.0) 158,436.8940 (263.57) 1,098.8082 (261.63) 1;1 4.7027 (0.00) 7 1
test_small_objects[validate-full-deref-5000] 199,991.2800 (337.45) 201,455.6210 (286.37) 200,741.6845 (330.58) 527.3214 (32.76) 200,681.9299 (333.85) 553.6124 (131.82) 2;0 4.9815 (0.00) 5 1
test_large_objects[validate-with-refs-1000] 340,174.8771 (573.98) 840,935.1900 (>1000.0) 441,361.3502 (726.84) 223,373.7926 (>1000.0) 340,934.3211 (567.17) 127,725.3492 (>1000.0) 1;1 2.2657 (0.00) 5 1
test_small_objects[validate-with-refs-5000] 431,852.9479 (728.67) 678,747.6570 (964.83) 524,877.2250 (864.37) 126,310.9421 (>1000.0) 433,891.0570 (721.81) 221,723.4730 (>1000.0) 1;0 1.9052 (0.00) 5 1
test_large_objects[validate-full-deref-5000] 779,967.8589 (>1000.0) 787,504.3331 (>1000.0) 783,249.0524 (>1000.0) 2,934.0774 (182.28) 782,172.6429 (>1000.0) 4,108.3973 (978.21) 2;0 1.2767 (0.00) 5 1
test_large_objects[validate-with-refs-5000] 1,703,638.5350 (>1000.0) 2,514,290.2499 (>1000.0) 2,007,788.7504 (>1000.0) 413,461.1340 (>1000.0) 1,710,246.5869 (>1000.0) 724,101.5536 (>1000.0) 1;0 0.4981 (0.00) 5 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
=========================== short test summary info ============================
FAILED tests/validate/validate_primitive_test.py::test_string_datetime_invalid_exception
== 1 failed, 908 passed, 2 deselected, 1207823 warnings in 136.69s (0:02:16) === |
|
Here is list updated of installed modules in build env Package Version
----------------------------- --------
alabaster 0.7.13
attrs 23.1.0
Babel 2.13.1
build 1.0.3
charset-normalizer 3.3.2
cppclean 0.13
distro 1.8.0
docutils 0.20.1
exceptiongroup 1.1.3
gpg 1.23.0
idna 3.4
imagesize 1.4.1
importlib-metadata 6.8.0
importlib-resources 6.1.0
iniconfig 2.0.0
installer 0.7.0
Jinja2 3.1.2
jsonref 1.1.0
jsonschema 4.19.1
jsonschema-specifications 2023.7.1
MarkupSafe 2.1.3
mock 5.1.0
msgpack 1.0.6
packaging 23.2
pkgutil_resolve_name 1.3.10
pluggy 1.3.0
py-cpuinfo 9.0.0
Pygments 2.16.1
pyproject_hooks 1.0.0
pytest 7.4.3
pytest-benchmark 4.0.0
python-dateutil 2.8.2
pytz 2023.3
PyYAML 6.0.1
referencing 0.30.2
requests 2.31.0
rpds-py 0.12.0
setuptools 68.2.2
simplejson 3.19.2
six 1.16.0
snowballstemmer 2.2.0
Sphinx 7.1.2
sphinx-rtd-theme 1.2.2
sphinxcontrib-applehelp 1.0.4
sphinxcontrib-devhelp 1.0.5
sphinxcontrib-htmlhelp 2.0.4
sphinxcontrib-jquery 4.1
sphinxcontrib-jsmath 1.0.1
sphinxcontrib-qthelp 1.0.3
sphinxcontrib-serializinghtml 1.1.9
swagger-spec-validator 3.0.3
tomli 2.0.1
typing_extensions 4.8.0
urllib3 1.26.18
wheel 0.41.3
zipp 3.17.0 |
|
Any update? |
|
gentle ping .. any update? 🤔 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Looks like something i wrong with that unit because it cannot finish its work saturating in 100 CPU single core
The text was updated successfully, but these errors were encountered: