[Bug] make installcheck-world - 44 of 659 tests failed.

[tuhaihe]

Apache Cloudberry version

main

What happened

After building the Cloudberry on one pure Rocky Linux 9 computer (Not a Docker container), run the test command PGCLIENTENCODING=UTF8 PGOPTIONS='-c optimizer=off' make installcheck-world, more tests failed.

What you think should happen instead

All the tests should pass.

How to reproduce

1. Compile and Build the Cloudberry

Following this doc: https://github.com/edespino/cloudberry/blob/rocky9-dev-readme/deploy/build/README-rockylinux9.md

2. Running the test command:

PGCLIENTENCODING=UTF8 PGOPTIONS='-c optimizer=off' make installcheck-world

Operating System

Rocky Linux 9

Anything else

Results:

=========================
 44 of 659 tests failed.
=========================

The differences that caused some tests to fail can be viewed in the
file "/home/gpadmin/cloudberry/src/test/regress/regression.diffs".  A copy of the test summary that you see
above is saved in the file "/home/gpadmin/cloudberry/src/test/regress/regression.out".

make[2]: *** [GNUmakefile:208: installcheck-good] Error 1
make[2]: Leaving directory '/home/gpadmin/cloudberry/src/test/regress'
make[1]: *** [Makefile:57: installcheck-regress-recurse] Error 2
make[1]: Leaving directory '/home/gpadmin/cloudberry/src/test'
make: *** [GNUmakefile:186: installcheck-world-src/test-recurse] Error 2

See the attachment for details:

regression.diffs.txt

Are you willing to submit PR?

• Yes, I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct.

[my-ship-it]

Seems the differences come from query id incompatible.

[edespino]

@tuhaihe If you have some time, I can review this issue with you in a live session. Let me know if you are interested.

[tuhaihe]

More infos:

[gpadmin@djwang-test-main regress]$ psql -c "select version()"
                                                                                                          version

-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------
 PostgreSQL 14.4 (Cloudberry Database 1.6.0+dev.197.gd162ebd28c build dev) on x86_64-pc-linux-gnu, compiled by gcc (GCC) 11.5.0 20240719 (Red Hat 11.5.0-2), 64-bit compi
led on Dec 17 2024 11:52:17 (with assert checking)
(1 row)



[gpadmin@djwang-test-main regress]$ df -kh
Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        4.0M     0  4.0M   0% /dev
tmpfs            63G  1.8M   63G   1% /dev/shm
tmpfs            26G  8.7M   26G   1% /run
/dev/vda1        50G   14G   33G  30% /
tmpfs            13G     0   13G   0% /run/user/0
[gpadmin@djwang-test-main regress]$ pg_config --configure
 '--prefix=/usr/local/cloudberry-db' '--disable-external-fts' '--enable-debug' '--enable-cassert' '--enable-debug-extensions' '--enable-gpcloud' '--enable-ic-proxy' '--enable-mapreduce' '--enable-orafce' '--enable-orca' '--enable-pxf' '--enable-tap-tests' '--with-gssapi' '--with-ldap' '--with-libxml' '--with-lz4' '--with-pam' '--with-perl' '--with-pgport=5432' '--with-python' '--with-pythonsrc-ext' '--with-ssl=openssl' '--with-openssl' '--with-uuid=e2fs' '--with-includes=/usr/local/xerces-c/include' '--with-libraries=/usr/local/cloudberry-db/lib'


[gpadmin@djwang-test-main regress]$ uname -m
x86_64


[gpadmin@djwang-test-main regress]$ cat /etc/os-release
NAME="Rocky Linux"
VERSION="9.0 (Blue Onyx)"
ID="rocky"
ID_LIKE="rhel centos fedora"
VERSION_ID="9.0"
PLATFORM_ID="platform:el9"
PRETTY_NAME="Rocky Linux 9.0 (Blue Onyx)"
ANSI_COLOR="0;32"
LOGO="fedora-logo-icon"
CPE_NAME="cpe:/o:rocky:rocky:9::baseos"
HOME_URL="https://rockylinux.org/"
BUG_REPORT_URL="https://bugs.rockylinux.org/"
ROCKY_SUPPORT_PRODUCT="Rocky-Linux-9"
ROCKY_SUPPORT_PRODUCT_VERSION="9.0"
REDHAT_SUPPORT_PRODUCT="Rocky Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="9.0"

[edespino]

@tuhaihe Is there any chance you can try this on Rocky Linux 9.5 (something newer than 9.0)?

I'm am trying to reproduce this on AWS EC2. The Rocky Linux public image (ami) only goes starts at 9.1. I'm trying to reproduce your issue with that.

[tuhaihe]

@tuhaihe Is there any chance you can try this on Rocky Linux 9.5 (something newer than 9.0)?

I'm am trying to reproduce this on AWS EC2. The Rocky Linux public image (ami) only goes starts at 9.1. I'm trying to reproduce your issue with that.

No problem. Will try on Rocky Linux 9.5. If any updates, will share them here for your information.

[edespino]

I do not know if this causes an issue, but I noticed the Xerces-c 3.3 check target had a FAIL (1) on 9.1:

============================================================================
Testsuite summary for xerces-c 3.3.0
============================================================================
# TOTAL: 36
# PASS:  31
# SKIP:  0
# XFAIL: 4
# FAIL:  1
# XPASS: 0
# ERROR: 0
============================================================================
See tests/test-suite.log for debugging.
============================================================================

[edespino]

Running on Rocky Linux 9.1 passed:

06:52:37 gpadmin@mdw cloudberry ±|main ✗|→ PGOPTIONS='-c optimizer=on' make --directory=~/cloudberry installcheck
PGOPTIONS='-c optimizer=on' make --directory=~/cloudberry installcheck
make: Entering directory '/home/gpadmin/cloudberry'
make -C ./src/backend generated-headers
make[1]: Entering directory '/home/gpadmin/cloudberry/src/backend'
make -C catalog distprep generated-header-symlinks

....

parallel group (2 tests):  uao_dml/ao_unique_index_build_row uao_dml/ao_unique_index_build_column
     uao_dml/ao_unique_index_build_row ... ok          611 ms (diff   49 ms)
     uao_dml/ao_unique_index_build_column ... ok          613 ms (diff   49 ms)
test bfv_copy                     ... ok          152 ms (diff   42 ms)
test dynamic_table                ... ok          617 ms (diff   55 ms)

=======================
 All 659 tests passed. 
=======================

make[1]: Leaving directory '/home/gpadmin/cloudberry/src/test/regress'
make: Leaving directory '/home/gpadmin/cloudberry'
07:32:02 gpadmin@mdw cloudberry ±|main ✗|→ cat /etc/os-release
cat /etc/os-release
NAME="Rocky Linux"
VERSION="9.1 (Blue Onyx)"
ID="rocky"
ID_LIKE="rhel centos fedora"
VERSION_ID="9.1"
PLATFORM_ID="platform:el9"
PRETTY_NAME="Rocky Linux 9.1 (Blue Onyx)"
ANSI_COLOR="0;32"
LOGO="fedora-logo-icon"
CPE_NAME="cpe:/o:rocky:rocky:9::baseos"
HOME_URL="https://rockylinux.org/"
BUG_REPORT_URL="https://bugs.rockylinux.org/"
ROCKY_SUPPORT_PRODUCT="Rocky-Linux-9"
ROCKY_SUPPORT_PRODUCT_VERSION="9.1"
REDHAT_SUPPORT_PRODUCT="Rocky Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="9.1"
07:32:46 gpadmin@mdw cloudberry ±|main ✗|→ 

[tuhaihe]

Hi, I tested again on Rocky Linux 9.5; now all checks passed. But still, one test failed, and the result is the same as this reported issue #781.