Apps loadup fails with missing CLOS package error

[pamoroso]

To test Maiko PR #523 I freshly cloned the full Maiko repo, as so far on my local Linux system I had initially cloned it with the --depth 1 option as well as the Medley and Notecards repo. To have matching, full repos of the latter I freshly cloned Medley and Notecards too.

Then I tried to rebuild everything as explained here. The Maiko build completed successfully but the apps loadup scripts/loadup-all.sh -apps failed with the error:

STACK OVERFLOW
Can't find package CLOS to look symbol LOAD-CLOS

This is the error:

And the console output:

[...]
>>>>> START loadup-apps-from-full
"/home/paolo/medley/medley/../maiko/linux.x86_64/lde" "/tmp/loadups-45336/full.sysout" -id "loadup_1" -title "Medley Interlisp :: loadup_1" -g 1024x768 -sc 1024x768 -noscroll
MEDLEYDIR: "/home/paolo/medley/medley"
LOGINDIR: "/tmp/loadups-45336/logindir"
GREET FILE: "/tmp/loadups-45336/loadup-apps-from-full.cm"
VMEM FILE: "/tmp/loadups-45336/logindir/vmem/lisp_loadup_1.virtualmem"

*Error* Stack Overflow, MUST HARDRESET!
Enter the URaid
CL:NIL

< 

I'm using amd64 Linux Mint 22 Cinnamon.

[pamoroso]

The head of my Medley local repo from git log:

commit 5b37dd09db4bba3633a5bed30de4bb53a7ced539 (HEAD -> master, tag: medley-241225-5b37dd09, origin/master, origin/HEAD)
Author: rmkaplan <69548581+rmkaplan@users.noreply.github.com>
Date:   Wed Dec 25 13:06:35 2024 -0800

[masinter]

there is a DRAFT PR that addresses this and other problems.
But I still haven't figured out why loadup-apps-from-full.sh succeeds in some situations and not in others. I have two clones of the medley, maiko, notecards, repos that are the same according to "diff" (excluding .git) both under Debian distro and one fails and the other succeeds.

The failure results from an error under NC.InitualizeUID failing with \MYHOSTNUMBER is NIL .

I'd like to screen share the situation and get some advice on how to narrow this down.

[masinter]

#1948
includes a patch for this problem.

[nbriggs]

The failure results from an error under NC.InitualizeUID failing with \MYHOSTNUMBER is NIL

Are you running Dodo in one case and not the other? \MY.NSHOSTNUMBER is NIL if there's no NS network.

[pamoroso]

I applied #1948 but the build still fails:

paolo@lispmachine:~/medley/medley$ ./scripts/loadup-all.sh -apps
>>>>> START loadup-init
"/home/paolo/medley/medley/../maiko/linux.x86_64/lde" "/home/paolo/medley/medley/internal/loadups/starter.sysout" -id "loadup_1" -title "Medley Interlisp :: loadup_1" -g 1024x768 -sc 1024x768 -noscroll
MEDLEYDIR: "/home/paolo/medley/medley"
LOGINDIR: "/tmp/loadups-40755/logindir"
GREET FILE: "/tmp/loadups-40755/loadup-init.cm"
VMEM FILE: "/tmp/loadups-40755/logindir/vmem/lisp_loadup_1.virtualmem"
+++++ SUCCESS +++++
..... files created .....
-rw-rw-r-- 1 paolo paolo 4311040 Jan  5 14:01 /tmp/loadups-40755/init.dlinit
-rw-rw-r-- 1 paolo paolo 117076 Jan  5 14:01 /tmp/loadups-40755/init.dribble
-rw-rw-r-- 1 paolo paolo 4164608 Jan  5 14:01 /tmp/loadups-40755/init.sysout
-rw-rw-r-- 1 paolo paolo 55805 Jan  5 13:59 /tmp/loadups-40755/RDSYS
-rw-rw-r-- 1 paolo paolo 42969 Jan  5 13:59 /tmp/loadups-40755/RDSYS.LCOM
-rw-rw-r-- 1 paolo paolo 89162 Jan  5 13:59 /tmp/loadups-40755/I-NEW
-rw-rw-r-- 1 paolo paolo 70633 Jan  5 13:59 /tmp/loadups-40755/I-NEW.LCOM
<<<<< END loadup-init

>>>>> START loadup-mid-from-init
"/home/paolo/medley/medley/../maiko/linux.x86_64/ldeinit" "/tmp/loadups-40755/init.dlinit" -id "loadup_1" -title "Medley Interlisp :: loadup_1" -g 1024x768 -sc 1024x768 -noscroll -NF
MEDLEYDIR: "/home/paolo/medley/medley"
LOGINDIR: "/tmp/loadups-40755/logindir"
GREET FILE: "/tmp/loadups-40755/loadup-mid-from-init.cm"
VMEM FILE: "/tmp/loadups-40755/init-mid.sysout"
evaluating initial expressions:
PACKAGE-CONVERSION-TABLE.EXPRESSIONS
LLSUBRS.EXPRESSIONS
FILEIO.EXPRESSIONS
EXTERNALFORMAT.EXPRESSIONS
IMAGEIO.EXPRESSIONS
LLBASIC.EXPRESSIONS
LLGC.EXPRESSIONS
LLARRAYELT.EXPRESSIONS
LLINTERP.EXPRESSIONS
LLMVS.EXPRESSIONS
DEFSTRUCT-RUN-TIME.EXPRESSIONS
CMLSEQBASICS.EXPRESSIONS
LLARITH.EXPRESSIONS
LLFLOAT.EXPRESSIONS
LLBIGNUM.EXPRESSIONS
LLREAD.EXPRESSIONS
XCCS.EXPRESSIONS
LLCHAR.EXPRESSIONS
LLDATATYPE.EXPRESSIONS
IOCHAR.EXPRESSIONS
LLKEY.EXPRESSIONS
LLTIMER.EXPRESSIONS
DTDECLARE.EXPRESSIONS
ATBL.EXPRESSIONS
LLCODE.EXPRESSIONS
COREIO.EXPRESSIONS
AOFD.EXPRESSIONS
ADIR.EXPRESSIONS
PMAP.EXPRESSIONS
VANILLADISK.EXPRESSIONS
ATERM.EXPRESSIONS
APRINT.EXPRESSIONS
ABASIC.EXPRESSIONS
AERROR.EXPRESSIONS
AINTERRUPT.EXPRESSIONS
MISC.EXPRESSIONS
BOOTSTRAP.EXPRESSIONS
CMLMACROS.EXPRESSIONS
CMLEVAL.EXPRESSIONS
CMLPROGV.EXPRESSIONS
CMLSPECIALFORMS.EXPRESSIONS
LLRESTART.EXPRESSIONS
LLERROR.EXPRESSIONS
LLSYMBOL.EXPRESSIONS
LLPACKAGE.EXPRESSIONS
PACKAGE-STARTUP.EXPRESSIONS
CONDITION-PACKAGE.EXPRESSIONS
XCL-PACKAGE.EXPRESSIONS
PROC.EXPRESSIONS
evaluating initial expressions:
CMLARRAY.EXPRESSIONS
DSK.EXPRESSIONS
UFS.EXPRESSIONS
PASSWORDS.EXPRESSIONS
FONT.EXPRESSIONS
LLDISPLAY.EXPRESSIONS
APUTDQ.EXPRESSIONS
COMPATIBILITY.EXPRESSIONS
DMISC.EXPRESSIONS
CMLLIST.EXPRESSIONS
CMLCHARACTER.EXPRESSIONS
CMLREADTABLE.EXPRESSIONS
MAIKOBITBLT.EXPRESSIONS
MAIKOINIT.EXPRESSIONS
MAKEINIT.EXPRESSIONS
 
+++++ SUCCESS +++++
..... files created .....
-rw-rw-r-- 1 paolo paolo 4971520 Jan  5 14:01 /tmp/loadups-40755/init-mid.sysout
<<<<< END loadup-mid-from-init

>>>>> START loadup-lisp-from-mid
"/home/paolo/medley/medley/../maiko/linux.x86_64/lde" "/tmp/loadups-40755/init-mid.sysout" -id "loadup_1" -title "Medley Interlisp :: loadup_1" -g 1024x768 -sc 1024x768 -noscroll
MEDLEYDIR: "/home/paolo/medley/medley"
LOGINDIR: "/tmp/loadups-40755/logindir"
GREET FILE: "/tmp/loadups-40755/loadup-lisp-from-mid.cm"
VMEM FILE: "/tmp/loadups-40755/logindir/vmem/lisp_loadup_1.virtualmem"
+++++ SUCCESS +++++
..... files created .....
-rw-rw-r-- 1 paolo paolo 32132 Jan  5 14:01 /tmp/loadups-40755/lisp.dribble
-rw-rw-r-- 1 paolo paolo 8739840 Jan  5 14:01 /tmp/loadups-40755/lisp.sysout
<<<<< END loadup-lisp-from-mid

>>>>> START loadup-full-from-lisp
"/home/paolo/medley/medley/../maiko/linux.x86_64/lde" "/tmp/loadups-40755/lisp.sysout" -id "loadup_1" -title "Medley Interlisp :: loadup_1" -g 1024x768 -sc 1024x768 -noscroll
MEDLEYDIR: "/home/paolo/medley/medley"
LOGINDIR: "/tmp/loadups-40755/logindir"
GREET FILE: "/tmp/loadups-40755/loadup-full-from-lisp.cm"
VMEM FILE: "/tmp/loadups-40755/logindir/vmem/lisp_loadup_1.virtualmem"
----- FAILURE -----
..... files created .....
<<<<< END loadup-full-from-lisp

----- loadup-all.sh: FAILURE -----

The /tmp/ directory no longer contains any Medley files, so I can't find a dribble file.

[pamoroso]

My last succesful build was on January 2, 2025 and the build broke on January 4, 2025.

[pamoroso]

Doing the loadup without apps with scripts/loadup-all.sh fails with XCL::WHERE-IS-NOTICE is an undefined function.:

>>>>> START loadup-aux
"/home/paolo/medley/medley/../maiko/linux.x86_64/lde" "/tmp/loadups-6068/full.sysout" -id "loadup_1" -title "Medley Interlisp :: loadup_1" -g 1024x768 -sc 1024x768 -noscroll
MEDLEYDIR: "/home/paolo/medley/medley"
LOGINDIR: "/tmp/loadups-6068/logindir"
GREET FILE: "/tmp/loadups-6068/loadup-aux.cm"
VMEM FILE: "/tmp/loadups-6068/logindir/vmem/lisp_loadup_1.virtualmem"

The heads of the sources:

paolo@lispmachine:~/medley/maiko$ git log|head
commit 6193f2733fd6b32eea3eed8fe08dfa2cabc22ff6
Author: Nick Briggs <nicholas.h.briggs@gmail.com>
Date:   Fri Jan 3 09:05:12 2025 -0800

    Declares correct size for scratch version string storage

commit d5430c2b0edc23109be8d81fab92df81d3d9de5f
Author: Nick Briggs <nicholas.h.briggs@gmail.com>
Date:   Thu Jan 2 17:57:21 2025 -0800

paolo@lispmachine:~/medley/maiko$ cd ../medley
paolo@lispmachine:~/medley/medley$ git log|head
commit 6bdcb1853d89772ce176ac95f51594d350e4d45a
Merge: 5b37dd09 fb7bb252
Author: Matt Heffron <heffron@alumni.caltech.edu>
Date:   Tue Jan 14 16:21:22 2025 -0800

    Fix GREET0 off by 1 error. Without changing the file's READTABLE (#1970)
    
    Replaces mth26 branch (PR #1969). This doesn't change the file's
    READTABLE.

paolo@lispmachine:~/medley/medley$ cd ../notecards
paolo@lispmachine:~/medley/notecards$ git log|head
commit 86daa57ad611f8aeb430f3d7418d0cdad564464e
Merge: 56e340b 9bef2e2
Author: Frank Halasz <frank@halasz.org>
Date:   Tue Jan 14 21:37:40 2025 -0800

    Merge pull request #17 from Interlisp/fgh_last-TEDIT
    
    Remove last \TEDIT.* call from Notecards

commit 9bef2e207f0a3044f8914683682b22d393a7f54a

[nbriggs]

I just built on Linux Mint 22 Cinnamon, and there was no problem. You might check to see if in your full.dribble there was some issue with loading medley/library/where-is.dfasl -- it's behaving as though the full.sysout was not properly created in your case.

[pamoroso]

Where can I find full.dribble? The sysout directory is empty when the build fails.

[nbriggs]

It's in the loadups directory if the shell thinks it succeeded, but copies should be left in /tmp/loadups-<processid> regardless of what happened.

[pamoroso]

I'm attaching a zip of all the dribble files of the latest failed build but full.dribble seems corrupted: loadup.zip

[nbriggs]

You should be able to repeat the loadup-full-from-lisp.sh step with (substitute your particular /tmp/loadup-nnnn directory)

% LOADUP_WORKDIR=/tmp/loadups-53124 ./scripts/loadup-full-from-lisp.sh

and see if you can see what it's doing.

[pamoroso]

I updated my local repos as follows:

paolo@lispmachine:~/medley/medley$ git status
On branch master
Your branch is up to date with 'origin/master'.

nothing to commit, working tree clean
paolo@lispmachine:~/medley/medley$ git log|head
commit 936337d6bb3d0a2dd47b28154955cb4eafa019d0
Author: rmkaplan <69548581+rmkaplan@users.noreply.github.com>
Date:   Wed Jan 15 10:52:18 2025 -0800

    Shakedown of field menu items (#1957)
    
    * Shakedown of field menu items
    
    * Suppress shift-select in menus
    
paolo@lispmachine:~/medley/medley$ cd ../notecards
paolo@lispmachine:~/medley/notecards$ git status
On branch main
Your branch is up to date with 'origin/main'.

nothing to commit, working tree clean
paolo@lispmachine:~/medley/notecards$ git log|head
commit 86daa57ad611f8aeb430f3d7418d0cdad564464e
Merge: 56e340b 9bef2e2
Author: Frank Halasz <frank@halasz.org>
Date:   Tue Jan 14 21:37:40 2025 -0800

    Merge pull request #17 from Interlisp/fgh_last-TEDIT
    
    Remove last \TEDIT.* call from Notecards

commit 9bef2e207f0a3044f8914683682b22d393a7f54a

Then I rebuilt with scripts/loadup-all.sh, the process completed succesfully, and I could run Medley.

Next, I rebuilt with with scripts/loadup-all.sh -apps and, again, the process completed successfully. Now I can run the newly built Medley as well as the apps and everything seems to be working fine. As new changes are committed to the repos I will continue building and monitoring Medley.

[pamoroso]

As the repos get updated the Medley builds continue to complete successfully. So I'm going to close this issue and will open new ones should builds fail again.