• invalid opcode after update

    From Rastus@VERT/EWBBS to All on Saturday, June 22, 2019 13:09:51
    Hello..

    I haven't been upgrading regularly. The last sucessful build I applied was on June Third at around noon est. I again tried to upgrade on 6-21 and while the build was successfull.. when starting sbbs it crashes and with invalid opcode error.

    I am running on ubuntu 18.04.2 32bit

    I set loglevel to Debug but nothing helpful is logged in synchronet.log.. however this is logged in syslog at the crash:

    bbs kernel: [170891.363698] traps: sbbs/webServer[9392] trap invalid opcode ip:b7cdf8bd sp:b418e83c error:0 in libsbbs.so[b77da000+6a2000]

    if I disable webserver in sbbs.ini I get this:

    bbs kernel: [171144.758026] traps: sbbs/termServer[12701] trap invalid opcode ip:b7ce18bd sp:b61967cc error:0 in libsbbs.so[b77dc000+6a2000]

    If I disble the Terminal Server, then BBS starts.. but without web or terminal services of course.

    I have reverted back to prior build for now.

    Anything insight would be appreciated.

    Thanks!

    Nicholas

    ---
    þ Synchronet þ Electronic Warfare BBS | telnet://bbs.ewbbs.net
  • From Digital Man@VERT to Rastus on Saturday, June 22, 2019 16:04:49
    Re: invalid opcode after update
    By: Rastus to All on Sat Jun 22 2019 01:09 pm

    Hello..

    I haven't been upgrading regularly. The last sucessful build I applied was on June Third at around noon est. I again tried to upgrade on 6-21 and while the build was successfull.. when starting sbbs it crashes and with invalid opcode error.

    I am running on ubuntu 18.04.2 32bit

    I set loglevel to Debug but nothing helpful is logged in synchronet.log.. however this is logged in syslog at the crash:

    bbs kernel: [170891.363698] traps: sbbs/webServer[9392] trap invalid opcode ip:b7cdf8bd sp:b418e83c error:0 in libsbbs.so[b77da000+6a2000]

    if I disable webserver in sbbs.ini I get this:

    bbs kernel: [171144.758026] traps: sbbs/termServer[12701] trap invalid opcode ip:b7ce18bd sp:b61967cc error:0 in libsbbs.so[b77dc000+6a2000]

    If I disble the Terminal Server, then BBS starts.. but without web or terminal services of course.

    I have reverted back to prior build for now.

    Anything insight would be appreciated.

    First, try a clean build:
    http://wiki.synchro.net/install:nix#clean_rebuild

    If the problem persists, capture a backtrace and provide here: http://wiki.synchro.net/howto:gdb

    If it's only the Web Server and Terminal Server that's giving issues, it could be related to TLS (https) and SSH support - so you could try also just disabling those features as a test (not a solution). If the backtrace from gdb shows cryptlib functions in the crashed thread, then that's likely the issue.

    digital man

    Synchronet/BBS Terminology Definition #83:
    XSDK = Synchronet External Program Software Development Kit for C/C++
    Norco, CA WX: 77.3øF, 56.0% humidity, 13 mph ENE wind, 0.00 inches rain/24hrs

    ---
    þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net
  • From Rastus@VERT/EWBBS to Digital Man on Sunday, June 23, 2019 12:10:34
    Re: invalid opcode after update
    By: Digital Man to Rastus on Sat Jun 22 2019 04:04 pm

    If it's only the Web Server and Terminal Server that's giving issues, it could be related to TLS (https) and SSH support - so you could try also just disabling those features as a test (not a solution). If the backtrace from gdb shows cryptlib functions in the crashed thread, then that's likely the issue.

    I had compiled with a clean build..

    Disabling SSH in Terminal Server and TLS in Webserver allowed SBBS to start.

    Debug info:

    [New Thread 0xb34ffb40 (LWP 20929)]

    Thread 4 "sbbs/termServer" received signal SIGILL, Illegal instruction. [Switching to Thread 0xb60ffb40 (LWP 20924)]
    0xb7dbc8bd in aes_ecb_encrypt ()
    from /sbbs/src/sbbs3/gcc.linux.lib.release/libsbbs.so
    (gdb) bt full
    #0 0xb7dbc8bd in aes_ecb_encrypt ()
    from /sbbs/src/sbbs3/gcc.linux.lib.release/libsbbs.so
    No symbol table info available.
    #1 0xb60fc900 in ?? ()
    No symbol table info available.
    Backtrace stopped: previous frame inner to this frame (corrupt stack?)

    ---
    þ Synchronet þ Electronic Warfare BBS | telnet://bbs.ewbbs.net
  • From Digital Man@VERT to Rastus on Sunday, June 23, 2019 13:18:15
    Re: invalid opcode after update
    By: Rastus to Digital Man on Sun Jun 23 2019 12:10 pm

    Re: invalid opcode after update
    By: Digital Man to Rastus on Sat Jun 22 2019 04:04 pm

    If it's only the Web Server and Terminal Server that's giving issues, it could be related to TLS (https) and SSH support - so you could try also just disabling those features as a test (not a solution). If the backtrace from gdb shows cryptlib functions in the crashed thread, then that's likely the issue.

    I had compiled with a clean build..

    Disabling SSH in Terminal Server and TLS in Webserver allowed SBBS to start.

    Debug info:

    [New Thread 0xb34ffb40 (LWP 20929)]

    Thread 4 "sbbs/termServer" received signal SIGILL, Illegal instruction. [Switching to Thread 0xb60ffb40 (LWP 20924)]
    0xb7dbc8bd in aes_ecb_encrypt ()
    from /sbbs/src/sbbs3/gcc.linux.lib.release/libsbbs.so
    (gdb) bt full
    #0 0xb7dbc8bd in aes_ecb_encrypt ()
    from /sbbs/src/sbbs3/gcc.linux.lib.release/libsbbs.so
    No symbol table info available.
    #1 0xb60fc900 in ?? ()
    No symbol table info available.
    Backtrace stopped: previous frame inner to this frame (corrupt stack?)

    Definitely appears to be a cryptlib issue. You could try getting the previous version of cryptlib (3.4.4) from cvs:
    http://cvs.synchro.net/cgi-bin/viewcvs.cgi/*checkout*/3rdp/dist/cryptlib.zip?revision=1.5
    And overwrite the file of the same name in your sbbs 3rdp/dist directory.

    That should still be compatible with the current sbbs source (I hope).

    digital man

    This Is Spinal Tap quote #37:
    David St. Hubbins: We are Spinal Tap from the UK - you must be the USA!
    Norco, CA WX: 81.9øF, 49.0% humidity, 6 mph ESE wind, 0.00 inches rain/24hrs

    ---
    þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net
  • From mark lewis@VERT to Digital Man on Sunday, June 23, 2019 16:23:14
    On 2019 Jun 23 13:18:14, you wrote to Rastus:

    Debug info:

    [New Thread 0xb34ffb40 (LWP 20929)]

    Thread 4 "sbbs/termServer" received signal SIGILL, Illegal instruction.
    [Switching to Thread 0xb60ffb40 (LWP 20924)]
    0xb7dbc8bd in aes_ecb_encrypt ()
    from /sbbs/src/sbbs3/gcc.linux.lib.release/libsbbs.so
    (gdb) bt full
    #0 0xb7dbc8bd in aes_ecb_encrypt ()
    from /sbbs/src/sbbs3/gcc.linux.lib.release/libsbbs.so
    No symbol table info available.
    #1 0xb60fc900 in ?? ()
    No symbol table info available.
    Backtrace stopped: previous frame inner to this frame (corrupt stack?)

    Definitely appears to be a cryptlib issue.

    i posted about a maybe similar problem i'm seeing with letsencrypt in sync_programming...

    You could try getting the previous version of cryptlib (3.4.4) from
    cvs: http://cvs.synchro.net/cgi-bin/viewcvs.cgi/*checkout*/3rdp/dist/cryptl ib.zi p?revision=1.5 And overwrite the file of the same name in your
    sbbs 3rdp/dist directory.

    will that affect the patch files that are also used on the cryptlib sources?

    That should still be compatible with the current sbbs source (I hope).

    i'm fairly sure that that's what i was using before updating to 3.4.5... i'm guessing that most folks running 3.17c were, too...

    )\/(ark

    Always Mount a Scratch Monkey
    Do you manage your own servers? If you are not running an IDS/IPS yer doin' it wrong...
    ... If Fortune calls, offer him a seat. - Jewish Proverb
    ---
    * Origin: (1:3634/12.73)
    þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net
  • From Digital Man@VERT to mark lewis on Sunday, June 23, 2019 13:41:16
    Re: invalid opcode after update
    By: mark lewis to Digital Man on Sun Jun 23 2019 04:23 pm


    On 2019 Jun 23 13:18:14, you wrote to Rastus:

    Debug info:

    [New Thread 0xb34ffb40 (LWP 20929)]

    Thread 4 "sbbs/termServer" received signal SIGILL, Illegal instruction.
    [Switching to Thread 0xb60ffb40 (LWP 20924)]
    0xb7dbc8bd in aes_ecb_encrypt ()
    from /sbbs/src/sbbs3/gcc.linux.lib.release/libsbbs.so
    (gdb) bt full
    #0 0xb7dbc8bd in aes_ecb_encrypt ()
    from /sbbs/src/sbbs3/gcc.linux.lib.release/libsbbs.so
    No symbol table info available.
    #1 0xb60fc900 in ?? ()
    No symbol table info available.
    Backtrace stopped: previous frame inner to this frame (corrupt stack?)

    Definitely appears to be a cryptlib issue.

    i posted about a maybe similar problem i'm seeing with letsencrypt in sync_programming...

    You were seeing a TLS client exception, not a crash, so not really that similar.

    You could try getting the previous version of cryptlib (3.4.4) from cvs: http://cvs.synchro.net/cgi-bin/viewcvs.cgi/*checkout*/3rdp/dist/cryptl ib.zi p?revision=1.5 And overwrite the file of the same name in your sbbs 3rdp/dist directory.

    will that affect the patch files that are also used on the cryptlib sources?

    It might. Some of the patches may fail to apply which may mean the build with fail, I'm not sure.

    That should still be compatible with the current sbbs source (I hope).

    i'm fairly sure that that's what i was using before updating to 3.4.5... i'm guessing that most folks running 3.17c were, too...

    Yup.

    digital man

    Synchronet "Real Fact" #63:
    "Baja" (name of Synchronet PCMS compiler/languege) is pronounced "ba-ha". Norco, CA WX: 83.6øF, 49.0% humidity, 5 mph E wind, 0.00 inches rain/24hrs

    ---
    þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net
  • From mark lewis@VERT to Digital Man on Sunday, June 23, 2019 17:49:46
    On 2019 Jun 23 13:41:16, you wrote to me:

    Definitely appears to be a cryptlib issue.

    i posted about a maybe similar problem i'm seeing with letsencrypt in
    sync_programming...

    You were seeing a TLS client exception, not a crash, so not really that similar.

    well, only in that this new cryptlib is involved...

    will that affect the patch files that are also used on the cryptlib
    sources?

    It might. Some of the patches may fail to apply which may mean the build with fail, I'm not sure.

    i just thought i'd ask... i don't remember which ones came in with the new CL...

    )\/(ark

    Always Mount a Scratch Monkey
    Do you manage your own servers? If you are not running an IDS/IPS yer doin' it wrong...
    ... "Selamat hari Christmas dan Selamat Tahun Baru." - Malay Christmas
    ---
    * Origin: (1:3634/12.73)
    þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net
  • From Rastus@VERT/EWBBS to Digital Man on Sunday, June 23, 2019 21:02:13
    Re: invalid opcode after update
    By: Digital Man to Rastus on Sun Jun 23 2019 01:18 pm

    Re: invalid opcode after update
    By: Rastus to Digital Man on Sun Jun 23 2019 12:10 pm
    Definitely appears to be a cryptlib issue. You could try getting the previous version of cryptlib (3.4.4) from cvs: http://cvs.synchro.net/cgi-bin/viewcvs.cgi/*checkout*/3rdp/dist/cryptlib.z ip?revision=1.5 And overwrite the file of the same name in your sbbs 3rdp/dist directory.

    That should still be compatible with the current sbbs source (I hope).

    I tried this, but the build failed..

    -- snip --

    Perhaps you used the wrong -p or --strip option?
    The text leading up to this was:
    --------------------------
    |--- ../tmp2/misc/os_detect.h 2019-01-31 14:57:46.000000000 -0500
    |+++ misc/os_detect.h 2019-06-03 18:26:42.394038000 -0400 --------------------------
    File to patch:
    Skip this patch? [y]
    Skipping patch.

    -- snip --

    After skipping the patch the build continued but failed when trying to compile baja.

    ---
    þ Synchronet þ Electronic Warfare BBS | telnet://bbs.ewbbs.net
  • From Rastus@VERT/EWBBS to Digital Man on Sunday, June 23, 2019 21:03:55
    Re: invalid opcode after update
    By: Digital Man to mark lewis on Sun Jun 23 2019 01:41 pm


    It might. Some of the patches may fail to apply which may mean the build with fail, I'm not sure.


    yep.. that's what happened

    ---
    þ Synchronet þ Electronic Warfare BBS | telnet://bbs.ewbbs.net
  • From Rastus@VERT/EWBBS to Digital Man on Friday, June 28, 2019 21:42:20
    Re: invalid opcode after update
    By: Rastus to Digital Man on Sun Jun 23 2019 09:03 pm

    Re: invalid opcode after update
    By: Digital Man to mark lewis on Sun Jun 23 2019 01:41 pm
    It might. Some of the patches may fail to apply which may mean the
    build with fail, I'm not sure.

    I believe I found this issue that was causing my problems with the new TLS stuff... the gcc.linux..... directory in the 3rdp were not being removed during a clean build.. I also removed the 3rdp src directory and then rebuilt.. I think it worked, but I'm getting other errors this evening due to ongoing word with smb etc...

    I'll try again later...

    ---
    þ Synchronet þ Electronic Warfare BBS | telnet://bbs.ewbbs.net
  • From Fat Rastus@VERT/EWBBS to Rastus on Tuesday, July 02, 2019 16:02:51
    Re: invalid opcode after update
    By: Rastus to Digital Man on Fri Jun 28 2019 09:42 pm

    Re: invalid opcode after update
    By: Rastus to Digital Man on Sun Jun 23 2019 09:03 pm
    I believe I found this issue that was causing my problems with the new TLS stuff... the gcc.linux..... directory in the 3rdp were not being removed during a clean build.. I also removed the 3rdp src directory and then rebuilt.. I think it worked, but I'm getting other errors this evening due to ongoing word with smb etc...

    I spoke too soon....

    I can again build SBBS after some issues were corrected with the hash lib stuff, but still do not have SSH or TLS working.. SSH and TLS must be disabled or SBBS still crashes as noted in prior message..

    Bummer.. I've been looking forward to TLS support... hope this can be corrected.. I am still running an earlier build since I don't want to give up SSH...

    ---
    þ Synchronet þ Electronic Warfare BBS | telnet://bbs.ewbbs.net