• Upgrading server

    From Digital Man@1:103/705 to All on Wed Aug 24 12:44:02 2022
    The server currently-known-as 'cvs.synchro.net' is an aging quad-core AMD (A10 PRO-7800B) based HP workstation with 16GB of DDR3 RAM running Debian Linux 10.9 on a SATA SSD. This server has a lot of duties, including the hosting of [www].synchro.net, ftp.synchro.net, cvs.synchro.net, wiki.synchro.net, git.synchro.net, gitlab.synchro.net and provides the primary domain name services for *.synchro.net.

    I'm in the process of upgrading this system to an new Intel i7-17200 based HP workstation with 32GB of DDR4 RAM running Debian Linux 11.4 on an NVMe SSD (bought it on sale for $800 from costco.com). This should speed-up a lot of Git-related things quite a bit (e.g. CI pipeline/builds) when the upgrade is complete.

    Since the old system was upgraded several times over many years from whatever was the current Debian Linux 10+ years ago (pre-systemd), I'm starting with a fresh install and migrating all the services and data over piece meal.

    Starting with GitLab, I had to have the same version running on each server before I could migrate the data, so I upgraded the GitLab install on cvs.synchro.net first from 13.12.15 to 14.0.12 then to 14.7.2.

    I'll be working on other migration tasks over the next week+ before making the final switch-over. Other than the upgrade to GitLab, you probably won't notice anything until the migration is done and I'll give some head's up when I'm about to do that (like I said, in several days), and then I won't be surprised if there are some hiccups at that time.

    I'll look into upgrading to the current GitLab (15.x) after the migration is complete.
    --
    digital man (rob)

    Rush quote #49:
    Some will sell their dreams for small desires or lose the race to rats
    Norco, CA WX: 90.4°F, 48.0% humidity, 4 mph ESE wind, 0.00 inches rain/24hrs --- SBBSecho 3.15-Linux
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)
  • From Ragnarok@1:103/705 to Digital Man on Fri Aug 26 00:16:54 2022
    El 24/8/22 a las 16:44, Digital Man escribi├│:
    The server currently-known-as 'cvs.synchro.net' is an aging quad-core AMD (A10 PRO-7800B) based HP workstation with 16GB of DDR3 RAM running Debian Linux 10.9 on a SATA SSD. This server has a lot of duties, including the hosting of [www].synchro.net, ftp.synchro.net, cvs.synchro.net, wiki.synchro.net, git.synchro.net, gitlab.synchro.net and provides the primary domain name services for *.synchro.net.

    I'm in the process of upgrading this system to an new Intel i7-17200 based HP workstation with 32GB of DDR4 RAM running Debian Linux 11.4 on an NVMe SSD (bought it on sale for $800 from costco.com). This should speed-up a lot of Git-related things quite a bit (e.g. CI pipeline/builds) when the upgrade is complete.

    Since the old system was upgraded several times over many years from whatever was the current Debian Linux 10+ years ago (pre-systemd), I'm starting with a fresh install and migrating all the services and data over piece meal.

    Starting with GitLab, I had to have the same version running on each server before I could migrate the data, so I upgraded the GitLab install on cvs.synchro.net first from 13.12.15 to 14.0.12 then to 14.7.2.

    I'll be working on other migration tasks over the next week+ before making the final switch-over. Other than the upgrade to GitLab, you probably won't notice anything until the migration is done and I'll give some head's up when I'm about to do that (like I said, in several days), and then I won't be surprised if there are some hiccups at that time.

    I'll look into upgrading to the current GitLab (15.x) after the migration is complete.

    cool!
    good lock and don't drink so much coffee =)

    ---
    ´┐ş Synchronet ´┐ş Dock Sud BBS TLD 24 HS - bbs.docksud.com.ar
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)
  • From Digital Man@1:103/705 to Ragnarok on Thu Aug 25 23:59:27 2022
    Re: Re: Upgrading server
    By: Ragnarok to Digital Man on Fri Aug 26 2022 12:16 am

    good lock and don't drink so much coffee =)

    Thanks! And what makes you think I drink a lot of coffee? <shaking hands> :-) --
    digital man (rob)

    Rush quote #15:
    I can't pretend a stranger is a long-awaited friend
    Norco, CA WX: 70.2°F, 84.0% humidity, 0 mph SE wind, 0.00 inches rain/24hrs
    --- SBBSecho 3.15-Linux
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)
  • From Digital Man@1:103/705 to All on Sat Nov 5 15:31:18 2022
    Re: Upgrading server
    By: Digital Man to All on Wed Aug 24 2022 12:44 pm

    The server currently-known-as 'cvs.synchro.net' is an aging quad-core AMD (A10 PRO-7800B) based HP workstation with 16GB of DDR3 RAM running Debian Linux 10.9 on a SATA SSD. This server has a lot of duties, including the hosting of [www].synchro.net, ftp.synchro.net, cvs.synchro.net, wiki.synchro.net, git.synchro.net, gitlab.synchro.net and provides the primary domain name services for *.synchro.net.

    I'm in the process of upgrading this system to an new Intel i7-17200 based HP workstation with 32GB of DDR4 RAM running Debian Linux 11.4 on an NVMe SSD (bought it on sale for $800 from costco.com). This should speed-up a lot of Git-related things quite a bit (e.g. CI pipeline/builds) when the upgrade is complete.

    Okay, the migration is finally going to happen today, so there will be some down time.

    Wish me luck,
    --
    digital man (rob)

    Sling Blade quote #19:
    Doyle: I can't so much as drink a damn glass of water around a midget
    Norco, CA WX: 71.0°F, 29.0% humidity, 5 mph E wind, 0.00 inches rain/24hrs
    --- SBBSecho 3.15-Linux
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)
  • From Digital Man@1:103/705 to All on Tue Nov 8 11:34:19 2022
    Re: Upgrading server
    By: Digital Man to All on Sat Nov 05 2022 03:31 pm

    Re: Upgrading server
    By: Digital Man to All on Wed Aug 24 2022 12:44 pm

    The server currently-known-as 'cvs.synchro.net' is an aging quad-core AMD (A10 PRO-7800B) based HP workstation with 16GB of DDR3 RAM running Debian Linux 10.9 on a SATA SSD. This server has a lot of duties, including the hosting of [www].synchro.net, ftp.synchro.net, cvs.synchro.net, wiki.synchro.net, git.synchro.net, gitlab.synchro.net and provides the primary domain name services for *.synchro.net.

    I'm in the process of upgrading this system to an new Intel i7-17200 based HP workstation with 32GB of DDR4 RAM running Debian Linux 11.4 on an NVMe SSD (bought it on sale for $800 from costco.com). This should speed-up a lot of Git-related things quite a bit (e.g. CI pipeline/builds) when the upgrade is complete.

    Okay, the migration is finally going to happen today, so there will be some down time.

    Update/status:

    - Bind/Dynamic-DNS service migrated successfully
    *.synchro.net hostnames are resolving and dynamically updated
    - GitLab migrated successfully, still on v14.7.2 - new SSH key (sorry)!
    Will upgrade to the latest (v15.x) soon
    - DokuWiki/PHP-FPM migrated successfully
    Upgraded to latest PHP-FPM and DokuWiki
    - Synchronet migrated successfully
    still resolving lingering broken symlinks and permissions
    - proFTPd migrated (ftp.synchro.net) successfully
    - SpamAssassin migrated successfully (new spam db)
    - CVS/cvsweb/viewcvs *not* migrated and probably not going to bother
    (will need to continue to find and fix any links to cvsweb/viewcvs)

    Still yet to do: ZNC, Murmur, automated backups, more stuff I'm forgetting
    --
    digital man (rob)

    This Is Spinal Tap quote #36:
    Bobbi Flekman: Money talks, and bullshit walks.
    Norco, CA WX: 64.7°F, 69.0% humidity, 7 mph ESE wind, 0.32 inches rain/24hrs --- SBBSecho 3.15-Linux
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)
  • From Ragnarok@1:103/705 to Digital Man on Wed Nov 9 19:17:17 2022
    El 8/11/22 a las 16:34, Digital Man escribi├│:

    Update/status:

    - Bind/Dynamic-DNS service migrated successfully
    *.synchro.net hostnames are resolving and dynamically updated
    - GitLab migrated successfully, still on v14.7.2 - new SSH key (sorry)!
    Will upgrade to the latest (v15.x) soon
    - DokuWiki/PHP-FPM migrated successfully
    Upgraded to latest PHP-FPM and DokuWiki
    - Synchronet migrated successfully
    still resolving lingering broken symlinks and permissions
    - proFTPd migrated (ftp.synchro.net) successfully
    - SpamAssassin migrated successfully (new spam db)
    - CVS/cvsweb/viewcvs *not* migrated and probably not going to bother
    (will need to continue to find and fix any links to cvsweb/viewcvs)

    Still yet to do: ZNC, Murmur, automated backups, more stuff I'm forgetting

    Great job! always.. thanks for your work!

    ---
    ´┐ş Synchronet ´┐ş Dock Sud BBS TLD 24 HS - bbs.docksud.com.ar
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)
  • From Angel Ripoll@2:341/66 to Digital Man on Thu Nov 10 17:35:42 2022
    Hola Digital!

    09 Nov 22 19:17, Ragnarok dijo a Digital Man:

    El 8/11/22 a las 16:34, Digital Man escribi├│:

    Update/status:

    - Bind/Dynamic-DNS service migrated successfully
    *.synchro.net hostnames are resolving and dynamically updated
    - GitLab migrated successfully, still on v14.7.2 - new SSH key (sorry)!
    Will upgrade to the latest (v15.x) soon
    - DokuWiki/PHP-FPM migrated successfully
    Upgraded to latest PHP-FPM and DokuWiki
    - Synchronet migrated successfully
    still resolving lingering broken symlinks and permissions
    - proFTPd migrated (ftp.synchro.net) successfully
    - SpamAssassin migrated successfully (new spam db)
    - CVS/cvsweb/viewcvs *not* migrated and probably not going to bother
    (will need to continue to find and fix any links to cvsweb/viewcvs)

    Still yet to do: ZNC, Murmur, automated backups, more stuff I'm forgetting

    Great job! always.. thanks for your work!

    +1

    Thanks Rob

    Un saludo,
    Angel Ripoll
    aripoll @ zruspas.org

    --- GoldED+/LNX 1.1.5-b20220504 + HPT 1.9 + Binkd 1.1 en Debian
    * Origin: Synchronet - bbs.zruspas.org - Zruspa's BBS - (2:341/66)
  • From Digital Man@1:103/705 to Angel Ripoll on Thu Nov 10 11:07:13 2022
    Re: Upgrading server
    By: Angel Ripoll to Digital Man on Thu Nov 10 2022 05:35 pm

    Hola Digital!

    09 Nov 22 19:17, Ragnarok dijo a Digital Man:

    El 8/11/22 a las 16:34, Digital Man escribió:

    Update/status:

    - Bind/Dynamic-DNS service migrated successfully
    *.synchro.net hostnames are resolving and dynamically updated
    - GitLab migrated successfully, still on v14.7.2 - new SSH key (sorry)!
    Will upgrade to the latest (v15.x) soon
    - DokuWiki/PHP-FPM migrated successfully
    Upgraded to latest PHP-FPM and DokuWiki
    - Synchronet migrated successfully
    still resolving lingering broken symlinks and permissions
    - proFTPd migrated (ftp.synchro.net) successfully
    - SpamAssassin migrated successfully (new spam db)
    - CVS/cvsweb/viewcvs *not* migrated and probably not going to bother
    (will need to continue to find and fix any links to cvsweb/viewcvs)

    Still yet to do: ZNC, Murmur, automated backups, more stuff I'm forgetting

    Great job! always.. thanks for your work!

    +1

    Thanks Rob

    Hopefully you've noticed the wiki and gitlab web UI are snappier (the wiki was already pretty fast), but builds are *way* fater now:

    BEFORE the upgrade:
    System: cvs - Linux 4.19.0-16-amd64 x86_64

    00:00 - src/sbbs3 make git_branch.h git_hash.h
    00:02 - tar --exclude=*output.txt --exclude=node1 --exclude=ctrl --exclude=docs --exclude=exec --exclude=install --exclude=text --exclude=web --exclude=webv4 --exclude=xtrn --exclude=src/crt --exclude=src/doors --exclude=src/odoors --exclude=src/sbbs2 --exclude=src/syncterm --exclude=src/ZuulTerm --exclude=3rdp/win32.release --exclude-vcs --exclude-vcs-ignores --dereference -czvf sbbs_src.tgz *
    21:51 - src/sbbs3 cov-build --dir ../../cov-int make RELEASE=1 all
    00:18 - src/sbbs3 make RELEASE=1 gtkutils
    -----
    22:11 - total

    AFTER the upgrade:
    System: git - Linux 5.19.0-1-amd64 x86_64

    00:00 - src/sbbs3 make git_branch.h git_hash.h
    00:01 - tar --exclude=*output.txt --exclude=node1 --exclude=ctrl --exclude=docs --exclude=exec --exclude=install --exclude=text --exclude=web --exclude=webv4 --exclude=xtrn --exclude=src/crt --exclude=src/doors --exclude=src/odoors --exclude=src/sbbs2 --exclude=src/syncterm --exclude=src/ZuulTerm --exclude=3rdp/win32.release --exclude-vcs --exclude-vcs-ignores --dereference -czvf sbbs_src.tgz *
    07:08 - src/sbbs3 cov-build --dir ../../cov-int make RELEASE=1 all
    00:06 - src/sbbs3 make RELEASE=1 gtkutils
    -----
    07:15 - total

    And that's a single-threaded build/analysis!

    For gitlab-CI builds, the improvement for just the sbbs-linux build job went from 09:33 to 2:57. That was the slowest job (among many, which *are* parallelized), so you that's approximately the improvement you should see now when waiting for CI to complete (e.g. for a merge request).

    So all the expense, work and hassle was worthwhile to me. :-)
    --
    digital man (rob)

    Synchronet "Real Fact" #16:
    Synchronet first supported FidoNet networking (with SBBSFIDO) in 1992
    Norco, CA WX: 65.0°F, 34.0% humidity, 0 mph ENE wind, 0.00 inches rain/24hrs --- SBBSecho 3.15-Linux
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)
  • From Digital Man@1:103/705 to All on Fri Nov 11 23:49:57 2022
    Re: Upgrading server
    By: Digital Man to All on Tue Nov 08 2022 11:34 am

    - GitLab migrated successfully, still on v14.7.2 - new SSH key (sorry)!
    Will upgrade to the latest (v15.x) soon

    Upgraded to GitLab 15.5.3 (the latest available for Debian bookworm/sid right now). Seems to be working fine so far. Let me know if you encounter any issues.
    --
    digital man (rob)

    Synchronet/BBS Terminology Definition #25:
    DSL = Digital Subscriber Line
    Norco, CA WX: 55.0°F, 34.0% humidity, 0 mph ENE wind, 0.00 inches rain/24hrs --- SBBSecho 3.20-Linux
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)