• Backing up w/users online/server active?

    From Khelair@VERT/TINFOIL to All on Sunday, February 01, 2015 14:18:19
    I'm wondering about some various ways to automate the best backup system that I can for my Synchronet subsystem. Right now, I've been handling things by shutting the BBS down for a few minutes after nightly message-base packing, and rsyncing a copy to a live tree that I've got, along with some other systems that aren't incremental as such. What I'm curious about, is can I skip checking for users online? What would be the worst repercussions of restoring from a backup made with users online? Also, if the BBS were performing some maintenance, posting, or adding to one of the message bases, say usenet, since it always spends the most time pulling and adding to bases, and I caught an rsync during that, would I be dealing with anything more than just having to do an 'smbfix' on that base?
    Thanks for your time. I appreciate it greatly, and I'll try to toss up some notes on the backup system that I've got implemented after I know the best route to go with all of this.

    -=-
    Borg Burger: We do it our way; your way is irrelevant.

    ---
    þ Synchronet þ Tinfoil Tetrahedron BBS telnet://tinfoil.synchro.net
  • From Poindexter Fortran@VERT/REALITY to Khelair on Monday, February 02, 2015 13:22:40
    Re: Backing up w/users online/server active?
    By: Khelair to All on Sun Feb 01 2015 02:18 pm

    I'm wondering about some various ways to automate the best backup system that I can for my Synchronet subsystem. Right now, I've been handling things by shutting the BBS down for a few minutes after nightly message-base packing, and rsyncing a copy to a live tree that I've got, along with some other systems that aren't incremental as such.

    I'm not doing anything that shiny -- I have a batch file that runs as an exclusive event and does a forced xcopy to allow it to copy the "active" semaphore file RADIUS keeps open. I did some batch jigggery-pokery to make a directory named after the date and am going to get motivated to do a grandfather/father/son arrangement once I remember all I've forgotten in DOS batch.

    ---
    þ Synchronet þ realitycheckBBS -- http://realitycheckBBS.org
  • From Digital Man@VERT to Khelair on Wednesday, February 04, 2015 17:29:51
    Re: Backing up w/users online/server active?
    By: Khelair to All on Sun Feb 01 2015 02:18 pm

    I'm wondering about some various ways to automate the best backup system that I can for my Synchronet subsystem. Right now, I've been handling things by shutting the BBS down for a few minutes after nightly
    message-base packing, and rsyncing a copy to a live tree that I've got, along with some other systems that aren't incremental as such. What I'm curious about, is can I skip checking for users online? What would be the worst repercussions of restoring from a backup made with users online?
    Also, if the BBS were performing some maintenance, posting, or adding to
    one of the message bases, say usenet, since it always spends the most time pulling and adding to bases, and I caught an rsync during that, would I be dealing with anything more than just having to do an 'smbfix' on that base?
    Thanks for your time. I appreciate it greatly, and I'll try to toss up some notes on the backup system that I've got implemented after I know the best route to go with all of this.

    It's possible you could have some out-of-sync files if you copied them while they were being modified (e.g. message base files while they were being posted to or messages being imported from a network), but so long as you're performing
    regular backups, you could always just go to previous (day's?) backup to get any files that happened to have been out-of-sync during the backup. I wouldn't worry about it too much.

    Now, timed events are running (usually) single-threaded and serialized, so if your backup is run as a Synchronet timed event, that will at least avoid some of the possible causes of out-of-sync files during the backup.

    digital man

    Synchronet "Real Fact" #80:
    Vertrauen has had the FidoNet node number 1:103/705 since 1992.
    Norco, CA WX: 69.7øF, 50.0% humidity, 4 mph ESE wind, 0.00 inches rain/24hrs

    ---
    þ Synchronet þ Vertrauen þ Home of Synchronet þ telnet://vert.synchro.net
  • From Joe Delahaye@VERT to Digital Man on Wednesday, February 04, 2015 22:57:04
    Re: Backing up w/users online/server active?
    By: Digital Man to Khelair on Wed Feb 04 2015 17:29:51

    Now, timed events are running (usually) single-threaded and serialized, so if your backup is run as a Synchronet timed event, that will at least avoid some of the possible causes of out-of-sync files during the backup.

    Hmm. I do a drive image (via Windows backup) once a week. If I could figure out how to call that from a command line, should I run it as an event, or would that stop the BBS until the event is finished running? I have yet to find a way to automate that.
    --- SBBSecho 2.27-Win32
    * Origin: The Lions Den BBS, Trenton, On, CDN (1:249/303)
    þ Synchronet þ Vertrauen þ Home of Synchronet þ telnet://vert.synchro.net
  • From Khelair@VERT/TINFOIL to Digital Man on Wednesday, February 04, 2015 19:35:41
    Re: Backing up w/users online/server active?
    By: Digital Man to Khelair on Wed Feb 04 2015 17:29:51

    It's possible you could have some out-of-sync files if you copied them while they were being modified (e.g. message base files while they were being post to or messages being imported from a network), but so long as you're perform regular backups, you could always just go to previous (day's?) backup to get any files that happened to have been out-of-sync during the backup. I wouldn worry about it too much.

    Now, timed events are running (usually) single-threaded and serialized, so i your backup is run as a Synchronet timed event, that will at least avoid som of the possible causes of out-of-sync files during the backup.

    Good to know. Thank you muchly.

    -=-
    Borg Burgers: We do it our way; your way is irrelevant.

    ---
    þ Synchronet þ Tinfoil Tetrahedron BBS telnet://tinfoil.synchro.net
  • From Digital Man@VERT to Joe Delahaye on Thursday, February 05, 2015 14:43:28
    Re: Backing up w/users online/server active?
    By: Joe Delahaye to Digital Man on Wed Feb 04 2015 10:57 pm

    Re: Backing up w/users online/server active?
    By: Digital Man to Khelair on Wed Feb 04 2015 17:29:51

    Now, timed events are running (usually) single-threaded and
    serialized, so if your backup is run as a Synchronet timed event, that will at least avoid some of the possible causes of out-of-sync files during the backup.

    Hmm. I do a drive image (via Windows backup) once a week. If I could figure out how to call that from a command line, should I run it as an event, or would that stop the BBS until the event is finished running?

    It won't stop the BBS, it just won't run any other timed events until the backup is complete (assuming the command-line executes sycnhronously).

    digital man

    Synchronet "Real Fact" #50:
    Rob Swindell was introduced to BBSing in 1982 by his older brother, Dr. Seuss. Norco, CA WX: 80.4øF, 28.0% humidity, 9 mph ESE wind, 0.00 inches rain/24hrs

    ---
    þ Synchronet þ Vertrauen þ Home of Synchronet þ telnet://vert.synchro.net
  • From Joe Delahaye@VERT to Digital Man on Thursday, February 05, 2015 23:04:15
    Re: Backing up w/users online/server active?
    By: Digital Man to Joe Delahaye on Thu Feb 05 2015 14:43:28

    It won't stop the BBS, it just won't run any other timed events until the backup is complete (assuming the command-line executes sycnhronously).


    I do it manually by using Control Panel and the backup option right now. However, unless I can find a command line to call that procedure in Vista, it probably will never make it as an event.
    --- SBBSecho 2.27-Win32
    * Origin: The Lions Den BBS, Trenton, On, CDN (1:249/303)
    þ Synchronet þ Vertrauen þ Home of Synchronet þ telnet://vert.synchro.net
  • From Poindexter Fortran@VERT/REALITY to Joe Delahaye on Friday, February 06, 2015 10:38:26
    Re: Backing up w/users online/server active?
    By: Joe Delahaye to Digital Man on Thu Feb 05 2015 11:04 pm


    Here's my backup script -- nothing fancy. I run it as a timed, exclusive event. Given the discussions here I thought it might inspire other people or someone might offer some improvements.

    I set a variable to equal the date in YYYYMMDD format, another for the target drive, copy everything in my SBBS directory (I have all of my BBS utils under c:\sbbs\) to a directory named with the target drive and current date. Once the backup's finished, I delete some log files and pack my message bases.

    Another script runs jkdefrag from a command line, but I don't hold the BBS open for it.


    @echo off

    SET backupdate=%date:~-4,4%%date:~-10,2%%date:~-7,2%
    SET target=D

    echo performing backup for %backupdate%:

    mkdir %target%:\Backups\%backupdate%
    xcopy c:\sbbs\*.* %target%:\Backups\%backupdate%\ /s /e /c /y

    echo deleting log files

    del c:\sbbs\data\fidonet.log
    del c:\sbbs\allfix\allfix.log
    rem del /q c:\sbbs\radius\log\*.*
    del /q c:\sbbs\data\logs\*.*

    echo running message base maintenance...

    smbutil /a mp c:\sbbs\data\subs\agoranet\*.shd
    smbutil /a mp c:\sbbs\data\subs\coa\*.shd
    smbutil /a mp c:\sbbs\data\subs\dovenet\*.shd
    smbutil /a mp c:\sbbs\data\subs\fidonet\*.shd
    smbutil /a mp c:\sbbs\data\subs\local\*.shd
    smbutil /a mp c:\sbbs\data\subs\micronet\*.shd
    smbutil /a mp c:\sbbs\data\subs\svnet\*.shd
    smbutil /a mp c:\sbbs\data\subs\usenet\*.shd

    exit

    ---
    þ Synchronet þ realitycheckBBS -- http://realitycheckBBS.org
  • From mark lewis@VERT to Poindexter Fortran on Friday, February 06, 2015 17:44:51
    On Fri, 06 Feb 2015, Poindexter Fortran wrote to Joe Delahaye:

    SET backupdate=%date:~-4,4%%date:~-10,2%%date:~-7,2%

    hey! there ya go! :)


    )\/(ark


    * Origin: (1:3634/12)

    ---
    þ Synchronet þ Vertrauen þ Home of Synchronet þ telnet://vert.synchro.net
  • From Digital Man@VERT to Joe Delahaye on Friday, February 06, 2015 16:09:48
    Re: Backing up w/users online/server active?
    By: Joe Delahaye to Digital Man on Thu Feb 05 2015 11:04 pm

    Re: Backing up w/users online/server active?
    By: Digital Man to Joe Delahaye on Thu Feb 05 2015 14:43:28

    It won't stop the BBS, it just won't run any other timed events until the backup is complete (assuming the command-line executes sycnhronously).


    I do it manually by using Control Panel and the backup option right now. However, unless I can find a command line to call that procedure in Vista, it probably will never make it as an event.

    A quick web search pointed me here: https://technet.microsoft.com/en-us/library/cc754015%28WS.10%29.aspx

    Apparently the command-line tool "wbadmin" is used for this purpose.

    digital man

    Synchronet "Real Fact" #34:
    The irc.synchro.net network has more servers than users.
    Norco, CA WX: 71.8øF, 41.0% humidity, 8 mph SE wind, 0.00 inches rain/24hrs

    ---
    þ Synchronet þ Vertrauen þ Home of Synchronet þ telnet://vert.synchro.net
  • From Joe Delahaye@VERT to Poindexter Fortran on Friday, February 06, 2015 19:41:49
    Re: Backing up w/users online/server active?
    By: Poindexter Fortran to Joe Delahaye on Fri Feb 06 2015 10:38:26

    Here's my backup script -- nothing fancy. I run it as a timed, exclusive event. Given the discussions here I thought it might inspire other people or someone might offer some improvements.


    Interesting. However, I meant more the weekly drive image to an external drive, using the windows backup utility. I also have things set to backup up files as they change, to that same drive, (Western Digital My Passport), using the program that came with it. I would like to find the command line to start the diskimage backup, but have yet to find that. I was able to create a shortcut, but that is not specific enought. It simply allows me to go directly to the backup and restore area, rather then having to open Control Panel first.

    --- SBBSecho 2.27-Win32
    * Origin: The Lions Den BBS, Trenton, On, CDN (1:249/303)
    þ Synchronet þ Vertrauen þ Home of Synchronet þ telnet://vert.synchro.net
  • From Bill McGarrity@VERT to mark lewis on Saturday, February 07, 2015 00:54:00
    On 02-06-15 17:44, mark lewis wrote to Poindexter Fortran <=-


    On Fri, 06 Feb 2015, Poindexter Fortran wrote to Joe Delahaye:

    SET backupdate=%date:~-4,4%%date:~-10,2%%date:~-7,2%

    hey! there ya go! :)


    Saw that... :)


    --

    Bill

    Telnet: tequilamockingbirdonline.net
    Web: bbs.tequilamockingbirdonline.net
    FTP: ftp.tequilamockingbirdonline.net:2121
    IRC: irc.tequilamockingbirdonline.net Ports: 6661-6670 SSL: +6697
    Radio: radio.tequilamockingbirdonline.net:8010/live


    ... Look Twice... Save a Life!!! Motorcycles are Everywhere!!!
    === MultiMail/Win32 v0.50
    --- SBBSecho 2.27-Win32
    * Origin: TequilaMockingbird Online - Toms River, NJ (1:266/404)
    þ Synchronet þ Vertrauen þ Home of Synchronet þ telnet://vert.synchro.net
  • From Mro@VERT/BBSESINF to Joe Delahaye on Saturday, February 07, 2015 06:17:37
    Re: Backing up w/users online/server active?
    By: Joe Delahaye to Digital Man on Wed Feb 04 2015 10:57 pm

    Hmm. I do a drive image (via Windows backup) once a week. If I could figure out how to call that from a command line, should I run it as an event, or would that stop the BBS until the event is finished running? I have yet to find a way to automate that.


    use windows scheduler
    ---
    þ Synchronet þ ::: BBSES.info - free BBS services :::
  • From Mro@VERT/BBSESINF to Joe Delahaye on Saturday, February 07, 2015 06:18:33
    Re: Backing up w/users online/server active?
    By: Joe Delahaye to Digital Man on Thu Feb 05 2015 11:04 pm


    I do it manually by using Control Panel and the backup option right now. However, unless I can find a command line to call that procedure in Vista, it probably will never make it as an event.


    just make a batchfile and archive your sbbs\data sbbs\ctrl once a week
    ---
    þ Synchronet þ ::: BBSES.info - free BBS services :::
  • From Joe Delahaye@VERT to Mro on Saturday, February 07, 2015 17:14:23
    Re: Backing up w/users online/server active?
    By: Mro to Joe Delahaye on Sat Feb 07 2015 06:17:37

    Hmm. I do a drive image (via Windows backup) once a week. If I could
    figure out how to call that from a command line, should I run it as an
    event, or would that stop the BBS until the event is finished running?
    I have yet to find a way to automate that.


    use windows scheduler

    I tried that. It wanted a command, which I could not find.
    I will try what DM has found, and see what happens
    --- SBBSecho 2.27-Win32
    * Origin: The Lions Den BBS, Trenton, On, CDN (1:249/303)
    þ Synchronet þ Vertrauen þ Home of Synchronet þ telnet://vert.synchro.net
  • From Joe Delahaye@VERT to Mro on Saturday, February 07, 2015 17:16:11
    Re: Backing up w/users online/server active?
    By: Mro to Joe Delahaye on Sat Feb 07 2015 06:18:33

    I do it manually by using Control Panel and the backup option right
    now. However, unless I can find a command line to call that procedure
    in Vista, it probably will never make it as an event.


    just make a batchfile and archive your sbbs\data sbbs\ctrl once a week

    Oh, I have no problems backing up files as they change <G> Its the disk image I wanted automated.
    --- SBBSecho 2.27-Win32
    * Origin: The Lions Den BBS, Trenton, On, CDN (1:249/303)
    þ Synchronet þ Vertrauen þ Home of Synchronet þ telnet://vert.synchro.net
  • From Joe Delahaye@VERT to Digital Man on Saturday, February 07, 2015 17:12:41
    Re: Backing up w/users online/server active?
    By: Digital Man to Joe Delahaye on Fri Feb 06 2015 16:09:48

    A quick web search pointed me here: https://technet.microsoft.com/en-us/library/cc754015%28WS.10%29.aspx

    Apparently the command-line tool "wbadmin" is used for this purpose.

    digital man

    I wonder why I never found that. I did indeed google for it, or should I say, I search the MS site. Obviously I used the wrong search terms <G>

    Thanks.
    --- SBBSecho 2.27-Win32
    * Origin: The Lions Den BBS, Trenton, On, CDN (1:249/303)
    þ Synchronet þ Vertrauen þ Home of Synchronet þ telnet://vert.synchro.net