Simple Machines Community Forum

Customizing SMF => SMF Coding Discussion => Topic started by: viulian on September 24, 2006, 05:00:55 PM

Title: Java SMF automated database backup
Post by: viulian on September 24, 2006, 05:00:55 PM
Hi Guys!

I have made an application which automatically downloads the SMF database at regular intervals (minimum 1 hour, maximum 72 hours).

For anyone's interested:
- Java based - runs on each platform where Java runs, and has a nice GUI for configuring the forums and downloads. It requires JDK 1.5 (Generics included).
- Supports multiple forums, for SMF lovers :)
- On Windows it can minimize itself to system tray, and will continue to run.
- I have tested it on Windows XP using Sun's JDK 1.5.0_07 and on a RedHat Linux 7.3 using the same version JDK but for Linux. I see no problem why it won't work on Mac too.
- SMF 1.0.8 and 1.1 RC3 were tested.
- HTTP Proxy support (no Socks yet).

Application should be considered beta so far.. I have tested only on my forums and it's a pretty straight forward configuration, for example I have not changed the default settings. But I can't figure out all the possible configurations out there in the wild, so please let me know if you have issues with the application. (There's also a Debug mode build it, it will generate a rather big file but I'll investigate it and provide a fix if i'll be able to understand what goes wrong).

For the latest update follow this link: http://hex.ro/wp/projects/java-smf-backup/

Screen Shots (using Liquid Look and Feel):

Main Window:
(https://www.simplemachines.org/community/proxy.php?request=http%3A%2F%2Fhex.ro%2Ffiles%2Fsmfbk%2Fscreenshots%2Fmainwindow.jpg&hash=cb9cb92383a9b1714a7d737ef70cb84145d7a91e)

Forum Management Dialog:
(https://www.simplemachines.org/community/proxy.php?request=http%3A%2F%2Fhex.ro%2Ffiles%2Fsmfbk%2Fscreenshots%2Fmanage_forums.jpg&hash=f26f308883f955cb1f40c971c4ae0bf8b662cedb)

PS: later edit -> updated Application URL, thanks SiNaN.

PS: later edit -> after discussions with ups, it may be that Java SMF Backup will not work on large forums with low PHP memory limits. PHP process creating the backup might run out of memory. It is not a limit of Java SMF Backup. For example, 128Mb memory limit for PHP process is low for a forum that has the raw SQL (mysql-dump of the database) of ~100Mb; I keep the memory limit to 256Mb and is OK without zip compression (but still fails if I enable _zip_ compression). In case you have low php memory limit which you can't modify, you might need to consider different backup solution. (March 22, 2011)

PS: I've disabled downloads for all versions which are older than 1.3.5 ... You will now be redirected on the project page where you can download version 1.4.0 (supporting latest SMF releases).(Oct 8, 2011)
Title: Re: Java SMF automated database backup
Post by: JayBachatero on October 23, 2006, 01:11:20 PM
viulian great job on this tool.  Will be very useful for many people.
Title: Re: Java SMF automated database backup
Post by: usermike3969 on October 24, 2006, 02:19:43 AM
Works very good  :) :D

i was looking for something like this thank you very much  :)


Title: Re: Java SMF automated database backup
Post by: viulian on October 26, 2006, 02:48:51 PM
Thank you :)

I saw that the software is being downloaded but no one said a thing about it :D so I did not know what to believe.
Title: Re: Java SMF automated database backup
Post by: xduugu on October 26, 2006, 04:14:27 PM
I don't see any possibility to download the source code :-\
Title: Re: Java SMF automated database backup
Post by: viulian on October 26, 2006, 04:18:55 PM
I will upload the sourcecode to google code shortly - but didn't have enough time to set up an account there and fiddle a bit with the system.
Title: Re: Java SMF automated database backup
Post by: xduugu on October 26, 2006, 05:15:14 PM
ah ok. thanks.
Title: Re: Java SMF automated database backup
Post by: viulian on October 28, 2006, 02:59:07 AM
For anyone interested, the source code is now available via SVN from:

http://javasmfbackup.googlecode.com/svn/releases/v1.00/src/
Title: Re: Java SMF automated database backup
Post by: viulian on December 21, 2006, 02:16:27 AM
Well, after 150 downloads - I see no feedback yet :)

Is anyone using this tool ?
Title: Re: Java SMF automated database backup
Post by: KGIII on December 21, 2006, 02:22:43 AM
viulian:

If you're interested I can send you a PM and perhaps set an account up for you where you can host it without relying on using Google? If you're happy with them (I understand they're more user-friendly than sourceforge.net) then just go ahead and ignore this.
Title: Re: Java SMF automated database backup
Post by: Ken. on May 18, 2007, 07:01:44 AM

Thanks for a great application!
For some time now I've been researching database backup options and trying different ways of doing daily backups with scripts + cronjob and some of them work good but to this point none have given me exactly what I want. Your app appears to do just that, do the backup on a schedule and download it directly to a specified folder on my computer.

So far I like the way it works and not seeing any downside to the app at all.
Thanks... Ken
Title: Re: Java SMF automated database backup
Post by: Tanks on May 18, 2007, 09:38:01 AM
Is there anyway to make this not use gzip ?
Title: Re: Java SMF automated database backup
Post by: viulian on May 18, 2007, 10:08:44 AM
Ken: Thank you for the kind words :)

Tanks:

Nope, not from the GUI.

I add this to the future release for the code.

Can you tell me what the problem is with gzip :) ?
I thought it is perfect (i mean my DB has 40mb and zipped goes down to 10Mb or so). I saw only advantages in using gzip so that's why I'm asking.

Thanks.
Title: Re: Java SMF automated database backup
Post by: Ken. on May 18, 2007, 11:31:50 AM
Heres a feature request:  ;)

Not knowing to coding requirements for an app like this my request may be way off base, but here it is...
Would you please consider adding the ability for Java SMF Backup to be able to also backup other types of databases? It would be great if it was also able to backup the db for Coppermine that many SMF users have along with their forums.
Title: Re: Java SMF automated database backup
Post by: viulian on May 18, 2007, 01:15:14 PM
Ken, it is possible (easiest for me that is) if coppermine lets you make backup from the webpage (just like on SMF for example, where you can make backups if you login as admin and go to the Forum Maintenance area).

Never used coppermine, that's why I'm asking :)

This application is nothing else, it's just a 'browser' which connects on your behalf to the SMF's admin area, and makes the exact 'clicks' you do when you manually backup your server.
If Coppermine offers such a way of backing up, than it will be easier for me to simulate a user interaction from the code.

Title: Re: Java SMF automated database backup
Post by: Ken. on May 18, 2007, 01:55:59 PM
There is not a built-in backup with Coppermine, but a plug-in is offered in this thread:
http://coppermine-gallery.net/forum/index.php?topic=40439.0

Please note that it is listed as experimental so I don't know if it would fit for this case.
Title: Re: Java SMF automated database backup
Post by: lesmond on May 18, 2007, 02:58:06 PM
viulian, Thanks for this :) I have just downloaded (Thanks to Ken, for telling us about it over at TinyPortal) I will let you know how I get on
Title: Re: Java SMF automated database backup
Post by: viulian on May 18, 2007, 03:47:06 PM
Thanks :)

I don't know how the application will behave with TinyPortal's index.php.
You should give it the URL of the forum itself, just as you'll be accessing the forum standalone. Otherwise there might be other 'clicks' in the middle before getting from TP index to SMF's Admin's area, hence the application will not work.

Title: Re: Java SMF automated database backup
Post by: Ken. on May 18, 2007, 04:32:40 PM
Quote from: viulian on May 18, 2007, 03:47:06 PM
Thanks :)

I don't know how the application will behave with TinyPortal's index.php.
You should give it the URL of the forum itself, just as you'll be accessing the forum standalone. Otherwise there might be other 'clicks' in the middle before getting from TP index to SMF's Admin's area, hence the application will not work.

Thats how mine is set (with a direct link to the forum) and it works as expected... my site is set to automatically go to the forum home page even if only www.mysite.com is entered into your browser, but I haven't tried that to see if it would work.
Title: Re: Java SMF automated database backup
Post by: Tanks on May 19, 2007, 04:06:28 AM
Quote from: viulian on May 18, 2007, 10:08:44 AM
Nope, not from the GUI.

I add this to the future release for the code.

Can you tell me what the problem is with gzip :) ?
I thought it is perfect (i mean my DB has 40mb and zipped goes down to 10Mb or so). I saw only advantages in using gzip so that's why I'm asking.

Thanks.

My Gzip times out.. it stopped working when my database hit 10 Mb.. i think its around14-15 Mb now..

And last time i had to run a database backup i could only get it to work with the unpacked sql file..

so thats two reasons for me to not use gzip..  :( even if i wanted to ;)

Ps. as a feature request i would like to see the possibility to restore the database using this tool.. Is that even possible.. the reason why i ask this is because i get all sweaty and nerveous when i go to phpmyadmin or whatever you call that bloody thing.. i want something simple when it comes to my database.. like the roll-back-feature that is buildt into my Windows OS.

Anyway keep up the good work making life as SMF admin simple  ;) And thanks to the Dude who posted the link over at TinyPortal  :D
Title: Re: Java SMF automated database backup
Post by: RoarinRow on May 19, 2007, 12:35:54 PM
Is there a way it could back up to a directory on my server instead of my PC? 
Title: Re: Java SMF automated database backup
Post by: viulian on May 19, 2007, 12:58:50 PM
Yep, it works, even if I didn't test it before with this scenario :)

You should go to Forums -> Settings... and in the "Backup Directory" text box type something like:

\\192.168.2.103\Share\BKForums

Of course you need to have write access, otherwise you'll end up with a FileNotFoundException/IOException or something Java would throw.
Title: Re: Java SMF automated database backup
Post by: Ken. on May 19, 2007, 03:02:48 PM
Quote from: Tanks on May 19, 2007, 04:06:28 AM
Ps. as a feature request i would like to see the possibility to restore the database using this tool.. Is that even possible.. the reason why i ask this is because i get all sweaty and nerveous when i go to phpmyadmin or whatever you call that bloody thing.. i want something simple when it comes to my database.. like the roll-back-feature that is buildt into my Windows OS.

And thanks to the Dude who posted the link over at TinyPortal :D

You are welcome!  ;)

Just a thought here based on the feature request by Tanks;
At this point this b/u script looks at the SMF built-in backup utility and executes it to get the backup, is this correct???

If so heres my thought/question... we also have two php backup/restore files available that might be worth a look to see if they could be used to add a restore feature to Java SMF Backup.
Those two files are in this thread posted by [Unknown];
http://www.simplemachines.org/community/index.php?topic=18350.msg168327#msg168327
Title: Re: Java SMF automated database backup
Post by: viulian on May 19, 2007, 03:39:18 PM
Thanks for the links :)

I have to describe why I have created the application, and my vision about it - and thus explain why I wouldn't like anything related to additional scripts uploaded on the servers.

My main drive when creating this application was to avoid any manual patching/hacking/uploading of helper scripts on the forums.
I mean you need ftp/rights/make sure they work standalone, and only then install the application and pray it works :)... And then maybe loose data when trying a restore, etc.
I have 2 live forums + some test ones and doing that much manual labor on them would amount to.... i don't even want to think about it.

I was so lasy I haven't tried any of that above - I kinda felt how shaky that would be.
I was content with manually making backup with PhpMyAdmin/SMF built in utility, till my hosting provider started failing from time to time, and I needed a way to know that each day I have a fresh backup.

And the rest is history :)
Never touched cron/fakecron/etc, I aimed for something that was painless even for me the lazy one to use :D
Took me a couple of weeks to do (worked from time to time) then with Grudge's help published it here, and now, after >3000 downloads, everyone likes it :)

Why ? No pain to run it + it works.

-

Those being said, here's how I think its best for the app to be extended:
It will be in fact a wrapper for phpmyadmin.
It will do the 'clicks' for you and intercept the download which will be saved on the filesystem. You will be able to specify all the databases you want to be backed up, such as they appear in the phpmyadmin dropdowns, specify the user/pass for each one, and then the program will take care of downloading them.
This will solve the coppermine bk issue (directly backing up the database), and will also let you restore the databases using phpmyadmin.

I'll also keep the current functionality - so if people are not that keen on restoring their db will still find the application very easy to use. I mean, I never needed a restore - I just want to feel safe that I have a backup :)

--

So please bare with me, till I get around and extend this application. It will probably take a month but it will work - but you won't ever need to touch FTP again :)

Title: Re: Java SMF automated database backup
Post by: Tanks on May 20, 2007, 12:35:57 PM
This sounds great  :)
Title: Re: Java SMF automated database backup
Post by: viulian on May 20, 2007, 12:54:13 PM
Thanks for support!

Just found out there are some heavy usage users who have SQL files that get up to 250Mb :D and that surpasses over any normal limit phpmyadmin (or any php script in fact) might accept via a POST.

So... I guess I might do it with some generic scripts which the application will upload via FTP, call them via HTTP to create backup SQL files and then the application downloads them back to the computer via FTP too. The same for restore.

But I'm a bit overwhelmed as there are only a few users which such huge requirements and all sort of things can make the whole FTP/HTTP/FTP chain to break, rendering the application a failure for anyone expecting it just to work.

I'll see..
Title: Re: Java SMF automated database backup
Post by: Ken. on May 21, 2007, 11:40:39 AM
If there are only a few who have the large file issue would it be reasonable to have a 'regular' version for smaller sized db's and then write some kind of add-on feature so that folks with those large file requirements could use the utility as well?

QuoteBut I'm a bit overwhelmed as there are only a few users which such huge requirements and all sort of things can make the whole FTP/HTTP/FTP chain to break, rendering the application a failure for anyone expecting it just to work.
Title: Re: Java SMF automated database backup
Post by: dyota on May 22, 2007, 09:24:52 AM
is it ok for smf 1.1.2 and other mods?
Title: Re: Java SMF automated database backup
Post by: viulian on May 22, 2007, 09:33:14 AM
Sure! As long as none of the mods will take over the index.php of the forum.

Here are the mods I have installed:

1.     Merge Double Posts      1.0.6      [ List Files ]  [ Delete ]
2.    Invite    1.13    [ Uninstall ] [ List Files ] [ Delete ]
3.    AvatarSelect    1.1.2    [ Uninstall ] [ List Files ] [ Delete ]
4.    Karma Description Mod    2.2    [ Uninstall ] [ List Files ] [ Delete ]
5.    Personality Tests    1.0.1    [ Uninstall ] [ List Files ] [ Delete ]
6.    Rename Topic    1.0.2    [ Uninstall ] [ List Files ] [ Delete ]
7.    require-dir Tag fix.    1.0    [ Uninstall ] [ List Files ] [ Delete ]
8.    YouTube BBC Tag (XHTML Compliant)    1.0    [ Uninstall ] [ List Files ] [ Delete ]
9.    Pligg Bridge Integration Mod    1.1.0    [ Uninstall ] [ List Files ] [ Delete ]
10.    SMF File Manager    1.0.3    [ Uninstall ] [ List Files ] [ Delete ]
11.    SMF 1.1.2 Update Package    1.1.2    [ Uninstall ] [ List Files ] [ Delete ]
Title: Re: Java SMF automated database backup
Post by: dyota on May 22, 2007, 11:04:11 AM
Quote1.     SMF 1.1.2 Update Package      1.1.2      [ List Files ]  [ Delete ]
2.    Gender On Registration    1.0    [ Uninstall ] [ List Files ] [ Delete ]
3.    Users Online Today Mod    1.4.0    [ Uninstall ] [ List Files ] [ Delete ]
4.    TinyPortal    0.983    [ Apply Mod ] [ List Files ] [ Delete ]
5.    MessagePreviewOnHover    1.5    [ Uninstall ] [ List Files ] [ Delete ]
6.    Invite a Friend    1.0    [ Uninstall ] [ List Files ] [ Delete ]
7.    Member Awards    1.0.2    [ Uninstall ] [ List Files ] [ Delete ]
8.    Frequency Bar    1.1    [ Uninstall ] [ List Files ] [ Delete ]
9.    PFCChatroom    1.0.9    [ Uninstall ] [ List Files ] [ Delete ]
10.    SMF Gallery Lite    1.7.1    [ Uninstall ] [ List Files ] [ Delete ]
11.    Welcome Topic Mod    1.0    [ Uninstall ] [ List Files ] [ Delete ]
12.    SMFShop    3.0    [ Uninstall ] [ List Files ] [ Delete ]
13.    Password Protect Boards    0.1    [ Uninstall ] [ List Files ] [ Delete ]
14.    Karma Description Mod    2.3    [ Uninstall ] [ List Files ] [ Delete ]
15.    Subject Statistics In Subject 2.2    2.2    [ Uninstall ] [ List Files ] [ Delete ]
16.    Ad Managment    2.3    [ Uninstall ] [ List Files ] [ Delete ]
17.    cbi, 1.0    1.0    [ Uninstall ] [ List Files ] [ Delete ]
18.    SMF Trader System    1.0.1    [ Uninstall ] [ List Files ] [ Delete ]
19.    View Only Boards    1.0    [ Uninstall ] [ List Files ] [ Delete ]
20.    Global Announcements    1.0    [ Uninstall ] [ List Files ] [ Delete ]
21.    Board Viewers Mod

these are my mods...hehehhe lot of..just to make sure
Title: Re: Java SMF automated database backup
Post by: viulian on May 22, 2007, 01:01:43 PM
[I just edited this post as it is flawed. Please check the next two answers for explanations]

My post was:
I don't know how TinyPortal works - that might use SMF Integration API.. making my module useless.

Title: Re: Java SMF automated database backup
Post by: Ken. on May 22, 2007, 01:27:18 PM
You would need to ask over on the TP forum to be sure, but I don't think that it would have any effect at all... I have TP installed on both of the forums that I'm using your current version of Java SMF Backup to do my b/u's and its no problem that I can see.

Several times in the past I've completely wiped my site clean and started over with a fresh database and then fresh installs of SMF, TP and my html pages and after its all up and running then simply import the last saved mySQL database backup into the d/b and its all back to like before. So, I don't see that this would be any different, but then I'm not a coder so my opinion may be wrong.

EDIT: This is just IMHO and keep in mind that I'm not a coder but whether you use the SMF built-in backup or wrap the phpmyadmin as you mentioned in the one post I just don't see it making any difference what mods are installed because the backup will just collect up the required data from the d/b and send a copy without having any direct effect on any mods because its not changing anything, just collecting data. 
Title: Re: Java SMF automated database backup
Post by: viulian on May 22, 2007, 01:47:02 PM
Darn.

I'm confused - sorry guys :)

I just published a integration mod for SMF to Pligg (open source social bookmarking tool) and being busy at work somehow I confused the threads and of course, the answers  >:(

Thanks Ken. for waking me up to it gently :)

The answer to the initial question dyota had remains as I gave it. It doesn't matter as long as the given URL is the forum URL (i mean it points to the SMF's index.php and not some other entry page).
Title: Re: Java SMF automated database backup
Post by: Ken. on May 22, 2007, 04:24:19 PM
Hey you had me confused too... but then I'm easy!  ;D
Title: Re: Java SMF automated database backup
Post by: CrayZ on May 27, 2007, 07:02:10 PM
It is a good program, but unfortunately on Yahoo server is not working. :(
Title: Re: Java SMF automated database backup
Post by: philwojo on June 01, 2007, 11:35:44 AM
I am getting the following when I try to run this now.  It was working, but not it has stopped.

[01/06 10:33:28] Backup request received.
[01/06 10:33:28] Connection starting.
[01/06 10:33:28] Connecting to http://www.aaaaaa.com/forum/index.php?action=admin
[01/06 10:33:28] class java.lang.NullPointerException: null
[01/06 10:33:28] Next run at: Jun 2, 2007 1:45:00 AM

The "aaaaaa" is where my domain name is at (removed by me to post here). 

Any ideas of what might be wrong on my end?

thanks,
Phil

Title: Re: Java SMF automated database backup
Post by: viulian on June 01, 2007, 12:11:36 PM
I can help if you enable Debug mode inside the application, and you can copy/paste the log around the exception you'll see there..

Thanks!
Title: Re: Java SMF automated database backup
Post by: philwojo on June 01, 2007, 12:20:47 PM
I am not sure if you need more or less than this, but here it is:

Jun 1, 2007 11:15:58 AM org.apache.commons.httpclient.HttpParser parseHeaders
FINEST: enter HeaderParser.parseHeaders(InputStream, String)
Jun 1, 2007 11:15:58 AM org.apache.commons.httpclient.HttpParser readLine
FINEST: enter HttpParser.readLine(InputStream, String)
Jun 1, 2007 11:15:58 AM org.apache.commons.httpclient.HttpParser readRawLine
FINEST: enter HttpParser.readRawLine()
Jun 1, 2007 11:15:58 AM org.apache.commons.httpclient.Wire wire
FINE: << "[\r]"
Jun 1, 2007 11:15:58 AM org.apache.commons.httpclient.Wire wire
FINE: << "[\n]"
Jun 1, 2007 11:15:58 AM org.apache.commons.httpclient.HttpMethodBase shouldCloseConnection
FINE: Should NOT close connection in response to directive: Keep-Alive
Jun 1, 2007 11:15:58 AM org.apache.commons.httpclient.HttpConnection isResponseAvailable
FINEST: enter HttpConnection.isResponseAvailable()
Jun 1, 2007 11:15:58 AM org.apache.commons.httpclient.HttpConnection releaseConnection
FINEST: enter HttpConnection.releaseConnection()
Jun 1, 2007 11:15:58 AM org.apache.commons.httpclient.HttpConnection releaseConnection
FINE: Releasing connection back to connection manager.
Jun 1, 2007 11:15:58 AM smfbackup.conf.Forum updateStatus
FINE: xxx: about to firelogupdate
Jun 1, 2007 11:15:58 AM smfbackup.conf.Forum updateStatus
FINE: AAAAAAA: class java.lang.NullPointerException: null
Jun 1, 2007 11:15:58 AM smfbackup.http.SMFConnection doJob
SEVERE: java.lang.NullPointerException
Jun 1, 2007 11:15:58 AM smfbackup.conf.Forum updateStatus
FINE: xxx: about to firelogupdate
Jun 1, 2007 11:15:58 AM smfbackup.conf.Forum updateStatus
FINE: Philwojo: Next run at: Jun 2, 2007 1:45:00 AM
Jun 1, 2007 11:16:01 AM java.awt.KeyboardFocusManager retargetFocusEvent
FINE: >>> java.awt.event.WindowEvent[WINDOW_LOST_FOCUS,opposite=null,oldState=0,newState=0] on frame0
Jun 1, 2007 11:16:01 AM java.awt.DefaultKeyboardFocusManager dispatchEvent
FINE: java.awt.event.WindowEvent[WINDOW_LOST_FOCUS,opposite=null,oldState=0,newState=0] on frame0
Jun 1, 2007 11:16:01 AM java.awt.DefaultKeyboardFocusManager dispatchEvent
FINE: Active smfbackup.MainWindow[frame0,314,232,653x520,invalid,layout=java.awt.BorderLayout,title=SMF Backup,resizable,normal,defaultCloseOperation=DISPOSE_ON_CLOSE,rootPane=javax.swing.JRootPane[,4,30,645x486,invalid,layout=javax.swing.JRootPane$RootLayout,alignmentX=0.0,alignmentY=0.0,border=,flags=16777673,maximumSize=,minimumSize=,preferredSize=],rootPaneCheckingEnabled=true], Current focused smfbackup.MainWindow[frame0,314,232,653x520,invalid,layout=java.awt.BorderLayout,title=SMF Backup,resizable,normal,defaultCloseOperation=DISPOSE_ON_CLOSE,rootPane=javax.swing.JRootPane[,4,30,645x486,invalid,layout=javax.swing.JRootPane$RootLayout,alignmentX=0.0,alignmentY=0.0,border=,flags=16777673,maximumSize=,minimumSize=,preferredSize=],rootPaneCheckingEnabled=true], losing focus smfbackup.MainWindow[frame0,314,232,653x520,invalid,layout=java.awt.BorderLayout,title=SMF Backup,resizable,normal,defaultCloseOperation=DISPOSE_ON_CLOSE,rootPane=javax.swing.JRootPane[,4,30,645x486,invalid,layout=javax.swing.JRootPane$RootLayout,alignmentX=0.0,alignmentY=0.0,border=,flags=16777673,maximumSize=,minimumSize=,preferredSize=],rootPaneCheckingEnabled=true] opposite null
Jun 1, 2007 11:16:01 AM java.awt.KeyboardFocusManager retargetFocusEvent
FINE: >>> java.awt.event.FocusEvent[FOCUS_LOST,temporary,opposite=null] on javax.swing.JTree[,0,0,146x415,alignmentX=0.0,alignmentY=0.0,border=,flags=16777576,maximumSize=,minimumSize=,preferredSize=,editable=false,invokesStopCellEditing=false,largeModel=false,rootVisible=true,rowHeight=0,scrollsOnExpand=true,showsRootHandles=false,toggleClickCount=2,visibleRowCount=20]
Jun 1, 2007 11:16:01 AM java.awt.DefaultKeyboardFocusManager dispatchEvent
FINE: java.awt.event.FocusEvent[FOCUS_LOST,temporary,opposite=null] on javax.swing.JTree[,0,0,146x415,alignmentX=0.0,alignmentY=0.0,border=,flags=16777576,maximumSize=,minimumSize=,preferredSize=,editable=false,invokesStopCellEditing=false,largeModel=false,rootVisible=true,rowHeight=0,scrollsOnExpand=true,showsRootHandles=false,toggleClickCount=2,visibleRowCount=20]
Jun 1, 2007 11:16:01 AM java.awt.KeyboardFocusManager setNativeFocusOwner
FINEST: Calling peer sun.awt.KeyboardFocusManagerPeerImpl@b85c17 setCurrentFocusOwner for null
Jun 1, 2007 11:16:01 AM java.awt.Component dispatchEventImpl
FINE: java.awt.event.FocusEvent[FOCUS_LOST,temporary,opposite=null] on javax.swing.JTree[,0,0,146x415,alignmentX=0.0,alignmentY=0.0,border=,flags=16777576,maximumSize=,minimumSize=,preferredSize=,editable=false,invokesStopCellEditing=false,largeModel=false,rootVisible=true,rowHeight=0,scrollsOnExpand=true,showsRootHandles=false,toggleClickCount=2,visibleRowCount=20]
Jun 1, 2007 11:16:01 AM java.awt.KeyboardFocusManager retargetFocusEvent
FINE: >>> java.awt.event.WindowEvent[WINDOW_DEACTIVATED,opposite=null,oldState=0,newState=0] on frame0
Jun 1, 2007 11:16:01 AM java.awt.DefaultKeyboardFocusManager dispatchEvent
FINE: java.awt.event.WindowEvent[WINDOW_DEACTIVATED,opposite=null,oldState=0,newState=0] on frame0
Jun 1, 2007 11:16:01 AM java.awt.KeyboardFocusManager setGlobalActiveWindow
FINER: Setting global active window to null, old active smfbackup.MainWindow[frame0,314,232,653x520,invalid,layout=java.awt.BorderLayout,title=SMF Backup,resizable,normal,defaultCloseOperation=DISPOSE_ON_CLOSE,rootPane=javax.swing.JRootPane[,4,30,645x486,invalid,layout=javax.swing.JRootPane$RootLayout,alignmentX=0.0,alignmentY=0.0,border=,flags=16777673,maximumSize=,minimumSize=,preferredSize=],rootPaneCheckingEnabled=true]
Jun 1, 2007 11:16:01 AM java.awt.KeyboardFocusManager retargetFocusEvent
FINE: >>> java.awt.event.FocusEvent[FOCUS_LOST,permanent,opposite=null] on frame0
Jun 1, 2007 11:16:01 AM java.awt.DefaultKeyboardFocusManager dispatchEvent
FINE: java.awt.event.FocusEvent[FOCUS_LOST,permanent,opposite=null] on frame0
Jun 1, 2007 11:16:01 AM java.awt.DefaultKeyboardFocusManager dispatchEvent
FINE: Skipping java.awt.event.FocusEvent[FOCUS_LOST,permanent,opposite=null] on frame0 because focus owner is null


I am trying to run this from work and I have tried it both with and without a proxy.  If it could be that I can try it from home also, but it did work from work previously, and I made no changes.

Thanks,
Phil
Title: Re: Java SMF automated database backup
Post by: viulian on June 01, 2007, 01:02:48 PM
It looks indeed to be a problem on the doLogin() method.

There can be to explanations:

a)

Have you installed some firewall/antivirus that intercepts the IP messages and maybe alters the headers that pass through it ?

b)

A mod installed on SMF which added a <form> tag without an 'action' specified.

Basically you should try and open http://www.aaaaaa.com/forum/index.php?action=admin in your browser (make sure you're not logged in; nor having the passwords saved, etc). Basically try and open the page just as the application would do, like it would connect for the first time to the site, having no cookies, no password saved, etc.

Search for all the <form> tags and find if there is one which doesn't have an 'action' attribute specified. If there is one, that's where the NullPointerException is generated.


I am positive one of these is the cause of your problems - and I incline towards the latter. Please check it and let me know..
Title: Re: Java SMF automated database backup
Post by: philwojo on June 01, 2007, 02:07:53 PM
I am able to get a login screen from that link.

I am not sure if there are any <form> tags, where would be the best place to look, I am very new to this, but have a solid idea of what is going on, at least I think I do.

Being I am at work I have not installed any firewall/antivirus programs at all, and I don't think that corporate has done any that I am aware of.

Thanks for the quick replies,
Phil
Title: Re: Java SMF automated database backup
Post by: viulian on June 01, 2007, 03:36:46 PM
If you use Internet Explorer, please go to the login prompt and select View menu, and from there the item "Source".
If you are using Mozilla Firefox, again, at the login page (on the ?action=admin URL I mean) press Ctrl-U.

Then, you should search the word "form".


The form tag, in HTML, should look something like
<form .... action="some_string_here" ....>

So please search for form and see, if between the '<' and '>' where the form stands if there an word named 'action'.

Thanks :)
Title: Re: Java SMF automated database backup
Post by: philwojo on June 01, 2007, 03:49:22 PM
I use firefox and do see several instances of that and they all have this link:

<form action="http://www.AAAAAAAA.com/forum/index.php?action=login2" method="post" accept-charset="ISO-8859-1" name="frmLogin" id="frmLogin" onsubmit="hashLoginPassword(this, 'xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx');">

Phil
Title: Re: Java SMF automated database backup
Post by: viulian on June 01, 2007, 04:02:01 PM
Can you please PM me with an URL to your forum ?
I do not need any username / password - I just need to make sure that when you type in "http://www.AAAAAAAA.com/forum/index.php?action=login" you actually see an SMF login.

Maybe you have an additional password set in a .htaccess file which the browser lets you through as you already saved it, and only after that you are prompted with the forum login ?

I am sure that's something with a form that doesn't have an action :) but I can only prove it if I have a look..
Title: Re: Java SMF automated database backup
Post by: DreAmTaKeR on November 17, 2007, 09:53:32 PM
Thank you   :D
Title: Re: Java SMF automated database backup
Post by: Matthew Schenker on November 30, 2007, 09:27:51 AM
Hello,
I was using this tool when I was running Windows XP.  But I recently got rid of Windows and changed all my systems over to Linux (Kubuntu).

I would like to run the Java SMF Backup tool on Kubuntu, but I'm a little lost about how to do it.  Has anyone done this, and if so can you post tips or suggestions?

Thanks!
Title: Re: Java SMF automated database backup
Post by: viulian on November 30, 2007, 12:57:07 PM
Sure!

For Ubuntu (I did not use Kubuntu but I assume it's almost the same) I did the following:

1. Install Sun Java SDK 1.5, Ant (for compilation)


apt-get install sun-java5-jdk
apt-get install ant


(and please accept the other dependencies / licenses).

2. Test the installation

You should issue java -version and see an output such as:

root@glimpses:~# java -version
java version "1.5.0_13"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05)
Java HotSpot(TM) Client VM (build 1.5.0_13-b05, mixed mode, sharing)


3. Download Java SMF Backup zip (from the Downloads page) or from my page:

wget http://www.hex.ro/wb/tracker/EasyTracker.php?id=3

Unzip it then cd to the directory:

unzip JavaSMFBackup_v101.zip
cd JavaSMFBackup


4. Compile:

a) Edit file build.xml from the JavaSMFBackup directory and remove these three lines:

  <!-- launch4j task definition -->
  <taskdef name="launch4j" classname="net.sf.launch4j.ant.Launch4jTask"
    classpath="${launch4j.dir}/launch4j.jar :${launch4j.dir}/lib/xstream.jar" />


b) Issue ant command

ant

You should see an output like this:

root@glimpses:~/JavaSMFBackup# ant
Buildfile: build.xml

init:
    [mkdir] Created dir: /root/JavaSMFBackup/bin
    [mkdir] Created dir: /root/JavaSMFBackup/dist
    [mkdir] Created dir: /root/JavaSMFBackup/installers

compile:
    [javac] Compiling 14 source files to /root/JavaSMFBackup/bin

dist:
    [mkdir] Created dir: /root/JavaSMFBackup/bin/img
     [copy] Copying 9 files to /root/JavaSMFBackup/bin/img
      [jar] Building jar: /root/JavaSMFBackup/dist/SMFBackup.jar
     [copy] Copying 1 file to /root/JavaSMFBackup

BUILD SUCCESSFUL
Total time: 4 seconds


c) From the same directory, issue

java -jar SMFBackup.jar

You should see the window and be able to use it as you did on Windows.
Maybe you should add a shortcut to your desktop (with running directory /root/JavaSMFBackup and command the java -jar from above.

Please let me know if it worked :)

Here's a proof (my setup is Ubuntu 6.06 with TightVNC as X window manager):

(https://www.simplemachines.org/community/proxy.php?request=http%3A%2F%2Fi23.photobucket.com%2Falbums%2Fb395%2Fviulian%2Fviulian%2Fjava_smf_backup_linux.png&hash=e8558a3473f4882f49b7051ef6399865e4480f65)

Title: Re: Java SMF automated database backup
Post by: Matthew Schenker on November 30, 2007, 04:53:17 PM
viulian,
Thanks for the help on getting Java SMF Backup to run.

I'm still kind of new at using Linux, so all those steps get me a little anxious.  But I'll dive in later and give it a try, the report on how it works.

Thanks again,
Matthew
Title: Re: Java SMF automated database backup
Post by: viulian on December 05, 2007, 05:21:21 AM
Matthew,

Did you get some time to set things up ? How did it went ?
Title: Re: Java SMF automated database backup
Post by: Matthew Schenker on December 06, 2007, 03:41:40 PM
Quote from: viulian on December 05, 2007, 05:21:21 AM&lt;br /&gt;Matthew, &lt;br /&gt;&lt;br /&gt;Did you get some time to set things up ? How did it went ?&lt;br /&gt;

Unfortunately, I can't seem to get it working.

For now, I'll just use the built-in backup system in SMF Admin > Forum Maintenance - Backup Database.

I'm still getting up to full speed on Linux, so it's probably something I'm doing wrong!

Matthew
Title: Re: Java SMF automated database backup
Post by: viulian on December 06, 2007, 03:47:21 PM
Ok, I understand

I might help with your problem if you give me some error messages. But if you're ok with the standard backup, no rush :)

Title: Re: Java SMF automated database backup
Post by: AlphaHot1 on January 10, 2008, 12:55:56 PM
Thanks for the great program. Any chance that we'll have a command line only version?

It just needs to run the backup, everything else it's fine from the gui.

Something like:

SMFBackup -doBackup

This way I can use it with wget and do fully automated backup, it wold be wonderful, thanks ;)
Title: Re: Java SMF automated database backup
Post by: viulian on January 10, 2008, 02:49:26 PM
Never thought of it :) and thank you for the kind words.
I liked more the ideea of seeing the log, the download speed, so I did not do a command line version.

Anyway, I would like to work on a different approach on the next version I work on. The trouble with the forum is that if the database reaches sizes of 150Mb or so, forum's built in backup doesn't work anymore as php process doing the backup will die with an 'Out of memory' error.

But I'll try and add - if you have any ideeas, please let me know :)
Title: Re: Java SMF automated database backup
Post by: AlphaHot1 on January 10, 2008, 09:16:25 PM
Thanks for the quick response, however I've found an opern source php script phpMyBackuPro which can do a scheduled dump of the db on the server, so if it works I have just to download everything with wget ;)
Title: Re: Java SMF automated database backup
Post by: viulian on January 11, 2008, 05:40:41 AM
Yeah, that's another good ideea - given that you have access to a shell / crontab editor. I too do backups that way (but created my own cronjob as it was less hassle - using mysqldump instead of php).
Title: Re: Java SMF automated database backup
Post by: AlphaHot1 on January 11, 2008, 10:29:18 AM
I agree: my idea is to use crontab on my local machine beacause I don't have any shell account on the server neither I can use mysqldump (the db on my host accepts connection from localhost only).
That php script can do a scheduled backup in a clever manner: it loads the script everytime the main forum index is loaded (with a transparent gif ora an invisible frame), and if enough time has passed since the previus backup, it runs the backup.

This way I can do everythong from my local machine with wget and cron. The other solution would be to use your app via command line, but if I can I'll save you the hassle ;)

Thanks!
Title: Re: Java SMF automated database backup
Post by: Oscar on January 29, 2008, 11:23:28 AM
Thank you for the program. I like the simple interface and easy to use schedule options. (I do not always remember to make back-ups of the database.)

Two questions:

+ Doe this application make a complete backup of the database? (As in could I use its file for a full restoration of everything in the sql database?)

+ Does anyone have tool that will restore a large database? Could that be built into this application? (My sql.gz files are too large to upload via phpadmin and I do not have shell access.)

Thanks,
Oscar
Title: Re: Java SMF automated database backup
Post by: viulian on January 29, 2008, 04:29:55 PM
Hi Oscar!

Thank you for using my software!

1) the application makes a complete backup, yes. It is actually a 'browser' which does the clicks for you and downloads the database that in fact the forum admin page creates. And that's complete (in fact I use these databases to setup my local environment and it works).

2) Application doesn't have support for restore. It tries to do what's 'painful' to do [having regular backups] however a restore is very rarely needed. And if it happens, you should just upload the latest .sql via FTP along with, for example, the script from here: http://www.ozerov.de/bigdump.php; you execute script and it should do the import for itself then).

But yes, it can be built in the application - however - only few people have requested it so I didn't thought of it as a priority..

I'll think about it :)

Title: Re: Java SMF automated database backup
Post by: kizer on February 04, 2008, 12:53:25 PM
Awesome app. I use it every day. I let my PC at home idle and it backsup. At first I didn't trust it so I backed up and opened up the files and looked for that last post and sure enough it was there.

Restore feature would be cool like requested an or a command line for us command line junkies. I run BSD at home so it would be great to let it do its thing several times a day so I dont have to worry about it.

Anyways thanks for the app.
Title: Re: Java SMF automated database backup
Post by: mitch2k on February 06, 2008, 03:56:38 AM
Hey! The backup tool looks great. But I keen getting this error:

09:55:53] Method failed (downloadAction): HTTP/1.1 500 Internal Server Error

Any idea?
Title: Re: Java SMF automated database backup
Post by: viulian on February 06, 2008, 04:48:05 AM
Can you do backups using SMF admin web interface ?
Please try it, I think you are getting the internal server error too there (probably some redirects or some additional security added in .htaccess file - assuming that you are using Apache).

Please check and let me know.
Title: Re: Java SMF automated database backup
Post by: mitch2k on February 06, 2008, 10:40:14 AM
Hey,

backup works from the admin interface, but not when I turn on GZIP compression. Strange, cause this worked before.

The SMF DB is on an apache shared server. Is there anyway to force your program not to use gzip?

Thanks alot!
Title: Re: Java SMF automated database backup
Post by: viulian on February 06, 2008, 11:41:09 AM
If it worked before, it means that probably your database grew in size, and gzip-ing it takes a lot of memory (hence the internal server error as probably the php script is killed when it reaches an upper memory limit).

I cannot disable the gzip compression - the reason I choose not to implement it was that if there's not enough memory for gzip, probably the database is big - and transferring it unzipped will do a lot of traffic on your account.

If you need it quick (I am in process of rethinking the code and implement the changes other people asked for) and do not want to work on the existing code.

Do you know how to compile a java program ? The source code is available, and it's easy to compile it (I'll explain what to change to turn off the automated gzip).

Title: Re: Java SMF automated database backup
Post by: mitch2k on February 06, 2008, 12:37:33 PM
Well, it worked before, and the database is only 12MB big... Wich should not be a problem I guess.

Maybe it is a temporary problem with my host (one.com).

I have no experience with Java programming. But I'll take a look at the Sun tutorials, to if it's hard to learn...

Thanks!!
Title: Re: Java SMF automated database backup
Post by: res6cue on March 05, 2008, 12:39:55 AM
Quote from: viulian on February 06, 2008, 11:41:09 AM
Do you know how to compile a java program ? The source code is available, and it's easy to compile it (I'll explain what to change to turn off the automated gzip).

Please advise what steps I have to take to turn gzip off.  This is a great program, but my database is just too large for the server's upper memory limit to handle compressing it before download.  Transfer bandwidth usage is of no concern to me, but having a daily, automated backup of my database is!
Title: Re: Java SMF automated database backup
Post by: viulian on March 05, 2008, 02:59:50 AM
If you got to the point where you can compile the application - you'll find the tutorial inside the source code - you can then:

1) Open the file smfbackup.http.SMFConnection.java
2) Find the line:
currentMethod = new GetMethod(config.getProperty("forum.url") + "?struct=on&data=on&compress=gzip&action=dumpdb&sesc=" + sesc);
3) remove this part
&compress=gzip
(make sure that an & remains between data=on&action=dumpdb)
4) Recompile and that's it :)

Title: Re: Java SMF automated database backup
Post by: res6cue on March 05, 2008, 08:02:58 AM
Thanks.  Now the question is:  Where do I find the source files I'll need to recompile?!?
Title: Re: Java SMF automated database backup
Post by: viulian on March 05, 2008, 08:12:55 AM
The address was listed on the first page of the topic.
Please use your favorite SVN client and download them from:

http://javasmfbackup.googlecode.com/svn/releases/v1.01/

To compile, please check the COMPILE.txt file in there, you will need some utilities which are mentioned in there..
Title: Re: Java SMF automated database backup
Post by: res6cue on March 05, 2008, 11:19:09 AM
Mission accomplished!

I'm not sure why you won't publish a non-compressed version of this program, or have a compression on/off option per server.  It was almost a deal killer for me, as my database is too large to have compression enabled due to the limited upper memory my host has set.  It's a fantastic program otherwise, but there are a lot of people out there running into this same issue who have no earthly clue how to recompile programs.

I should point out that your instructions were incomplete, for those who might attempt to turn off compression and recompile themselves.  The following 3 lines in src\smfbackup\http\SMFConnection.java need to be changed in order to disable compression and name the file properly:

Line 254 changed from:
currentMethod = new GetMethod(config.getProperty("forum.url") + "?struct=on&data=on&compress=gzip&action=dumpdb&sesc=" + sesc);

To:
currentMethod = new GetMethod(config.getProperty("forum.url") + "?struct=on&data=on&action=dumpdb&sesc=" + sesc);


Line 259 changed from:
forum.updateStatus("Proceeding to backup. GET on " + config.getProperty("forum.url") + "?struct=on&data=on&compress=gzip&action=dumpdb&sesc=" + sesc);

To:
forum.updateStatus("Proceeding to backup. GET on " + config.getProperty("forum.url") + "?struct=on&data=on&action=dumpdb&sesc=" + sesc);


Line 307 from:
String path = Configuration.getBackupDir() + System.getProperty("file.separator") + forum.getName() + "_" + sdf.format(new Date()) + ".sql.gz";

To:
String path = Configuration.getBackupDir() + System.getProperty("file.separator") + forum.getName() + "_" + sdf.format(new Date()) + ".sql";
Title: Re: Java SMF automated database backup
Post by: res6cue on March 05, 2008, 11:33:22 AM
One other issue you need to fix is that the program gives an exception if Administration Security is enabled in SMF (which it is by default):

class smfbackup.http.SMFException: No "sesc" or "sc" input field found in the reply page. Cannot proceed.

I suspect it has something to do with this bit of code in SMFConnection.java:

        currentMethod.releaseConnection();
       
        if (sesc == null)
            throw new SMFException("No \"sesc\" or \"sc\" input field found in the reply page. Cannot proceed.");


We should not have to disable the Administration Security option in SMF just for the sake of running a backup.  It's an unnecessary security risk to do so.  There should be no reason your program can't send the password again when admin.php asks for it!
Title: Re: Java SMF automated database backup
Post by: viulian on March 05, 2008, 12:33:16 PM
Yah, thanks for pointing those lines out :) I coded this software an year ago or so - so I forgot.

About the Administrative Security issue, I've quickly glanced over the php code and it seems not as straight forward as you put it.
Basically sesc / sc should be there when the admin user tries to access the administrative pages. If admin's session has more than 1 hour inactivity, then the login prompt will popup [which happens unless you have checked "Disable Administrative Security"].

This means that software is able to run at 2AM when the prev. session already expired, and is able to find out the sesc/sc parameter to make SMF understand that's the same user.
Also, this was not an error that was reported - and should have popped out a lot, since it makes the program futile :). So I'm thinking that maybe it's something particular on your server.. probably related to the admin session time or something.

I want to release a new version, but too many things to do - and too little time :) I hope to release it in one month or so..

Thanks again for the info, if you have other things, please put them here, I will read the whole thread again.. when I start to code.
Title: Re: Java SMF automated database backup
Post by: viulian on April 16, 2008, 05:20:00 PM
I've just done some test runs with an updated version, which works with SMF 2.0 Beta 3.

I feel I need to redo parts of the code - to handle the new SMF version (mainly different action URLs + another way of detecting the session code + the actual backup action is now a POST instead of a GET).
Also, UI will need a face lift as well as adding the gzip option, per the request above.

Also, current version of the application has a bug because it assumes the SMF Cookie (which is named in Settings.php) is always named "SMFCookie". I will need to handle this case automatically so this will be a bug fix.

I need to add some more logging, so when errors appear, they will be more meaningful.

So I am working on it :)
Title: Re: Java SMF automated database backup
Post by: metallica48423 on April 16, 2008, 11:39:16 PM
Good to hear :)
Title: Re: Java SMF automated database backup
Post by: scalawaggirl on May 05, 2008, 01:12:36 PM
Viulian, I could just kiss you!  Thanks so much for sharing this.  The SMF backups have been the bane of my existence for too long and you've saved me!  I've had two disasters with SMF, so relevant back ups are well appreciated.

Looking forward to the new version and enhancements.  Great stuff.

Thanks!!!!!
Title: Re: Java SMF automated database backup
Post by: viulian on May 30, 2008, 04:52:41 PM
I've just finished version 1.2b with support for SMF 2.0 Beta 3/3.1. [Attention, these version is not the latest anymore. Check the webpage for the latest, and use that please.]

Here's the download page: http://hex.ro/wb/pages/projects/java-smf-backup.php  (http://hex.ro/wb/pages/projects/java-smf-backup.php)

ATTENTION: Before uninstalling, please make a copy of smfbackup.conf file found in the application directory. It will work with the new version, and will save you the time to redefine the configuration you have.

Change Log:

  * Added support for SMF 2.0 Beta 3 / 3.1.
  * Added download counter (indicator) for each forum (to the bottom left of the main screen when backup is running).
  * Compression can now be turned on/off for each forum.
  * Face lift - Silk icons + draggable tool bar.
  * Made the logs more user friendly.
  * Improved exception logging in the log file
  * Added Tips And Tricks dialog.
  * Added Change Log dialog.

I'm looking forward to your feedback :)

Title: Re: Java SMF automated database backup
Post by: Sudhakar Arjunan on May 31, 2008, 05:28:45 PM
will try now and give you a feedback immediately. :)
Title: Re: Java SMF automated database backup
Post by: scalawaggirl on June 09, 2008, 02:20:50 PM
I just uninstalled my old version to reinstall this one (install worked fine); however, I am getting the follow error when trying to run a backup:

[09/06 13:30:01] java.lang.NullPointerException

   at smfbackup.http.SMFConnection.doLogin(Unknown Source)

   at smfbackup.http.SMFConnection.doBackup(Unknown Source)

   at smfbackup.http.SMFConnection.doJob(Unknown Source)

   at smfbackup.run.Manageable.run(Unknown Source)

I am running SMF 1.1.5.
Title: Re: Java SMF automated database backup
Post by: viulian on June 09, 2008, 03:06:19 PM
Ahh... I forgot to add the debug info parameter to the ANT script, and instead of some useful line numbers I see (Unknown source).

a) Did you use the previous configuration file, or did you recreate your configuration ?

I'm creating a new installer with the application having debug enabled and will reply.
Title: Re: Java SMF automated database backup
Post by: scalawaggirl on June 09, 2008, 03:08:26 PM
Hi, I saved it originally but got a weird error, so started fresh.  This error is w/the fresh config.
Title: Re: Java SMF automated database backup
Post by: Sudhakar Arjunan on June 09, 2008, 03:27:43 PM
Hi , i have tried many time,

1st time uninstalled previous version, then reinstalled

2nd time installed a fresh copy by clearing all files

3rd time renamed the existing folder and installed a new copy.

Everytime i have only this error.

Connecting to admin backend.

java.lang.StringIndexOutOfBoundsException: String index out of range: -1

   at java.lang.String.substring(Unknown Source)

   at smfbackup.http.SMFCookieContainer.trimCookiePathAndDomain(Unknown Source)

   at smfbackup.http.SMFCookieContainer.saveCookies(Unknown Source)

   at smfbackup.http.SMFConnection.doLogin(Unknown Source)

   at smfbackup.http.SMFConnection.doBackup(Unknown Source)

   at smfbackup.http.SMFConnection.doJob(Unknown Source)

   at smfbackup.run.Manageable.run(Unknown Source)


Using 1.1.5, sys win xp.

Kindly help me out.
Title: Re: Java SMF automated database backup
Post by: viulian on June 09, 2008, 04:13:10 PM
I've deployed the new versions (Windows (http://hex.ro/wb/tracker/EasyTracker.php?id=4) and Linux (http://hex.ro/wb/tracker/EasyTracker.php?id=5)). Warning! these are not the latest anymore, please check the my web page for the latest version

@scalawaggirl - unfortunately I cannot say what the error is, but the new version will print the line numbers instead of (Unknown source) and that will pinpoint the error location easier. Please let me know.

@asudhakar -> Fixed the error.

For other errors - please enable Debug logging mode (in Settings) and send me a PM with the smfbackup.log file (password isn't displayed there, and if you do not want your forum name to be seen, you can paste it first in Notepad and search and replace the name).
Title: Re: Java SMF automated database backup
Post by: viulian on June 10, 2008, 12:37:42 AM
I've made a new version, and fixed the bugs reported by scalawaggirl and asudhaker.
Please download from here:

http://hex.ro/wb/pages/projects/java-smf-backup.php

You should reinstall.
Title: Re: Java SMF automated database backup
Post by: Bancherd on June 10, 2008, 05:34:38 AM

Uh...how should I config the program if I am using a portal.. ??? .ie. simpleportal.

Title: Re: Java SMF automated database backup
Post by: viulian on June 10, 2008, 06:20:04 AM
Does the portal offer access to the forum's backend admin page ?

I never used simpleportal, but I assume you can reach the forum via some URL in fact, when you login to the admin page of the forum, such as http://example.com/portal/forum/index.php?action=admin or something like that.

If you don't figure out, I'll try to install simpleportal and see how it works, and then come up with an answer, if possible.
Title: Re: Java SMF automated database backup
Post by: [SiNaN] on June 10, 2008, 07:29:18 AM
It uses the usual ModSettings panel. Nothing different from other mods. Is there a problem with it about this tool?
Title: Re: Java SMF automated database backup
Post by: scalawaggirl on June 10, 2008, 08:00:41 AM
I have uninstalled and downloaded the new version, which is working perfectly now!  Thanks, viulian for such a helpful tool and your personal time on this.

It's so much nicer than doing it manually and/or paying for more server resources so I can actually use gzip.
Title: Re: Java SMF automated database backup
Post by: viulian on June 10, 2008, 02:37:34 PM
Quote from: Bancherd on June 10, 2008, 05:34:38 AM
Uh...how should I config the program if I am using a portal.. ??? .ie. simpleportal.

I've just installed simpleportal 1.2 (with SMF 1.1.5) and everything is OK. Application works with simple portal.
Just give it the forum's URL, such as http://example.com/community/index.php (do not put anything else after index.php).

Quote from: [SiNaN] on June 10, 2008, 07:29:18 AM
It uses the usual ModSettings panel. Nothing different from other mods. Is there a problem with it about this tool?

No problems noticed. The mod does not alter the forum's Admin URL and the actions are properly redirected. (basically the app just appends ?action=admin at the end of the forum URL. As long as this is working, everything else is ok.

Quote from: scalawaggirl on June 10, 2008, 08:00:41 AM
Thanks, viulian for such a helpful tool and your personal time on this.

Thanks scalawaggirl, glad to hear everything is alright :)
Title: Re: Java SMF automated database backup
Post by: Bancherd on June 10, 2008, 11:03:24 PM
Got it!  Thanks.  :D

My problem was that "admin" was not named 'admin'  ;D
Title: Re: Java SMF automated database backup
Post by: Sudhakar Arjunan on June 11, 2008, 02:47:58 PM
Quote from: viulian on June 10, 2008, 12:37:42 AM
I've made a new version, and fixed the bugs reported by scalawaggirl and asudhaker.
Please download from here:

http://hex.ro/wb/pages/projects/java-smf-backup.php

You should reinstall.
Hey viulian,

Thanks a lot and its really working perfectly for me.

And if possible let me know how to overright the current backup i had.

Is that i have to use phpmyadmin to do it.

Any how it worked perfectly for me and its really a good tool.
Title: Re: Java SMF automated database backup
Post by: viulian on June 11, 2008, 04:32:27 PM
Well, I thought about the restore thing in the past and reached to the conclusion it's too much work to make it work right (different php / mysql version, different security for php that would always cause problems and so on).
Plus, restores should rarely be needed - plus you can't do with phpmyadmin in fact as I think there's a limitation on how big the restore file is.
So you either need SSH connection / or the hosting provider to restore the database and you just send them your file.

So no matter how I look at it, isn't actually needed (at least from my point of view, that is).
Title: Re: Java SMF automated database backup
Post by: Sudhakar Arjunan on June 12, 2008, 06:34:57 AM
Thanks for the detailed explanation.

Thanks for this excellent mod.
Title: Re: Java SMF automated database backup
Post by: kizer on June 13, 2008, 02:44:26 PM
New download said it could not find the "Main class"

Yes I uninstalled the old version and installed the new one.

The problem I was having is it would appear to download a few K of the backup and stop.
Title: Re: Java SMF automated database backup
Post by: viulian on June 13, 2008, 04:45:56 PM
Please give me a couple of more details..

Are you using the windows version or the linux one ? What is the file path in which you installed the software ?

Title: Re: Java SMF automated database backup
Post by: SiL on July 16, 2008, 09:47:10 AM
Mac OS X compiled version of latest? 
(getting problems with uper mem on host - gz verson quits at 2MB with original MAc OS X versoin of utility
Title: Re: Java SMF automated database backup
Post by: viulian on July 16, 2008, 11:39:25 AM
As I don't have a MacOS to be able to maybe offer an executable for it, you should get the _linux.zip version, unpack it to some folder, then go into that folder and issue:

java -jar JavaSMFBackup.jar

One thing, please make sure that you have Sun JDK 1.5 installed, and that java -version returns indeed version 1.5. Please check the UNIX_README contained in the zip.
Title: Re: Java SMF automated database backup
Post by: SiL on July 16, 2008, 08:19:38 PM
Quote from: viulian on July 16, 2008, 11:39:25 AM
As I don't have a MacOS to be able to maybe offer an executable for it, you should get the _linux.zip version, unpack it to some folder, then go into that folder and issue:

java -jar JavaSMFBackup.jar

I get the following error...

Exception in thread "main" java.lang.UnsupportedClassVersionError: Bad version number in .class file
        at java.lang.ClassLoader.defineClass1(Native Method)
        at java.lang.ClassLoader.defineClass(ClassLoader.java:620)
        at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:56)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:195)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
        at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)

java -version reports

java version "1.5.0_13"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13-b05-241)
Java HotSpot(TM) Client VM (build 1.5.0_13-121, mixed mode, sharing)

Mac OS X 10.4.11
Title: Re: Java SMF automated database backup
Post by: viulian on July 17, 2008, 12:51:20 AM
Yep, you were right. Can you please download again the _linux.zip version from http://hex.ro/wb/pages/projects/java-smf-backup-2.php ?

I forgot to add the ant javac target to java 1.5 and as I was using the 1.6 version, it produced a .jar file which was only understood by JDK 1.6.
Thank you for letting me know. I created two new files (version is the same, 1.2.1b because nothing was changed in the code, just the build file) - which have the source/code target to 1.5 and it should work.
Title: Re: Java SMF automated database backup
Post by: SiL on July 17, 2008, 03:52:53 AM
Quote from: viulian on July 17, 2008, 12:51:20 AM
Yep, you were right. Can you please download again the _linux.zip version from http://hex.ro/wb/pages/projects/java-smf-backup-2.php ?

I forgot to add the ant javac target to java 1.5 and as I was using the 1.6 version, it produced a .jar file which was only understood by JDK 1.6.
Thank you for letting me know. I created two new files (version is the same, 1.2.1b because nothing was changed in the code, just the build file) - which have the source/code target to 1.5 and it should work.

confirmed - worked by click on the .jar file and the gui opened.  Just have to get the mem settings changed on the host server now (sql server "goes away" even with no compression)

thanks
Title: Re: Java SMF automated database backup
Post by: [SiNaN] on August 21, 2008, 05:02:21 PM
Does anybody have any idea about what happened to this tool? Seems like links are dead.
Title: Re: Java SMF automated database backup
Post by: viulian on August 21, 2008, 11:10:23 PM
Nothing happened to the tool :)
I just checked both the Tools section of SMF, as well as the latest links on my web page were I distribute the versions working with 2.0 beta; all are working.

How did you test ?
Title: Re: Java SMF automated database backup
Post by: Sudhakar Arjunan on August 22, 2008, 02:36:05 AM
Quote from: [SiNaN] on August 21, 2008, 05:02:21 PM
Does anybody have any idea about what happened to this tool? Seems like links are dead.

Am Using this Tool only. ITs working good.
Not aware of 2.0 beta version.
Am Using 1.1.5 and its taking backup perfectly.
Title: Re: Java SMF automated database backup
Post by: [SiNaN] on August 22, 2008, 04:08:29 AM
Quote from: viulian on August 21, 2008, 11:10:23 PM
Nothing happened to the tool :)
I just checked both the Tools section of SMF, as well as the latest links on my web page were I distribute the versions working with 2.0 beta; all are working.

How did you test ?

This is the error I'm getting when I try to download it:

No input file specified.
Title: Re: Java SMF automated database backup
Post by: viulian on August 22, 2008, 06:24:58 AM
Please go to http://hex.ro/wb/pages/projects/java-smf-backup-2.php and click on one of the two download links you see above (I mean choose one depending on the OS on your computer).

Does it still gives you the error ? It works for me..

To be able to fix it I would need more data:
a) what browser are you using ?
b) If possible, let me know the time (including timezone) at which you attempted to download. No input file specified is indeed an issue - fastcgi probably does not receive the input file (script) from the URL.
c) Can you please paste me the URL you are using ?

Thanks, and sorry for any inconvenience..
Title: Re: Java SMF automated database backup
Post by: [SiNaN] on August 22, 2008, 07:24:11 AM
The last link you gave worked.

a) FF 2.0.0.14

b) Time was exactly the same with the post time of this message:

http://www.simplemachines.org/community/index.php?topic=115957.msg1670696#msg1670696

c) http://hex.ro/wb/pages/projects/java-smf-backup.php

Some more info; I still get the same error and another user is having the same problem with me.

The difference is "-2" with the url you gave above and the urls you posted before.
Title: Re: Java SMF automated database backup
Post by: DirtRider on August 22, 2008, 08:11:39 AM
SMF 1.1.5 I got this error

[22/08 14:08:03] Method failed (downloadAction): HTTP/1.1 500 Internal Server Error
[22/08 14:08:03] Downloading...
[22/08 14:08:03] Using file: D:\SMF Backup\TriumphTalk_22Aug08_140803.sql.gz
[22/08 14:08:03] Download complete. [more than 0 kb/s]
[22/08 14:08:03] Next run at: 2008/08/22 10:45:00
Title: Re: Java SMF automated database backup
Post by: viulian on August 22, 2008, 12:26:51 PM
SiNaN - thanks for letting me know. I have updated the web site - because once the SMF 2.0 is out, I will be rename the app to Java SMF Backup 2; Hence CMS added a -2 at the end of the URL - and the links I posted were out of date.
I'm going to reedit the topics and update the links.

DirtRider - are you able to do a backup using the forum interface ? That Internal Server Error, seems to me that the php script has reached the memory limit while trying to backup the database. Please use the latest version (1.2.1 from here: http://hex.ro/wb/pages/projects/java-smf-backup-2.php) and while configuring your forum, make sure the 'compress' tick is NOT on.

Of course, try using the forum interface first (backup with compression and without).

If the error still persists, please PM me. The thing is that the internal server error happens after you enter your username and password, so for me to test it I would require a temporary user created (admin). However, I strongly belive that the error is server side, and related to php.ini memory limits reached while compressing the database. Try without compression, and please let me know.
Title: Re: Java SMF automated database backup
Post by: kizer on August 22, 2008, 05:31:45 PM
[22/08 14:34:59] Requesting the backup file.
[22/08 14:35:37] Method failed (downloadAction): HTTP/1.1 500 Internal Server Error
[22/08 14:35:37] Downloading...
[22/08 14:35:37] Using file: C:\Program Files\JavaSMFBackup\Links4jeeps.com_22Aug08_143537.sql.gz
[22/08 14:35:37] Download complete. [more than 0 kb/s]
[22/08 14:35:37] Next run at: Aug 22, 2008 3:45:00 PM
Title: Re: Java SMF automated database backup
Post by: viulian on August 22, 2008, 06:13:42 PM
kizer, I think you too have the same memory issue - please disable compression (Manage Forum -> Compression and untick that). You have to use version 1.2.1b of Java SMF Backup.

[22/08 14:34:59] Requesting the backup file.
[22/08 14:35:37] Method failed (downloadAction): HTTP/1.1 500 Internal Server Error

It took the forum 40 seconds to attempt to create the backup file (that's what it does when the app requests the backup file), and when the memory limit was reached, the script was killed, and the server reported Internal Server Error.

You can either try to rise your memory limit, or use uncompressed version which streams the backup file directly without asking the forum to first compress it in memory.
Title: Re: Java SMF automated database backup
Post by: kizer on August 23, 2008, 12:29:04 AM
Thanks for the info. Now with compression removed I can at least download. However Im getting around 1meg of data and normally compressed its around 14meg so the app or the server is timing out. When I visit phpmyAdmin I can download the entire database, but with the app and looks like within the forum I can not.

I guess it sounds like a host problem unless your going to tell me I'm wrong.
Title: Re: Java SMF automated database backup
Post by: viulian on August 23, 2008, 01:37:13 AM
You are right... it does seem to be related somehow to the forum (not able to finish streaming the backup file).

If I were you, I'd try to diagnose the issue (enabling forum error logging, see if something comes up when doing the uncompressed download), or checking the httpd server error logs (via cPanel, or whatever you have). If you don't find the server error logs please try to talk to the hosting provider to activate the logs or at least tell you where get to them.

Also, check the end of that small 1Mb chunk you get. Maybe there's something strange there. Also, if it's constantly 1Mb, maybe there's some kind of firewall which doesn't work properly - try to disable your firewall for some minutes while you test.

There's an answer, I'm sure :)
Title: Re: Java SMF automated database backup
Post by: kizer on August 25, 2008, 02:45:45 PM
Yeah its just annoying. I can do it in My Cpanel, but your little app is to simple not to use. ;)
Title: Re: Java SMF automated database backup
Post by: AlaStar on September 17, 2008, 08:04:37 AM
I try with version 1, I got this error

class smfbackup.http.SMFException: No "sesc" or "sc" input field found in the reply page. Cannot proceed.

with version 1.2.1 beta, I got this error

org.apache.commons.httpclient.NoHttpResponseException: The server www.my_forum.com failed to respond

at org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1976)

at org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)

at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)

at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)

at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)

at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)

at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)

at smfbackup.http.SMFConnection.doBackup(SMFConnection.java:333)

at smfbackup.http.SMFConnection.doJob(SMFConnection.java:464)

at smfbackup.run.Manageable.run(Manageable.java:29)


I use SMF 1.1.6 and my server can't compress to gzip :(
it's possible that this app works  ::)
Title: Re: Java SMF automated database backup
Post by: viulian on September 17, 2008, 06:08:03 PM
What theme do you use for the forum ? \
Is the forum embedded in some kind of portal - or is it standalone?

Also, I'm a bit confused by the 'failed to respond' message though, that would mean either a timeout on the server, or some kind of a communication probleme. Can you please try without the www. in front of the forum name? Also, you can pm me the forum URL, hopefully I'll be able to figure out what goes wrong.
Title: Re: Java SMF automated database backup
Post by: AlaStar on September 18, 2008, 09:21:11 AM
Quote from: viulian on September 17, 2008, 06:08:03 PM
What theme do you use for the forum ? \
Is the forum embedded in some kind of portal - or is it standalone?

The theme is dilbermc, the forum it's standalone.

Quote from: viulian on September 17, 2008, 06:08:03 PM
Also, I'm a bit confused by the 'failed to respond' message though, that would mean either a timeout on the server, or some kind of a communication probleme. Can you please try without the www. in front of the forum name? Also, you can pm me the forum URL, hopefully I'll be able to figure out what goes wrong.

I said before my server can't compress to gzip, it's disable. I only download in sql.
Title: Re: Java SMF automated database backup
Post by: bfeo on September 18, 2008, 09:59:20 AM
Can't get it to connect.  I've tried putting in database username and forum username, without any success.  It keeps saying that it fails to connect.

[18/09 09:58:31] smfbackup.http.SMFException: Connect failed: HTTP/1.1 401 Authorization Required

   at smfbackup.http.SMFConnection.doLogin(SMFConnection.java:120)

   at smfbackup.http.SMFConnection.doBackup(SMFConnection.java:202)

   at smfbackup.http.SMFConnection.doJob(SMFConnection.java:464)

   at smfbackup.run.Manageable.run(Manageable.java:29)
Title: Re: Java SMF automated database backup
Post by: bfeo on September 20, 2008, 10:51:55 AM
Still haven't figured this one out.
Title: Re: Java SMF automated database backup
Post by: viulian on September 21, 2008, 11:36:53 AM
Hi, sorry I've been away for the weekend.
AlaStar, bfeo - please pm me the URL to the forum, I need to manually investigate what is wrong with the welcome page, to be able to figure out what goes wrong. I mean I hope I can, there are some missing fields in the form, or some custom authentication scheme which comes before the forum login.

Without the access, the error is the one that is printed out, no sesc / sc field OR the auth error - so I need an explanation on why these are happening.

Thanks,
Title: Re: Java SMF automated database backup
Post by: RLawrence on January 17, 2009, 07:03:31 AM
Morning Viulian-

Was using your great java program without a hitch - on SMF 1.1.7 - for 3 days and then just this AM I started getting this error:

smfbackup.http.SMFException: no <form> tag whith action pointing to login2 (URL not pointing to SMF?)

Any ideas ... would like to be able to use your app steadily!

Thanks for your time, expertise and reply in advance,
RLawrence

Title: Re: Java SMF automated database backup
Post by: RLawrence on January 17, 2009, 09:07:32 AM
NIX that last post Viulian ...

Your program is GREAT and doing EXACTLY what it should be doing!

A new webpage was created and uploaded last nite, using the original name of the SMF forum ... a secondary link was created, so the forum was callable from a tab on the website ... but the forum's name had to change ... it was appended with '/forum' ...

So your program correctly responded with  the error:
smfbackup.http.SMFException: no <form> tag whith action pointing to login2 (URL not pointing to SMF?)

Original forum name: http://restoretheconstitutionalrepublic.org
NEW website named the same: http://restoretheconstitutionalrepublic.org
'Forum' callable from web page: http://restoretheconstitutionalrepublic.org/forum

Added: /forum to update and provide the correct forum name

AND

We're back in business!!!

Thank you very much, Viulian, for a SUPER utility!

RLawrence
Title: Re: Java SMF automated database backup
Post by: viulian on January 17, 2009, 06:03:12 PM
Super! Sorry for the cryptic message, I thought it might help debugging if someone is viewing the page source of the login page. But I did add an "(URL not pointing to SMF?)" which is the likely cause of the missing <form> element.

Glad to hear everything is alright :)

PS: Please remember to double check the backup file. Once the backend .php script hits the php.ini memory limit, you might end up with truncated .sql file (when gzip is off) or empty backup files (if gzip is on). But the HTTP dialog still takes place normally... so no error is thrown.
I will add two checks in the next version - one for each case, and issue an warning to an email configured in the options.
Title: Re: Java SMF automated database backup
Post by: viulian on February 14, 2009, 06:30:13 PM
I've just installed Windows 7 Beta and attempted to run Java SMF Backup.

The thing is that I was able to install it, but it did not start. On careful examination, the software is not allowed to write to its own directory (in Program Files/JavaSMFBackup).

I had to access the folder's security tab (properties -> security) and allow the Users full access to it.
Also, discovered that 2.0 RC1 does not work (due to updates to security checks etc).
I have to investigate this and will come up with a newer version supporting 2.0 RC1 too..
Title: Re: Java SMF automated database backup
Post by: Mikey2009 on March 17, 2009, 03:27:45 PM
Hi,
is there already a version for SMF 2.0RC1?

Mikey
Title: Re: Java SMF automated database backup
Post by: Sudhakar Arjunan on March 20, 2009, 03:33:44 PM
Quote from: Mikey2009 on March 17, 2009, 03:27:45 PM
Hi,
is there already a version for SMF 2.0RC1?

Mikey

Hi Mikey 2009.

We will wait for the 2.0. RC 1 as said by the author on this post http://www.simplemachines.org/community/index.php?topic=115957.msg1932573#msg1932573
Title: Re: Java SMF automated database backup
Post by: viulian on March 20, 2009, 05:02:10 PM
Sorry guys for not answering earlier, the thing is that I switched jobs and moved into another country for a while :) so my spare time was actually very .... nil.

I have the source codes with me - hence in 1 week or so I should have them published.
Title: Re: Java SMF automated database backup
Post by: Sudhakar Arjunan on March 21, 2009, 02:31:42 AM
Quote from: viulian on March 20, 2009, 05:02:10 PM
Sorry guys for not answering earlier, the thing is that I switched jobs and moved into another country for a while :) so my spare time was actually very .... nil.

I have the source codes with me - hence in 1 week or so I should have them published.

Thanks for your prompt reply.

Hope your new work place is cool.
Title: Re: Java SMF automated database backup
Post by: viulian on April 13, 2009, 11:37:19 AM
Hello,

I finally got some time to clean the app and get it ready for delivery.

For Windows you can use this: JavaSMFBackup_1.3.0b_setup.exe (http://hex.ro/wb/tracker/EasyTracker.php?id=9)
For Linux, MacOSX: JavaSMFBackup_1.3.0b_linux.tar.gz (http://hex.ro/wb/tracker/EasyTracker.php?id=8)

Change Log:

* Added support for SMF 2.0 RC1
* Sun JDK 1.6 is mandatory.
* Given up on JDesktop stuff as now it's built into JDK (since 1.6)
* Added 'Visit Homepage / Donate' button in 'About' dialog.

I haven't got a chance to test this on Microsoft Vista (or Windows 7), however, if you are using a normal user (not admin), please install it in your local directory (if you use 'Program Files' install will work because installer works with elevated rights; but when you want to start it up the application fails because it cannot write to its own install directory).

I need to read more about UAC etc, try to move settings into 'Application Data' into the user's home dir, but did not have the time to do it properly yet.

If you have any problems, please post..

[DO NOT FORGET to select the proper forum version. Otherwise you'll have 'Login Error' problems :) as the app cannot decide if the forum is one version or another].
Title: Re: Java SMF automated database backup
Post by: Mikey2009 on April 13, 2009, 04:24:22 PM
Hi,
The tool works very well once again.  :D
Thank you ;D
Title: Re: Java SMF automated database backup
Post by: viulian on April 13, 2009, 05:43:19 PM
Thank you too :)
Title: Re: Java SMF automated database backup
Post by: Sudhakar Arjunan on April 14, 2009, 04:59:00 AM
Hi viulian,  its an excellent update.

I have tried and first time it transferred o size file of smf 2.0.RC1.

For the next time its keep on going by saying Request for backup file and so far not ended more than 15 mins.
Title: Re: Java SMF automated database backup
Post by: viulian on April 14, 2009, 05:13:11 AM
A couple of questions:

I think it happens the same if you are using the web interface to do the backup.
How big is your database ? And please check what is the behaviour using the web interface ?

When the database is big, you might want to disable compression. Otherwise, the php scripts on the forums will try to zip in memory, and then it reaches the maximum memory allowed for php and script will die.. not returning any output.
Title: Re: Java SMF automated database backup
Post by: Sudhakar Arjunan on April 14, 2009, 05:31:14 AM
Yes Viulian, My Database is too big with 10000 users and 90000 topics in it.

And when i tried to restart it , that shows me  Backup is already running. Please stop it or wait to finish.

Let me remove compression and try to store it once.
Title: Re: Java SMF automated database backup
Post by: Vincent Volmer on April 17, 2009, 06:14:07 AM
Quote from: viulian on April 13, 2009, 11:37:19 AM

I finally got some time to clean the app and get it ready for delivery.


Thanks for the update!!

Vincent
Title: Re: Java SMF automated database backup
Post by: viulian on April 22, 2009, 05:32:56 PM
Thank you Vincent :)

@all: I have also uploaded the source code here: http://javasmfbackup.googlecode.com/svn/releases/v1.3b/
It is the Netbeans project, as I use it. When SMF 2.0 will be released as a full, I'll also clean up the project (as it is for now in the SMF download page) and upload a generic source that you can build without Netbeans.
Title: Re: Java SMF automated database backup
Post by: Sudhakar Arjunan on April 23, 2009, 01:03:01 PM
Ok thanks for the update.

I need to have a error free code for v 2.0
Title: Re: Java SMF automated database backup
Post by: viulian on May 26, 2009, 05:48:40 PM
Vincent discovered a bug inside the Jericho HTML Parser library, hence, I've upgraded it to the latest stable version, and now is working.

Thank you Vincent!

Here's the new download link for the version Java SMF 1.3.1b - http://hex.ro/wb/tracker/EasyTracker.php?id=10

I will provide a linux version in the weekend, I need to test it first.

PS:

I've tested the code (version 1.3.0b and 1.3.1b) and I can confirm that is working for the newest SMF update, 2.0 RC1-1. Just make sure you use the value 'SMF 2.0 RC1' the 'SMF Version' combo box, as you define your forum(s).
Title: Re: Java SMF automated database backup
Post by: Sudhakar Arjunan on June 01, 2009, 12:08:35 PM
Thank you for the update.

Will check now.
Title: Re: Java SMF automated database backup
Post by: SimmoAUS on June 15, 2009, 08:06:31 PM
Gday Guys and Gals, first post here so please be kind to the newbie :D

Viulian, I have been using your software pretty successfully for the past 6 months. It works the majority of the time even though we are using a Yahoo server. The backup occured probably half the time it was scheduled which I am more than happy with.

That is, up until recently where now it doesn't run at all. Java did an upgrade on my computer, that was the JRE and maybe that is the cause? It is 1.6.0_14

The error I am getting from SMFBackup is -

[16/06 09:51:35] Backup notification received.
[16/06 09:51:35] Starting backup procedure.
[16/06 09:51:35] Connecting to admin backend.
[16/06 09:51:36] java.io.IOException: Resetting to invalid mark

   at java.io.BufferedInputStream.reset(Unknown Source)

   at au.id.jericho.lib.html.EncodedSource.construct(Unknown Source)

   at au.id.jericho.lib.html.Source.<init>(Unknown Source)

   at smfbackup.http.SMFConnection.doLogin(SMFConnection.java:127)

   at smfbackup.http.SMFConnection.doBackup(SMFConnection.java:203)

   at smfbackup.http.SMFConnection.doJob(SMFConnection.java:514)

   at smfbackup.run.Manageable.run(Manageable.java:29)

[16/06 09:51:36] Next run at: 16/06/2009 8:30:00 PM

I am running the 1.3.0 Beta version. The forum is running version 1.1.9 of SMF.

I would love to keep running the utility so any help would be greatly appreciated.

Also is the server storing the program not working anymore? :-\

Cheers
Simmo from Australia
Title: Re: Java SMF automated database backup
Post by: viulian on June 16, 2009, 01:46:39 AM
Hello,

About the exception:

Is due to the Jericho html parser library which is outdated. I upgraded it on version 1.3.1b.
Can you also describe better the behaviour with backups getting done only half of the time ?

About the websites:

My sites were wiped out :( when VAServe was attacked 10 days or so ago.. For those who don't know: http://www.theregister.co.uk/2009/06/08/webhost_attack/

I got a new VPS about a couple of days ago, but is not the OS I had (I had Ubuntu 6.06, rock stable, now I have to redo everything with a newer Ubuntu).

The sites will be back in a week or so. I do have backups - but I have to reinstall / reconfigure everything - I'm doing my best, even if I'm pretty annoyed, because Google already delisted them due to downtime.

Please PM me with your email address, and I can send you version 1.3.1b.
Title: Re: Java SMF automated database backup
Post by: SimmoAUS on June 16, 2009, 02:22:42 AM
Hi Viulian,

Thanks for emailing it to me, I have installed the newer version and the backup has worked 6 times straight. The previous version never did that before so it is already showing improvement.

Not saying the previous version was at fault though, I always thought it was due to the sometimes unworkable yahoo servers. They are pretty limited, for example files with spaces aren't allowed.

If I do receive any erroneous output, I will post it up for you ;)

Cheers again
Simmo
Title: Re: Java SMF automated database backup
Post by: viulian on June 16, 2009, 02:27:08 AM
Great :)

Good news. Good luck now, and keep your backups safe!
Title: Re: Java SMF automated database backup
Post by: timmytimmy on June 16, 2009, 11:54:18 AM
hi.  i am trying to download the latest version of this but the links seem to be dead.  can someone re-upload for me please?

thanks!
Title: Re: Java SMF automated database backup
Post by: viulian on June 16, 2009, 01:31:53 PM
Hi greg. Please try the URL below.

I will keep it up till I can set up the VPS properly and reactivate the links.

Thanks!

http://94.76.254.176/JavaSMFBackup_1.3.1b_setup.exe
Title: Re: Java SMF automated database backup
Post by: viulian on June 20, 2009, 11:57:45 AM
A quick note:

The site is back online, and latest version can be downloaded from the previous URL: http://hex.ro/wb/tracker/EasyTracker.php?id=10
Title: Re: Java SMF automated database backup
Post by: Norv on June 22, 2009, 05:53:50 PM
Doesn't seem to work for me. Also, you may want to note that the link in the first post in this thread leads to http://www.hex.ro/wb/pages/projects/java-smf-backup-2.php, which seems to say that JavaSMFBackup_1.3.0b_setup.exe is the latest file.
Either way, this application sounds like a great help, thank you for your work on it, it is very appreciated!
Title: Re: Java SMF automated database backup
Post by: viulian on June 22, 2009, 05:59:56 PM
Ahh you're right Norv, thanks for letting me know.
The web page (your href has a comma afterwards) does indeed state that.. I will fix right now. Were you able to download the app after all ?

Until I fix the page - please use this URL: http://www.hex.ro/wb/tracker/EasyTracker.php?id=10
Title: Re: Java SMF automated database backup
Post by: Sudhakar Arjunan on June 24, 2009, 02:18:54 PM
Quote from: viulian on June 22, 2009, 05:59:56 PM
Ahh you're right Norv, thanks for letting me know.
The web page (your href has a comma afterwards) does indeed state that.. I will fix right now. Were you able to download the app after all ?

Until I fix the page - please use this URL: http://www.hex.ro/wb/tracker/EasyTracker.php?id=10

My forum has 1 lakh post.

So its overloading after starting the backup process.

What to do.
Title: Re: Java SMF automated database backup
Post by: viulian on June 24, 2009, 02:58:25 PM
Can you please provide more details about the issue ?
Title: Re: Java SMF automated database backup
Post by: Norv on June 24, 2009, 03:05:53 PM
viulian: sorry for the delay. I still cannot download from this link either (http://www.hex.ro/wb/tracker/EasyTracker.php?id=10).
EDIT: Can you please tell me if you can download from it?
Title: Re: Java SMF automated database backup
Post by: viulian on June 24, 2009, 07:17:58 PM
Umm.. I've just tried it and is working.
I've updated hex.ro DNS a couple of days ago, and all DNS caches should have refreshed by now, who knows ..

I will also upload it to the Google Code project page shortly - I need to first see how the things are organized there. I'll post an update tomorrow morning.. Thanks for letting me know.
Title: Re: Java SMF automated database backup
Post by: Juo on June 24, 2009, 08:44:42 PM
Great piece of software :) Ive got my forum backing up every 6 hours. Nice
Title: Re: Java SMF automated database backup
Post by: SimmoAUS on July 28, 2009, 07:20:56 AM
Hi Vuilian,

Just thought I would let you know after posting up an error back on the 16th of June and the subsequent upgrade to the 1.3.1b version backups have been running flawlessly for the past 6 weeks.

I hope I am not pushing my luck here but I thought I would also add a couple of suggestions that could be included in further updates.

1. With the running of the program, I have created a shortcut in my Startup folder so that it starts everytime the computer is turned on. The only problem is if I am not the one who turns the computer on (family computer(https://www.simplemachines.org/community/proxy.php?request=http%3A%2F%2Fi192.photobucket.com%2Falbums%2Fz63%2Faussieferalhunters%2Fsmileys%2Fforums%2Fb_banghead.gif&hash=3fa4a515f69dcbded4c93806cc54cb4a8affa83e)), they close your program, which raises my question - Is there anyway to make your program minimize to the system tray automatically on startup?

I have tried changing the shortcut properties to run the program "minimized" but this doesn't work.

2. Creating a button in the tool bar which runs the selected backup. You have a stop button, I just figure a start button would be handy.

In no way I am unhappy with your program, I just thought you might want to consider these in a future update.

Keep up the great work(https://www.simplemachines.org/community/proxy.php?request=http%3A%2F%2Fi192.photobucket.com%2Falbums%2Fz63%2Faussieferalhunters%2Fsmileys%2Fforums%2Fa_thumbsup.gif&hash=884aefba069d07e44423b287ceac16fc4d2aab9a)
Simmo

Title: Re: Java SMF automated database backup
Post by: viulian on July 28, 2009, 12:31:50 PM
Thank you for the nice words and feedback :)

For 1) - I've just added the functionality :) it never crossed my mind to have it. You will find in Settings. I need a bit of time to prepare the delivery and upload it, will post post back after I finish.

For 2) - The start functionality already exists for the selected forum, you can right click on one and then the first option is "Run backup now" ?
Title: Re: Java SMF automated database backup
Post by: viulian on July 31, 2009, 06:02:16 PM
I've finished the last delivery.

You can get the files here:

JavaSMFBackup_1.3.2_setup.exe (http://hex.ro/wb/tracker/EasyTracker.php?id=11)
JavaSMFBackup_1.3.2_linux.tar.gz (http://hex.ro/wb/tracker/EasyTracker.php?id=12)

I've also built a version for Linux - including the option to start minimized.

Title: Re: Java SMF automated database backup
Post by: osterlentracker on August 03, 2009, 07:49:15 PM
Quote from: viulian on February 14, 2009, 06:30:13 PM
I've just installed Windows 7 Beta and attempted to run Java SMF Backup.

The thing is that I was able to install it, but it did not start. On careful examination, the software is not allowed to write to its own directory (in Program Files/JavaSMFBackup).

I had to access the folder's security tab (properties -> security) and allow the Users full access to it.
Also, discovered that 2.0 RC1 does not work (due to updates to security checks etc).
I have to investigate this and will come up with a newer version supporting 2.0 RC1 too..

Looking forward to thar   TY for fast work .....

// Krister
Title: Re: Java SMF automated database backup
Post by: SimmoAUS on August 03, 2009, 07:50:41 PM
Quote from: viulian on July 31, 2009, 06:02:16 PM
I've finished the last delivery.

I installed it and restarted the computer to try it out - works perfectly.

Keep up the good work Viulian (https://www.simplemachines.org/community/proxy.php?request=http%3A%2F%2Fi192.photobucket.com%2Falbums%2Fz63%2Faussieferalhunters%2Fsmileys%2Fforums%2Fc_rockon.gif&hash=659857735dca0f5c6c8fc96b715fb32cc8958077)
Title: Re: Java SMF automated database backup
Post by: rpacheco on August 05, 2009, 04:02:42 PM
Hi,

Getting the Following error:

[05/08 16:55:47] java.io.IOException: chunked stream ended unexpectedly

   at org.apache.commons.httpclient.ChunkedInputStream.getChunkSizeFromInputStream(ChunkedInputStream.java:252)

   at org.apache.commons.httpclient.ChunkedInputStream.nextChunk(ChunkedInputStream.java:221)

   at org.apache.commons.httpclient.ChunkedInputStream.read(ChunkedInputStream.java:176)

   at java.io.FilterInputStream.read(Unknown Source)

   at org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:108)

   at java.io.FilterInputStream.read(Unknown Source)

   at org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:127)

   at smfbackup.http.SMFConnection.doBackup(SMFConnection.java:399)

   at smfbackup.http.SMFConnection.doJob(SMFConnection.java:491)

   at smfbackup.run.Manageable.run(Manageable.java:29)



Any help?
Title: Re: Java SMF automated database backup
Post by: viulian on August 05, 2009, 04:34:37 PM
Unfortunately it seems to be an issue with the server, not sending the content properly encoded .... This is extremely rare.

It might be that the server is very very slow and it doesn't finishes what it has to send. Or maybe there's a firewall / proxy in the middle that doesn't do the job properly.

If you can send me (private message), just the URL to have a look and give it a try ...
Title: Re: Java SMF automated database backup
Post by: sonst-was on August 16, 2009, 10:02:58 AM
Hi viulian,

first, thanks for the tool ;)

but ive got also a small feature request:

Would it be possible to add other intervalls for the backup? For example every x days/weeks... In my forum i havent got a posting every day, so it would be senseless to make a backup every day...
Title: Re: Java SMF automated database backup
Post by: viulian on August 16, 2009, 02:23:12 PM
Ok :)

I will add as soon as possible. I've just installed Windows 7 RC (downloaded from Microsoft) I have a couple of months available to try it out - so I'll also try to fix the UAC issues upon install of the

Although the first thing I did was to disable UAC :( :D cos was too annoying.
Title: Re: Java SMF automated database backup
Post by: tfs on November 13, 2009, 12:12:52 PM
Looks like this was broken by SMF 2.0 RC2.  Any intents to update the program so that it'll work with RC2?
Title: Re: Java SMF automated database backup
Post by: viulian on November 13, 2009, 02:15:46 PM
Yes. It will take about a week :)
Title: Re: Java SMF automated database backup
Post by: Ken. on November 13, 2009, 02:33:57 PM
Quote from: viulian on November 13, 2009, 02:15:46 PM
Yes. It will take about a week :)

Thanks viulian.  8)
Title: Re: Java SMF automated database backup
Post by: tfs on November 13, 2009, 04:11:04 PM
Quote from: viulian on November 13, 2009, 02:15:46 PM
Yes. It will take about a week :)

A thousand times Bless You!  :)  I've come to depend on your program.
Title: Re: Java SMF automated database backup
Post by: Mikey2009 on November 15, 2009, 05:58:41 PM
Hi,
Quote from: viulian on November 13, 2009, 02:15:46 PM
Yes. It will take about a week :)
Great, Thanks!
Title: Re: Java SMF automated database backup
Post by: viulian on November 15, 2009, 06:12:33 PM
Thank you for the support :)

The code works with the new version, however, I'm trying to fix the old UAC problem... I will have a release probably on next Saturday.
Title: Re: Java SMF automated database backup
Post by: viulian on November 22, 2009, 06:36:56 PM
Still having some issues with UAC ... Right now it installs, but I cannot get it to start unless I click "Run As Administrator...".

I need to know: Do you guys use UAC - I mean, am I working for just a minor thing here :) ?
So far nobody complained about the application not working with UAC active - so maybe it is not needed...
Title: Re: Java SMF automated database backup
Post by: Ken. on November 22, 2009, 07:41:00 PM
viulian, it would be nice if that issue were resolved but speaking only for myself, I leave my PC running for days or even weeks without a restart so if the "Run As Administrator" thing is only happening when the Java SMF is first started then it's not that big of a deal for me.
Title: Re: Java SMF automated database backup
Post by: tfs on November 22, 2009, 08:59:20 PM
I run my backups on an XP machine, so it won't matter to me.
Title: Re: Java SMF automated database backup
Post by: Mikey2009 on November 23, 2009, 12:44:08 AM
Hi,
I run it on Server2003, it's no Problem.
Title: Re: Java SMF automated database backup
Post by: viulian on November 24, 2009, 05:27:55 PM
The new release is here:

Java SMF Backup 1.3.3 (Windows) (http://hex.ro/wb/tracker/EasyTracker.php?id=14)
Java SMF Backup 1.3.3 (Linux/Others) (http://hex.ro/wb/tracker/EasyTracker.php?id=15)

Related to UAC, I got tired checking NSIS. Yes, it was a clean install some years ago when I started this program and everything worked wonders from command line and ant based installer, but now, with this UAC plugin they have, all seems more just a dirty hack than clean and straightforward.
I will investigate the MSI as an alternative installer, compared to a setup file as is now.

Thank you for waiting, and please excuse if this release came later than said.
Title: Re: Java SMF automated database backup
Post by: Ken. on November 24, 2009, 10:06:07 PM
Your efforts are appreciated viulian and it will be worth the wait.  8)
Title: Re: Java SMF automated database backup
Post by: Mikey2009 on November 25, 2009, 01:22:08 AM
Hi,
I installed it and it works perfectly.
Thanks.
Title: Re: Java SMF automated database backup
Post by: toma on January 09, 2010, 01:48:36 PM
Love the tool

One of my forums is running under ssl (https) and I was just wondering if there are any plans on supporting such a configuration?

Cheers
Tom
Title: Re: Java SMF automated database backup
Post by: Nameless? on January 09, 2010, 01:53:38 PM
Well done there m8  8)
Title: Re: Java SMF automated database backup
Post by: viulian on January 11, 2010, 02:41:46 PM
Quote from: toma on January 09, 2010, 01:48:36 PM
One of my forums is running under ssl (https) and I was just wondering if there are any plans on supporting such a configuration?

I didn't think of this - but I can add it of course. However, setting up the https means adding more configuration in the Settings window (where to store the certificates, trusting them later, etc) plus some debugging, hence, it will take a while (let's say up to a month to add it - given my free time available for the app).

Please check back for updates...
Title: Re: Java SMF automated database backup
Post by: kai920 on January 11, 2010, 11:08:17 PM
viulian, many thanks for this. I have tested this on OS X 10.6.2 with java 1.6.0_17 and it's working great.
Title: Re: Java SMF automated database backup
Post by: naijaecash on March 16, 2010, 03:30:46 AM
Thanks buddy for this piece of software. It has really been of great help to me. I was using the version 1 but it couldn't handle SMF2.0. Thanks for the updated version. Kudos ;)
Title: Re: Java SMF automated database backup
Post by: kizer on March 16, 2010, 01:43:19 PM
I just tried it and I can login to the admin area, but then I get an Error 500 and nothing downloads. I'm guessing my host is timing out.
Title: Re: Java SMF automated database backup
Post by: viulian on March 16, 2010, 01:49:39 PM
The application doesn't yet support 2.0 RC3, but I will have an update ready in the next few days.

@kizer - Can you please try to change your admin user theme to the SMF default one ? It may be something related to the theme (if it modifies the forms layout somehow, the application may be tricked).
Title: Re: Java SMF automated database backup
Post by: kizer on March 16, 2010, 02:32:01 PM
Wow, I didn't know you could tell what template I was using. I forgot I had changed it to do some testing on something else.

I still get this:

[16/03 11:25:32] Method failed (downloadAction): HTTP/1.1 500 Internal Server Error
[16/03 11:25:32] Downloading...
[16/03 11:25:32] Using file: C:\Program Files\JavaSMFBackup\New Forum_16Mar10_112532.sql.gz
[16/03 11:25:32] Download complete. [more than 0 kb/s]
[16/03 11:25:32] Next run at: Mar 16, 2010 1:45:00 PM

I checked my forum logs and my website logs and didn't see anything odd.
Title: Re: Java SMF automated database backup
Post by: viulian on March 16, 2010, 02:57:31 PM
Can you please tell me how long it takes to report the error message ? What is the line on top of the one with 500 error code ?

Is it working if you download the logs yourself, from the admin interface ?

It might be that you have a big database and the server dies while trying to compress it in memory. If it takes some time before you get the 500 error code, it may indicate this.

About the site - I assumed is the one you have in the signature :)
Title: Re: Java SMF automated database backup
Post by: kizer on March 16, 2010, 04:13:01 PM
You assume correctly about the URL in my signature. Please forgive the front page it looks like heck since I started changing things around and well never got back to it.. ;)
Its around 100meg uncompressed around 14meg or so compressed. I will try some more later when I get home so I don't get in trouble playing at work so much. I already have a cron job that does my backups, but I figured I'd try this app since I thought I used something just like it a while back and it worked great.
Title: Re: Java SMF automated database backup
Post by: viulian on March 28, 2010, 12:28:00 PM
A quick announcement: application works with version SMF 2.0 RC3, you just have to select RC2 from the drop down.
Title: Re: Java SMF automated database backup
Post by: Vincent Volmer on April 05, 2010, 04:45:07 PM
Quote from: viulian on March 28, 2010, 12:28:00 PM
A quick announcement: application works with version SMF 2.0 RC3, you just have to select RC2 from the drop down.

thanks!!

Vincent
Title: Re: Java SMF automated database backup
Post by: Dordt on April 18, 2010, 05:11:51 PM
Thanks viulian !!!!!!

Great Tool ....
Title: Re: Java SMF automated database backup
Post by: andy12gr on June 02, 2010, 01:38:49 PM
Thank you ;D
Title: Re: Java SMF automated database backup
Post by: naijaecash on July 12, 2010, 09:05:51 AM
Quote from: viulian on March 28, 2010, 12:28:00 PM
A quick announcement: application works with version SMF 2.0 RC3, you just have to select RC2 from the drop down.
Thanks. Great tool
Title: Re: Java SMF automated database backup
Post by: imno007 on November 25, 2010, 10:40:45 AM
Damn! Too bad, looks like another abandoned project. :(
Title: Re: Java SMF automated database backup
Post by: viulian on November 25, 2010, 12:08:13 PM
Quote from: imno007 on November 25, 2010, 10:40:45 AM
Damn! Too bad, looks like another abandoned project. :(

Who told you that :) ? It is not abandoned - if you have some troubles with the main web page of the project (http://hex.ro) is because I decided to give up on the former CMS I had, and it might that some of the links are not working anymore.
Title: Re: Java SMF automated database backup
Post by: ups on November 26, 2010, 07:12:20 PM
Awesome tool!! especially after my hosting decided to restore all data from two months back!!!

Lets see if I can get this to work for daily downloads.

[edit] Not working.. i'll try to find out why in the next days.
Title: Re: Java SMF automated database backup
Post by: viulian on November 27, 2010, 03:54:04 AM
If there are problems, most likely they are because of configuration issues on the forum / pc side (for example, proxies, or ... requesting .zip backup, but the forum doesn't have too much memory to zip everything in memory; if you have a big database > 100Mb of SQLs for example, is better if you disable .zip - or, of course, increase php allowed memory, if you can control that).

If you believe the problem is within the application, please enable Logging (in the options), and send me the log file.
In very rare cases I had to ask the user for a temporary admin user so I can do test on my own, since I could not tell from the logs.

Please let me know,
Title: Re: Java SMF automated database backup
Post by: ups on November 27, 2010, 09:47:11 AM
It seems that the programs thinks that is downloading the database but instead, I get a HTML file with a redirect.

Can I PM you with the link to the logfile?
Title: Re: Java SMF automated database backup
Post by: viulian on November 27, 2010, 01:12:51 PM
Of course.
Title: Re: Java SMF automated database backup
Post by: viulian on November 27, 2010, 06:51:57 PM
After discussions with ups, it may be that Java SMF Backup will not work on large forums with low PHP memory limits.
PHP process creating the backup might run out of memory. It is not a limit of Java SMF Backup. For example, 128Mb memory limit for PHP process is low for a forum that has the raw SQL (mysql-dump of the database) of ~100Mb; I keep the memory limit to 256Mb and is OK without zip compression (but still fails if I enable _zip_ compression). In case you have low PHP memory limit which you can't modify, you might need to consider different backup solution.

PS: I've also updated the first post of the topic, so people are informed beforehand. Thank you ups for the idea.
Title: Re: Java SMF automated database backup
Post by: imno007 on November 27, 2010, 10:20:29 PM
Hmm, maybe it is a memory thing then, all I know is the download file I get is 4 KB in size, which definitely ain't right - not to mention the fact that when I try to unzip it I get an invalid file error message. :(
Title: Re: Java SMF automated database backup
Post by: viulian on November 28, 2010, 08:32:04 AM
Can you please open the file with Notepad (text editor) and see the contents ? It is probably an error message that got saved as a .zip file ..

Also, try to disable the .zip compression, and attempt the backup without it.
Title: Re: Java SMF automated database backup
Post by: tfs on November 30, 2010, 01:47:35 PM
Ever since I changed my forum over to SSL (HTTPS://) I can't get this to work.  First problem is in the .CONF file, where it insists on placing "http://" in front of the "https://", so the line ends up looking like this....


<entry key="forum.0.url">http://https://www.xxx.com/helpdesk/index.php</entry>



So I can edit the .CONF file myself to get rid of the http:// and it looks like it's working.  But the file that it downloads is only 5 kilobytes, and is corrupted.  Additionally, the progress indicator ends up saying "Download complete. [more than 5 kb/s]"

[30/11 10:37:39] Forum set to do backup upon program startup.
[30/11 10:37:39] Connecting to admin backend.
[30/11 10:37:41] Sending password...
[30/11 10:37:41] Attempting to load the admin page.
[30/11 10:37:42] Got a redirect. Checking if password was ok...
[30/11 10:37:43] Requesting the backup file.
[30/11 10:37:43] Downloading...
[30/11 10:37:43] Using file: C:\WWW\\JavaSMFBackup\Helpdesk_30Nov10_103743.sql.gz
[30/11 10:37:43] Download complete. [more than 5 kb/s]
[30/11 10:37:43] Next run at: Nov 30, 2010 1:45:00 PM


I've tried it with file compression on and off but still no joy.  SMF 2.0 RC4.
Title: Re: Java SMF automated database backup
Post by: viulian on November 30, 2010, 03:02:26 PM
tfs ...  :(

Application doesn't have support for HTTPS. I will have time to investigate this, but in the weekend to come...
The .conf file behavior is correct, I mean it checks if the forum URL starts with 'http://' and if not, assumes that the user was lazy and did not put 'http://' himself/herself. So it 'helps' by pre-pending the 'http://' for the lazy user :)

I will fix this, but it might take up to one week to have an update... [I will announce here]
Title: Re: Java SMF automated database backup
Post by: wonky on January 13, 2011, 05:15:46 AM
I have a problem that the downloaded file is almost always cut of at 19.8 Mb. Sometimes it manages to download about double that. The database is around 50 Mb and I don't use any compression, as the server seems to not be able to handle it. Does anyone know what could cause the file to be cut off at the same size almost every time?
Title: Re: Java SMF automated database backup
Post by: viulian on January 13, 2011, 05:58:24 AM
Can you please tell me if you can successfully do the backup using the Forum's admin web page ?

To me this seems again an issue with the memory on the server, since there's nothing specific in the code of Java SMF Backup to make it crash at that size. As long as the server is sending data, data is written to disk.
Is there any error in the log system that might indicate a timeout ?
Title: Re: Java SMF automated database backup
Post by: wonky on January 13, 2011, 07:24:06 AM
Yes, the weird thing is that from the forum admin page it works flawless every time. I tried to open a log but it said "Execution of the ASP page caused the Response Buffer to exceed its configured limit." It's a windows server and I'm not the owner, but it seems it might be a buffer issue. Strange though, that the forum maintenance interface works fine.
Title: Re: Java SMF automated database backup
Post by: viulian on January 13, 2011, 02:16:42 PM
I see ... I only tested Java SMF Backup with Apache / Nginx web servers.

I'm not sure I understand "I tried to open a log" .. you mean the log file from JSB folder ? In JSB there's a setting that allows you to have Debug logging. Please set it to debug and attempt another backup. Then, in the folder where you run JSB there will be a .log file - can you please paste the content of that file here ? (of course, you have to edit it to suppress your specific hostname, etc).

Also: It might that the server treats the browsers differently - you may try to fiddle with User Agent settings and act as Internet Explorer or Firefox ?

In the worst case scenario, in the past I've asked the users to activate a temporary admin user so that I can try it myself and try to figure out what happens.

Please keep me posted.
Title: Re: Java SMF automated database backup
Post by: tfs on March 16, 2011, 10:18:33 PM
Quote from: viulian on November 30, 2010, 03:02:26 PM
Application doesn't have support for HTTPS. I will have time to investigate this, but in the weekend to come...

Any chance for an RC5 update that works with HTTPS?
Title: Re: Java SMF automated database backup
Post by: viulian on March 17, 2011, 10:07:01 AM
I've installed an HTTPS server and playing with it. I cannot give a time reference as I gave, since a lot of things are happening now, but I will get it done :)
Title: Re: Java SMF automated database backup
Post by: tfs on March 17, 2011, 02:17:38 PM
Thanks.  Looking forward to using this on HTTPS when you get the time.
Title: Re: Java SMF automated database backup
Post by: perfec2 on March 20, 2011, 10:39:03 AM
Is there a way I can back t up online and how?. And how can restore it?
I am using version 1.1.13
Title: Re: Java SMF automated database backup
Post by: tfs on March 20, 2011, 10:38:39 PM
This program backs up your online SQL database to a file on your local hard drive.  To restore that database you'd use something like phpMyAdmin, which is a common SQL database administration program provided by web hosts.
Title: Re: Java SMF automated database backup
Post by: viulian on March 22, 2011, 02:40:08 AM
I have an HTTPS version working, I've tested it against SMF 1.1 and it does the job.
In case the forum (website) is signed with a self signed certificate or with a certificate that Java Runtime Env / JDK does not trust, there will be an additional step to configure the certificate, as described here: http://blogs.sun.com/andreas/entry/no_more_unable_to_find

I've decided to keep the certificate management outside the application for now since:
1) I assume that if forum are HTTPS, somebody did pay for a trusted certificate (otherwise all users will get warnings, etc). Chances are that latest JVMs will trust these certificates too, so the additional step mentioned above might only be needed when testing (and using untrusted certificates).
2) there are many ways to do manage a keystore that includes a self-signed certificate (the simplest I found is above). Thus no need to complicate the application with an additional layer of checks (pass-phrase, keystore management, handling all new possible errors, etc).

I will release the application in 1 day, I need to test (and adjust the instructions) on Linux too.
Title: Re: Java SMF automated database backup
Post by: perfec2 on March 22, 2011, 02:50:33 PM
Quote from: tfs on March 20, 2011, 10:38:39 PM
This program backs up your online SQL database to a file on your local hard drive.  To restore that database you'd use something like phpMyAdmin, which is a common SQL database administration program provided by web hosts.

I mean backing it up online not on local hard drive(pc). As I use slow internet connect most times, I doubt if such connection would carry ou this work.
Title: Re: Java SMF automated database backup
Post by: viulian on March 22, 2011, 03:26:03 PM
A new version (1.3.5) is available here: http://hex.ro/wp/projects/java-smf-backup/

Please let me know how it works! I've added also a small tutorial on how to setup the application to make a backup if the forum is signed with a self-signed certificate (or a certificate that JVM does not trust).
Title: Re: Java SMF automated database backup
Post by: pitbull10 on March 23, 2011, 08:35:18 AM
I have downloaded this and installed it to C: drive, desktop icon when clicked nothing happens?????
Title: Re: Java SMF automated database backup
Post by: Ken. on March 23, 2011, 12:52:22 PM
Quote from: pitbull10 on March 23, 2011, 08:35:18 AM
I have downloaded this and installed it to C: drive, desktop icon when clicked nothing happens? ??? ?

You may need to run it as 'Administrator'... rt click the icon to select 'run as admin'.
Title: Re: Java SMF automated database backup
Post by: tfs on March 24, 2011, 02:50:52 AM
Quote from: viulian on March 22, 2011, 03:26:03 PM
A new version (1.3.5) is available here: http://hex.ro/wp/projects/java-smf-backup/

Please let me know how it works! I've added also a small tutorial on how to setup the application to make a backup if the forum is signed with a self-signed certificate (or a certificate that JVM does not trust).

Seems to work fine.  Thank you so much!
Title: Re: Java SMF automated database backup
Post by: tfs on April 15, 2011, 06:59:12 PM
Correction... It's not working for me.  The result file isn't a backup of sql...  it appears to be an HTML page that is being backed up... not the SQL database.

Also, when I turn off compression, I get a .SQL file, but it's still a GZ file, simply named .SQL.  And as I said, when the file is uncompressed, it's not really a SQL file... it's an HTML file.

This is on a HTTPS forum, running SMF 2.0 RC5.
Title: Re: Java SMF automated database backup
Post by: viulian on April 17, 2011, 09:01:05 AM
There are some ways to tell what goes wrong:
a) try to rename the .sql file to .html and open it in the browser. Do you see an error ? Sometimes the forum, instead of replying with the raw SQL file, might show you an error page instead (and that's what the application picks up).
b) try enabling debug mode and see if there are any apparent issues within.

I hope that point A) will provide the details...
Title: Re: Java SMF automated database backup
Post by: tfs on April 19, 2011, 11:06:28 AM
When I rename the .sql file to .gz, then uncompress it, I get an SQL file that is really an HTML file.  Then I rename that SQL file to HTML and open it in a browser.  Sure enough, it's my Forum Maintenance page displaying an error.  The error says "An Error Has Occurred! -- Your session timed out while posting.  Please go back and try again."

There's nothing in the forum error log.

I enabled debug mode but there's nothing in the log that jumps out at me.  I'm not sure how best to proceed.
Title: Re: Java SMF automated database backup
Post by: tfs on April 24, 2011, 03:18:55 PM
Anything I can do to help resolved this HTTPS problem I'm having?
Title: Re: Java SMF automated database backup
Post by: viulian on April 26, 2011, 04:49:41 AM
Hello,

Sorry for the delay, I was in the Easter break and did not have time to investigate :)
I will also try with the latest SMF version and see how it goes - will post an update in two days.
Title: Re: Java SMF automated database backup
Post by: viulian on April 28, 2011, 03:31:45 PM
Can you please test this release : http://hex.ro/tracker/EasyTracker.php?id=22 ?

I had an error while detecting the sesc value for 2.0 RC5 SSL version (I've only tested with version 1.1.11 over SSL, and did not notice the error on 2.0 RC5).
Please choose version 2.0 RC2.X as usual and post back the results.

It should now work for SMF 2.0 RC5 (at least this is what I tried) over SSL.
Title: Re: Java SMF automated database backup
Post by: tfs on April 28, 2011, 10:48:43 PM
Works now under ssl for RC5.  Thank you!!! 
Title: Re: Java SMF automated database backup
Post by: yogesh_gamer on May 15, 2011, 02:23:02 AM
There are some problem in window 7.
1) Doesn't minimize to system tray
2) Can't open directly, run as administrator
3) Backup doesn't start automatically
Title: Re: Java SMF automated database backup
Post by: viulian on May 15, 2011, 03:09:02 AM
What app. version are you running ?
I run it on Windows 7 Ultimate as well as Windows 7 Home Premium without any issues. Is true that I keep the UAC disabled though, since I don't like the annoying popups for everything I do ..
Title: Re: Java SMF automated database backup
Post by: PLAYBOY on June 20, 2011, 06:08:52 AM
Is there anyway to get an update on this? I think its a very useful program.
Title: Re: Java SMF automated database backup
Post by: tfs on June 20, 2011, 09:03:11 AM
It seems to be working for me.  I'm using 1.3.6, which apparently isn't available for download on the home site.  I'm not sure where I got it from.  Perhaps from a link provided upthread somewhere. 
Title: Re: Java SMF automated database backup
Post by: viulian on June 20, 2011, 10:36:18 AM
tfs - I think I've sent you the link on my post from April 28, 2011 to try out the HTTPS part.
Other than that, no changes in 1.3.6 as opposed to 1.3.5.

And thanks for mentioning it, I will update the website (since only you requested HTTPS anyway :) ).
Title: Re: Java SMF automated database backup
Post by: tfs on June 20, 2011, 11:13:58 AM
You're welcome.  I'm not sure why Playboy would ask for an update, as it seems to be working fine with SMF 2.0 final for me.  I wonder if it's possible for different themes to break something?

I'm surprised that there's not more HTTPS going on since it's so trivial to steal a login on an unsecured network.
Title: Re: Java SMF automated database backup
Post by: PLAYBOY on June 20, 2011, 11:45:42 AM
Well the reason i asked for an update was because i couldnt see 2.0 on the list of forums. So i uninstalled it.
Its ok. I couldnt really figure out how it works anyways. I had some problems with it so i gave up. Going back to old cron job method.

Thanks anyways.
Title: Re: Java SMF automated database backup
Post by: tfs on June 20, 2011, 12:20:56 PM
Oh, I see what you're saying now.  Yes, the last SMF option in the list is SMF 2.0 RC2.X, but it appears to work fine with 2.0 final for me.
Title: Re: Java SMF automated database backup
Post by: viulian on August 02, 2011, 05:42:48 PM
Hello,

I've just released version 1.4.0, with support for SMF 2.0 Final (nothing changed in fact from SMF 2.0 RC5 related on how backup is handled through the browser). So if you still have 2.0 RC5, you can use this new release (but just select 2.0 from the dropdown).

The application also upgrades the configuration file, so before you uninstall, please copy it somewhere else then copy it back after you install the new version. The version of the forums will be updated automatically to SMF 2.0 (for 2.0 release candidates).

I've tested it also with SMF 1.1.14 as well as HTTPS and it works.

Here are the links:

JavaSMFBackup_1.4.0_setup.exe (http://hex.ro/tracker/EasyTracker.php?id=24)
JavaSMFBackup_1.4.0_linux.tar.gz (http://hex.ro/tracker/EasyTracker.php?id=25)

The source code: https://code.google.com/p/javasmfbackup/source/browse/#svn%2Ftags%2F1.4.0%2Ftrunk (https://code.google.com/p/javasmfbackup/source/browse/#svn%2Ftags%2F1.4.0%2Ftrunk)

Homepage of the application is here (http://hex.ro/wp/projects/java-smf-backup/).

Please let me know in case of issues or success stories :)
Title: Re: Java SMF automated database backup
Post by: tfs on August 03, 2011, 02:02:30 AM
Works great on my regular and HTTPS forums.  Thanks for the update!
Title: Re: Java SMF automated database backup
Post by: tfs on September 01, 2011, 04:22:18 PM
Something to add to this would be the ability to run the backup while server is in maintenance mode.  I had to go to maint mode, and then wanted to run backup, but forgot that it doesn't work while in maintenance mode.
Title: Re: Java SMF automated database backup
Post by: viulian on September 01, 2011, 04:26:32 PM
I hope you mean maintenance mode 1 (and not 2 when forum is unavailable)

:)

I will check to see how easy is to implement and what is different (because there shouldn't be too many things different as long as the username is that of an admin).
Title: Re: Java SMF automated database backup
Post by: viulian on September 01, 2011, 04:29:28 PM
I notice in my logs that people are still downloading very old versions of Java SMF Backup .... Which probably don't even work on newer versions, etc.

Please always use latest version. In the short future, I will actually remove the old versions and all download links will provide the latest version (which works with latest SMF releases, 1.1 and 2.0 anyway).

I did not put any "call home" functionality or anything, so I have no way to warn users that a newer version is available, etc.
Title: Re: Java SMF automated database backup
Post by: tfs on September 08, 2011, 11:31:08 PM
Quote from: viulian on September 01, 2011, 04:29:28 PM
I notice in my logs that people are still downloading very old versions of Java SMF Backup ....

SMF is still handing out JavaSMFBackup_1-3-3_setup.exe

http://download.simplemachines.org/?tools
Title: Re: Java SMF automated database backup
Post by: viulian on October 08, 2011, 05:42:21 AM
I will contact SMF to put the latest version up for downloads :) I did the same in the past.

I've just disabled downloads for versions less than 1.3.5 (on my web page) and people will now be redirected to the project page to download latest version.
Title: Re: Java SMF automated database backup
Post by: tfs on October 10, 2011, 02:44:40 AM
Any news on being able to backup a forum that is placed into maintenance mode?

Admin > Configuration > Server Settings > Enable Maintenance Mode

Title: Re: Java SMF automated database backup
Post by: tenshico on October 14, 2011, 06:56:49 AM
I should of used this :x didn't think was updated,
also a bit off question but same thing, is there a away to automatically do it from linux SSH ?
i love to use this on my windows, but what about ssh script wise?
Title: Re: Java SMF automated database backup
Post by: Kimmie on October 15, 2011, 10:02:49 PM
I just tried to use this and my download was empty when it should have been about 65MB.


ANy idea why?
Title: Re: Java SMF automated database backup
Post by: viulian on October 16, 2011, 08:12:42 AM
Any error output ?
Title: Re: Java SMF automated database backup
Post by: tfs on January 26, 2012, 06:51:30 PM
Quote from: tfs on October 10, 2011, 02:44:40 AM
Any news on being able to backup a forum that is placed into maintenance mode?

Admin > Configuration > Server Settings > Enable Maintenance Mode

Bump
Title: Re: Java SMF automated database backup
Post by: viulian on January 30, 2012, 12:47:12 AM
I will check to see how easy it is...
Basically, I thought of the tool as something that you use to make backups while forum is running, just in case. If I put the forums in maintenance mode, I can do local backups with mysql just in case something goes wrong - and since this rarely happens, I did not add such behavior.

I will investigate :)
Title: Re: Java SMF automated database backup
Post by: tfs on February 24, 2012, 08:01:12 PM
Not sure what and when it started, but this isn't working for me any more unless I turn off compression.

[24/02 16:51:03] Backup notification received.
[24/02 16:51:03] Starting backup procedure.
[24/02 16:51:03] Connecting to admin backend.
[24/02 16:51:04] Sending password...
[24/02 16:51:04] Attempting to load the admin page.
[24/02 16:51:06] Got a redirect. Checking if password was ok...
[24/02 16:51:07] Requesting the backup file.
[24/02 16:51:10] Downloading...
[24/02 16:51:10] Using file: I:\WWW\C3M_HelpDesk\Backups\JavaSMFBackup\Backups\patsong.com_24Feb12_165110.sql.gz
[24/02 16:51:10] Download complete. [more than 0 kb/s]
[24/02 16:51:10] Automatic backups disabled for this forum. Sleeping...


Note the "more than 0 kb/s" message.  I get a zero byte gz file.  If I turn off compression it appears to work properly, producing a SQL file.
Title: Re: Java SMF automated database backup
Post by: viulian on February 28, 2012, 03:18:11 AM
Your forum is getting bigger :)

Basically the PHP script on the server side ran out of memory when trying to ZIP the entire thing in memory before sending it to you.
You either have to increase the maximum allowed memory in server's php.ini, or continue to download unpacked...

I am 99.99% sure this is the problem. To see, it will also fail if you try to download from the forum admin interface as zip and you will find an error message somewhere in the server logs (not on forum logs).
Title: Re: Java SMF automated database backup
Post by: toma on May 13, 2013, 04:58:04 PM
I'm running into a problem after i installed DreamPortal on my SMF forum. The password and username and version is correct, but this is the result:

[13/05 23:47:08] Backup notification received.
[13/05 23:47:08] Starting backup procedure.
[13/05 23:47:08] Connecting to admin backend.
[13/05 23:47:08] Sending password...
[13/05 23:47:08] Attempting to load the admin page.
[13/05 23:47:08] Got a redirect. Checking if password was ok...
[13/05 23:47:08] smfbackup.http.SMFException: Access denied (have you correctly chosen the forum version?).
   at smfbackup.http.SMFConnection.doBackup(SMFConnection.java:336)
   at smfbackup.http.SMFConnection.doJob(SMFConnection.java:500)
   at smfbackup.run.Manageable.run(Manageable.java:29)

The debug log says:
2013-05-13 23:55:50,494 [ailu.org_thread] ERROR   smfbackup.http.SMFConnection  - No "sesc" or "sc" input field found in the reply page. Cannot proceed.
2013-05-13 23:55:50,494 [ailu.org_thread] ERROR   smfbackup.http.SMFConnection  - Exception occured:


Title: Re: Java SMF automated database backup
Post by: viulian on May 13, 2013, 05:44:58 PM
Hello,

I need to install Dream Portal just to see what happens with the admin page .. will let you know as soon as possible.
Title: Re: Java SMF automated database backup
Post by: viulian on May 25, 2013, 02:22:22 AM
Hello,

Sorry for the late reply - I've just installed Dream Portal on my test forum and everything works correctly. These are the values:

Forum URL: http://192.168.0.101/community/index.php
SMF Version: 2.0

(using Dream Portal v1.1 and SMF 2.0.4)

What is your configuration ?
Title: Re: Java SMF automated database backup
Post by: rajeshvv on July 31, 2013, 02:12:21 AM
HI
I had installed the tool and while adding new forum settings am able to see the version up to 2.0 Rc2.X
how about compatibility for smf 2.0.4 version.
please let me know
Title: Re: Java SMF automated database backup
Post by: viulian on July 31, 2013, 02:53:38 PM
Hello,

It does work with that version - I am using it like that :)

Give it a try,
Title: Re: Java SMF automated database backup
Post by: rajeshvv on August 07, 2013, 08:15:26 AM
Quote from: viulian on July 31, 2013, 02:53:38 PM
Hello,

It does work with that version - I am using it like that :)

Give it a try,


HI,

I am pleased to use this plugin... it works great for first backup... once I scheduled for second backup fro next day the login was not success.. showing

Sending password...
smfbackup.http.SMFException: Login failed (no redirect received to the forum's admin page).

at smfbackup.http.SMFConnection.doBackup(SMFConnection.java:206)

at smfbackup.http.SMFConnection.doJob(SMFConnection.java:496)

at smfbackup.run.Manageable.run(Manageable.java:29)


please help me... ):
Title: Re: Java SMF automated database backup
Post by: toma on December 12, 2013, 01:51:23 PM
Quote from: viulian on May 25, 2013, 02:22:22 AM
Hello,

Sorry for the late reply - I've just installed Dream Portal on my test forum and everything works correctly. These are the values:

Forum URL: http://192.168.0.101/community/index.php
SMF Version: 2.0

(using Dream Portal v1.1 and SMF 2.0.4)

What is your configuration ?

Hi Viulian,
i use exactly that as an URL ( SMF 2.06) the error is as follows:

[12/12 20:48:29] Connecting to admin backend.
[12/12 20:48:29] javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target

   at sun.security.ssl.Alerts.getSSLException(Unknown Source)

   at sun.security.ssl.SSLSocketImpl.fatal(Unknown Source)

   at sun.security.ssl.Handshaker.fatalSE(Unknown Source)

   at sun.security.ssl.Handshaker.fatalSE(Unknown Source)

   at sun.security.ssl.ClientHandshaker.serverCertificate(Unknown Source)

   at sun.security.ssl.ClientHandshaker.processMessage(Unknown Source)

   at sun.security.ssl.Handshaker.processLoop(Unknown Source)

   at sun.security.ssl.Handshaker.process_record(Unknown Source)

   at sun.security.ssl.SSLSocketImpl.readRecord(Unknown Source)

   at sun.security.ssl.SSLSocketImpl.performInitialHandshake(Unknown Source)

   at sun.security.ssl.SSLSocketImpl.writeRecord(Unknown Source)

   at sun.security.ssl.AppOutputStream.write(Unknown Source)

   at java.io.BufferedOutputStream.flushBuffer(Unknown Source)

   at java.io.BufferedOutputStream.flush(Unknown Source)

   at org.apache.commons.httpclient.HttpConnection.flushRequestOutputStream(HttpConnection.java:828)

   at org.apache.commons.httpclient.HttpMethodBase.writeRequest(HttpMethodBase.java:2116)

   at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1096)

   at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)

   at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)

   at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)

   at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)

   at smfbackup.http.SMFConnection.doLogin(SMFConnection.java:120)

   at smfbackup.http.SMFConnection.doBackup(SMFConnection.java:206)

   at smfbackup.http.SMFConnection.doJob(SMFConnection.java:477)

   at smfbackup.run.Manageable.run(Manageable.java:29)

Caused by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target

   at sun.security.validator.PKIXValidator.doBuild(Unknown Source)

   at sun.security.validator.PKIXValidator.engineValidate(Unknown Source)

   at sun.security.validator.Validator.validate(Unknown Source)

   at sun.security.ssl.X509TrustManagerImpl.validate(Unknown Source)

   at sun.security.ssl.X509TrustManagerImpl.checkTrusted(Unknown Source)

   at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(Unknown Source)

   ... 21 more

Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target

   at sun.security.provider.certpath.SunCertPathBuilder.engineBuild(Unknown Source)

   at java.security.cert.CertPathBuilder.build(Unknown Source)

   ... 27 more

[12/12 20:48:29] Next run at: 13.12.2013 1:45:00
[12/12 20:49:10] Aborting connection. Terminating active connection.
[12/12 20:49:10] Reloading the forum configuration.
[12/12 20:49:10] Configuration reloaded
[12/12 20:49:10] Next run at: 13.12.2013 1:45:00

Title: Re: Java SMF automated database backup
Post by: toma on December 12, 2013, 01:59:02 PM
And the URL is not https
Title: Re: Java SMF automated database backup
Post by: viulian on December 12, 2013, 02:19:05 PM
Hello,

It might be that your server automatically redirects http traffic over https ... but I have never tested the application against https URLs so I can't really tell if it is a bug in the app or in the communication with the server. However, for sure there is a redirect over https (type http://facebook.com in the browser and you'll see that you'll end up with https://facebook.com and with a secure page).

I guess something like this happens on your configuration too ?
Title: Re: Java SMF automated database backup
Post by: hugbear on January 24, 2015, 03:09:23 PM
Hi, Iulian!

I' ve been trying to get this working with the latest version of SMF (2.0.9) and I'm only getting this log (DEBUG level for JavaSMFBackup v. 1.4.0, 03 Aug 2011 at hex.ro/wp/projects/java-smf-backup/):

2015-01-24 21:56:41,347 [t.ro/smf_thread] INFO    smfbackup.http.SMFConnection  - Connecting to http://hugb...ro/smf/index.php?action=admin
2015-01-24 21:56:42,559 [t.ro/smf_thread] INFO    smfbackup.http.SMFConnection  - Issuing POST to http://hugb...ro/smf/index.php?PHPSESSID=96...h1&action=login2
2015-01-24 21:56:43,285 [t.ro/smf_thread] INFO    smfbackup.http.SMFConnection  - Issuing GET on http://hugb...ro/smf/index.php?topic=9.0
2015-01-24 21:56:44,453 [t.ro/smf_thread] INFO    smfbackup.http.SMFConnection  - Maintain: POST to http://hugb...ro/smf/index.php?action=admin;area=maintain;sa=database
2015-01-24 21:56:45,517 [t.ro/smf_thread] ERROR   smfbackup.http.SMFConnection  - No "sesc" or "sc" input field found in the reply page. Cannot proceed.
2015-01-24 21:56:45,517 [t.ro/smf_thread] ERROR   smfbackup.http.SMFConnection  - Exception occured:
smfbackup.http.SMFException: Access denied (have you correctly chosen the forum version?).    /* Obviously, SMF 2.0 chosen in "Manage forum" setting */
at smfbackup.http.SMFConnection.doBackup(SMFConnection.java:336)
at smfbackup.http.SMFConnection.doJob(SMFConnection.java:500)
at smfbackup.run.Manageable.run(Manageable.java:29)


Is there a way to get this going?

Thanks!
Title: Re: Java SMF automated database backup
Post by: hartiberlin on February 16, 2015, 08:55:32 PM
Hi,
is there a problem with Windows 7 64 Bit ?

It says, when I want to install the version
JavaSMFBackup_1.4.0_setup.exe

He can not access the data and I might not have the right permissions...

What can this be ?

DonĀ“t I have the right Java version or is
JavaSMFBackup_1.4.0_setup.exe
not compatible with Windows 7 64 Bit version ?

P.S. What are other good backup tools for a big SMF 2.09 forum ?

Many thanks.

Regards, Stefan.
Title: Re: Java SMF automated database backup
Post by: tfs on March 28, 2019, 08:43:48 PM
I used to use this years ago but had to remove Java from my machines due to security policies. Does anyone know of something akin to this program that doesn't need Java installed?

I'm looking  to automate a backup of our MySql database that sits on an Ionos web hosted site.
Title: Re: Java SMF automated database backup
Post by: Sir Osis of Liver on March 29, 2019, 12:37:10 PM
Cron job.
Title: Re: Java SMF automated database backup
Post by: Biology Forums on March 29, 2019, 10:20:42 PM
I was thinking why would anyone need this
Title: Re: Java SMF automated database backup
Post by: Sir Osis of Liver on March 29, 2019, 10:56:49 PM
Decent host packages should include daily 30-day backup of all files and databases (mine does), many crappy hosts do not, or charge extra for it (GD :P).  In the absence of reliable backup service, you can do it with cron jobs (if host supports cron jobs, some don't).  Without regular backups, you run the risk of losing years of forum content if server crashes or host screws up.  I've seen this happen more than once.
Title: Re: Java SMF automated database backup
Post by: tfs on March 29, 2019, 10:58:02 PM
I've never setup a cron job before and am a little nervous about doing it. Specifically, where does the backup file go and can I have it emailed to me like I can do with MySQLDumper? What I'm really looking for is something with a UI that can run via a scheduler. This JAVA program used to do that for me.

The backup files should be named using the DB name (I have more than one), and the date. It should allow me to rotate backups for X days... etc.

Can a cron job do something like that?
Title: Re: Java SMF automated database backup
Post by: Sir Osis of Liver on March 29, 2019, 11:22:13 PM
You can create a cron job that backs up all databases to a server directory, from where you can download them to local drive.  I have it set up so daily backups, which have same file names every day, are copied to subdirectory with prefix added that is current date (i.e., today's dump is smf20.sql, renamed to 29_smf20.sql) so they're not overwritten next day.  It gives me 30 days of backups for each database.  Never tried emailing dumps, but that could be problematic if databases are very large.

Title: Re: Java SMF automated database backup
Post by: tfs on March 30, 2019, 12:13:48 PM
Since I don't really have "access" to the servers at Ionos, but use their web based user interface, I'm just not comfortable doing it. I know there's tools out there like this Java SMF backup, which worked great when I used it. And it could be easily automated via a UI that was fairly obvious to use.

Maybe I'll look at some type of browser macro that interfaces with MySQLDumper.