Simple Machines Community Forum

SMF Support => Converting to SMF => Topic started by: nneonneo on August 13, 2007, 11:00:47 PM

Title: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on August 13, 2007, 11:00:47 PM
Please note, these converters are not official converters provided by the SimpleMachines Team. Please use them at your own risk.


Hello all:

I have Invisionfree & ProBoards converters which are (basically) ready to be released. However, as both IF and PB do not offer database backups for free (IF does for a fee), I do not know if it is _legal_ to post such a converter (it is a crawler-type, similar to that used on ezBoards a long time ago).

*EDIT: Converters are posted in the next post.

If you have any questions/comments/concerns/etc. with regards to these converters, don't hesitate to post them in this topic, e-mail me (my email is in my signature) or PM me.

*EDIT [Feb 18 2008]: Added Yuku converter.
*EDIT [April 22 2008]: removed Yuku and Proboards converters, per request.
Title: Re: Invisionfree & ProBoards to SMF Converters
Post by: nneonneo on August 25, 2007, 12:01:21 AM
Current converters:
As nobody has raised any concerns about the release of these converters, I will publish them. You need to be logged in to download the file.

Both require Python with the basic library -- the Python 2.7 installation from http://www.python.org (http://www.python.org) (Windows users click Windows Installer under Quick Links on the left) will suffice. I chose not to write them in PHP as the time requirements can vary widely from a few minutes to several hours, depending on the size of the board (unlike most converters, this one must download each page and parse it, instead of simply converting a preexisting SQL file).

This converter should be run on your own computer and not your host, unless your internet connection is very slow AND your host doesn't mind a potentially demanding and/or long-running script on the server.

Follow the directions in the accompanying Instructions.txt for each converter. In the future, I may make these more general (and thus require less work on the part of the user), but that is not a short-term goal.

If an error occurs, it will usually be logged in convert_error.log, which you should attach in case the conversion fails for any reason. More serious errors will be logged to critical_error.log.

Note that the script is periodically re-uploaded due to changes and updates, so the download count will not be correct. As of time of writing, it has been downloaded over 720 times.

*EDIT: Updated instructions in attached converters.
*EDIT2: Updated instructions again; added view counts to Proboards (due to the way the IF converter works, it may not be possible to add view counts easily)
*EDIT3: Added sticky and lock detection to Proboards.
*EDIT4 [Sept 17 2007]: Increased protection from bad characters. This should prevent members and posts from randomly vanishing.
*EDIT5 [Sept 19 2007]: Added delay to Proboards PM script to facilitate PM sending by non-admin users. Default delay 17 seconds; if you are an admin (i.e. username = admin) set the wait time to 0.
*EDIT6 [Jan 19 2008]: Added ActiveBoards converter and some minor updates to the others.
*EDIT7 [Jan 22 2008]: Fixed bug where "\" characters could potentially cause queries to fail.
*EDIT8 [Jan 27 2008]: Instructions changed to use "javascript:document.cookie" instead of a prompt, to accommodate Internet Explorer 7. Fixed settings.py to produce sensible error on accidental execution. Changed some defaults in settings.py to be more sensible (applies only to default SMF setups)
*EDIT9 [Jan 27 2008]: Added a sensible error message if the settings file is not correct.
*EDIT10 [Jan 27 2008]: Fixed a bug which occurred with invisible users on Proboards.
*EDIT11 [Jan 30 2008]: Fixed a bug for Proboards which caused times to be improperly parsed, fixed a bug for proboards which cause topics viewed more than 1000 times to be omitted and improved the default password security (it is still not highly secure, so PLEASE urge users to change their passwords immediately!)
*EDIT12 [Feb 2 2008]: Fixed a bug in the Proboards converter which caused announcement topics to have repeated posts.
*EDIT13 [Feb 18 2008]: Code cleanup; moved a bunch of common routines to "common.py", added Yuku converter, tiny bug fixes for things I've forgotten, etc. :P . The old versions are still attached for history.
*EDIT14 [Feb 24 2008]: Removed Yuku converter by request; added board crawler to Proboards converter (no more messing with BOARDS!); fixed a few minor bugs; bumped Proboards version to 0.2.
*EDIT15 [Feb 24 2008]: Minor fixes for Proboards; script compatibility with Linux/Mac OS X/Cygwin; updated multi-page detection in Proboards. Version bumped to 0.2.1.
*EDIT16 [Feb 24 2008]: Fixed missing field in common.py. Multiple updates to handle "new" Proboards boards. Version bumped to 0.2.2. Thanks to jasonp for finding all these things.
*EDIT17 [Mar 30 2008]: Fixed a bug with members conversion in ActiveBoards, bumped version to 0.1.2. Thanks go to Nicki for finding and reporting it.
*EDIT18 [Mar 31 2008]: Set the common.py file to use UNIX format line-endings: this should fix execution problems for non-Windows users.
*EDIT19 [Apr 2 2008]: Added robust handling of certain broken tags (thanks fmp777 for reporting it)
*EDIT20 [Apr 15 2008]: Added support for Proboards "v4.5".
*EDIT21 [Apr 16 2008]: Fixed bug in common.py caused by last update; thanks to Blakey for reporting it
*EDIT22 [Apr 22 2008]: Removed ProBoards converter per their request.
*EDIT23 [Jul 19 2008]: Added several converters and updated all of them.
*EDIT24 [Dec 08 2008]: Updated all converters, added several
*EDIT25 [Mar 18 2009]: Updated all converters.
*EDIT26 [Mar 27 2009]: Updated all converters.
*EDIT27 [Apr 24 2009]: Forumotion (fixed member conversion) and Zetaboards (fixed attachments and PM sending) updated.
*EDIT28 [Aug 30 2009]: Updated all converters.
*EDIT29 [Sep 3 2009]: Improve conversion of old topics on Zetaboards.
*EDIT30 [Sep 20 2009]: Update Forumotion converter.
*EDIT31 [Feb 2 2010]: Update Forumotion converter.
*EDIT32 [Feb 15 2010]: Update Yuku converter.
*EDIT33 [Mar 3 2010]: Update all converters.
*EDIT33 [Mar 19 2010]: Update all converters, and add Forumer phpBB2 converter.
*EDIT34 [Mar 25 2010]: Update all converters, and add Forumer phpBB3 converter.
*EDIT35 [Jun 15 2010]: Update all converters.
*EDIT36 [Sept 20 2010]: Update all converters.
*EDIT37 [Oct 12 2010]: Update all converters. Added a timeout to alleviate problems with slow or unstable connections.
*EDIT38 [Dec 16 2010]: Update all converters. Added support for content compression, which drastically speeds up conversion (by up to five fold in my testing) and reduces the load on both the network and the server.
*EDIT39 [Jan 22 2011]: Update all converters.
*EDIT40 [May 14 2011]: Update all converters, merge phpBB2 converters into a generic phpBB2 converter, remove iPBfree converter.
*EDIT41 [Jun 07 2011]: Removed Proboards converter again (thanks tjd100 for pointing this out)

If you don't see an attachment below, then you will need to login or register with the SMF community forums to download the converter.
Title: Re: Invisionfree & ProBoards to SMF Converters
Post by: Flying Drupalist on September 04, 2007, 11:12:28 PM
Thank you, you are god.
Title: Re: Invisionfree & ProBoards to SMF Converters
Post by: Mega Mario Deluxe on September 04, 2007, 11:16:20 PM
Looks interesting. Good work, however! :)
Title: Re: Invisionfree & ProBoards to SMF Converters
Post by: nneonneo on September 05, 2007, 09:19:17 PM
I should note that the documentation is a bit out of date. Please read the comments in settings.py for more up-to-date information about specific settings

I will try to update the docs if I get the time.
Title: Re: Invisionfree & ProBoards to SMF Converters
Post by: vbgamer45 on September 05, 2007, 09:34:57 PM
That is awesome I thought making a script to do the same thing.
Title: Re: Invisionfree & ProBoards to SMF Converters
Post by: nneonneo on September 15, 2007, 12:20:31 PM
Instructions updated. Proboards converter can now do view counts.

See second post for updated package.
Title: Re: Invisionfree & ProBoards to SMF Converters
Post by: newbee on September 17, 2007, 01:59:00 AM
Thanx a million, nneonneo. Your converter really pulled me thru (with your patient help). It's bye bye proboards! I thought it was gonna be so much harder to change over. Sure saved me a LOT of time.  You da man :) :)
Title: Re: Invisionfree & ProBoards to SMF Converters
Post by: Bytor on September 25, 2007, 06:14:41 PM
Thanks nneonneo, for your patience & all your help during the conversion process from proboards to SMF. 

Much appreciated.

Bytor
Title: Re: Invisionfree & ProBoards to SMF Converters
Post by: Tarni on November 25, 2007, 03:29:21 PM
I am so lost we got stuck on Step 3 for the PB converter is there anyone who can help?  when I run it I get a message that says converted: 0 posts 0 topics... am I supposed to install this somewhere ON the proboards forum?  so that it will convert those posts? 

ANY help is appreciated

Thanks
Nik
Title: Re: Invisionfree & ProBoards to SMF Converters
Post by: nneonneo on November 25, 2007, 07:45:47 PM
Hi Tarni:

Earlier you sent me a message about downloading the converter; presumably that's resolved now.

The most important step is step 2. You'll need an SMF board set up the way you have it on Proboards (I can't convert the board structure due to some big differences in how they are laid out in Proboards vs. SMF).

Each setting must be set. The most critical settings are:
1) BOARDS: This is a variable mapping Proboard short board names to SMF board IDs. If you don't have an SMF board already, then you will need to make one to check the IDs. This is probably the hardest one to get right -- everything else is quite straightforward.
2) COOKIEDATA: This allows the converter to log in as you, so it can download the board. The instructions are pretty basic.
3) URL: Where the board is. This one is self-explanatory, but if it is wrong or doesn't end in index.cgi, it probably won't work (or not correctly, anyway)
Those are the important settings; the rest may affect the accuracy of the conversion but should not affect the overall conversion.

If you still can't get it to work, send me (do _not_ post) the settings.py file and I'll see what I can do.
Title: Re: Invisionfree & ProBoards to SMF Converters
Post by: nneonneo on December 19, 2007, 11:04:06 PM
Based off the existing code for Proboards and Invisionfree, and a request for an ActiveBoard conversion, I've created an ActiveBoard converter. It works fine, but it's not yet ready for general use.

If you are interested in an ActiveBoard conversion, PM me and let me know!
Title: Re: Invisionfree & ProBoards to SMF Converters
Post by: Aaron on January 19, 2008, 07:17:47 AM
The attachment seems to have been lost in yesterday's server maintenance. Could you reupload it, please? :)
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 19, 2008, 10:54:10 AM
Thanks for letting me know. It has been updated and uploaded.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 22, 2008, 09:23:46 PM
Update! I have been notified that \ (backslash) characters can cause MySQL to potentially produce error messages on the files. This has now been fixed. If you were encountering such issues, please update your converters.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 25, 2008, 05:48:52 PM
Has anyone been succesful in converting your proboard over to SMF using this converter? 
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 25, 2008, 05:58:10 PM
Yes, a number of people, myself included, have successfully converted Proboards to SMF.

However, I understand that this set of converters may not be as easy to use as the convert.php based ones; this is because of the sheer amount of "hidden" or difficult-to-retrieve information present on such boards, compared to the transparency of a database.

If you need assistance with a conversion, I will be glad to help.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 25, 2008, 06:09:26 PM
I sure could use some help.  I need to set up the smf board first, but after that I want to get my proboard info over to it asap.

Anything I should be watching out for as I set up the smf board?

I catch onto things pretty quickly, so I'm confident I can make it work.

I did post a question in another thread, but maybe you can answer it for me.

Will members be able to sign in the new smf board with their current log-in info?
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 25, 2008, 06:20:58 PM
Quote from: Randy A. on January 25, 2008, 06:09:26 PM
I sure could use some help.  I need to set up the smf board first, but after that I want to get my proboard info over to it asap.

Anything I should be watching out for as I set up the smf board?
Make sure that the boards on SMF resemble the ProBoards ones -- i.e. you can clearly tell (for yourself) which ProBoards boards go to which ones on SMF. This isn't a strict requirement, but it helps when you need to set up the BOARDS variable (quite possibly the trickiest part of the entire process).

Quote from: Randy A. on January 25, 2008, 06:09:26 PM
I catch onto things pretty quickly, so I'm confident I can make it work.

I did post a question in another thread, but maybe you can answer it for me.

Will members be able to sign in the new smf board with their current log-in info?
No, the members will not. The reason is because if the converters could tell what the password was, or even the hash, it would be a major security hole for Proboards. Hence, short of bruteforcing everyone's passwords (not a good idea), the answer is no. However, the converters I've written have an extra feature: pseudorandom password generation. When you setup the converter, one of the variables is a large random number. Setting this value causes the script to generate the same set of random passwords for each run (to guard against the possibility of a failed run), but in a random manner. Additionally, you have the option of mass-PMing every user on your Proboards forum their new password and a link to the new forum page.

**n.b. passwords thus generated are not strong, so it is highly recommended that users change their passwords immediately. If you want to increase the strength of the generated password, increase 32767 in passnumber=str(random.randint(0,32767))
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 25, 2008, 09:06:20 PM
I can deal with the password issue, as long as the member info gets brought over.  I can work that detail as I close the old site and bring the new site online.

Now, off to find a good host.  I see two good possibilities right here on the board and one of them has already graciously offered some great advise.

Very enjoyable experience so far, here at this forum.

Thanks!!
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 25, 2008, 10:08:34 PM
Can you point me to the exact Python download that I need?
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 25, 2008, 10:19:56 PM
Left side, under Windows Installer (assuming you use Windows).

Direct link, http://python.org/ftp/python/2.5.1/python-2.5.1.msi
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 25, 2008, 10:23:52 PM
Got it.  Downloading now.

Will be working on getting the new smf site up this weekend.

Looking forward to the conversion.

I hope I have enough hair left! :)
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 25, 2008, 11:12:56 PM
Cool! If you run into any problems, or have questions, don't hesitate to post.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 26, 2008, 09:42:01 AM
Can't quite get the cookie data javascript.  I'm pasting "javascript:prompt('Your Cookie',document.cookie)" (without quotes) into the address bar, but it comes up 'null'.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 26, 2008, 10:25:29 AM
When you hit "enter" in the location bar, it should pop up with a prompt box. Copy the info from that prompt (alternately, click "OK" rather than Cancel).

The reason I'm using a prompt box has to do with characters like "<" which may appear in cookies (encoded); these are only correctly represented in a prompt box.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 26, 2008, 03:05:16 PM
Using IE7, pasting the above javascript into the address bar of my proboard, hit enter, no pop up box, just a page saying null.

Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 26, 2008, 03:46:21 PM
Nneonneo - not sure if you'd be available this evening, but I'm off to a basketball game.  I'd love to get this conversion kicked off during the night.

I'll check back in after I get home.

Basically, I believe I have everything else ready, just need to get this cookie data figured out and I'm ready to try it.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 27, 2008, 12:47:58 AM
Argh, Internet Explorer 7 pisses me off so much >:(

The solution to the problem?
javascript:document.cookie

(when you tried the previous technique, you probably got a blip, indicating that IE blocked some "malicious content" or some nonsense like that. I think IE7 is being paranoid)
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 27, 2008, 07:27:24 AM
So, if I'd use this with IE6 or FF, it would work better?  I'll try that too.

I used the new code and it only gives me the user and password, no cookie info.

I did not get a blip.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 27, 2008, 07:42:44 AM
BTW, just used the old javascript in FF, got the same 'null' page.

Used your new java and just got the user and password, no cookie info.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 27, 2008, 11:37:12 AM
User and password? That's the cookie.

It should look like
rand=abcdefghij; user=admin; pass=klmnopqrstuv

As for the prompt() javascript in Firefox, it works for me; I get a prompt box with the cookie in it. I've updated the converters to reflect the new javascript code.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 27, 2008, 11:43:32 AM
I apologize then.  I have been waiting for the 'rand' part of it.  Duh!

Let me update the file and see if I can get it to run.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 27, 2008, 11:46:10 AM
Ok, updated the file with the user and password.

Double clicked the 'members_topics_posts' --- a box comes up and closed so quick I can't see what it says.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 27, 2008, 12:05:34 PM
Try the converter I just uploaded (you only need the members_topics_posts.py file).

I suspect that there is a syntax error in your settings.py file; I've updated the converter to let you know what the problem is.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 27, 2008, 12:10:14 PM
Quote from: nneonneo on January 27, 2008, 11:37:12 AM
User and password? That's the cookie.

It should look like
rand=abcdefghij; user=admin; pass=klmnopqrstuv

As for the prompt() javascript in Firefox, it works for me; I get a prompt box with the cookie in it. I've updated the converters to reflect the new javascript code.

Ok, did I understand you right.

I should get all this info when running the script?

I'm only getting the user and password info, no 'rand' info.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 27, 2008, 12:14:32 PM
rand is not important (I should actually note this!) as far as I can tell. When you use
javascript:document.cookie
out pops the username, password and _maybe_ a rand value.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 27, 2008, 12:17:41 PM
Ok.  Thanks so much for your patience.

I'll update the new settings file and see how it goes.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 27, 2008, 12:39:23 PM
Updated the settings file and I'm getting a syntax error, it appears line 11 & 12 are invalid. 
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 27, 2008, 12:56:15 PM
Would you mind if I sent the files to you for review?
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 27, 2008, 01:43:47 PM
No, I wouldn't mind; go ahead -- nneonneo {AT} gmail
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 27, 2008, 01:47:17 PM
Just sent it.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Randy A. on January 27, 2008, 04:35:09 PM
Hi Everyone!

I wanted to quickly pop in and thank nneonneo for all of his assistance in getting my conversion to SMF completed.

It has a learning curve, but overall, a very nice experience.

Thank You!!
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: DeadSnipe on January 28, 2008, 10:38:08 PM
In the instructions 4) and 5):

What exactly does it mean to Execute the SQL batch file topic_posts.sql in the forum database and Execute the SQL batch file members.sql in the forum database?

In the proboards folder (same as where the instructions.txt file is), i see:
topic_posts_smf.sql  and
members_smf.sql

Do i have to upload those file via ftp to the forums root? or do i have to actually access the mysql database and execute something from there?

Also, when i run the membes_topic_posts.py file, it says 0 posts and 0 topic converted and i dont recall getting any error messages. I labeled all the shotnames exactly, from top to bottom in order as they are on my proboards and made the smf forums layed out the same from top to bottom giving the shortname the same as in the proboards forums'.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 28, 2008, 10:51:19 PM
You have to access your MySQL database. The exact method varies for different user interfaces, but for phpMyAdmin, you go to the database, then select "Import", upload the file and click Go. If the file exceeds the posted size limit, you can try compressing it with zip before uploading.

When it gives you the "0 posts/0 topics" message, that means the script was unable to find any topics. This can mean a few things.

a) Wrong cookie: grab a fresh one (redo the document.cookie thing)
b) Wrong URL: fix it in settings.py
c) No board mappings: there are no boards (shortnames) to download - check BOARDS
d) I have no idea what else could go wrong; if those don't help, email me the settings.py file (do NOT attach it here) and I'll take a look.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Universe_JDJ on January 29, 2008, 07:30:18 PM
Is there a way to get it to assign topic and message numbers (ID_TOPIC, ID_MSG) from a higher number (100001, 100002, 100003 etc) instead of starting with 1,2,3 etc?
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: DeadSnipe on January 29, 2008, 07:45:25 PM
Quote from: nneonneo on January 28, 2008, 10:51:19 PM
You have to access your MySQL database. The exact method varies for different user interfaces, but for phpMyAdmin, you go to the database, then select "Import", upload the file and click Go. If the file exceeds the posted size limit, you can try compressing it with zip before uploading.

When it gives you the "0 posts/0 topics" message, that means the script was unable to find any topics. This can mean a few things.

a) Wrong cookie: grab a fresh one (redo the document.cookie thing)
b) Wrong URL: fix it in settings.py
c) No board mappings: there are no boards (shortnames) to download - check BOARDS
d) I have no idea what else could go wrong; if those don't help, email me the settings.py file (do NOT attach it here) and I'll take a look.

I guess i'll have to download/install Firefox in order to get this javascript:document.cookie thing because nothing comes up using IE.6 :(

*UPDATE* Ok, not even using Firefox was i able to get the cookie thing :(
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 29, 2008, 07:47:17 PM
@Universe_JDJ: Hmm, that's an interesting question.

Increase the 1 in
topicmap['%i/%s'%(topicid,board)]=i+1
and change 1 in
postid=1
(note that there are two spots for that last one)
and removing the TRUNCATE TABLE SQL statements (presumably, you are appending to a database?)

@DeadSnipe: Huh? Try "javascript:prompt(document.cookie,document.cookie)" and see if that works.
Also, before you type that in, are you on the Proboards page?
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: DeadSnipe on January 29, 2008, 07:56:39 PM
Quote from: nneonneo on January 29, 2008, 07:47:17 PM@DeadSnipe: Huh? Try "javascript:prompt(document.cookie,document.cookie)" and see if that works.
Also, before you type that in, are you on the Proboards page?

Yes, i am on the main login page of my proboards forum with the admin/password field blank. I tried the prompt command you just mentioned to use and i popup prompt box comes up, but it is blank.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Universe_JDJ on January 29, 2008, 07:59:05 PM
Quote from: nneonneo on January 29, 2008, 07:47:17 PM
@Universe_JDJ: Hmm, that's an interesting question.

Increase the 1 in
topicmap['%i/%s'%(topicid,board)]=i+1
and change 1 in
postid=1
(note that there are two spots for that last one)
and removing the TRUNCATE TABLE SQL statements (presumably, you are appending to a database?)

Yes, I am appending to a database. Thanks for that greatly, it worked. One last question, seeing that registration ID's on the source and destination forum differ would it be possible to have all imported posts show up as guest posts (this is probably going to be tricky)?

Unless, of course there's a way of mapping an old username ID to a new one (similar to how boards are done)...
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 29, 2008, 08:14:46 PM
@DeadSnipe: Have you logged in?

@Universe_JDJ: There's a way to map users. The alternative is just to let everyone's user ID be zero. Both involve changing this line:
memberslist[m]=i+1
To map users, change that to
if m not in memberslist: memberslist[m]=i+1
and to let them be zero (guests), just use
pass

To map users, just edit the memberslist variable, using their shortnames mapped to their SMF IDs:
memberslist={'guest hack':0} # the space ensures that "real" users will not have this ID
Importantly, please do not change the guest hack entry (it's a hack, and it should stay that way :P)

That should fix things up.

As a final afterthought: if you don't want to map ALL users (which could become tedious!) you can use "pass" on the memberslist[m]=i+1 line. Any users from Proboards who aren't mapped will be silently ignored and their posts made into guest posts.

P.S. Also remember that doing this will prevent the members from being converted (which may not be a bad thing in your case); particularly, posting statistics, etc. won't be updated.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: DeadSnipe on January 29, 2008, 08:26:42 PM
Ok, i got the javascript:document.cookie information and updated the settings.py with it.

I ran the member_posts_topics.py file and when it was going through the members, it was saying something about the date/time info was incorrect. Then it started converting everything. After it was done, it closed out and i wasnt able to see any of the errors it had. When i went to see my smf forum, it didnt seem like anything was transferred/converted... and now i can't log into my forum under admin :(

Jeez i think i screwed up bigtime lol.... is this reversible in any way? or anything i can do to fix it and re-run it?

Thanks!

Ps. How do i send you my settings.py file in a PM? I don't see an option for that
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 29, 2008, 08:33:14 PM
For logging in to the forum, check to see if a file "pm_passwords.txt" has been created and use that to log in -- it's in the format username|passnumber.

As for date/time info being wrong, have you changed your date time preferences? I'll post that here if you missed it.
In the Dates and Times section:
Time Format: am/pm (e.g. 11:11 pm)
Date Format: Dec 28th, 2004, 11:11pm
Month Format: December 28


If that still doesn't work, email me the settings.py and I'll help work something out.

Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: DeadSnipe on January 29, 2008, 08:45:50 PM
i found the pm_passwords.txt and saw all the members along with numbers sitting next to it, sorta like this:

botman|6693

I used the number next to admin| .... but it didnt work.

As for the dates and times, that is exactly what i have. I didn't touch anything there because it was the same info as in my profile preferences.

settings.py sent via email.

Also, when i checked my forum, NONE of the categories/posts were transferred. Everything says O on it.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 29, 2008, 09:48:03 PM
Hmm. It looks like Proboards has updated something. Typically, this may cause the converter to malfunction (e.g. dates).

OK. New plan. Change your date format to 12/28/2004 at 11:11pm.
Then, change this block of code in the converter:
def parsetime(tm,fmt='%b %d, %Y, %I:%M%p'): # glorious time parser, returns the UNIX time-since-epoch-in-seconds thing ;)
    return mktime(
        strptime(
            tm.replace("Sept","Sep").
                           replace("<b>Today</b> at ",strftime('%b %d, %Y, ')).
                           replace("[b]Today[/b] at ",strftime('%b %d, %Y, ')).
                           replace("Yesterday at ",strftime('%b %d, %Y, ',localtime(time()-24*3600)))
            ,fmt)
        )

with
def parsetime(tm,fmt='%m/%d/%Y at %I:%M%p'): # glorious time parser, returns the UNIX time-since-epoch-in-seconds thing ;)
    return mktime(
        strptime(
            tm.replace("Sept","Sep").
                           replace("<b>Today</b> at ",strftime('%m/%d/%Y at ')).
                           replace("[b]Today[/b] at ",strftime('%m/%d/%Y at ')).
                           replace("Yesterday at ",strftime('%m/%d/%Y at ',localtime(time()-24*3600)))
            ,fmt)
        )


I am fairly certain this will resolve the issue. I'm sorry about the inconvenience.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: DeadSnipe on January 29, 2008, 09:59:36 PM
YES! You're a genious!..... Although, i have 151 topic and 1,299 posts on my proboards forum but only 107 topics and 545 posts were converted :(

Anyway to get all of them to come over to smf? or what i'm doing wrong?

Thanks,
- Dead

*UPDATE* Ok, my smf forums still say no posts/topic on all of my boards and stuff... and i still can't log in as admin using the password i found in the password.txt file :( Do i have to execute the pm_passwords.py file first in order to login as admin using that numbered password?
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on January 29, 2008, 10:08:25 PM
You did execute the SQL file(s) in the database, right?

Do NOT run pm_passwords.py until the conversion is done. It PMs EVERYONE on your forum of their new password (as an admin you can set the wait time to 0 in settings.py to speed that up *when you go to do it*)
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: DeadSnipe on January 29, 2008, 11:27:06 PM
I didn't run the sql batch files a second time....no.

I am double checking the settings.py file to make sure it is all right (hopefully) then i will run everything in order how they are explained in the instructions.txt file.

I'm almost burnt out on this lol  :(
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: Universe_JDJ on January 30, 2008, 12:11:49 AM
Quote from: nneonneo on January 29, 2008, 08:14:46 PM
@Universe_JDJ: There's a way to map users. The alternative is just to let everyone's user ID be zero. Both involve changing this line:
memberslist[m]=i+1
To map users, change that to
if m not in memberslist: memberslist[m]=i+1
and to let them be zero (guests), just use
pass

To map users, just edit the memberslist variable, using their shortnames mapped to their SMF IDs:
memberslist={'guest hack':0} # the space ensures that "real" users will not have this ID
Importantly, please do not change the guest hack entry (it's a hack, and it should stay that way :P)

That should fix things up.

As a final afterthought: if you don't want to map ALL users (which could become tedious!) you can use "pass" on the memberslist[m]=i+1 line. Any users from Proboards who aren't mapped will be silently ignored and their posts made into guest posts.

P.S. Also remember that doing this will prevent the members from being converted (which may not be a bad thing in your case); particularly, posting statistics, etc. won't be updated.

Thanks for all the help. Everything ended up working great.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on February 02, 2008, 10:25:56 PM
Wow, tons of bugfixes inbound. Most of these bugs were exposed when I converted an extremely large board. I will probably end up fixing tons more before this is all over :P
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: DeadSnipe on February 08, 2008, 09:00:44 PM
Thanks nneonneo for helping with the conversion. I'm sure you found some bugs while dealing with my stupid proboard conversion lol. Everything is fine and converted except for 1 thing.... when i sent out the PM's for the passwords using the pm_passwords.py file, i had to set the waittime to 17 seconds even though i'm admin. What's weird is that the very first time i tried doing the pm_passwords.py, it started to send using 0 waittime. So i don't know what happened between there and now. But it is sending PM's as i type this post on my other PC. Roughly bout a 20 minute wait but it's only 1 time so i'm cool with it, although if this is a bug, people who have like 200+ members will not be happy lol.

Thanks again!
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on February 08, 2008, 09:26:11 PM
Heh, I've seen boards with 2000+ members. If the PMs took that long to send on those forums, I can imagine people would be unhappy.

I'll see about that. Maybe it's necessary to have 1 or 2 seconds between PMs.

EDIT: Argh, Proboards went and changed this on me. So, now, 15 seconds is the minimum time between PMs for *everyone*, including admins.

That is quite annoying. There's nothing I can really do about that, so waittime is now going to be 17 seconds for everyone.

(as for why I chose 17 seconds, well, it's a safety thing. If you're adventurous, you can make it 16 or 15. Don't blame me if it doesn't work.)
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: DeadSnipe on February 08, 2008, 09:33:13 PM
I tried 1 and 2. Even 5.

With 1 second waittime it sent 1 PM then it gave me the error.
With 2 second waittime it sent 2 PM's then it gave me the error.
With 5 second waittime it sent like 3-4 PM's then it gave me the error.
So i just went with the 17 default so i wouldnt be there all day lol.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on February 08, 2008, 09:42:08 PM
Yeah, I tried it on my own test mini-forum, and it throws the "15-second" error even when logged in. I'll change the instructions to reflect this change (minor, but irritating nonetheless).
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: DeadSnipe on February 10, 2008, 11:56:10 AM
Oh, one question. When you do the conversion, it changes everyone's password, right?........... so then, you activate the pm_passwords.py file and it's suppose to send PM's to everybody to let them know their password has changed. How can people know to check their PM when they can't even log in since their password has changed? I'm sure most of the non-clan members will be like, "oh well, i'll try later or something".... then forget and never come back.

Would be better (if possible) to send the auto-message to their registered email that is on their profile, so it makes sure they got their message. Don't know if this can be done or not though.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on February 10, 2008, 11:59:24 AM
It sends the message to the Proboards account. That password is not changed.

So, what they'll do is login to Proboards like the always do (usual username and password), read the PM, and then know the password for the new forum.
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: DeadSnipe on February 11, 2008, 02:45:36 PM
Hmm... weird. The members that contacted me asked if something changed on the forum because their log-in doesnt work. They thought i deleted them or something LoL. I'll have to check this out and see if it's something on their side or what...

Thanks,
- Dead
Title: Re: Invisionfree/ProBoards/ActiveBoards to SMF Converters
Post by: nneonneo on February 11, 2008, 06:18:32 PM
The Proboards forum?? That should not happen.

EDIT: I can log in to the Proboards forum with my "old" password (the one I used to sign up) and I can log in to the new SMF forum using the password in the PM. So, I am guessing that it is not a problem for everyone, maybe just a few users.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: jasonp on February 24, 2008, 11:17:16 AM
Are the older versions still attached?  I dont seem to see anything except the newest one, but I'm probably looking in the wrong place.  I'm trying to convert a proboards board, and for some reason it only pulls in the first 30 usernames (The ones that appear on the first page when I browse the members).  After it pulls those in, it continues on and gets all the posts.  I dont remember it doing that in the last version, but maybe I just didn't notice.  If the old version of members_topics_posts.py is posted somewhere, I'd like to try it and see if I still have the same issue.  Thanks!
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on February 24, 2008, 11:23:49 AM
I do remove older versions, but thanks for letting me know. I probably went and broke the page detection, so I'll get on that right away. Thanks!
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: jasonp on February 24, 2008, 11:29:44 AM
Hmm. I think I got it.  I'm not sure if it was always like this, but it seems to default to 30 per page now.  I made this change and now it seems to work (I have ~140 members)

changed:

req=urllib2.Request(URL+'?action=members',headers={'COOKIE':COOKIEDATA})
to:   

req=urllib2.Request(URL+'?action=members&view=all&perpage=150&page=1',headers={'COOKIE':COOKIEDATA})
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on February 24, 2008, 11:31:22 AM
That's really odd, since it's working for me :-\

I think it was always 30 per page. Do you have a board URL so I could have a look?
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: TriumphTalk on March 10, 2008, 12:24:46 AM
Well I am presently looking at converting from IF so I hope this will come in handy   
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: greya on March 31, 2008, 05:46:01 PM
hi all, trying to get this done before proboards totally messes it up with version5 :o

I've defined my settings.pl and followed every last detail of the Instructions.txt file included in the Proboards subdirectory, but when running the script on my fedora/python2.5, I get this:

# python members_topics_posts.py
Traceback (most recent call last):
  File "members_topics_posts.py", line 22, in <module>
    exec file("../common.py", "rt").read() in globals(), locals()
  File "<string>", line 2
   
    ^
SyntaxError: invalid syntax



I'm good with many languages, but a complete dolt when it comes to python, don't even know where to start here.  Any ideas?
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on March 31, 2008, 05:53:22 PM
I thought I fixed that. Guess not!
Presumably, you know about line endings, and how they differ between Windows and Linux (if you don't, don't worry). Just open up every Python file in the distribution, and save it in "UNIX/Linux" format. That should clear that error.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: greya on March 31, 2008, 05:58:14 PM
ahhh ok - will do a find/replace to convert to linux standards

the line-ending thing always amused me, i mean COME ON can't we at least have a standard on THAT! lol


[EDIT]
hmm, so far not working, same error.  *ponder*
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on March 31, 2008, 06:01:12 PM
Yeah, I would love a proper standard on it.

Anyway, I did fix it, but I had forgotten to include the modified common.py file in the archive! So, now I've put a proper version of common.py in the archive; hopefully this saves you some time. Sorry about that!

As for version 5: well, I don't know how different it will be, but I suspect I've already converted boards with version 5 features. Hopefully it'll be mostly minor, so I can simply fix up the regex core and have a working v5 converter :)
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: greya on April 01, 2008, 12:12:49 PM
yep! that did it!  odd my conversion didn't work, but the new download works perfectly on linux! thanks much! *does a little dance*
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: greya on April 01, 2008, 01:06:54 PM
OK, script is done now, looks to have ended in error


Renumbering Posts
Traceback (most recent call last):
  File "members_topics_posts.py", line 560, in <module>
    postdata[i][10]=parseformats(postdata[i][10])
  File "members_topics_posts.py", line 216, in parseformats
    fmtdata+=parseformats(text[:-(len(rest)+len(fe))])+endtag # gotcha! the end of the tag. Now, process the innards for nested tags.
  File "members_topics_posts.py", line 164, in parseformats
    starttag='[size='+str(min(int(rest[len(' size="'):].split('"')[0]),9))+']'
ValueError: invalid literal for int() with base 10: '1,5'
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 01, 2008, 04:55:34 PM
Err, that's weird, it looks like altered BBCode to me. Can I get your Proboards forum URL, or settings.py, in a PM? I will check it out. Maybe Proboards has changed something.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 02, 2008, 06:57:30 PM
Posted a new version of the converter. This one should fix the aforementioned problem -- I have successfully run it against your board with no issues.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: greya on April 03, 2008, 11:57:06 AM
Elapsed Conversion Time 3616.72 seconds
Converted 65128 posts and 5958 topics.
Complete! Press <enter> to exit.


WOOT! Thanks nneonneo!!
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: silentcross on April 08, 2008, 06:22:23 AM
i'm tryin to convert from InvisionFree to SMF, but when i look the sql there are different table.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 08, 2008, 12:25:35 PM
silentcross, what do you mean by that? Different tables?
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: silentcross on April 08, 2008, 12:53:12 PM
i do as you told in manual but when i try to import the sql, it has different table.

in smf database it say smf_messages , but in the sql it say smf_post, and theres other not maching table
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 08, 2008, 01:05:54 PM
Did you run the right program? You need to execute topics_posts_smf.py, not topics_posts_phpBB.py.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: silentcross on April 08, 2008, 01:23:48 PM
hmmmm, omg my bad... i run topics_postphpBB.py , i'll try again and report again if i make any wrong. Thanks
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: bros on April 09, 2008, 09:11:07 PM
Does the IF converter only work with SMF 1.1 RC3, or would it work on 1.1.4?
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 09, 2008, 09:51:56 PM
Should work with 1.1.4; there are no database changes between the two versions that I am aware of.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: bros on April 10, 2008, 06:52:14 AM
Just double checking!

It worked perfectly, thanks.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: BarbulaM1 on April 10, 2008, 07:21:12 PM
This might sound horribly stupid, but I am using Windows Vista and I cannot seem to find the actual MySQL file or the log file, they are not in the folder I am executing the script in.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 10, 2008, 07:39:12 PM
Hmm? Presumably, you've run the scripts, and it says "Completed" or something like that. A few SQL files should come out.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 15, 2008, 05:49:11 PM
You've edited settings.py, right? If your URL ends with "index.c.cgi" or "v45index.cgi" then you have a "new" Proboards forum, and so there's some minor changes to make. In members_topics_posts.py, change all ".cgi" to ".c.cgi" if you have "index.c.cgi", otherwise change all "/index" to "/v45index".
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 15, 2008, 06:22:05 PM
I've updated the converters, since Proboards got around to updating my test forum, so that I can verify it all works correctly. Grab the newest copy, and edit the settings.py file. All the pertinent settings are stored there.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 15, 2008, 06:33:23 PM
Checklist:
1) downloaded and unzipped the newest converter package (posted about 5 minutes ago)
2) installed Python
3) read the Instructions.txt file in the Proboards folder
4) edited the settings.py file, in a text editor.
5) run members_topics_posts.py program to do the conversion

If you are having problems, please be specific; I can't help you if you are too vague on the problem.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 15, 2008, 07:07:26 PM
Second post of this thread. It's in a zip file.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: silentcross on April 16, 2008, 05:16:47 AM
i have problem when i run the topics_posts_smf.py , if i leave it, when it's done my comp crash, should i make the raw_input("Complete! Press <enter> to exit.") into #raw_input("Complete! Press <enter> to exit.")
so when it's done it will close by it self ?
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 16, 2008, 11:01:32 AM
blakey: It opens then closes? Try running settings.py. If that happens as well, then you've made a typo in settings.py; check it carefully.

silentcross: Your computer crashes at the end of running it? Can you be more detailed -- e.g. the program hangs, your computer shuts down, or something?
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 16, 2008, 07:41:12 PM
@blakey: Oops >:( I forgot to update the common.py file. Fixed now.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 17, 2008, 09:19:00 PM
If it says the time is in the wrong format, that would be the cause of failed conversions. Proboards lets you set the date and time options. You have to make it *exactly* what it asks for, or it won't work.

The other problem (for me) is that v4.5 may have some changes which I don't know about. I can improve my converter if you let me see your board; PM me the address to your board and I will look at it.

Regards,
Robert
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: silentcross on April 18, 2008, 10:44:30 AM
sorry for the late response, when the process is done, i cant do right click and Start Menu wont appear when i click it, TaskManager wont run. Internet connection went down, BitComet down,  and i cant shutdown my computer, and the weird thing is when i try to force shutdown the computer it will self on again and then off. Same thing happen if i force reset it.

ow i forget, i dont know what happen when the process exactly done. I left the process running while i'm sleeping (i do the process in the night), so when i woke up, as i state above.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 18, 2008, 03:06:28 PM
@blakey: Looking into it now. I haven't got any time format errors after changing my profile.

@silentcross: Absolutely bizarre. Has it happened more than once? Is the program still running when you saw it, or did it finish and say "Completed"?
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 18, 2008, 05:03:35 PM
Is your date format exactly 12/28/2004 at 11:11pm?
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 18, 2008, 05:48:18 PM
It converted all the posts and topics? You said before it wasn't converting everything, so I'm just wondering if that's been resolved.

Uploading: I presume you have SMF already setup, right? You should have 3 _smf.sql files: categories_forums, members, and topics_posts. Your host should've given you access to "phpMyAdmin" or a similar tool for managing the database. You can use the "import" or "upload" tab in phpMyAdmin to upload the scripts, in that order (categories_forums first, then members, then topics_posts).

Your board is pretty big. If phpMyAdmin gives you an error about exceeding the memory size or file limit, you can use the tool called "split_sql.py" to solve this problem. Copy this script into the converter folder (where the sql files are), and run it to split the SQL files into manageable pieces.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: silentcross on April 18, 2008, 11:56:46 PM
Quote from: nneonneo on April 18, 2008, 03:06:28 PM
@blakey: Looking into it now. I haven't got any time format errors after changing my profile.

@silentcross: Absolutely bizarre. Has it happened more than once? Is the program still running when you saw it, or did it finish and say "Completed"?

It Happened if i run it until it's completed and not press the enter key for a long time.
I search for a hosting to do this that can run phyton for a low cost  (or even for free  :) ) but it's hard to find one
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 19, 2008, 12:58:00 AM
If it runs to completion, it should produce the files you want. Why it crashes is totally beyond me; I've left the program in "Completed" for hours on end with no ill effects.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: silentcross on April 19, 2008, 06:16:16 AM
Yup
Quote from: nneonneo on April 19, 2008, 12:58:00 AM
If it runs to completion, it should produce the files you want. Why it crashes is totally beyond me; I've left the program in "Completed" for hours on end with no ill effects.

This is strange, so i'll try with editing the raw_input("Complete! Press <enter> to exit.") into #raw_input("Complete! Press <enter> to exit."), this will get the process to exit automatically without enter key when finish ?
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 19, 2008, 08:05:26 AM
blakey, I think you ran the wrong converter...you need to run the one called "members_topics_posts_smf.py" (they all look the same, I don't blame you)
Quote from: blakey on April 16, 2008, 05:05:00 PM
  File "C:\Documents and Settings\user\Desktop\convertor\Proboards\members_topics_posts_phpBB3.py", line 284, in
Once you do that, you should get files whose names end with _smf.sql.

silentcross: Yes.
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 19, 2008, 06:14:11 PM
Don't panic. Pop open the pm_passwords.txt file and find "admin|". The number after the bar is your password. The reason it has been changed is because Proboards provides no access to passwords (nor should they).
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 20, 2008, 11:26:51 AM
Yep, recount and find/fix all errors should make everything smooth over.

If the boards you mentioned were hidden, then the converter can't know about them. If they were password-protected, you need to add them to BOARDPASSWORDS in settings.py. But it sounds like you have everything under control :)
Title: Re: Invisionfree/ProBoards/ActiveBoards/Yuku to SMF Converters
Post by: nneonneo on April 21, 2008, 10:13:29 PM
See PM.
Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: FreddyJames on August 06, 2008, 08:26:32 PM
Hi there.

I'm a total noobie to this, so I wanted to just check I am on the right track before continuing. I have a free darkbb.com board that was set up 6 weeks ago, that has really taken off in a way I never expected. It quickly became important that we move from the free board to our own hosting for security, and we went with SMF.

The new forum is hosted, all of the forums etc are up in the exactly the same way as the free one, all I need to do now is copy the threads/posts/users into the new forum.

I have zero experience in this sort of thing, and just basically want to make sure I am on the right road.
Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: nneonneo on August 06, 2008, 08:46:45 PM
darkbb is Forumotion, right? In that case, it's doable, *but* you will have to perform a double conversion from phpBB3 to SMF.

Grab the Forumotion converter and a copy of phpBB3 (just install phpBB3, but you don't need to add forums or anything since that is done automatically by the Forumotion->phpBB3 converter). Follow the instructions, then import the SQL into phpBB3.

Then, use this converter (http://www.simplemachines.org/community/index.php?topic=218449.0) to convert to SMF.

If you have any questions about the process, feel free to ask.
Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: FreddyJames on August 07, 2008, 12:49:52 AM
EDIT: Just received pm

I downloaded the converter and python and edited the settings.py file. Not sure what the table_prefix was so left it as default.

Ran the members_topics_posts_phpBB3.py, and python sprang into life...

"Warning member 1 does not exist"
all the way to member 200, then completed without finding any topics or posts.

I can, in my display options on my old forum, change to phbb3 version - will this help?

Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: FreddyJames on August 07, 2008, 01:47:49 AM
I temporarily changed the old forum to phbb3, and it found the members, but no topics or posts - help???
Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: nneonneo on August 07, 2008, 12:38:07 PM
I'd need to take a look at the board in phpBB3 mode, so I can see what might be the problem. Any chance that could be done?
Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: FreddyJames on August 07, 2008, 01:03:10 PM
I have changed it temporarily for you to look at as of now.
Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: nneonneo on August 07, 2008, 03:24:57 PM
Heh, they have quite recently changed some of the HTML. It was very easy to fix, though, so an updated version is attached.

(P.S. you will need the original phpBB3 skin to make it work...)
Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: FreddyJames on August 07, 2008, 08:13:33 PM
Switched the forum to phbb3, default (which is prosilver I believe - how the forum looked when you checked it), ran the script, and it only copied 250 posts from 50 topics.

Have I got the incorrect phbb3 version?



Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: nneonneo on August 07, 2008, 09:16:32 PM
I just ran the conversion, and it showed
Elapsed Conversion Time 509.58 seconds
Converted 3494 posts and 331 topics.
Complete! Press <enter> to exit.

which are exactly the correct totals of the forums I can see. I made a minor change to the converter, but it should not affect your board; nonetheless, the exact script I used is attached.

If you still can't get it, e-mail/PM me settings.py (address in my signature)
Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: FreddyJames on August 12, 2008, 10:35:06 PM
Found the problem, conversion stage 1 is in progress.
Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: Deal on August 13, 2008, 09:40:05 PM
nneonneo, We have made some great progress using your conversion script. We now have all the major components working and are successfully importing into a phpbb3 forum that sits on the same host as the SMF forum we ultimately want to use. Once we get everything into the phpbb3 forum I anticipate that the next conversion should be a breeze.

There are just a couple hopefully small issues that we can't get working. Would appreciate any advice you might be able to offer.

When we run your python crawler script (on the darkbb forum) first of all we only get the first 25 users copied into members_phpBB3.sql. Not sure why it stops there.

Then, when we import categories_forums_phpbb3.sql. Only the first forum actually displays. The rest sucessfully import into the DB and in fact in the admin controls we can see them. I'm not sure why only the first one displays but thought it might have something to do with the numbers that are used for the forum_id. I included some of that here without repeating the insert clause that is part of each line.

INSERT INTO phpbb_forums (forum_id, parent_id, left_id, right_id, forum_name, forum_desc, forum_type)



VALUES (2, 1, 2, 3, 'Moderators\' Discussion', '', 1);

VALUES (4, 1, 4, 5, 'ANNOUNCEMENTS', '', 1);

VALUES (6, 1, 6, 7, 'Introduce Yourself', '', 1);

VALUES (8, 1, 8, 9, 'General Poker Discussion', '', 1);

VALUES (10, 1, 10, 11, 'Strategies, Tips and Advice', 'You are invited to write articles with advice and tips to share with other members', 1);

VALUES (1, 0, 1, 40, 'Forum', '', 1);

If you can help us past these two issues we should have it!

Thanks,

Deal/Freddy
Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: nneonneo on August 13, 2008, 10:43:02 PM
Members: hmm, I'm not too sure why that would be. I performed a test conversion on your forum about a week ago and got 67 members.

As for the "missing" forums: the imported data has no permissions information (phpBB3's permissions are rather arcane and easiest to avoid), so the forums are defaulted to "no-view". This is easy to fix: you simply edit the permissions for each forum, granting permissions as necessary. However, it's probably worth noting that permissions don't transfer to SMF from phpBB3, and on SMF, they default to viewable for all users (AFAIK). So, you might want to give just the Admins access simply to view the forums and make sure everything is OK.

Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: Deal on August 14, 2008, 07:41:38 PM
nneonneo, another successful convert to SMF. Thanks so much for your scripts and your support. I look forward to exploring all the features of our new forum software.

ftr. We went from a forumotion / darkBB board to a phpBB3 board then to SMF.

Thanks again,

Deal
Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: FreddyJames on August 15, 2008, 03:12:41 AM
Thanks nneo!

As deal has said, once we made the first conversion it was plain sailing from there - your help was invaluable!

Thanks again

FJ
Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: Deal on August 15, 2008, 01:58:52 PM
nneonneo, is there a trick to finding out what the table_prefix is on an IPB board you didn't install?

I was thinking it might be exposed when viewing source from within the forum. I really don't have a clue what it is. I assume that receiving the message Error: Topic is empty over and over again while crawling a forum is due to that issue.
Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: nneonneo on August 17, 2008, 11:21:45 PM
@Deal: IPB? Use the regular IPB->SMF converter, since my converters are for iPBfree and Invisionfree. The table_prefix in the crawler converter is used for the destination forum (i.e. SMF), and being a crawler, has nothing to do with the source board database.
Title: Re: Invisionfree/ActiveBoards/iPBfree to SMF Converters
Post by: Deal on August 19, 2008, 12:09:35 PM
thanks for the response. I'm not an admin on the IPB board I tried to crawl. It's being shutdown by the owner and thought I might be able to get some of the posts to move to the new forum. Your crawler did gather the category info but like I said I got a 'topic is empty' error after that. I'm not worried about it though. We have moved on and our SMF board is thriving. Thanks for your help.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: gk007 on December 10, 2008, 12:00:37 PM
I'm using the ForumMotion converter.
Is the cookie data value the cookie data for the new SMF forum, or the old ForumMotion forum?
Where do I upload the .py files to?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Sailor Libra on December 10, 2008, 04:12:32 PM
This is a nice bit of information to have.  Does anyone have any feedback to how invisionfree converted over to zetaboards handles this?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on December 10, 2008, 06:37:50 PM
@gk007: Cookie data should be for Forumotion. The .py files should be executed on your own computer. Also, I realized that I've somewhat neglected to update this page, so please grab an updated copy of the converters before you start.

@Sailor Libra: I don't know what you mean. I have a board converted to ZB from IF that can be crawled by these crawler converters, so it should work for converted boards, but the only way to know for sure is to try it...
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: sP0ng33 on December 31, 2008, 03:44:13 AM
This is an amazing converter, everything went according to plan, but when I upload the topics_posts.sql file it tells me it's too large. I tried zipping it up and uploading it but it says it cant accept it as a .zip and i have to change the config somewhere?

i use godaddy hosting btw

how can I split the file in 2 and upload in pieces?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: bros on December 31, 2008, 12:37:59 PM
Use bigdump.php instead.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: moss on January 06, 2009, 03:30:12 AM
I have to thank nneonneo....    He built me a Script that converted my Chatarea forum to SMF.    Worked beautifully.   Converted over everything:  Topics, posts, members and their profiles.....  even had a script that put a private message in every members' Chatarea mailbox with a new Temporary password to the new site.

   Much much much thanks my friend.     The SMF forums are ruling everyone right now.



Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: comtech on January 13, 2009, 11:57:30 AM
Thank you for the converters.
I just have to ask.. how do I get this to work?

I installed python on windows 7.  But when I click on a file it just pops up the windows command box for a second...

sorry... just needing some help here!
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: comtech on January 13, 2009, 12:36:13 PM
I keep getting "Invalid Syntax"
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 13, 2009, 01:05:38 PM
Install Python 2.6. The converters don't work with 3.0 yet.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: comtech on January 13, 2009, 01:35:58 PM
Thank you. Now it seems to be working but I am getting an error:

Post 1329: Bad timestamp (01/12/09 09:16)
Traceback (most recent call last):
  File "C:\Yuku\members_topics_posts_smf.py", line 292, in <module>
    post[0]=parsetime(ln[4].strip('(').strip(')')) # brackets? wtf?
  File "C:\Yuku\members_topics_posts_smf.py", line 122, in parsetime
    return mktime(strptime(tm,fmt))
  File "C:\Python26\lib\_strptime.py", line 454, in _strptime_time
    return _strptime(data_string, format)[0]
  File "C:\Python26\lib\_strptime.py", line 325, in _strptime
    (data_string, format))
ValueError: time data '01/12/09 09:16' does not match format '%m/%d/%y %H:%M:%S'

Any help on this?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 13, 2009, 01:59:22 PM
It's exactly what it says: the date format you specified doesn't match the format it expected.

Try removing :%S.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: comtech on January 13, 2009, 06:14:05 PM
Thank you again.  I have all of the categories, threads and posts downloaded now.
Will the second file about pm members their password include the members?

I ask because the first did not.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: comtech on January 13, 2009, 06:53:40 PM
Here is my test board:

http://xfilesmagazine.com/index.php
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 13, 2009, 07:23:14 PM
You mean to say that the members did not convert? Can you look at members_smf.sql? The PM module depends on the file "pm_passwords.txt". Check that file. If it is empty, or contains fewer lines than there are members, then something went wrong during the conversion...
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: comtech on January 13, 2009, 07:45:55 PM
That's just it. There was no members_smf.sql file when it completed. It just did the categories, posts and threads.

Quote from: nneonneo on January 13, 2009, 07:23:14 PM
You mean to say that the members did not convert? Can you look at members_smf.sql? The PM module depends on the file "pm_passwords.txt". Check that file. If it is empty, or contains fewer lines than there are members, then something went wrong during the conversion...
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: comtech on January 13, 2009, 07:49:54 PM
Is there any way to rewrite the conversion script just to grab the members? Everything else came about just fine.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 13, 2009, 08:01:46 PM
The converter should grab the members. The posts conversion depends on it, though, in order to link the posts to users correctly.

Is there a pm_passwords.txt file at least? It seems very strange to me that the converter would not output members_smf.sql...
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: comtech on January 13, 2009, 08:05:09 PM
I tried it again & the members_smf.sql was pretty much empty:

TRUNCATE TABLE `smf_members`;
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 13, 2009, 08:32:04 PM
So, the problem seems to be that your "active members" list isn't shown. Try going here:
http://xprojectforum.yuku.com/admin/options

and checking the "active members list" box. If http://xprojectforum.yuku.com/domainstats/activemembers gives you a list of all the members, you should be good to go.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: comtech on January 13, 2009, 08:40:42 PM
I see!  I just inherited the board from the original owner with the promise that I would save it & convert it over to our own server.

Thank you for all the help you have been offering! I deeply appreciate it.

Quote from: nneonneo on January 13, 2009, 08:32:04 PM
So, the problem seems to be that your "active members" list isn't shown. Try going here:
http://xprojectforum.yuku.com/admin/options

and checking the "active members list" box. If http://xprojectforum.yuku.com/domainstats/activemembers gives you a list of all the members, you should be good to go.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: comtech on January 14, 2009, 06:42:31 PM
How long will converting members take?   The whole process has been going on almost 24 hours now.  I have close to 4,000 members. 
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 14, 2009, 07:52:04 PM
If it is still producing output, then it is probably working. However, if it is not showing any progress information, that is a problem.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: comtech on January 14, 2009, 08:00:34 PM
It is still producing. What has been going on for the past 14 hours or so is the generating of passwords for the members.

I should have expected this seeing as I have close to 4,000 members.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: jgsmuzzy on January 30, 2009, 03:45:03 PM
Evening,

One quick question (the first of many!).

In IF, what date format do I need? 

Got this message in the convert error log

"ValueError: time data 'Nov 10 2007, 23:06' does not match format '%b %d %Y, %I:%M %p'"

Many thanks in advance.

James
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 30, 2009, 06:36:34 PM
Nov 10 2007, 11:06 pm is the format you want.

If you want to keep the current format, the string '%b %d %Y, %H:%M' will parse it (edit the main converter and replace '%b %d %Y, %I:%M %p' by that)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Jimi1810 on February 03, 2009, 05:57:27 PM
Thanks for the help you gave me via email nneonneo. Not successfully downloaded all the posts yet, I have got about 24 hours in to the process 2 or 3 times now before the download froze >:( is it possible because I have a LOT of Javascript customising the forum causing this? it worked fine on a small test forum with empty headers and footers. I did try disconnecting from the internet a number of times each time it froze but to no avail.

Has anyone else had this problem?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 03, 2009, 07:45:17 PM
Try increasing the number of posts and topics per page to the maximum allowable. This should make the downloads faster, which may prevent this from occurring.

There's a very specific fix for terminating frozen connections.

Download a utility called Process Explorer, from this site: http://live.sysinternals.com/procexp.exe

This utility will allow you to close the connection which is being held open. When the connection freezes, fire up Process Explorer, and look for the python.exe process in the top window. Select it and press Ctrl+H; the bottom pane should show a long list of entries and filenames. Sort it by name, and look for "\Device\Afd" or "\Device\Afd\Endpoint". Right click on it and Close Handle. You may receive a warning about potential system instability; confirm and the converter should print out an error message and retry (which should clear the problem).

I have only tested this under Windows XP running Python 2.5-2.6. Under another operating system, e.g. Vista, this may not work; on Mac or Linux I have no idea how to achieve this result.

If I can get some further information, I might be able to devise a proper timeout mechanism to deal with this in the future.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Jimi1810 on February 04, 2009, 03:56:40 AM
Great info thanks :) I'll give both of them a shot. I've got a Vista/Linux dual boot so will give it a try with Vista and see what happens, will let you know.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Jimi1810 on February 04, 2009, 02:19:04 PM
Okay just to let you know it froze so I did as instructed for "\Device\Afd" but after the instability warning I got "Error opening process: the handle is invalid" I don't know if this should possibly be chalked off as 'another vista quirk' then.

I'm only trying to do a test convert for the time being, nothing urgent as I'm still not 100% sure whether I have the right host, so it's not a huge problem and I will probably try every now and again to see if anything works, but if there is anything I can provide which would be useful just ask.

Thanks again for all your help though :)

*sorry, scrap that; right clicking on the process explorer and running as administrator allowed me to perform it without any problems, the converter is now running again as it should be  :D
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Jimi1810 on February 07, 2009, 08:40:30 PM
Is there any way I can import the databases straight to SMF 2.0? it works perfectly with 1.1.7 but with 2.0 RC1 I get this in phpmyadmin:

Error

SQL query:

INSERT INTO `smf_categories` ( ID_CAT, catOrder, name )
VALUES ( 1, 0, 'English Football Boards' ) ;

MySQL said: Documentation
#1054 - Unknown column 'catOrder' in 'field list'


Only reason I ask is because I would like to do the whole setup on 2.0 and then import the database right at the end, rather than import the database to 1.1.7 upgrade and then do the setup.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 07, 2009, 08:52:59 PM
The output is not compatible with SMF 2.0, so you will have to import to 1.1.7 then upgrade.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Jimi1810 on February 07, 2009, 09:15:35 PM
okay no problem, thanks for the clarification :)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: acrox999 on March 08, 2009, 04:49:45 AM
Thanks man!!! I owe you this!! :D
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: acrox999 on March 09, 2009, 01:50:11 AM
Well, I got a problem. Forumotion converter. It won't convert Posts, Topics, Forums etc. It only convert users. And when PMing password, I don't know why it stop at a user. Any help please?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on March 09, 2009, 02:02:25 AM
Try downloading a new converter from http://nneonneo.net46.net.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: acrox999 on March 09, 2009, 02:51:52 AM
Thanks!!! I thought this converter is dead. :D
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: accountholder on March 18, 2009, 09:49:31 AM
nneonneo, friends, it doesn't work for me.
I downloaded the latest version.
Then, what is the difference of IPBfree and InvisionFree folders?
I only got the forum, but nor the posts/topics and member lists.
The forum I wish to convert is: http://gitalovers.com/.
Also, I do not understand to type a javascript code to the address bar to get the cookie. What the new URL should be?
It produced error.

TRUNCATE TABLE `smf_boards`; TRUNCATE TABLE `smf_categories`;
INSERT INTO `smf_boards` (ID_BOARD, ID_CAT, childLevel, ID_PARENT, boardOrder, name, description) VALUES (1, 255, 0, 0, 1, 'RULES', '');
INSERT INTO `smf_boards` (ID_BOARD, ID_CAT, childLevel, ID_PARENT, boardOrder, name, description) VALUES (6, 255, 0, 0, 6, 'Introduction', '');
INSERT INTO `smf_boards` (ID_BOARD, ID_CAT, childLevel, ID_PARENT, boardOrder, name, description) VALUES (8, 255, 0, 0, 8, 'Important', '');
INSERT INTO `smf_boards` (ID_BOARD, ID_CAT, childLevel, ID_PARENT, boardOrder, name, description) VALUES (10, 255, 0, 0, 10, 'Art', '');
INSERT INTO `smf_boards` (ID_BOARD, ID_CAT, childLevel, ID_PARENT, boardOrder, name, description) VALUES (11, 255, 0, 0, 11, 'Entertainment', '');
INSERT INTO `smf_boards` (ID_BOARD, ID_CAT, childLevel, ID_PARENT, boardOrder, name, description) VALUES (18, 255, 0, 0, 18, 'Polls', '');
INSERT INTO `smf_boards` (ID_BOARD, ID_CAT, childLevel, ID_PARENT, boardOrder, name, description) VALUES (28, 255, 0, 0, 28, 'Fun', '');
INSERT INTO `smf_boards` (ID_BOARD, ID_CAT, childLevel, ID_PARENT, boardOrder, name, description) VALUES (33, 255, 0, 0, 33, 'Gita&#39;s Show', '');
INSERT INTO `smf_boards` (ID_BOARD, ID_CAT, childLevel, ID_PARENT, boardOrder, name, description) VALUES (37, 255, 0, 0, 37, 'Latihan posting', '');
INSERT INTO `smf_categories` (ID_CAT, catOrder, name) VALUES (255, 254, 'Lost category');


settings.py
#!/usr/bin/python

# ---GLOBAL SETTINGS---

# Prefix of your forum tables
table_prefix='smf_'

# Make this value at least as high as the highest topic ID, if not higher. You can check by making a new topic and seeing what the showtopic= value is. Making it higher provides some protection against new topics.
NUMTOPICS=10000

# Make this value at least as high as the highest forum ID, if not higher.
NUMFORUMS=100

# URL to your index.php file
# for iPBfree, this should be
# http://<boardname>.<domain>.com/index.php
URL='http://gitalovers.com/index.php'

# ---TOPIC AND POST SETTINGS---

# IDs of stickied [pinned] topics. The pinned status is only retrievable by a mod from within the topic data (because they can "Unpin" it, otherwise the pinning is invisible). This script attempts to locate the Unpin, but if you are not a moderator or higher you will have to set the sticky/pinned topics setting manually!
# Example: sticky=[1,2,3,5]
sticky=[]

# URL to the lock/closed topic image (the image that appears instead of "Post Reply" in a closed topic)
# \\d means any digit
lockimage='http://static.\\d.ipbfree.com/style_images/ipbfree_v21/t_closed.gif'

# ---MEMBER SETTINGS---

# A random number, used to seed the passnumber generator. You'll want to keep this a secret! CHANGE THIS.
# Keep this the same across runs, because this ensures that the same passwords
# are assigned to the same people.
RANDOMNUMBER=12345678

# Make this value at least as high as the highest member ID, if not higher. Check by noting the ID of the member with the most recent join date.
NUMUSERS=100

# MAP THE GROUPS AND POSTGROUPS ACCORDING TO YOUR FORUM SETUP
# Mapping: for groups, map the "special" groups to their group #s, and the "nonspecial" or post-based groups to 0.
#groups={'Admin':1,
#'Subadmin':2,
#'Validating':0,
#'Members':0}
groups={'Admin':1,'Contributor':2,'Elite Member':3,'Global Moderators':4,'Graphic Team':5,'Moderators':6,'Retired Staff':7,'Validating':0,'Members':0}

# Here, define the postgroup based groups.
def postgroup(posts):
if posts>=5000: return 13 # Gita freaks
if posts>=3500: return 12 # Gita fanatic
if posts>=2000: return 11 # Gita holic
if posts>=1000: return 10 # Gita lover
if posts>=500: return 9 # Gita addict
if posts>=200: return 8 # Gita super fans
if posts>=100: return 7 # Gita fans
if posts>=25: return 6 # Interest
if posts>=10: return 5 # Just looking
return 4 # Newbie
#Newbie 0 Just looking 10 Interest 25 Gita fans 100 Gita super fans 200 Gita addict 500 Gita lover 1000 Gita holic 2000 #Gita fanatic 3500 Gita freaks 5000
# ---PERSONAL MESSAGE SETTINGS---

# Title for the new automated password messages
msgtitle="Password for New Forums"

# What to say. Place "%s" (without quotes) at the location you want the password to be.
# Use "%%0A" (without quotes) in place of a line break.
msgbody="Your password for the new forums at http://yournewforums.com is %s. The first time you login, you may be prompted to login again because of upgraded security. This will only occur once. After logging in, please change your password!%%0A%%0A[SIZE=-1]This is an automated message.[/SIZE]"

# Don't edit below this line
def get_cookie():
try:
return file("cookie.txt","rt").read().strip()
except IOError:
import sys
print "Error: cookie.txt not found."
print "Please run ipbfree_get_cookie.py to generate it."
raw_input("Press <enter> to quit.")
sys.exit(1)

if __name__=='__main__':
raw_input("This is not meant to be run. Please edit this file and follow the instructions. Press <enter> to close.")



Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on March 18, 2009, 11:21:22 AM
Well, first of all, that forum is on Invisionfree, so you should use the Invisionfree converter.

When you visit your forum, change the address to "javascript:document.cookie" and you will get some text which should be put into COOKIEDATA. What error did you get?

iPBfree is a different hosting service with different code, so that is why there is a difference between iPBfree and Invisionfree.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Smile123 on March 27, 2009, 04:35:51 AM
Hi

A week ago forumotion updated their forum software and now the posting can not be exported anymore. The update that was installed by forumoition can be found here: http://help.forumotion.com/updates-and-new-features-f1/new-update-reputation-mod-points-system-advanced-profile-multi-quote-and-more-to-see-inside-t38734.htm (http://help.forumotion.com/updates-and-new-features-f1/new-update-reputation-mod-points-system-advanced-profile-multi-quote-and-more-to-see-inside-t38734.htm)

Some weeks ago I could succesfully use the conversion tool. Now it only creates an export of members and categories. When it's exporting the postings, I see it's exporting something, but it ends everytime with "Error: Topic is empty" and the file topics_posts_phpBB3.sql is containing afterwards only delete commands. The critical_error.log stays empty. I tried also the most recent converter from http://nneonneo.net46.net (http://nneonneo.net46.net), but that didn't solve my problem.

I double checked settings.py, the default style of the forum and the time setting. When I remove line 405 till 408 from members_topics_posts_phpBB3.py it creates a new log convert_error.log saying "IndexError: list index out of range".

Did I overlooked something or is it the last update of forumotion which caused the malfunction of the converter?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on March 27, 2009, 10:33:48 AM
It is most definitely this recent update. I have updated the converter for it.

I'm not sure why you would try to remove those lines. The rest of the conversion assumes that at least one post was converted, so you will likely get weird errors that have nothing to do with the original problem.

Anyway, http://nneonneo.ath.cx and http://nneonneo.net46.net have updated converters, so give 'em a go.
Title: 2 Issues: Emails were not converted,& the signatures were stored in post tables.
Post by: accountholder on March 27, 2009, 01:56:46 PM
Hi nneneo...
So many thanks Sir, your scripts realy worked after I placed the cookie data on the COOKIEDATA=''.

The original URL is: http://z8.invisionfree.com/gitalovers/index.php

I used the latest verson:
http://nneonneo.ath.cx/

The next problems are:

1. Email Issue

I couldn't pull the members' emails.
I got them empty.

Then I viewed the members_smf.sql, I found this scheme:

INSERT INTO `smf_members` (`memberName`,`realName`,`ID_MEMBER`,`posts`,`dateRegistered`,`lastLogin`,`AIM`,`ICQ`,`YIM`,`MSN`,`websiteUrl`,`websiteTitle`,`birthdate`,`location`,`ID_GROUP`,`usertitle`,`avatar`,`ID_POST_GROUP`,`passwd`,`passwordSalt`) VALUES ...


The emailAddress column did not available there.

I do not have an administrator access to that forum. That was my friend's forum.
Is it required an admin previlege? Should I  request it from the administrator?
Did  the previlege as a general user cause that?
From what I saw, emailAddress column has already written in members_smf.py.
But it was not generated on the sql output.

Here is the query produced likes:
INSERT INTO `smf_members` (`memberName`,`realName`,`ID_MEMBER`,`posts`,`dateRegistered`,`lastLogin`,`AIM`,`ICQ`,`YIM`,`MSN`,`websiteUrl`,`websiteTitle`,`birthdate`,`location`,`ID_GROUP`,`usertitle`,`avatar`,`ID_POST_GROUP`,`passwd`,`passwordSalt`) VALUES ('Hawamaru','Hawamaru',4,4939,1194109200,1238177400,'','','[email protected]','[email protected]','http://www.friendster.com/xxx','http://www.friendster.com/xxx','1987-08-01','Banyuwangi',6,'jangan suka pipis sembarangan..&#33;?','http://209.85.12.227/12159/124/upload/av-4.jpg',12,'26497875811b23f489e607f1ebe518d2','');



2. signature issue

Signature was bundled in messages, not in members table.
Help me again please :)

Thank you.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Smile123 on March 27, 2009, 08:58:53 PM
Quote from: nneonneo on March 27, 2009, 10:33:48 AM
It is most definitely this recent update. I have updated the converter for it.

I'm not sure why you would try to remove those lines. The rest of the conversion assumes that at least one post was converted, so you will likely get weird errors that have nothing to do with the original problem.

Anyway, http://nneonneo.ath.cx and http://nneonneo.net46.net have updated converters, so give 'em a go.

By removing these lines I was trying to get some other logging, explaining me what is going wrong. I tested the converters from http://nneonneo.ath.cx and http://nneonneo.net46.net, but I still have the same problem. Is there a way to create debug logging?

When the exporting of users is finished I see this:

Downloading Forum Structure...
Forum f8 ... Completed!
Topic ID 1 ... Error: Topic is empty!
Topic ID 2 ... Error: Topic is empty!
Topic ID 3 ... Error: Topic is empty!
Topic ID 4 ... Error: Topic is empty!
Topic ID 5 ... Error: Topic is empty!
Topic ID 6 ... Error: Topic is empty!
Topic ID 7 ... Error: Topic is empty!
Topic ID 8 ... Error: Topic is empty!

and the converter ends with:

Topic ID 273 ... Error: Topic is empty!
Topic ID 274 ... Error: Topic is empty!
Topic ID 275 ... Error: Topic is empty!
Elapsed Conversion Time 349.41 seconds
Converted 0 posts and 0 topics.
Complete! Press <enter> to exit.

Like I said before the export of users and topics is running correct. The export of posts does not work. I don't understand what I'm doing wrong.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on March 29, 2009, 10:42:15 PM
@accountholder: You can't see member e-mails if you are not admin; this is a restriction of Invisionfree and I cannot help it.

About the signatures: you should set "Do you wish to view members signatures when reading topics?" in your Profile options to "No" to avoid showing them and accidentally appearing in converted data. Signatures are not converted to member data.

@Smile123: You probably aren't doing anything wrong; can you e-mail me settings.py at (my username)@gmail.com? At the very least, I'd like a URL so I can see for myself if anything is different from my test board, so I can make the converter work properly (it seems Forumotion rolls out their changes gradually across the boards, instead of all-at-once)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: accountholder on March 30, 2009, 06:14:39 PM
Thanks for the answer, nneonneo.
I have logged as an admin too, my friend gave me that previlege, but i still could not convert members' emails.
I tried this twice.
I logged in as an admin, then I grab my cookie data in the board, to be stored at settings.py, and I ran the members_smf.py.

Signature is okay, fixed. Thank you.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: ziycon on April 19, 2009, 03:27:13 PM
What version of SMF does the zetabaords convertor work with? All them?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Nisorin on April 24, 2009, 11:24:04 PM
Ziycon, from what I understand from reading it, his converter will work with up to SMF 1.7.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on April 24, 2009, 11:34:57 PM
Zetaboards converter will work up to SMF 1.1.8.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: ziycon on April 26, 2009, 05:53:04 PM
So convert the forum from zetaboards to 1.1.8 then upgrade from 1.1.8 to 2.0 is the best way yo go!?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: ziycon on April 26, 2009, 07:09:00 PM
Ok, i have python installed, I've changed the settings file and I've gotten the cookie, when i run the members_topics_posts.py script the command shell window opens and closes straight away and i don't have any SQL files??
Getting this error:
QuoteC:\Converters\ZetaBoards>c:\python26\python.
exe members_topics_posts_smf.py
members_topics_posts_smf.py:7: DeprecationWarning: the md5 module is deprecated;
use hashlib instead
  import os,re,sys,md5,random
Traceback (most recent call last):
  File "members_topics_posts_smf.py", line 19, in <module>
    from common import *
ImportError: No module named common

I'm using it to convert from zetaboards to SMF 1.1.8.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on April 26, 2009, 10:01:33 PM
Drop the common.py file from the converters package in the Zetaboards directory.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: ziycon on April 27, 2009, 01:59:54 PM
Quote from: nneonneo on April 26, 2009, 10:01:33 PM
Drop the common.py file from the converters package in the Zetaboards directory.
There is no common.py file?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on April 27, 2009, 02:15:23 PM
You are using the converter from here (http://www.simplemachines.org/community/index.php?action=dlattach;topic=188741.0;attach=96041)? In the Converters directory, there are two files "common.py" and "split_sql.py"; drop the first one in Zetaboards.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: ziycon on April 27, 2009, 02:34:48 PM
Got it working, was me being stupid, i only kept the zetaboards folder and it was unable to find the two files you mentioned, downloaded it again and re-ran fine, thanks.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: ziycon on May 06, 2009, 09:36:30 PM
I'm getting the below error when importing the members_smf.sql file??
QuoteField 'lngfile' doesn't have a default value
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on May 06, 2009, 10:20:51 PM
Is MySQL in strict mode?

http://www.simplemachines.org/community/index.php?topic=55616.msg392947#msg392947
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: ziycon on May 07, 2009, 06:33:50 AM
Ok, sorted that, It was in strict mode. I've imported everything fine and recounted it.
I have admin access to the zetaboards but i have noticed that boards only admins can see and the posts in the admin boardsd didn't copy over and also the users email address didn't copy over either??

I have full admin right on the zetaboards.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on May 07, 2009, 10:50:22 PM
You *should* be able to convert the admin boards, unless the cookie is wrong (you may try rerunning the get_cookie script).

As for emails, they can copy over if you can see them on their profile. If they have taken measures to hide their email, you might not be able to convert it.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Shan2 on June 04, 2009, 04:24:09 PM
can i use this converter to convert invisionplus db ?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: H on July 08, 2009, 04:10:23 PM
Quote from: Shan2 on June 04, 2009, 04:24:09 PM
can i use this converter to convert invisionplus db ?

What exactly is invisionplus? How does it differ from standard IPB/ipbfree?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: TwitchisMental on August 10, 2009, 09:16:07 PM
Okay I need some help..

Every has went easy for me until adding the sql..

Mostly because the information for that part is limited.

Can someone give me step by step on what I am suspose to do with the .sqls?

I am loving how easy this converter is and I am hoping it be able to switch me from ipbfree :D.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on August 10, 2009, 10:46:57 PM
Install SMF, then go to phpMyAdmin (or another tool you use to administrate the database on your webhost), and import the SQL files into the database.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: TwitchisMental on August 11, 2009, 12:27:31 AM
Quote from: nneonneo on August 10, 2009, 10:46:57 PM
Install SMF, then go to phpMyAdmin (or another tool you use to administrate the database on your webhost), and import the SQL files into the database.

Ahh okay I will do this now thanks for helping a poor noob like me out lol.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: TwitchisMental on August 11, 2009, 04:33:27 PM
New Problem, Everything is working until members.

It keeps sayong member does not exist...(I have 206 member btw .. )

How to fix?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on August 11, 2009, 07:40:20 PM
Hmm, it may mean a bug in the converter. Can you forward me the URL of your forum?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: TwitchisMental on August 11, 2009, 07:57:54 PM
Quote from: nneonneo on August 11, 2009, 07:40:20 PM
Hmm, it may mean a bug in the converter. Can you forward me the URL of your forum?

Yes the ipbfree forum is 311entertainment.co.cc/forums.html
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on August 11, 2009, 09:36:14 PM
Sorry, I had a few little problems in the members script.

Here's a new one.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: TwitchisMental on August 11, 2009, 10:01:06 PM
Quote from: nneonneo on August 11, 2009, 09:36:14 PM
Sorry, I had a few little problems in the members script.

Here's a new one.

Thanks trying it now :D .

Edit: Okay it got the members,but when uploading the .sql I get this error -

Error     SQL query:     
         TRUNCATE  TABLE  `smf_users` ;

     
     MySQL said: (http://taynec8.co.uk:2082/3rdparty/phpMyAdmin/themes/original/img/b_help.png) (http://dev.mysql.com/doc/refman/5.0/en/error-messages-server.html)   #1146 - Table 'twitch_smf1.smf_users' doesn't exist
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on August 11, 2009, 10:21:44 PM
What table prefix did you install SMF with? You must use that as table_prefix in settings.py.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: TwitchisMental on August 11, 2009, 10:23:12 PM
Quote from: nneonneo on August 11, 2009, 10:21:44 PM
What table prefix did you install SMF with? You must use that as table_prefix in settings.py.

Uhmm If I am right it is -

twitch_smf1 (http://taynec8.co.uk:2082/3rdparty/phpMyAdmin/index.php?token=60624a215d9c25f6b2d7e1ffbfd28e93&db=twitch_smf1)

To be sure can you tell me where the table prefix is normally found?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on August 11, 2009, 10:30:47 PM
twitch_smf1 is the database name. The table prefix is the prefix of every table in that database: for example, my table prefix is "smf_", so I have tables named "smf_members" and "smf_messages". You may have a different prefix, and that needs to be put in settings.py.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: TwitchisMental on August 11, 2009, 10:35:00 PM
Quote from: nneonneo on August 11, 2009, 10:30:47 PM
twitch_smf1 is the database name. The table prefix is the prefix of every table in that database: for example, my table prefix is "smf_", so I have tables named "smf_members" and "smf_messages". You may have a different prefix, and that needs to be put in settings.py.

Oh okay

Edit: Okay another problem I just found.

its giving all members random numbers as the password :[.

How to fix?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: TwitchisMental on August 11, 2009, 10:43:32 PM
Sorry for double posting,but it also seems that I cannot see the posts and topics.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on August 11, 2009, 10:44:48 PM
The password can't be fixed, because I can't convert the passwords from iPBfree. Use pm_passwords.py to let each member know their new password.

As for viewing the forum, you have to do step 10a first.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: TwitchisMental on August 11, 2009, 10:46:54 PM
Quote from: nneonneo on August 11, 2009, 10:44:48 PM
The password can't be fixed, because I can't convert the passwords from iPBfree. Use pm_passwords.py to let each member know their new password.

As for viewing the forum, you have to do step 10a first.

Oh Okay
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: pr0grammer1 on August 12, 2009, 07:20:10 PM
I'm having a problem getting this to work on a DarkBB board: It downloads all the members correctly but doesn't download any forums, topics or posts. I've tried all the fixes you've posted through the thread as well as the version on ht@tp://nneonneo.net46.net/ and none of them change anything. I'm guessing it might be something in the cookie data (since the board requires registration).

The board is at ht@tp://menotah.darkbb.com/.

Thanks in advance for any help you can give. :)

(Remove @ from the links, it won't let me post the correct ones.)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on August 12, 2009, 08:33:14 PM
Is DarkBB run by Forumotion? If so, use phpBB3 mode.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: pr0grammer1 on August 12, 2009, 08:53:46 PM
Yes it is. I'll see if I can get the admin to switch it (I assume you checked and it's in phpBB2 mode now? It's a little hard for me to tell but it looks more like phpBB2 than phpBB3.)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: EvenAngels on August 24, 2009, 12:56:37 PM
Er... Hi there...

Sorry for my first post (i think) being a cry for help, but... Well, I'm trying to convert a ZB board, but when I run the members_topics_posts_smf script, it opens the command window for a split second before closing.

I recieve no sql files from doing it either... So... What should I do?

Evens
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on August 24, 2009, 01:39:18 PM
@EvenAngels: I assume you are running in Windows? Did you install Python 3.x? If so, install Python 2.5 or 2.6 and try again.

If that's not the problem, drop the attached batch file in the converter directory and run it; post the output (right-click on the taskbar button and hit Edit->Select All; right click anywhere in the command window to copy)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: EvenAngels on August 24, 2009, 04:11:34 PM
Hi nneonneo, I've actually already got 2.6 installed. So I downloaded and ran that batch file you attached, and it came up with this:

D:\www\eternalgarden.net\community>members_topics_posts_smf.py
D:\www\eternalgarden.net\community\members_topics_posts_smf.py:7: DeprecationWar
ning: the md5 module is deprecated; use hashlib instead
  import os,re,sys,md5,random
Traceback (most recent call last):
  File "D:\www\eternalgarden.net\community\members_topics_posts_smf.py", line 19
, in <module>
    from common import *
ImportError: No module named common

D:\www\eternalgarden.net\community>pause
Press any key to continue . . .
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on August 24, 2009, 04:14:32 PM
Ah. You need to make sure that you extract common.py from the original package and put it in the converter directory.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: EvenAngels on August 24, 2009, 04:23:15 PM
That seems to have got it downloading. Thank you very much for the help. :)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Moneymaker13 on September 02, 2009, 05:45:45 PM
Sounds awesome, I really need to go from forumotion to smf as soon as I can.. Do you have a link with instructions? I'm sorta a 14 year old newbie haha..
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: TwitchisMental on September 02, 2009, 07:07:05 PM
Quote from: Moneymaker13 on September 02, 2009, 05:45:45 PM
Sounds awesome, I really need to go from forumotion to smf as soon as I can.. Do you have a link with instructions? I'm sorta a 14 year old newbie haha..
Download it and the instructions will be in the folder.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: mamaof2boys on October 10, 2009, 12:20:12 PM
I just wanted to thank you for releasing this converter.  I migrated my board from Yuku last night and it was an absolute breeze!!!  I really appreciate all the hard work you put into this and can't thank you enough!
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Dr3w on October 11, 2009, 05:18:10 PM
Ok... I admit I am new at this. I have been trying to escape from yuku. Here is where I am:

I can't find settings.py where I am supposed to "change some settings" - I'm guessing that is a Python file, but I can't find it using a search of my hard drive.

I can write CSS and HTML, but I feel as lost as a goose in a hailstorm right now.  :)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Norv on October 11, 2009, 05:55:05 PM
Quote from: Dr3w on October 11, 2009, 05:18:10 PM
I can't find settings.py where I am supposed to "change some settings" - I'm guessing that is a Python file, but I can't find it using a search of my hard drive.
Please the second topic in this board: you can see an attached .zip file, which has several converters.
You can find there also instructions, including for each converter.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: ABCDiamond on November 15, 2009, 07:53:58 PM
Will this work with the new Zetaboards from invisionfree ?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on November 15, 2009, 08:32:34 PM
Yes, it should work; there's a separate converter in the package for ZetaBoards, since ZB uses different software from Invisionfree.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Quexinos on November 20, 2009, 06:28:56 AM
This thing is pretty cool, thanks... I won't like get in trouble with invisionfree now will I? :(
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Enders on January 21, 2010, 12:55:46 AM
It seems that the similes don't work. It shows them as links instead of replacing them with smf's
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 21, 2010, 12:59:34 AM
@Enders: Some converters don't convert the smileys. Which one are you using?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: ABCDiamond on January 21, 2010, 01:33:35 AM
Is it possible to create a new smiley set, using the ones we have on IF/Zeta, and importing that to take advantage of the smiley codes on all the posts ?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 21, 2010, 01:38:20 AM
@ABCDiamond: Yes, that should work.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Enders on January 21, 2010, 01:56:22 AM
Quote from: nneonneo on January 21, 2010, 12:59:34 AM
@Enders: Some converters don't convert the smileys. Which one are you using?

ipbfree to smf
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 21, 2010, 02:01:40 AM
From the instructions (note 2nd point):
QuoteIn your IF control panel, Board Settings, change each of these settings to "No":
Do you wish to view members signatures when reading topics?   
Do you wish to view images in posts, such as smilies and posted images?   
Do you wish to view members avatars when reading topics?   
Do you wish to get a pop up notification when you get a new personal message?   
Open Fast Reply automatically when available? *

See if that helps.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: tanshin on February 01, 2010, 06:15:49 PM
Hi there! Do you know how this works with SMF 2.0 RC2?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: kherezae on February 06, 2010, 01:44:07 AM
Quote from: tanshin on February 01, 2010, 06:15:49 PM
Hi there! Do you know how this works with SMF 2.0 RC2?

I tried it; didn't work.  I ended up installing 1.1.11 (or whatever), doing this, and then upgrading to RC2, which seems to be working fine so far, EXCEPT:

--

I'm having trouble with the PM passwords script.  It says it can't find the auth key.  Anyone have any idea why?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: tanshin on February 06, 2010, 12:20:03 PM
That's what I ended up doing as well.

I did not have that issue with my PM script though...
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Dangerosking on February 06, 2010, 10:07:13 PM
Thanks! You're awesome! Finally I know how to go from zetaboards to phpBB!

I've done the step one and im getting an error when I run the zetaboards_get_cookie.py script. The thing closes up. So I ran the command in a cmd window and i get:
File "[where the scripts are]\Board Converter\Converters\Zetaboards\zewtaboards_get_cookie.py"
Traceback (most recent call last):
File "[where the scripts are]\Board Converter\Conveters\Zetaboards\zetaboards_get_cookie.py", line 5 in <module>
from settings import *
File "[where the scripts are]\Board Converter\Conveters\Zetaboards\settings.py", line 55
SyntaxError: Non-ASCII character '\xe1' in file [where my script is]\Board Converter\Conveters\Zetaboards\settings.py on line 55, but no encoding declared; see python.org/peps/pep-0263.html for details

Might this have to do with that I'm using python version 2.6.4? Is there anything I can do?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 06, 2010, 10:25:56 PM
The problem is that there is a non-ASCII character in settings.py; in Python, using non-ASCII characters requires an encoding to be specified.

To specify the encoding, on the second line of settings.py (right under #!/usr/bin/python) add this line:
# -*- coding: iso-8859-1 -*-

replacing iso-8859-1 with your text encoding if you know it (iso-8859-1 is default, but you should also try utf-8 if it doesn't work).
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Dangerosking on February 07, 2010, 08:49:30 AM
Thanks a lot man, the coding thing worked :)
I've done everything fine untill step 4. I went to the database and executed categories_forums.sql but I get an error saying the table categories does not exist... which is true... there is no table categories...
I think this is probably beacause im using the version 3.0.6? Should I install an older version? Or should I skip the lines that refer to the categories table and then reorder the forums manually in the admin cp?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 07, 2010, 11:31:19 AM
The ZetaBoards converter only converts to phpBB2; you'll have to install that, import the .SQL files, then upgrade to phpBB3.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Dangerosking on February 08, 2010, 03:07:36 PM
Thanks a lot for all your help but I think Im gonna start over. After days of working with phpBB and zetaboards I've decided to start off from zero. After all my board doesn't have that many members or posts so it's not that important. I wish I had known more about web hosting before I started my board so I would have chosen to host my board in my own server instead of a free server.
Lol I tryed everything to upgrade from phpBB2 to phpBB3, but I get tons of errors, can't log in the admin cp, etc.
Anyway, thanks again for everything, you're awesome!
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: donw9876 on February 15, 2010, 03:58:46 PM
This is a continuation of some posts I made on an older thread about Yuku conversion.

So far, I have gotten quite far in a conversion. Forums and messages are getting converted properly and I have gotten them to display in a test SMF forum I set up.

Now, here's the one sticking point: the member list is not being converted. (So, everyone is shown on every converted SMF post as "guest".)

I tracked down an issue where the domainstats/activemembers URL was not being served by my Yuku forum. That was actually an admin feature I had to turn on. So now the script is getting these pages (I see them downloading while the script runs).

The script members_topics_posts_smf.py is apparently failing to parse any users or user attributes out of these pages (or maybe it's just on my Yuku board - I notice that another Yuku board doesn't show member titles but mine does.)

I'm kinda thinking that the regular expression at "member_search" in the script doesn't work with my board's member list. I played with the expression in a text editor that has Unix regular expression support and this regular expression only works on my member list up to the expression:

<tr class="(?:even|odd) ([^ ]+)

If I add any more of the original expression from the script, it fails and doesn't match anything in a sample memberlist page.

nneonneo, if you want to look at this problem, I can PM you with the URL of my board and you can try it for yourself.

Thanks!
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 15, 2010, 10:17:32 PM
Yes, I can see the problem.

It appears that Yuku has stopped putting the forum title and forum position (Admin, Owner, etc.) on the memberlist page (at least, I wasn't able to find it on my test board).

I've attached an updated version of the Yuku converter. Try it out and see if it helps.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: donw9876 on February 16, 2010, 12:55:10 AM
Hi, nneonneo,

It worked! I had started on modifying your regular expression, but my regexes are pretty rusty and I don't know much Python.

The conversion seems to be perfect - members that I randomly checked were imported correctly with the right join dates and post counts, and even their avatars made it through OK.

I want to say that this is a great piece of work. I have been struggling to liberate my message board from Yuku for several years, and every attempt crashed and burned for lack of time. The straw that broke the camel's back was the idiotic Yuku video ads being inserted inline in our page views. Some of our members don't have the skills to troubleshoot Adblock Plus to remove the ads, and we weren't about to pay Yuku to remove the ads. We don't even see our board get indexed by Google. Yuku has really limited our board's potential and your script has made a move possible. Finally we can do this.

Thanks very much for putting this tool in the hands of the public.
Title: Further Questions about Yuku-SMF Converter
Post by: donw9876 on February 18, 2010, 02:21:09 PM
Everything works great now for a trial run I did. I have members exported and I have tested the script with two small forums on my board.

I want to export the entire board. We have 139,000 total posts (as reported by Yuku) scattered into about 8 main forums. The biggest forum on my board has 853 threads and 7824 individual posts.

I have two concerns now:

One is that the export process is an "all at once" operation, and Yuku will throttle the export and thus the export operation will never be allowed to complete because it gets throttled in the middle.

A second concern is string capacity. I don't know Python but it looks like you have several places in the script where you download multiple pages together, paste them into one big string variable, and then split the data out with regexe's. My concern here is that my board will blow up the script.

Note - I have had these downloads get throttled by Yuku at times. And I have not seen any string operation blow up (IE, cause Python to barf because of an unrealistically large string.)

I am doing this downloading on a Windows 7 PC with 12 GB of memory, and I believe that I installed the AMD64/Win64 port of Python. I will be doing the downloading on a residential DSL connection. The DSL is no problem, I regularly download 2+ GB ISOs. My concern, again, is that Yuku may shut me out.

Please let me know what you think.  Or maybe someone else who has imported a large Yuku board can advise.

Thanks.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 18, 2010, 03:44:55 PM
Concern #1: If a single page fails to download, the script will retry up to 10 times at 5 second intervals; all of this is controlled in common.py. If you want to add a delay to every HTTP request, you can edit common.py:
Change
            printline(progressline)
to
            printline(progressline+"Waiting for 1 second between downloads...")
            sleep(1)

This will make the process take a lot longer, but should prevent Yuku from throttling you.

Concern #2: Python doesn't barf on long strings (strings as long as 100MB have worked fine). However, reducing the amount of data processed is still desirable. The easiest way to do this is to set the topics per page and posts per page settings as high as they will go in Yuku. This reduces the number of pages downloaded -- it reduces the amount of extraneous (non-post) data downloaded, as well as reducing the number of requests made.

For the record: the largest board I've personally converted on Yuku had 95000 posts in 16000 topics. It took about 5 hours to convert, and the result was 51MB of SQL.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: donw9876 on February 18, 2010, 04:25:50 PM
Thank you again. Do you have a tip jar somewhere? This is a heck of a piece of work.

I will check in when I have something new to report. It sounds like I will be considerably above your previous record in terms of volume of posts.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 18, 2010, 06:31:58 PM
I accept PayPal donations at nneonneo(at)gmail(dot)com.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: donw9876 on February 19, 2010, 02:02:17 AM
Quote... now the forums don't get parsed. The script apparently doesn't see any forums, so it doesn't download anything, and the set of boards that I was seeing in the file categories_forums_smf.sql is not present now.

Update: It appears that the cookie provided by Yuku gets invalidated if a client logs in again from a different location to the same Yuku ID/user name. The cookie that has to be manually copied to the settings.py probably gets invalidated. That's what seemed to account for not seeing any message sections.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Madbullet on February 25, 2010, 01:25:33 PM
Is there anyway to convert forumotion phpbb3 theme for SMF? I hate forumotion but I love their themes and smf themes are ok but I really want this 1 theme form them please can anyone help me?!
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 25, 2010, 02:42:15 PM
@Madbullet: this is a converter for posts, topics and members (data), not themes; you might want to ask on the Graphics and Templates board (http://www.simplemachines.org/community/index.php?board=34.0).
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on February 25, 2010, 05:11:10 PM
nneonneo, thanks for the conversion script. I am currently converting an IPB Forumer forum to SMF, but I'm currently confused on what to do after running members_smf.py. In Execute the SQL script, does that mean upload the two SQL files through phpMyAdmin (well, could you re-iterate that)? Also, I don't get the significance of the PM thing. Does it rely on that it will be sent through email?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 25, 2010, 05:15:21 PM
Yes, it means to import the SQL. I will clarify this in a future release.

PMs will be sent as Forumer personal messages: they will tell users on the old Forumer forum where to find the new forum and what their converted password is.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on February 25, 2010, 05:19:45 PM
Alright, thanks for all the clearing up, my fellow Canadian :).
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on February 25, 2010, 07:08:01 PM
By the way, after importing categories_forums_smf, topics_posts_smf, and members_smf, all the posts are orphaned, while all the forums are located in "Lost Category." Everything else seemed to be good. I'm converting everything to here.

http://rockbandforums.ej.am/index.php

This is the forum I'm attempting to convert.
http://dashing.5.forumer.com/index.php?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 25, 2010, 07:23:15 PM
URL should be http://dashing.5.forumer.com/index.php, not http://dashing.5.forumer.com/index.php? (note lack of ?)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on February 25, 2010, 07:29:02 PM
No. The python script ran almost flawlessly (there were a few date errors but nothing's wrong with that). As a matter of fact, my URL says this.

# URL to your index.php file
URL='http://dashing.5.forumer.com/index.php'

I'm actually trying to convert a Zetaboards forum too, but I'm having difficulty on the zetaboards_get_cookie part. I enter my username/password (I am an admin), and all I get is the Unknown error occurred; try again? error.

I'll be quite frank with you though. I do appreciate your efforts, but I'm actually going to convert and merge these two forums (the Zetaboards and the forumer) into one using a different software. Might phpBB be a better option? I do appreciate your efforts.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 26, 2010, 12:42:54 AM
Ah. Forumer made a code change, which is why the forums got lost.

In the members_topics_posts script, change
repstrings=[("""<div id='navstrip' align='left'>.+<a href='"""+URL+"""\\?showforum=(\\d+)'>[^<]+?</a></div>\\n<br />""","""<^>FORUM<|>\\1</^>"""),
to
repstrings=[("""<div id='navstrip' align='left'>.+<a href='"""+URL+"""\\?showforum=(\\d+)'>[^<]+?</a>""","""<^>FORUM<|>\\1</^>"""),
(delete </div>\\n<br /> from the line).

Let me know if that works for you.

As for the ZetaBoards issue, presumably you are trying to convert http://dashingforums.com/? The URL is 'http://dashingforums.com/', without /index/, and not on zetaboards.com due to the redirection.

If you want to merge the two, it's possible, but you'll need to do a little work, and it won't be possible to have users associated with posts from both boards without a significant amount of work.

Basically, you pick one forum to be your "main" forum: users are converted from the main forum, and posts from the other forum are simply converted as if they were from guests.

The main forum is converted first, and the other forum is grafted on. You can do this by adding a category to the board ("archive" or something similar), and modifying the script to put all forums in this category, generate higher IDs when converting, and set up to convert no members (so all posts are made by "guests"). Then, you remove the "TRUNCATE" commands, and import the SQL.

It's technically tricky, but I've done it a few times. I can help you with the modifications.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on February 26, 2010, 08:08:53 AM
I'm aware of that. I'm using the Zetaboards URL instead. http://s1.zetaboards.com/dashing/. Mind you, I'm just loosely giving you the URLs and I do follow the instructions, so don't regard me using those. I'll try the edits and that stuff.

I shouldn't have a problem with the merging of the two databases, because the new software has something built in already. I don't want to say which one just to respect the developers of the few forums here. I do respect SMF a lot, but the owner of the two forums want something else (I'm doing this as a favour). I will however be doing this when I get home from school today.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 26, 2010, 10:48:53 AM
No, the URL for the ZetaBoards should not be the zetaboards.com address due to redirection: it should be the redirected domain.

It's very common to use these converters as a First step towards converting to a different software, and I would suggest you use the phpBB converters where available since most forum software can convert from
it, but that's just a suggestion. 
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on February 26, 2010, 02:12:59 PM
Alright, then that's most likely it then. The merge/conversion script after the SMF/phpBB conversion supports them both. However, if the phpBB conversion DIRECTLY converts to phpBB's password system, I'll do that then.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 26, 2010, 03:32:29 PM
The converter uses MD5 for all forums (SMF, phpBB2, and phpBB3). All three forums can use it, but MD5 is the default for phpBB2, whereas SMF uses SHA1 (I think) by default.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on February 26, 2010, 07:37:57 PM
Alright, then what's this error? This is the Zetaboards one after I changed the URLs.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 26, 2010, 08:51:50 PM
Like it says, you should take a look at error.html and see if there's an error of some sort.

If you can't determine this, send it to me at nneonneo [at] gmail [dot] com and I'll take a look.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on February 26, 2010, 09:41:29 PM
Absolutely empty. Oh well, I'll still go on anyways.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 26, 2010, 10:21:17 PM
Grr...apparently, ZetaBoards redirects you back to zetaboards.com if you login to the Admin CP. The easiest solution might just be to disable domain redirection for the duration of the conversion.

Without the Admin CP, user emails might not be converted; this could potentially be a problem if your forum assumes that users must have e-mail addresses (I know it causes some minor issues with phpBB2).
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on February 26, 2010, 10:37:11 PM
Alright, will do that one then. Again, I'm appreciating your efforts.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on February 27, 2010, 10:14:51 AM
The forumer thing went very well, so now onto the Zetaboards conversion.

I got it changed and the cookie thing was perfect. Right now, I'm on the members part of the conversion, but this doesn't quite look right to me.

EDIT: I think they both went very well, thank you.

http://rockbandforums.ej.am/dashingzeta/
http://rockbandforums.ej.am/phpbb/

I think this will be my very last question. How do you make a member an admin through phpMyAdmin? Might you know how to do that?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 27, 2010, 02:57:16 PM
For phpBB, set user_level to 1 in the phpbb_users table.
For SMF, set ID_GROUP to 1 in the smf_members table.

The admin should be automatically converted if the "groups" setting is correctly configured.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on February 27, 2010, 03:27:57 PM
You're wonderful. Thanks again. I would give a donation but I don't really have internet money.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Hitakashi on February 27, 2010, 05:46:51 PM
i tried this and it downloads the members but has errors on custom fields. and it doesn't download the post/threads/forums.
im trying to convert from forumotion
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 27, 2010, 06:36:05 PM
@Hitakashi: Make sure you follow all the instructions, particularly these two:

Before you begin, make some profile changes (NOTE: If these changes are not done, conversion will probably fail!)
In your user profile preferences, choose the English language
In your user profile preferences, set the date format to "2008-03-29, 19:46".
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Hitakashi on February 27, 2010, 08:49:53 PM
do i have to update it for all members or just me?

EDIT: i get this when i try it (i changed the date)

C:\Documents and Settings\Alex\Desktop\Forumotion\members_topics_posts_phpBB3.py
:8: DeprecationWarning: the md5 module is deprecated; use hashlib instead
  import os,re,urllib2,sys,random,md5,cgi
Downloading Members...
Member 1 ... Downloading - Failed! <urlopen error [Errno 11001] getaddrinfo fail

EDIT: nevermind i forgot the / at the end of URL

EDIT: its not working, i did what you said it downloads the members but not the forums and post and threads
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 28, 2010, 04:44:37 AM
It should be changed in your profile preferences.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Hitakashi on February 28, 2010, 05:17:41 AM
yep i did all of that and it still doesn't convert threads/post
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 28, 2010, 05:35:09 AM
Make sure that the URL you used for the cookie is the same as the one you used in settings.py; this may be relevant if you use domain redirection.

If you still can't get it, PM me your settings.py and I'll have a look.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on February 28, 2010, 07:05:56 AM
Alright, I guess that wasn't quite the end of the chapter as I said.

The converter did not convert some of the very big topics. Even when I was viewing 40 posts/page, it was going in excess of 90 or so pages, believe it or not. I understand it's a ridiculous amount of posts, so I told the owner that big threads might not convert due to the higher chance that it might end up crashing. Could you make a take on that?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 28, 2010, 01:06:54 PM
I've successfully converted topics with over 150 pages without any issues. What problems do you see when it tries to convert a huge topic?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Hitakashi on February 28, 2010, 03:27:59 PM
i sent you a email i did what you said and added www. and im trying it out now, ill email/PM back if it doesn't work

Yea it didn't work
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on February 28, 2010, 04:33:32 PM
Quote from: nneonneo on February 28, 2010, 01:06:54 PM
I've successfully converted topics with over 150 pages without any issues. What problems do you see when it tries to convert a huge topic?

We got around it by splitting the big topic into two. There were at least 1000 posts and the thread didn't show up. So I think I'm fine now, thank you very, very much.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 28, 2010, 04:37:28 PM
Oh, haha, I think I get it.

There's probably a comma somewhere (as in, "1,203 posts") which I forgot about.

So that I can fix this for a future release, can you please give me the URL of this topic? Thanks!
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on February 28, 2010, 05:19:05 PM
:P.

The forum I did that in? I overwrote it after the owner split the topic.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 28, 2010, 05:20:42 PM
OK, that's alright then; can you tell me if it was ZetaBoards or Forumer, so I can try it out?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on February 28, 2010, 06:37:03 PM
I was doing it in a forumer. The Zetaboards one seemed to convert with no complaints.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on March 05, 2010, 09:50:33 PM
By the way, second comment and issue with the Zetaboards conversion (pretty minor).

After my Zetaboards conversion, the final category (just for fun on the link below) did not convert.

http://s1.zetaboards.com/Dashing/index/

Also, I am attempting to convert a second Zetaboards forum to phpBB and then to another software. The same thing happened here, where the Admin Forum (hidden) did not convert.

http://s1.zetaboards.com/ResumeBulletin/index/

Having said that, those were more minor categories, so that wasn't as bad, but thanks anyway.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: TNoob on March 05, 2010, 11:59:17 PM
Can you really convert a Forumotion forum to SMF? I thought Forumotion doesn't give databases out?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on March 06, 2010, 12:03:29 AM
@TNoob: it converts by downloading and padding the webpages served by Forumotion, so it does not operate on a database. 
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: TNoob on March 06, 2010, 12:07:14 AM
Quote from: nneonneo on March 06, 2010, 12:03:29 AM
@TNoob: it converts by downloading and padding the webpages served by Forumotion, so it does not operate on a database.

Would it essentially still work out to the same result though?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on March 06, 2010, 12:58:12 AM
Yes, it should.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: ABCDiamond on March 06, 2010, 02:16:49 AM
Quote from: elcanadianoSH on March 05, 2010, 09:50:33 PM
By the way, second comment and issue with the Zetaboards conversion (pretty minor).

After my Zetaboards conversion, the final category (just for fun on the link below) did not convert.

http://s1.zetaboards.com/Dashing/index/

Also, I am attempting to convert a second Zetaboards forum to phpBB and then to another software. The same thing happened here, where the Admin Forum (hidden) did not convert.

http://s1.zetaboards.com/ResumeBulletin/index/

Having said that, those were more minor categories, so that wasn't as bad, but thanks anyway.
When I ran a conversion it didn't convert any boards that were password protected, such as the admin forum.  All passwords needed to be removed before running the process.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: TNoob on March 06, 2010, 04:23:06 PM
Would I be allowed to pay somebody to complete this conversion for me?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Norv on March 06, 2010, 04:28:30 PM
TNoob: there is a board on this forum, the Help Wanted (not for support) (http://www.simplemachines.org/community/index.php?board=50.0) board, for this purpose, it can be used if you wish: you can post there a request for professional paid or free help (outside the scope of the free support of this forum).
You may want to note that the board is there only as convenience for people to advertise their services and/or use paid/free services. Simple Machines does not have control on the offers/services exchanged there.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on March 06, 2010, 05:44:42 PM
Quote from: ABCDiamond on March 06, 2010, 02:16:49 AM
Quote from: elcanadianoSH on March 05, 2010, 09:50:33 PM
By the way, second comment and issue with the Zetaboards conversion (pretty minor).

After my Zetaboards conversion, the final category (just for fun on the link below) did not convert.

http://s1.zetaboards.com/Dashing/index/

Also, I am attempting to convert a second Zetaboards forum to phpBB and then to another software. The same thing happened here, where the Admin Forum (hidden) did not convert.

http://s1.zetaboards.com/ResumeBulletin/index/

Having said that, those were more minor categories, so that wasn't as bad, but thanks anyway.
When I ran a conversion it didn't convert any boards that were password protected, such as the admin forum.  All passwords needed to be removed before running the process.

Well the final category in Dashing wasn't a password-protected forum. Heck, it wasn't even an admin forum. I had ACP access throughout the whole thing.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Hitakashi on March 26, 2010, 10:05:45 PM
i tried uploading our topics SQL but it was too big so i used big dump and it says a error:
Error at the line 1: TRUNCATE TABLE `smf_boards`; TRUNCATE TABLE `smf_categories`;

Query: TRUNCATE TABLE `smf_boards`; TRUNCATE TABLE `smf_categories`;

MySQL: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'TRUNCATE TABLE `smf_categories`' at line 1

This is NOT working, i got members to import but IT DIDN'T WORK


edit: it worked but i can't put the topics, cause its too big

and it works :\
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on March 27, 2010, 12:52:05 AM
You can use the "split_sql.py" utility, provided with the program, to split the large SQL files into smaller ones which can be imported one-by-one.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: veventoangel on April 06, 2010, 05:46:01 AM
Thank you for sharing.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on April 14, 2010, 07:40:01 PM
Just a question nneonneo.

What are the chances you will be supporting the MyBB merge system through this (or have converters for MyBB)?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on April 14, 2010, 08:09:41 PM
Close to zero, I'm guessing, simply because I don't really have the time to develop a new converter, particularly when the existing converters can be chained onto a MyBB conversion to achieve the desired effect.

I apologize if this causes any inconvenience, but there are no plans to develop MyBB converters right now.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on April 14, 2010, 08:21:59 PM
Quote from: nneonneo on April 14, 2010, 08:09:41 PM
Close to zero, I'm guessing, simply because I don't really have the time to develop a new converter, particularly when the existing converters can be chained onto a MyBB conversion to achieve the desired effect.

I apologize if this causes any inconvenience, but there are no plans to develop MyBB converters right now.

That's fine. I've been getting around that without a problem mainly by converting to MyBB (and the other guys) via. phpBB 2. I think it would be cool, personally, because the MyBB Merge System is an excellent platform to convert to.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on April 14, 2010, 10:59:07 PM
Actually, the reason why most converters have a phpBB2 backend is because it can be converted to nearly every other platform in existence. Not having to worry about multitudes of other platforms reduces my maintenance workload significantly.

I still would like to, at some point, have pluggable front- and back-ends, so I don't have to deal with so many single-use converters. But for now, that's only a pipe dream.

Of course, if anyone is willing to take up the challenge and write such a framework, I'd be very happy ;)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Hitakashi on May 14, 2010, 11:08:49 PM
Hey nneonneo im just wondering will you ever consider making a converter for forumotion punbb?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on May 14, 2010, 11:31:45 PM
I believe that Forumotion allows you to switch your skin style to phpBB3 at any time through the Display>Theme>Version admin page. Then you can run the existing phpBB3 converter.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Quexinos on May 21, 2010, 05:10:07 PM
a friend of mine wants to do this but is really worried that invisionfree will get pissed off or sue her or something if she does.  That's not possible is it?  I mean it's just running a spider operation which is legal as far as I know but I want to tell her something to put her mind at ease.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Joey67500 on July 20, 2010, 04:27:20 PM
Hi,

I can't seem to get the admin/mod only forums off my Zetaboards and onto SMF. I'm the root for both.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Austin01 on July 21, 2010, 04:44:53 PM
I get this error when uploading the members script
#1062 - Duplicate entry '144' for key 'PRIMARY'

Also only a few of my 1000 posts show up? The rest are there its just when you click on them it says it dose not exist.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: bros on July 22, 2010, 09:10:12 PM
Question - Converter worked excellently for Zetaboards, but I have a question, now that I have converted the board, when I go to track IP, it says all of the people are potentially in the same range. Any way to resolve this issue?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on July 23, 2010, 09:25:41 PM
@Joey67500: The get_cookie script should have grabbed all the necessary credentials to view the forums, unless they aren't visible on the board index.

@Austin01: What converter are you using?

@bros: The converter isn't able to convert post IP addresses, so they are all converted as "0.0.0.0". I don't know what SMF uses to signify that the post has an unknown IP address; if you know, please tell me.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Austin01 on July 23, 2010, 10:32:01 PM
Im using Forumotion to Phpbb3.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Joey67500 on July 24, 2010, 07:49:59 AM
I can't figure out what's wrong. They're viewable on the index, I have root. I even tried making them visible to everyone and it still didn't get them.

Any suggestions?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on July 25, 2010, 10:55:52 PM
@Austin01: Under Forumotion, the import error should not occur. If you can, please e-mail me your settings.py file and I'll see what's up.

@Joey67500: See your e-mail.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Paul_Pauline on July 26, 2010, 04:38:11 AM
Hi nneonneo  :)

Could you clarify whether this script will work for IPB v3 ?

I have a friend that is looking to convert his forum over to SMF, but can only find a converter for v2  :(

Apparently he cannot backport his forum to the earlier version in order to do the conversion.

Thanks, Paul.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Austin01 on July 26, 2010, 11:32:19 AM
I have fixed it, i had to turn off some post setting's on the forumotion board, like show first post on all pages. But some forum's did not transfer but that's ok. Thank's for this converter!
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on July 28, 2010, 01:21:35 AM
@Paul_Pauline: the IF/iPBfree converters are specifically designed for those forum hosting services; the crawlers in general are used only if it isn't feasible to obtain a database backup.

If this is a free forum host running IPBv3 then I may eventually develop a crawler for it; otherwise, if you can get a database dump, try a convert.php based converter instead.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: bros on July 28, 2010, 02:07:30 AM
Quote from: nneonneo on July 23, 2010, 09:25:41 PM
@Joey67500: The get_cookie script should have grabbed all the necessary credentials to view the forums, unless they aren't visible on the board index.

@Austin01: What converter are you using?

@bros: The converter isn't able to convert post IP addresses, so they are all converted as "0.0.0.0". I don't know what SMF uses to signify that the post has an unknown IP address; if you know, please tell me.

Thanks. I was thinking as much.

I already tried wiping smf_messages IPs and that didn't work :P

Since it records the unknown in IPs used in recent posts
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Austin01 on July 28, 2010, 03:32:53 PM
My registration date say's today(after transfer)? How do i get it to the correct date?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: bros on July 31, 2010, 02:21:53 AM
Quote from: Austin01 on July 28, 2010, 03:32:53 PM
My registration date say's today(after transfer)? How do i get it to the correct date?

Profile - Account Settings - change the registration date
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: bros on July 31, 2010, 02:34:56 AM
Quote from: nneonneo on July 23, 2010, 09:25:41 PM
@Joey67500: The get_cookie script should have grabbed all the necessary credentials to view the forums, unless they aren't visible on the board index.

@Austin01: What converter are you using?

@bros: The converter isn't able to convert post IP addresses, so they are all converted as "0.0.0.0". I don't know what SMF uses to signify that the post has an unknown IP address; if you know, please tell me.

smf_members

member_ip
member_ip2

if you put a value into both, then the unknown issue goes away.

Now I have 2000+ members...

How to deal with this >_>

edit:
You also need to attach an IP to each of their messages so it isn't blank
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on July 31, 2010, 05:44:20 AM
The converter leaves the member IP fields entirely blank, and uses the string "unknown" for the post IPs. I have found this to be the least confusing option.

If you have a better idea, please let me know.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: bros on July 31, 2010, 05:38:15 PM
Quote from: nneonneo on July 31, 2010, 05:44:20 AM
The converter leaves the member IP fields entirely blank, and uses the string "unknown" for the post IPs. I have found this to be the least confusing option.

If you have a better idea, please let me know.

I think the unknown/blank value for the post IPs is what causes it.

Hmm.

Something like assigning a random IP might work, like 0.0.0.1 for all posts by user ID 1, 0.0.0.2 for posts by user ID 2, and so on.

Not sure how feasible that would be coding wise though.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: bros on August 04, 2010, 01:17:39 PM
Currently trying things.

UPDATE smf_messages SET poster_ip = RAND() worked... Sort of.

Time to play around a bit more :P
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: bros on August 04, 2010, 01:39:14 PM
here we go

Running this a few days after the conversion when everyone has logged in and settled down...

UPDATE smf_messages s SET s.poster_ip = (Select m.member_ip from smf_members m where m.id_member = s.id_member)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: TNoob on August 16, 2010, 03:21:49 PM
Would anybody be willing to use this to convert a free forum hosted on forumotion.com to SMF? You will be paid cash via PayPal.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: bros on August 19, 2010, 09:38:05 PM
Getting an error with the forumotion converter

Using python 2.5

It grabs all of the members, then I get this:
Downloading Forum Structure...
Forum c0 ... Completed!
Elapsed Conversion Time 32.43 seconds
Converted 0 posts and 0 topics.
Completed! Press <enter> to exit.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on August 19, 2010, 09:41:33 PM
Check your date settings (must be set in your preferences), check that the forum is in phpBB3 mode, check that the cookie is right.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: bros on August 20, 2010, 12:04:47 AM
Quote from: nneonneo on August 19, 2010, 09:41:33 PM
Check your date settings (must be set in your preferences), check that the forum is in phpBB3 mode, check that the cookie is right.

Language is English

Date/Time is "2010-08-19, 23:57"

Ahhhh. I did not see the phpbb3 mode thing in the instructions.

That did it. Thanks. Never done forummotion before so it was new to me :P
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: bros on August 20, 2010, 02:40:12 AM
Hm. I just ran the converter and now it is not getting all of the posts.

It converts 1161 posts and 302 topics (I believe there are 328 topics)

"Our users have posted a total of 3551 messages"

Version is set to phpBB3
Style is set to Version Default style
Yes, I have an admin account.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on August 21, 2010, 09:20:43 PM
@bros: It might be a code update which broke the converter. PM settings.py and I'll take a look...

@TNoob: please contact me at the email address in my signature and we can discuss this.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: koralliya on August 22, 2010, 11:24:38 AM
Hello. I'm trying to convert a forumotion board into smf and I have a couple of questions.

First of all, regarding the step 4 of the instructions. How do I import the SQL batch files since forumotion doesn't allow access to the database? Is there some option in the admin panel? Sorry for my dumb question but I have no clue what should I do.. 

Furthermore I would like to know..: Does the conversion affect only the forum boards? I mean once you have completed the conversion, the administration panel is the same as it used to be in forumotion, with the same options etc? And is there some way afterwards to get back the forum to the software under which it used to run?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on August 22, 2010, 04:40:48 PM
The converter will generate the required .sql files when you run it. These .sql files are generated by parsing the HTML source code of the Forumotion forum pages.

The converter converts phpBB3-style boards into phpBB3-compatible SQL files, which can be imported into a phpBB3 board. After that, you can perform a second conversion to SMF.

This results in an SMF board, with an SMF administration panel, which differs from the Forumotion administration panel. Forumotion uses their own software which is not available to the public (i.e. you must sign up with Forumotion to use their software). After conversion, there is no way to import a forum back into a new Forumotion forum.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: koralliya on August 22, 2010, 07:28:09 PM
Oh! Thank you for your clarification.  :)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: bros on August 23, 2010, 12:50:29 PM
That worked, thanks!

I thought I downloaded the newest version before running it. Hm
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Gold1s on September 23, 2010, 10:45:25 AM
Hello.
I have problem with converter ActiveBoard > SMF.
I set all (I think correctly) in settings.py, install python on WIN XP (I do it on localhost), script was correctly join to AB board. I have 1,687 members, 3,870 topics and 74,980 total posts. And there is a problem. Converter download only 35 members, 1582 topics and 7395 posts. On some posts I see info: "Error: Topic is empty!" and I don't know why.
Someone know why?
Greetings.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: MagitekElite on September 26, 2010, 12:54:37 AM
I hope this is allowed.....

But is it possible to convert Zetaboard posts, threads, members and boards over to Simple Machines 2.0 RC3? I saw the first post and it mentions Zetaboards....  :-[
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: converteruser on September 27, 2010, 04:23:12 AM
This looks rather amazing. Is the Forumotion converter updated lately?

Also I have a question regarding proboard converter, I'd like to ask you a question about it in private message. XD
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on September 27, 2010, 07:54:37 AM
@MagitekElite: Zetaboards to SMF 1.1.x is supported; you can perform a second conversion to SMF 2.0.

@converteruser: Forumotion converter was updated last week or so.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: MagitekElite on September 27, 2010, 05:25:40 PM
Yes! Thanks, Nneonneo. Doing this won't harm my Zetaboard forum will it?  ???
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on September 27, 2010, 06:01:16 PM
Not that I know of, no.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: MagitekElite on September 27, 2010, 06:51:09 PM
Ah, okay then....I didn't want it going badly and then ruining the Zetaboard forum :>

I have a few questions. First, what do you do when you don't get "March 2, 2008" to set as Join date and the time?
The instructions manual says to change the Board Clock to the following (or does that mean the PC's clock?).

QuoteBefore you begin, you must make the following time format adjustments:
In the Administration Panel:
Admin CP -> Board Preferences -> Board Clock:
    Change the Standard Time Format to the format matching "Mar 2 2008, 01:23:45 PM".
    Change the Join Date Format to the format matching "Mar 2 2008".
    Change "Use relative times" to No.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on September 27, 2010, 07:33:39 PM
The converter won't change any settings or modify any posts/topics/etc. This is why the instructions specifically ask you to make the settings changes.

In your ZetaBoards Admin CP, you see the Preferences option under Board Customization. Near the bottom is the Board Clock option; make the changes there.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: MagitekElite on September 27, 2010, 07:40:00 PM
Mine only allows me to change it to September 2 or pass that... :<
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on September 27, 2010, 07:42:02 PM
Oh, the Mar 2 2008 is an example of the format, not the exact thing you'll see in the box. Today, it should be Sep(t) 27 2010.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: MagitekElite on September 29, 2010, 04:46:52 PM
I have a question...after running the converter and you get all the SQLs, where do you upload them? Into my forum Databass (I'm using Godaddy)? It says into the Databass of SMF, but where is that exactly? (sorry if I'm a bother! :C) And how do I make them "utf8" character set encoding (it says it has to be utf8). I don't know what utf8 is >.>
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on September 29, 2010, 05:03:47 PM
Godaddy's control panel should have a "database admin", "phpMyAdmin", "SQL database" or similar option available. Click on it, select your database, and use the import tab.

Note that I don't actually know what Godaddy's control panel looks like; most hosts work this way, but you may have to feel around a bit to find it.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: MagitekElite on September 29, 2010, 05:10:05 PM
Ah, okay, just checked around. I have a MySQL, and then when I clicked it, brought me to a myPHPAdmin place to log in.  Once inside, I just upload, right? Just to the first place I see, or will there be a folder or something? ;D

So I don't have to make the files utf8, do I?  :-\
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on September 29, 2010, 05:27:42 PM
Use the "import" tab in phpMyAdmin. It will prompt for a file to upload, and a character set; that's where the "utf8" goes.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: MagitekElite on September 29, 2010, 05:29:46 PM
Ah! Okay! Once last question before I test this out....the log in, is the log in for Dodaddy, or for the forum?  :P
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on September 29, 2010, 05:32:36 PM
GoDaddy login.

If you have further questions, please continue by PM; I'd like to keep the thread on-topic.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: flame1916 on October 02, 2010, 07:49:35 PM
a tech wise noob here who is very glad to here of this program but unsure on many points so a few questions

1) currently work with a forumer phpbb2 forum. This has become too limited for needs and are losing posters as it is too 'old fashioned'.
would set up a new board entirely but we would lose all post history as well as member list. Will this allow a forumer phpbb2 set up to migrate AND maintain post history/members?

2) Do i set up a SMF forum first and then download this? Sorry but as opening sentence says I am a complete noob and am worried I will get it wrong.

I would be able to work on this without interfering in the current forumer set up? Thank you nneonneo for any help you give!
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on October 02, 2010, 09:17:05 PM
1) Forumer phpBB2 forums can be downloaded entirely using this converter, producing a phpBB2 database format suitable for importing into a new phpBB2 forum. Subsequently, you can use the phpBB2->SMF converter to convert this forum to SMF.
2) You actually need to set up a phpBB2 forum first, to receive the converted phpBB2 database, then set up an SMF forum to perform the second conversion.
3) Forumer will not be affected by the conversion.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Jag00 on November 11, 2010, 07:16:54 PM
Hey nneonneo I have a question about forumotion converter.

First I tried it on a small forum that has 200 members and 3000 posts and it worked perfectly.

Then I tried on my big forum (big for me :D ) - 2000 Members 300,000 Posts .. and after 15 hours  :o it finished.

But the problem begins here.

The topic_post_phpbb3.sql is larger than 50MB and as that I cannot upload it to my forum because it is too big. (upload is limited to a 5mb, I think)

Is there a way how to split this? Or reduce size. (without deleting almost everything in my forum)

I had an idea  :-[ to split this to a smaller part and upload it to a diferent forum, than merge it with some mod to one forum but I don't know how to split.

Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on November 11, 2010, 07:59:38 PM
There is a program included with the converter called split_sql.py, which you can run to split the SQL file into smaller pieces for uploading.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Jag00 on November 12, 2010, 05:38:03 PM
Just to say thanks. Now everything is fine...

Thanks again for this converter.

Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: howling_haggis on November 20, 2010, 03:54:00 PM
Hi I'm trying to run the converter from Zetboards to SMF and so far it's going well but I don't understand how to import the sql files generated by the converter into the new SMF board. Can you say how that is done?

Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on November 20, 2010, 04:05:28 PM
Ask your webhosting provider; they usually provide a CPanel, where you can access phpMyAdmin or a database administration tool to perform the import.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: bros on November 20, 2010, 05:23:08 PM
You can also import large files using bigdump.php
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: howling_haggis on November 20, 2010, 08:16:07 PM
thanks - I got help from my hosting provider and it's working.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: neojin3 on November 25, 2010, 10:49:36 AM
This might sound stupid.. but can I use this to convert my Zetaboards forum to a forum hosting site that uses SMF software, or do I need web hosting?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on November 25, 2010, 10:59:48 AM
If the SMF site lets you import databases, then you could. You'd have to check, first.

Also, be aware that if the SMF site doesn't allow you to backup or save the database, then you may end up in the same position as before (no access to your data).
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: neojin3 on November 25, 2010, 11:30:28 AM
Thanx.

Sorry for being so ignorant of this stuff, but which version of 2.6 do you recommend for Windows?

# Windows x86 MSI Installer (2.6.6) (sig)
# Windows X86-64 MSI Installer (2.6.6) [1] (sig)

http://www.python.org/download/releases/2.6.6/
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on November 25, 2010, 11:34:01 AM
Use the x86 MSI version.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: neojin3 on November 25, 2010, 01:15:38 PM
So, when I run Python, are the files converted into an SMF file on my computer and then I upload it onto web hosting?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on November 25, 2010, 01:35:06 PM
Yes, basically.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: villedepuissance on November 29, 2010, 12:04:54 PM
Hi! I'm trying to convert my proboards website to Smf and I noticed there are tons of converters...but I have no clue which one to use for my site. I am trying to get everything ready before publishing my new site.

Any help or suggestions, or anything really I would be very appreciative of.

Thank you.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on November 29, 2010, 12:46:15 PM
The Proboards converter has been removed due to a legal request by Proboards, Inc. and is no longer available.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: neojin3 on December 05, 2010, 09:34:28 AM
Still haven't gotten to converting yet, but are PMs carried over or lost?

Also, my understanding is that you can't convert the old forum (in this case Zetaboards) into an already existing SMF forum that already has activity, correct?

Thanx in advance.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on December 05, 2010, 12:27:41 PM
1) PMs cannot be converted.
2) You can merge forums, but it isn't easy.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: thehonestwaterbottle on December 07, 2010, 01:44:49 AM
I'd just like to say thanks a million for this :D

I just want to ask how to access the ACP in the new forum after transferring everything over, because permissions are not carried over.

Also, my board has about 16,000 posts and ~100 members. When I try to convert it, it only converts one category in the forum out of several.  The table prefix, URL and date format is as mentioned in the instructions.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on December 07, 2010, 03:58:24 AM
Which converter are you using?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: thehonestwaterbottle on December 07, 2010, 04:14:36 AM
Sorry I'm using the Forumer --> phpbb3 converter.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on December 07, 2010, 04:26:12 AM
Are you performing a second conversion to SMF?

The Forumer forum must be using the prosilver theme. No other themes are supported.

To make an SMF account admin, change their ID_GROUP to 1.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: thehonestwaterbottle on December 07, 2010, 04:46:40 AM
Nope I'm just converting from phpbb3 on Forumer to phpbb3.

It is currently using the prosilver theme under my username. Does this have to be done via adminCP?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on December 07, 2010, 05:12:18 AM
No, you shouldn't need to change it in the Admin CP.

To get admin on phpBB, use the Support Toolkit, available from the phpBB website.

I don't know why only one category converts. Can I take a look at your Forumer board?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: thehonestwaterbottle on December 07, 2010, 04:43:00 PM
Certainly :) It's: http://forum.oamicro.org (http://forum.oamicro.org) or http://oam.50.forumer.com (http://oam.50.forumer.com).
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Randy A on December 08, 2010, 09:52:50 AM
Quote from: nneonneo on November 29, 2010, 12:46:15 PM
The Proboards converter has been removed due to a legal request by Proboards, Inc. and is no longer available.

Well, that sucks.  I was just going to offer to move a friends board over.  Glad I stopped in to check it out.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: thehonestwaterbottle on December 11, 2010, 12:22:19 AM
Quote from: bobbrown99 on December 07, 2010, 04:43:00 PM
Certainly :) It's: http://forum.oamicro.org (http://forum.oamicro.org) or http://oam.50.forumer.com (http://oam.50.forumer.com).
Is anything happening with this?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on December 11, 2010, 02:19:04 AM
Worked fine for me. Do all the categories appear in categories_forums_phpBB3.sql, or only some of them?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: thehonestwaterbottle on December 13, 2010, 12:26:55 AM
Quote from: nneonneo on December 11, 2010, 02:19:04 AM
Worked fine for me. Do all the categories appear in categories_forums_phpBB3.sql, or only some of them?
Only some of them.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on December 13, 2010, 12:34:23 AM
120 categories and forums appeared in the categories_forums_phpBB3.sql file from converting your forum. This seems like all of them.

I wish I could tell you what setting(s) were causing the problem, but unfortunately, I really don't know. I could just hand over my account and you could use it for your conversion; PM me if you'd like to use that option.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: neojin3 on December 16, 2010, 12:57:17 PM
Can I convert Zetaboards to Phpbb 3 and then convert it/use it directly to upload to a Phpbb platform such as FreeForums?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on December 16, 2010, 01:20:04 PM
Only if the phpBB host supports importing (most don't). I'd ask the host if they support this feature first.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Austin01 on January 22, 2011, 10:02:30 PM
I have a forum that has about 1500 topics and for some reason I get 200-300 or so to show, but with only one post in them and they clearly have more. The rest I get "Topic Is Empty"
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 22, 2011, 10:16:40 PM
What forum host are you converting from?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Austin01 on January 22, 2011, 10:20:57 PM
Forumotion
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on January 22, 2011, 10:36:49 PM
Quote from: Austin01 on January 22, 2011, 10:02:30 PM
I have a forum that has about 1500 topics and for some reason I get 200-300 or so to show, but with only one post in them and they clearly have more. The rest I get "Topic Is Empty"

Did you use the updated one? He released another one after he converted Forumansion initially from my knowledge.

By the way nneonneo, I'm getting my own problems again, which I posted it in the phpBB forum. Did you see it? If not, is it easier for you to contact you here?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Austin01 on January 22, 2011, 10:39:12 PM
I believe I'm using the most recent from here, I just downloaded the one on the first post.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 22, 2011, 11:03:12 PM
I missed updating these packages the last time; my apologies. I will go do that now.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Austin01 on January 22, 2011, 11:13:55 PM
Thanks! It's all good now  8)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: SleepyTight on January 23, 2011, 10:59:16 AM
Hello, I am new and I appreciate all the hard work put into this.

I was wondering if I can use this to download my forum: cityofangels.freeforums.org
On my computer and then put it on my own domain/web space?

and are there any concequences, losing data etc.

Thanks for the support.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 23, 2011, 12:54:27 PM
Yes, FreeForums is supported. Download the converter package, install Python (http://www.python.org/download/ (http://www.python.org/download/)), and follow the instructions for the Forumer_phpBB3 package. Polls are not converted, and user passwords will be set to a random value (which can be reset by members using their e-mail addresses). FreeForums will be converted to phpBB3; you can use the phpBB3->SMF converter (http://www.simplemachines.org/community/index.php?topic=218449.0) to get an SMF database from that.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: converteruser on January 24, 2011, 05:04:59 AM
umm does forumotion converter take too long to grab information? My friend tries to move her forum with 800 members and 60000+ posts out of forumotion to her own hosting account, and it has taken more than two days. She eventually gave up on that, for some reason I dunno. Is there a way to improve performance of this converter? o_o
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: el canadiano on January 27, 2011, 12:55:41 PM
Quote from: converteruser on January 24, 2011, 05:04:59 AM
umm does forumotion converter take too long to grab information? My friend tries to move her forum with 800 members and 60000+ posts out of forumotion to her own hosting account, and it has taken more than two days. She eventually gave up on that, for some reason I dunno. Is there a way to improve performance of this converter? o_o

It could just be your connection as well. Just be patient, really. Sometimes, if you know that you're going to take a while, just do it overnight (but it shouldn't take more than 2 days to do a conversion of your size, it's most likely the connection).
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: brandon199511 on February 07, 2011, 07:55:35 PM
Im converting from zeta, and I have no idea where to put the files
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 07, 2011, 08:51:37 PM
Look for phpMyAdmin or a similar MySQL administration tool in your web host control panel (cPanel), and use the import function to import the files into your database.

If you can't find it or can't use it, ask your web host; different web hosts may differ widely from this guide.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Austin01 on March 17, 2011, 04:12:34 PM
I have the converter up to date via here, however it seems to be giving me errors. It only transfers 25 out of 120 members and I get "Topic Not Found" for every topic. Any fixes?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on March 17, 2011, 05:06:49 PM
Which converter are you using? Please remember to include that when you ask for help!
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Austin01 on March 18, 2011, 02:40:27 PM
Forumotion converter for http://dsi-rage.forumotion.com
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on March 19, 2011, 05:00:44 AM
Nothing's changed. Please recheck your settings, and try it from a fresh account.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Austin01 on March 26, 2011, 03:55:50 PM
Is it possible to create a free forums converter? Thanks!
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on March 26, 2011, 05:39:15 PM
There is probably a freeforums converter in the posted package or in the package at the phpBB forums.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Austin01 on March 28, 2011, 02:27:48 PM
Ok, I sent a reply there.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: NuclearWizard on April 11, 2011, 11:34:48 PM
Using ZetaBoards converter to go to PhpBB2.0.22 on s1.zetaboards.com/Nukia (Down for the move.)

It won't process user emails, but my major problem is that my host won't import the files.

I figured I'd post here first, but basically, it says something like:

"Error

SQL query:

TRUNCATE TABLE `smf_topics` ;

MySQL said: Documentation
#1046 - No database selected "

Using cPanel/phpMyAdmin.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on April 11, 2011, 11:45:01 PM
On the left sidebar of phpMyAdmin, select the SMF database. You should see all the tables in the database appear on the right side. Use the import tab that appears to import the database.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: josepzin on April 17, 2011, 06:17:37 PM
Hi, i am new in Python (i am PHP programmer) and i am trying to convert a forum from foros.net on phpBB2

I have modified the Forumer_phpBB2. Members and Categories works ok, but topics, posts & posts_text dont work and i dont have idea what is the problem :/

Foros.net has this tips:
- The URL is http://www.foros.net/viewforum.php?f=2&mforum=Commodoremania (<<-- my forum identifier is here)
- The language is Spanish

I have added a new global setting: URL_POSTFIX='&mforum=Commodoremania' what i use in same places of members_topics_posts_phpBB, for example: userdata=download_page(URL+'profile.php?mode=viewprofile&u='+str(memberid)+URL_POSTFIX,statusline+"Downloading - ",COOKIEDATA)

And it works! :)

But i do not know what is the problem with Topics and next...

There are my 2 files: http://dl.dropbox.com/u/546470/temporal/borrar/Foros.net_phpBB2.zip

Suggestions & helps are grateful!!!
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on April 17, 2011, 07:01:51 PM
The problem is that none of the regular expressions for links (categories, forums, topics) are expecting another parameter at the end, so they fail to recognize the links.

You will want to change these three lines:
# category detection
re_cats=re.compile('''<span class="cattitle">\\s*<a href="[^"]*index\\.php\\?c=([^"]+)" class="cattitle">(.*?)</a></span></td>([\\w\\W]*?)(?:<td class="catLeft"|</table>)''')

# forum detection
re_forums=re.compile('''<span class="forumlink">\\s*<a href="[^"]*viewforum\\.php\\?f=([^"]+)" class="forumlink">(.*?)</a><br />\\s*</span>\\s*<span class="genmed">([\\w\\W]*?)<br />\\s*</span><span class="gensmall">''')

re_pages=re.compile('Ir a p&aacute;gina <b>1</b>.+?">(\\d+)</a>&nbsp;&nbsp;')

re_topicviews=re.compile('<a href="[^"]*viewtopic\\.php\\?t=(\\d+)" class="topictitle">[\\w\\W]*?<td class="row2" align="center" valign="middle"><span class="postdetails">([\\d,]+)</span></td>\\s*<td class="row3Right"')


to
# category detection
re_cats=re.compile('''<span class="cattitle">\\s*<a href="[^"]*index\\.php\\?c=(\\d+)[^"]*" class="cattitle">(.*?)</a></span></td>([\\w\\W]*?)(?:<td class="catLeft"|</table>)''')

# forum detection
re_forums=re.compile('''<span class="forumlink">\\s*<a href="[^"]*viewforum\\.php\\?f=(\\d+)[^"]*" class="forumlink">(.*?)</a><br />\\s*</span>\\s*<span class="genmed">([\\w\\W]*?)<br />\\s*</span><span class="gensmall">''')

re_pages=re.compile('Ir a p&aacute;gina <b>1</b>.+?">(\\d+)</a>&nbsp;&nbsp;')

re_topicviews=re.compile('<a href="[^"]*viewtopic\\.php\\?t=(\\d+)[^"]*" class="topictitle">[\\w\\W]*?<td class="row2" align="center" valign="middle"><span class="postdetails">([\\d,]+)</span></td>\\s*<td class="row3Right"')


You will also need to add URL_POSTFIX to the remaining download_page calls.

Thanks for the heads-up about foros.net! It seems there's a lot of phpBB2 systems using the &mforum thing so I will try to see if I can add this change to the next version.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: josepzin on April 19, 2011, 04:56:13 PM
Wow... thanks for responding so quickly!

later I try to see if I have luck :)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: josepzin on April 24, 2011, 10:33:21 AM
Ok!! Now i can read categories, topics and posts!!!! :)

But there are a problem: only read the first page of topics.

I think the problem is here:
re_pages=re.compile('Goto page <b>1</b>.+?">(\\d+)</a>&nbsp;&nbsp;')

Using "Goto page " stop by error:
Categories and Forums
Traceback (most recent call last):
  File "members_topics_posts_phpBB.py", line 338, in <module>
    forumnumber=dl_cvt_subforum(catnumber, catid, None, forumnumber, name, '')
  File "members_topics_posts_phpBB.py", line 334, in dl_cvt_subforum
    nextfn=dl_cvt_subforum(catnumber, cid, sfid, nextfn, sname, sdesc)
  File "members_topics_posts_phpBB.py", line 327, in dl_cvt_subforum
    perpage=int(re.findall('f=%s&amp;topicdays=0&amp;start=(\\d+)">2</a>'%fid, pagedata)[0])
IndexError: list index out of range


If i change "Goto page " to anything (for example "XXXX") it works but only read the first page of topics. HELP! :P

Tip: in my foros.net profile i have changed the language from "spanish" to "English"
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on April 24, 2011, 12:00:44 PM
Actually, the problem is this line:

  File "members_topics_posts_phpBB.py", line 327, in dl_cvt_subforum
    perpage=int(re.findall('f=%s&amp;topicdays=0&amp;start=(\\d+)">2</a>'%fid, pagedata)[0])


On that line you have to add the URL_POSTFIX part too.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: josepzin on April 24, 2011, 10:17:22 PM
Thanks, thanks!!  :) :) :)

Now work it! I am cheking what all the data are OK in my new SMF forum, and then i will send you the new code!
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Rammelslakje2 on April 29, 2011, 12:58:15 PM
Hello,

I re-registered on this site especially for this. I loved using SMF and the features it comes with, also addons like Tinyportal etc. I have also i've read most of the topics in this thread, unfortunately didn't read all 20 of them so I might missed something. Cause i would like to export a proboards database into SMF.

But which one do I use for proboards?

thanks
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: josepzin on April 29, 2011, 02:16:26 PM
Quote from: Rammelslakje2 on April 29, 2011, 12:58:15 PM
But which one do I use for proboards?

First you need to know the forum type, for example phpBB2 or phpBB3 you can use Forumer or phpBB2
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on April 29, 2011, 02:31:54 PM
Proboards converter was removed due to a legal request from them.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Old Marcus on May 04, 2011, 06:00:31 PM
Hi, just to double check, this will import into SMF 2.0 successfully, yeah? Apologies if this has already been covered, But big thread and late night. :P
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on May 04, 2011, 09:23:59 PM
No, SMF 1.1.x only. You'll have to do a second conversion from 1.1 to 2.0.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Old Marcus on May 05, 2011, 06:56:59 AM
Thanks, I discovered this when looking up a SQL import error. So I dropped to 1.1 and I'm staying there for now. Thanks for your script, it was exactly what I needed. :)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: josepzin on May 08, 2011, 09:34:20 PM
foros.net > phpBB2 > SMF2 = Finished!!!

I have added a filter to clear the HTML code of HOTWordsTxt ads.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Austin01 on May 10, 2011, 03:13:00 PM
I'm having an issue with forumr_phpbb3 (For FreeForums) converter. It won't generate a random password/create the members in the sql file or the password file.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Old Marcus on May 14, 2011, 01:34:15 PM
Another question, my conversion went fine except passworded boards were not transferred. I'm planning to un password them and run the script again to get the data. If I import the forum data to the database, will it merge or overwrite the existing data? I don't want to reset the forum accidentally.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: bestcolleges on May 14, 2011, 02:12:51 PM
thanks
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Austin01 on May 14, 2011, 03:19:27 PM
nneonneo, any help?  O:)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on May 14, 2011, 04:05:04 PM
@Old Marcus: The converted SQL will overwrite the existing forum data. Merging is not yet supported.

@Austin01: I just uploaded a new converter package; try the phpBB3 converter from that package.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Austin01 on May 14, 2011, 11:09:04 PM
Thanks! Works like a charm!

Your the best.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Austin01 on May 29, 2011, 01:19:55 AM
Hi,

I'm having an issue with the forumotion one. I follow everything, after the import I click a topic and I get Topic doesn't exist but it shows the title and all topics imported fine. Help?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: tjd100 on June 07, 2011, 09:24:50 PM
You say the Proboards converter was removed... i just downloaded the zip file and it's still there.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on June 07, 2011, 09:41:37 PM
Whoops. Fixed.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Eric_WP on July 20, 2011, 03:55:01 AM
I'm fairly confused, every time I try to convert my Zetaboards forum, the database is no where to be found.  This is despite the fact that the script completes the process.  If it's not in the actual folder where the Python file resides, where else could it be? (I've already tried this twice, by the way)  Sorry if this has already been answered!
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on July 20, 2011, 11:42:50 AM
You don't see a bunch of .sql files in the same directory as the Python scripts?

When the script finishes, does it print out the conversion statistics? It should say "Completed! Elapsed conversion time xxxx seconds" followed by the number of topics and posts converted. If it doesn't print that out, the conversion was unsuccessful and you should see the critical_error.log or convert_error.log files for guidance.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Eric_WP on July 20, 2011, 02:19:53 PM
Unfortunately, it didn't generate any files, not even an error log even after it displayed the "Completed! Elapsed conversion time xxxx seconds" message.  I couldn't get it to work under Windows Vista, but fortunately I dual-boot Ubuntu as well and it worked perfectly there (I used Python 2.7, so it looks like yet another version works great with these scripts!).

Thanks a lot for the wonderful converters nneonneo!
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: PsychoticHorticulture on August 01, 2011, 01:55:08 AM
Great concept, thanks for all your hard work.

I was able to grab the SQL files from my old ZetaBoards forum, but I'm not able to import them in phpMyAdmin, I'm getting the "table 'smf_forums' doesn't exist" error whenever I try to import categories_forums. I've made sure they match up, but it's not working for some reason.

I've repeated this a couple of times, using different variations of the prefix. Sort of at a loss as to where to go from here. Using SMF 1.1.4.

Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: ThePro on August 01, 2011, 06:50:58 PM
When trying to convert http://logosdecanales.com, which is a forumotion forum, It says that both members and topics don't exist

(http://www.uploadimage.com.ar/images/98736492088907277816_thumb.png) (http://www.uploadimage.com.ar/images/98736492088907277816.png)    (http://www.uploadimage.com.ar/images/22469968875304373976_thumb.png) (http://www.uploadimage.com.ar/images/22469968875304373976.png)22469968875304373976

Is there anything that can be done?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: rafaweborama on November 17, 2011, 01:18:19 AM
Hi there,
I can't download the files from the second post. It only sends me a blank index.php download prompt, I'm not sure if it's a SMF issue here or a the attachment.
Thanks.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on November 17, 2011, 01:27:16 AM
Rename the index.php to Converters.zip, and it might work.

It's most likely a temporary SMF issue.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: converteruser on November 23, 2011, 01:45:30 AM
Why is proboard converter removed? Is there a way I can get it? Please help.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Oldiesmann on November 24, 2011, 11:46:43 AM
Quote from: converteruser on November 23, 2011, 01:45:30 AM
Why is proboard converter removed? Is there a way I can get it? Please help.

It was removed because ProBoards asked us to remove it. nneoneo might still have one that he can send you though - send him an email or PM for more info.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on December 11, 2011, 09:07:21 PM
Actually, you do run this on your own computer (unless your host supports running Python scripts, e.g. through SSH).
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on December 14, 2011, 02:38:34 AM
When it says "edit", it means you open that file with a text editor. You will see some lines like the following:

URL='http://forum.com'

and you can edit those lines as specified in the Instructions.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on December 14, 2011, 11:47:58 AM
The converter produces .sql files. If your SMF host lets you import those, great. Otherwise, you will have to find some other way.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: EpsilonSigma on December 17, 2011, 06:07:18 AM
Hello!
I have 2 questions:

1. Can I convert from forumotion directly to smf or do I have to convert to phpbb first?

2. After I tried the forumotion converter, everything went fine through the end, but it only detected 285 users out of 460.
The convert_error log has this:

Member ID 74
Traceback (most recent call last):
  File "C:\...\Converters\Forumotion\members_topics_posts_phpBB.py", line 292, in <module>
    raise Exception("Please log in to your administration panel and update the cookie in order to download member e-mails.")
Exception: Please log in to your administration panel and update the cookie in order to download member e-mails.

Member ID 176
Traceback (most recent call last):
  File "C:\...\Converters\Forumotion\members_topics_posts_phpBB.py", line 292, in <module>
    raise Exception("Please log in to your administration panel and update the cookie in order to download member e-mails.")
Exception: Please log in to your administration panel and update the cookie in order to download member e-mails.

Member ID 196
Traceback (most recent call last):
  File "C:\...\Converters\Forumotion\members_topics_posts_phpBB.py", line 292, in <module>
    raise Exception("Please log in to your administration panel and update the cookie in order to download member e-mails.")
Exception: Please log in to your administration panel and update the cookie in order to download member e-mails.
.
.
.
.
And keeps going for the rest members.

I took the COOKIE thing from the forum, while i was logged in as administrator. Do I have to change cookie and take it from admin panel as the error says?


Thanks in advance for your help.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on December 17, 2011, 12:25:03 PM
@neojin3: Are you using Python 3? If so, please install Python 2.7. Does critical_error.log have any content?

@EpsilonSigma: 1) No, you have to convert to phpBB first.
2) Do what the error says to do.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: EpsilonSigma on December 17, 2011, 01:13:58 PM
I did it but now it cant locate any username.

The first time I run the members_topics_posts_phpbb.py , it went smouthly through the entire proccess, but the problem is it detected only half of the usernames. The rest (topics and posts) where all there.
Now that I try it again, it gives me this convert error log for all the usernames:
Member ID 1
Traceback (most recent call last):
  File "C:\...\Converters\Forumotion\members_topics_posts_phpBB3.py", line 292, in <module>
    raise Exception("Please log in to your administration panel and update the cookie in order to download member e-mails.")
Exception: Please log in to your administration panel and update the cookie in order to download member e-mails.


I do what it says, I log in to my admin panel, take the cookie, paste it in settings, but still the same problem.
Any ideas on what am I doing wrong?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on December 17, 2011, 01:22:14 PM
Please download the Forumotion converter from http://www.phpbb.com/community/viewtopic.php?f=65&t=861505 and let me know if that works better.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: EpsilonSigma on December 17, 2011, 01:39:41 PM
No, even worse.
It returns this critical error:

File "C:\...\Forumotion\members_topics_posts_phpBB3.py", line 217, in process_member_email_page
    raise Exception("Empty admin page -- double check cookie?")
Exception: Empty admin page -- double check cookie?

I checked the cookie and it seems ok.


Edit:

I noticed that in my administration panel, when I go to the users and try to navigate to other pages than the 1st, it redirects me to home. Is it possible that this causes the problem? Did forumotion do something to my account?

And the javascript:document.cookie did nohing on firefox, so I took it from ie (dont think it has to do with this though...)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on December 17, 2011, 10:40:42 PM
@EpsilonSigma: If you can't see the admin panel, then the crawler can't either. Just leave it be for a few hours (up to a day); it usually resolves itself. The new converter should be less likely to trigger this "bug" in the admin panel.

@neojin3: Again, does critical_error.log have any contents?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on December 18, 2011, 02:46:47 AM
You need to unzip all files. In particular, the "common.py" file must be present.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: neojin3 on December 18, 2011, 03:04:02 AM
Yes, I realized that may have been the mistake, after you mentioned the log file, and it's working now.
I'm gonna delete all the posts of mine with stupid questions.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on December 18, 2011, 01:22:11 PM
@neojin3: Please don't delete your posts. They may help others in the future.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: CF on January 23, 2012, 09:31:37 PM
Ok, I read all 22 pages and I think I've followed the instructions to the letter (I am fairly tech savvy, but not coding, SQL, HTML, or database saavy).  But I get hung up right out of the gate.

Preliminary info:
*Using Zetaboards to SMF crawler/converter.
*Using Python 2.7
*Moved the "common.py" file into the Zetaboards folder
*Edited the "settings.py" file with:
--custom domain/URL
--ZBURL
--location of the locked icon image (NOTE: this is a custom Theme and the locked icon resides in a photobucket album)

When I double-click the "zetaboards_get_cookie.py", the DOS-like window open and prompts me for the username and password.  I enter those (they are correct, I checked).  There is a short pause, then several lines of text flash faster then I can read them, and the window closes.  There is no confirmation of anything before or after the window closes.

However, a new file called "settings.pyc" appears in the Zetaboards folder.

When I try to run "members_topics_posts_smf.py", I get "Error: cookie.txt not found" "Please run IPBfree_get_cookie.py" to generate it."

Any help would be appreciated.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 23, 2012, 10:36:03 PM
Could you put the line

import common

at the top of zetaboards_get_cookie.py, on a line by itself? Then run it again. It might close unexpectedly, but this time it should generate a file called critical_error.log; post the contents of that file.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: CF on January 24, 2012, 03:30:18 AM
Quote from: nneonneo on January 23, 2012, 10:36:03 PM
Could you put the line

import common

at the top of zetaboards_get_cookie.py, on a line by itself? Then run it again. It might close unexpectedly, but this time it should generate a file called critical_error.log; post the contents of that file.

In the Python window, I get:
"Warning: confusables database not found; phBB3 conversion may be inaccurate!
Username?"

I enter the username and password and the python window closes immediately.
The critical_error.log file contains the following text:

Traceback (most recent call last):
  File "C:\Users\CF\Documents\SMF Crawler Files\Converters\ZetaBoards\zetaboards_get_cookie.py", line 19, in <module>
    conn=urllib2.urlopen(URL+"login/log_in", data=urlencode({'anon_on':1,'cookie_on':1,'uname':username,'pw':password}))
  File "C:\Python27\lib\urllib2.py", line 126, in urlopen
    return _opener.open(url, data, timeout)
  File "C:\Python27\lib\urllib2.py", line 394, in open
    response = self._open(req, data)
  File "C:\Python27\lib\urllib2.py", line 412, in _open
    '_open', req)
  File "C:\Python27\lib\urllib2.py", line 372, in _call_chain
    result = func(*args)
  File "C:\Python27\lib\urllib2.py", line 1199, in http_open
    return self.do_open(httplib.HTTPConnection, req)
  File "C:\Python27\lib\urllib2.py", line 1174, in do_open
    raise URLError(err)
urllib2.URLError: <urlopen error [Errno 11004] getaddrinfo failed>


(Then I went back and removed "import common" from the Zetaboards_get_cookie.py file so I wouldn't forget to do it later.)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 24, 2012, 09:42:52 AM
That means that the URL was entered incorrectly in settings.py. The most likely cause is a missing slash at the end.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: CF on January 24, 2012, 04:53:58 PM
Quote from: nneonneo on January 24, 2012, 09:42:52 AM
That means that the URL was entered incorrectly in settings.py. The most likely cause is a missing slash at the end.

That, of course, fixed the problem and the cookie.txt file was generated.

I was then able to run the "members_topics_posts_smf.py" file, which finished much faster than I thought it would.  Just a few minutes in fact.  But it completed with verification of only slightly fewer posts than I manually counted (look at members table and add up total posts from each user for grand total).

Is it normal for the crawl to take such a short time?  (for slightly less than 20,000 posts and just fewer than 30 members)?

Next, I am trying a test run by importing the data into SMF 1.1.16 running locally on wamp  (I want to see and understand everything before I make the final decision to move to SMF, buy hosting, and go live).  It appears that I successfully imported the categories_fourms.sql and members.sql SQL batch files.  But when I try to import the topics_posts_smf.sql file, I get the following error:

(http://i148.photobucket.com/albums/s11/CharlesFoxtrot/phpMyAdmin_error2.jpg)

Once again, any help would be appreciated.

Thanks

EDIT:

Additional Information:
-the "topics_posts_smf.sql" file is 6,925 kb and, when opened with universal viewer, seems to contain the posts contents.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 24, 2012, 05:16:19 PM
Quote from: CF on January 24, 2012, 04:53:58 PM
Is it normal for the crawl to take such a short time?  (for slightly less than 20,000 posts and just fewer than 30 members)?

A board of that size can be crawled in less than 10 minutes if the server is cooperative. The crawler downloads each thread page and each member page, so the time taken is roughly proportional to the number of threads plus the number of users. If you have only a few threads with many pages each, the crawl can be very fast.

Quote from: CF on January 24, 2012, 04:53:58 PM
Next, I am trying a test run by importing the data into SMF 1.1.16 running locally on wamp  (I want to see and understand everything before I make the final decision to move to SMF, buy hosting, and go live).  It appears that I successfully imported the categories_fourms.sql and members.sql SQL batch files.  But when I try to import the topics_posts_smf.sql file, I get the following error:

[No data was received to import]

How big is the file? The default WAMP upload size is probably around 2MB, so if the topics_posts.sql file is bigger than that then the import will fail.

You have a few options:

1) Zip the file by itself (creating topics_posts.zip) and try uploading that. Zipping the file should shrink it by a substantial margin, up to 95% in many cases.
2) Edit the WAMP configuration to increase PHP's maximum file upload size (upload_max_filesize).
3) Use the provided split_sql.py utility (double-click to run) to split the SQL file into several smaller SQL files. Choose a filesize that is below the import limit; 800000 bytes (~780KB) usually works well.

I recommend trying the first option first, as it should work given your WAMP configuration.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: CF on January 24, 2012, 05:37:10 PM
Quote from: nneonneo on January 24, 2012, 05:16:19 PM
How big is the file? The default WAMP upload size is probably around 2MB, so if the topics_posts.sql file is bigger than that then the import will fail.

You have a few options:

1) Zip the file by itself (creating topics_posts.zip) and try uploading that. Zipping the file should shrink it by a substantial margin, up to 95% in many cases.
2) Edit the WAMP configuration to increase PHP's maximum file upload size (upload_max_filesize).
3) Use the provided split_sql.py utility (double-click to run) to split the SQL file into several smaller SQL files. Choose a filesize that is below the import limit; 800000 bytes (~780KB) usually works well.

I recommend trying the first option first, as it should work given your WAMP configuration.

Wow, right there on the image I uploaded, it says the maximum size and I never even noticed it.  Sorry, and thanks for being so patient. (Note: I edited my previous post with the size info while you were posting.)

I zipped the entire file and got it below the threshold.  I got a "Import has been successfully finished, 102 queries executed. (topics_posts_smf.sql.zip)" message, but the main forum is still showing zero threads and zero posts and the individual boards are empty when clicking from the main forum page.  However, threads and posts can be accessed by going through the " View the most recent posts on the forum" or the "More stats" link and clicking on the thread topics listed under "Top 10 Threads".


EDIT:  In the interim, I browsed through the threads I can access through the above-mentioned "back doors."  Wow.  Better transfer than I could have hoped for.  Formatting, photos, quotes . . . all seem good.  This is an awesome service you provide nneonneo. 
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on January 24, 2012, 05:41:14 PM
There are more instructions after the import; see Instructions.txt.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: CF on January 24, 2012, 05:46:58 PM
Quote from: nneonneo on January 24, 2012, 05:41:14 PM
There are more instructions after the import; see Instructions.txt.

Crap.  I thought I had read that somewhere.  I'm just full of fail today.

(But please see the edit to my above post.)


And that worked without a hitch.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: neojin3 on February 05, 2012, 08:14:38 PM
Dear nneonneo, my conversion from Zetaboards to SMF led to 3403 topics while my Zetaboards recount shows that I actually have 3542 topics. Any idea what would be the problem?
None of the sections are password protected.
There are certain sections that are accessible only to mods and 1 section that is only accessible to me.
There are no hidden sections but I'm not sure if limited access qualifies as "hidden".
Some topics are hidden and others are queued.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 05, 2012, 08:37:03 PM
Can you find a specific topic in the conversion that went missing? It might be a miscount on ZetaBoards.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: neojin3 on February 05, 2012, 08:39:24 PM
I wouldn't even know where to start to look for that. Zetaboards has recounted twice, once automatically and once by my request, so I don't think it's a miscount. Could the crawler have missed topics by members who have been deleted? I have a lot of that.

Here's the conditions in case you missed some of my edited-in stuff:
None of the sections are password protected.
There are certain sections that are accessible only to mods and 1 section that is only accessible to me.
There are no hidden sections but I'm not sure if limited access qualifies as "hidden".
Some topics are hidden and others are queued.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 05, 2012, 10:53:23 PM
Compare a few of the forums between Zetaboards and the new converted board. Set the number of topics per page to the same value so that you can tell whether the same topics show up in the same place.

EDIT: I've heard a fair bit about divergent counts with ZetaBoards, but so far, nobody has been able to find a specific topic which fails to be converted. If you can find such a topic, I can figure out how to fix the converter.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: neojin3 on February 06, 2012, 09:48:10 PM
I haven't gotten to installing the new board yet. I've encountered a problem installing.

An SMF-based free forum-hosting service is installing my data as one of their boards, but this is what the staff emailed me as the problem they have with my data: "This is not a full MySQL backup, please send me all the tables".

I gave them the following files:
1. topics_posts
2. members
3. categories_forums
What are they looking for?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 06, 2012, 10:10:29 PM
They're looking for a full database backup.

Either
a) import into a local SMF installation (use XAMPP or something to install a local webserver), or
b) tell them to just import those into a blank board.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: neojin3 on February 08, 2012, 07:48:00 PM
Dear nneonneo, how long does this installation take usually, and how complicated is it? He hasn't gotten back to me in 2 days..
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: neojin3 on February 09, 2012, 10:21:29 PM
The host is asking me what version of SMF the SQL files convert to..
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 10, 2012, 12:16:16 AM
1.1.x.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Dream of Omnimaga on February 12, 2012, 04:42:47 PM
It seems your script for Invisionfree might need to be updated for a few reasons:

1) All topics ends up being assigned to category #0.
2) The cookie script no longer works. It says it was unable to get the cookies. I thought this was because of the new Guest Welcome box feature IF added recently like the one on Zetaboards, but even after disabling it it still didn't work. As a result, before converting I had to manually create a blank cookie.txt file.
3) Would it be possible to allow parsing posts that has attachments in them? Your script choke on them and won't convert any topic containing attached images. It gives the following error:
ValueError: unconverted data remains:  <br />
<br />
<strong><span class='edit'>Attached File ( Number of downloads: 6 )</span></strong>
<br />
[url=http://z9.invisionfree.com/omnimaga/index.php?s=15c41ace77fe66124b05d32519c9af1b&amp;act=Attach&amp;type=post&amp;id=13584907' title='Download attachment]<img src='http://209.85.48.10/html/mime_types/quicktime.gif' border='0' alt='Attached File' />[/url]
&nbsp;[url=http://z9.invisionfree.com/omnimaga/index.php?s=15c41ace77fe66124b05d32519c9af1b&amp;act=Attach&amp;type=post&amp;id=13584907' title='Download attachment]GAME01.8xg [b](3.87 kb)[/b][/url]</div>

Invisionfree has no option to make attachments invisible and I don't want to delete those attachments completely already (for historical/nostalgia reasons, after the posts are converted, I want to keep the original board online, intact, as it has been since our move). I don't mind if it doesn't include the actual attachments, but just so it at least parse the post content above the attached files.

Note, I tried this on both SMF 1.1.5 (the required version) and 1.1.16 (the latest), after following all instructions to import topics and posts correctly, and it didn't work correctly. The Zetaboards conversion worked fine, though.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 12, 2012, 06:10:39 PM
What version of the Invisionfree converter are you using? I just tried version 0.2.1 (the one posted on the first topic), and it correctly grabs the cookie, assigns all categories and converts posts containing both binary and image attachments.

Try using 'http://z<number>.invisionfree.com/yourforum/index.php?' as the URL. The s<number> servers sometimes behave strangely.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Dream of Omnimaga on February 13, 2012, 06:14:18 PM
I used the one attached in the 2nd post of the topic. No version number was specified in the readme. I effectively used z9 too.

Could it be because I use custom board wrappers and CSS on the two Invisionfree boards?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 13, 2012, 06:20:09 PM
The version number is at the top of the file you run.

When you say "effectively", what do you mean? If you are trying to convert through a custom domain or some frame-wrapping domain, be aware that it may not work correctly or at all.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Dream of Omnimaga on February 14, 2012, 12:13:18 AM
I mean I had used z9.invisionfree.com, not s9.invisionfree.com. No custom domain name were used, either.

Could it be that I use Python 2.7 instead of 2.6? I couldn't find 2.6 anywhere...
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on February 14, 2012, 12:26:57 AM
2.7 works; it's what I'm using. Disable every customization and use the default theme, then try again.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: geoff691 on February 29, 2012, 03:27:56 PM
Hi guys.  I have left ProBoards and they gave me a text file with all my posts on it.

Is there any way I can transfer that to SMF ?

Thanks.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: bros on March 15, 2012, 07:27:10 PM
Trying to use this for a forum motion forum.

It is running into an issue because it is going too fast.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: bros on March 16, 2012, 06:36:39 PM
Never mind, got it working. Now trying to user pm_passwords and it does not work. says view a HTML file to see the error, it is just the login screen
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: geoff691 on May 10, 2012, 08:56:58 AM
Hi guys.  I have left ProBoards and they gave me a text file with all my posts on it.

Is there any way I can transfer that to SMF ?

Thanks.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: emanuele on May 10, 2012, 10:50:44 AM
Hello geoff691,

it depends on the file structure...(do not post it here)

ETA: it would be better if you open a new topic for this kind of requests I think. ;)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Lout on May 16, 2012, 09:40:22 PM
Worked great for me converting a Zetaboards forum with over 100,000 posts and 350+ members. Spoilers didn't work but that's not a major issue tbh.

Thanks for the hard work in creating the converter tool  :D
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: smagal on July 15, 2012, 08:06:53 AM
converter says that (for example): 'member 159... warning: member doesnt exist'
and also it says that topic id 765 is empty...
I try to convert phpbb2 forum from fora.pl (Polish host, they dont allow you to download your databese) but it doesnt work.

what do i do wrong?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: STRetard on July 16, 2012, 06:29:06 PM
Does the converter still work with moving from Yuku?

I tried to run it, it works up until the point of downloading forums. Board 1 completes with 0 topics, then it hangs at Finding topics for Board 2. Any ideas?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on July 16, 2012, 09:33:38 PM
@smagal: does it say that about all topics and posts? Or just some of them? phpBB2 converter should work with fora.pl, though you must ensure the board is in English and that the time format is "U".

@STRetard: Yuku converter should still work. Make sure you've enabled topic views, and changed all "blog" forums into regular forums.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: m0j0mann on July 18, 2012, 10:39:59 AM
Hi, I downloaded managed to get a hold of the proboards converter before it was removed, but I'm befuddled by this line in settings.py:

Quote# This variable is a "map" of ProBoards board shortnames to board passwords.
# Put the shortname followed by the password, both in single quotes.
BOARDPASSWORDS={''}

What exactly is it asking for?

Assuming you're still allowed to help people who already have the converter, I'd really appreciate some assistance.  :)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: struggler on July 22, 2012, 04:36:30 PM
Hey,

I'm trying to get away from Forumotion....

Pythonscript worked flawless, however I have problems imporing the members.sql

Whenever I try it get :

#1146 - Table 'test.smf_users' doesn't exist

I triplechecked if I had the wrong prefix but it is "smf_" in the settings.py aswell as in my installation.

I would appreciate any help.

could it be that this crawler doesn't work for the latest SMF 2.0.2 release (table name changes?) ?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on July 22, 2012, 04:38:29 PM
@struggler: Script specifically says it works only for SMF 1.3.x. Import to an SMF 1.3 board, then upgrade that to SMF 2.0.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: struggler on July 22, 2012, 04:40:21 PM
Ah...my bad. Thx for the hint. :)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: DamselStruction on August 09, 2012, 10:59:14 PM
Hello Everyone,

I am not very good with this kind of thing, so I'm going to ask some layman's questions here and I hope you can be patient with me.

I need to convert and Invisionfree Power Board to SMF. I need to know what I will need from Invisionfree to make this happen.

Will I simply need a (full database backup from Invisionfree) + a blank SMF forum of the correct series on my server to accept the database backup?

Is it that simple or much more complex than that?

Thanks very much for any assistance you can provide.

Jim
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on August 10, 2012, 03:07:53 AM
@DamselStruction: This Invisionfree converter is meant for users who can't (or won't) get a database backup from Invisionfree.

If you can get the backup, you should convert using the normal IPB 1.3 converter (http://www.simplemachines.org/community/index.php?topic=146211.0).

The process is almost as you describe, but the backup you get will need to be converted first. Follow the IPB converter's instructions at the posted link.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: hensko on September 18, 2012, 03:03:28 AM
Hi there!

I have an forum at forumup.com, and the are not willng to give me an backup of the database..  :(
They are using phpBB 2.0.23 and I´+m trying to get the crawle going..

I can get the users, but get some errors in convert_error.log
Member ID 2 (e-mail retrieval)
Traceback (most recent call last):
  File "./members_topics_posts_phpBB.py", line 222, in <module>
    dat[3]=re.findall('<input [^>]*name="email"[^>]*value="([^"]*)" />', adminda
ta)[0]
IndexError: list index out of range


The output is:
Downloading Members...
Member 1 ... Warning: Member doesn't exist!
Member 2 ... Exception: See convert_error.log
Member 2 ... Completed! User Password: 383877983212
Member 3 ... Warning: Member doesn't exist!
Member 4 ... Warning: Member doesn't exist!
Member 5 ... Warning: Member doesn't exist!
Downloading Forum Structure...
Categories ... Completed!
Smileys ... Completed!
Renumbering Posts
Elapsed Conversion Time 5.20 seconds
Converted 0 posts and 0 topics.
Complete! Press <enter> to exit.


And no critical errors..

Any ideas?
My skills in python is none, but shellscripting and php is my thing..  ;)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on September 18, 2012, 05:03:36 AM
Try this updated converter...
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: struggler on September 21, 2012, 09:13:45 AM
I'm still having a similar problem, with the forumotion converter . I am able to grab the users (with help of dions modified version, but which he posted on the phpbb forums.
However each topic/category grabbed has 0 posts/topics.

Any help would be (once again) appreciated!
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Se7yne on October 05, 2012, 11:01:01 PM
Hi nneonneo

I'm not too sure how to explain my problem so I hope this makes sense... I've made it through the first 3 steps with no issues and I think I've done everything right so far, but I'm stuck on step 4. I've never done anything like this so I'm sorry if I'm missing something obvious...

I'm trying to import the SQL files but I keep getting this error:

QuoteError
SQL query:

INSERT INTO  `smf_categories` ( ID_CAT, catOrder, name )
VALUES ( 1, 0,  'Welcome' ) ;


MySQL said:

#1054 - Unknown column 'catOrder' in 'field list'

I've tried importing the file a couple times, I've set the character set to UTF-8... I also tried copying the data directly into the SQL query window and got the same error message.

Do you have an idea what I'm doing wrong? Any help would be greatly appreciated!
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: zellogames on June 29, 2013, 09:39:56 PM
Hello,

I am trying to convert a zeta to the new SMF version
How can I do that?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Gwenwyfar on September 26, 2014, 06:22:05 AM
Would it be possible to adjust it to use local files? I keep getting errors (and etoxic is always trying to break this too) when trying to get forumotion, but other programs that download the entire site work fine. I tried just changing the url and putting it on a local server with link to localhost but it didn't work. Maybe if I upload the downloaded files to a host to have a normal url?

Edit: Still needs more adjustments than that, gives url not found error even when the files are in a server =/

I imagine it is trying to look for the links in the same manner they are in forumotion (with a slash and then the ids, nothing else in-between), but the local files have different links maybe.

Edit2: Nope, managed to get it to have the same structure, but it is looking for categories/structure by order of creation, so it attempts to get c0, which doesn't exist/gives not found error, then it doesn't move on, just keeps trying it again, and nothing gets added. Any simple way around this? I'm only getting categories/topics, nothing else. (Members give the same error though, url not found)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: margarett on September 26, 2014, 09:57:19 AM
I'm sorry but I don't think anyone here really knows how to "ride" these converters... Does anyone here knows Pyton? :P
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on September 26, 2014, 10:01:30 AM
Fortytwo: the easiest way may simply be to upload the relevant files to a webserver, but with the names changed to fit the converter's wants.

I do have a version that uses a local cache, but I haven't released it publicly.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Gwenwyfar on September 26, 2014, 10:05:11 AM
That's exactly what I have done, I've uploaded it to a subdomain on my SMF forum server. Still gives the same error. It has the same structure as the forumotion server, but it fails at the first step, c0.

When trying to use it "normally" it just gives topic empty on every topic too, so fixing it to work on a copy could still be easier than fixing whatever they did to break the script this time.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: nneonneo on September 26, 2014, 10:07:05 AM
The converter doesn't use the proper filenames from the server, because that would involve knowing the category, forum and topic titles in advance. Instead it just uses a dummy name, which Forumotion corrects to the proper URL.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: margarett on September 26, 2014, 10:09:31 AM
OT: Nice to see you back nneonneo :)
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Adrek on October 01, 2014, 03:14:48 PM
Is there crawler converter for SMF > SMF (or anything else)? Someone wants to move their forum from free hosted service and update to SMF 2.0 but admin doesn't want to help with it :|
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Gwenwyfar on December 15, 2014, 12:04:57 PM
Using the invisionfree converter now to merge two more old boards's history, works perfectly, no trouble in the crawling at all, thanks! :D

Just a couple details:
The smf files conversion is a bit problematic, it converted some column names wrong (which means import doesn't work, but its a simple fix by just updating the names, they are in a format like modifiedTime and posterName, when the actual name should be modified_time and poster_name). Nothing big, but if anyone else has the same issue, just need to replace those and it works.

And another thing: How do I import it without breaking latin characters? The sql file is fine, they're all there, but when I import it, it breaks them. Its not smf as I can make new posts with it fine. The SQL import format is the same I've used for all other imports, which worked fine too. Edit2: Fixed this one by changing the save format in the text editor to utf-8 :)

And for some reason, the topics are not showing inside the boards. I can go to them through the topic id, but the boards they're in show as empty. Any clues on what I could do to fix this? Repair didn't do anything to it, nor recount. Edit: Fixed this last issue by simply moving one topic somewhere else, fixed all boards :)

Now on to doing this with the other board and messing with numbers to merge the forums... Thanks again for making these converters!  :D
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Kenamura on February 23, 2015, 12:54:27 PM
So does this still work with FM(Forumotin)? also what does it do exactly and since FM is a closed DB type of forum host how does it work to preserve the member bade, topics, etc. I am possibly looking into converting a FM board over to SMF but im still on the fence about it. ive used SMF before in the past (like years ago lol) but ive never really converted a board nor really used a crawler. so in other words, if by using this what is the possible loss as well?
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Gwenwyfar on February 23, 2015, 01:04:31 PM
Unless he updated something since last time, unfortunately no... They already broke it again, and I had little luck with his beta converter as well  :(
Forumotion is such a &%$#@.

There is a guy that does paid conversions though, Dion (http://www.dion-designs.com/). He can do the whole work for you, or if you want to pay less you just run the script yourself and he helps you through the process. Its what I did, had no problems at all.

Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Kenamura on February 23, 2015, 01:22:50 PM
Aye only problem i have is the paid part haha! I don't have much right now in the means of actually providing any cash to have this done for me it is why i was looking around to see if i could do it myself, never had much issues with these sort of things. Plus im not even sure if we would end up switching over since i am only one of a few admins on the site so i cant make said choice by myself. Mostly trying to find out the simplest and cheapest means to do it.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Gwenwyfar on February 23, 2015, 01:27:53 PM
I didn't have any either, I had to wait a while before I could do it, but there's no other easy choice unless you're willing to make something to get the data yourself or get all the topics manually :P

nneoneo is the only one that has a free convertor for forumotion as far as I know, but since it is open to anyone they always keep breaking it :/

I paid only $40 for running the script myself though.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: Kenamura on February 23, 2015, 01:32:19 PM
Aye that is no fun, i use to do that before XD was never any fun.

Hmm only 40 huh? hmm might have to think on that could probably set money aside for this possible endeavor
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: goosekeeper on October 26, 2015, 07:18:40 PM
Anyone have any luck using this script for Yuku recently?

I receive a Critical Error, but it's blank.  The process appears to work correctly until conversion where every Topic receives the following error: Error: Topic is empty!.

Thanks for any help.
Title: Re: [SMF Converter] Invisionfree/ActiveBoards/iPBfree
Post by: CalPablito on July 10, 2022, 01:41:19 PM
Does this still work for Forumotion?
They dont make their databases available to admins and their forum sucks but we want to keep our last year of posts