Simple Machines Community Forum

SMF Support => Converting to SMF => IPB => Topic started by: emanuele on May 17, 2012, 03:44:15 PM

Title: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on May 17, 2012, 03:44:15 PM
This is a beta, don't expect to obtain a working forum at the end of the process!
Better safe than sorry. :P

New files posted here (http://www.simplemachines.org/community/index.php?topic=477019.msg3339363#msg3339363)
New files posted here (http://www.simplemachines.org/community/index.php?topic=477019.msg3341342#msg3341342)
New files posted here (http://www.simplemachines.org/community/index.php?topic=477019.msg3364303#msg3364303)

How to redirect IPB URLs to SMF: here (http://www.simplemachines.org/community/index.php?topic=480648.msg3371679#msg3371679)

Mod Mark kindly provided me a backup of an IPB 3.2 board.
Starting from the IPB 3.0 converter I tried to obtain something working.

Now I get at least a forum up, there are still a couple of problems with PMs, notifications and calendar.

Personal Messages
I had to change the query and I'm not sure if the result is correct: if you can you should check bot if you see all the recipients of a certain PM and if you have *only* the PMs you are supposed to have.

Notifications and calendar
I have no idea where these two are kept...

So, if you have any IPB 3.2 forum that you would like to convert to SMF 2.0 and you have the possibility to test it and provide feedback, please do so! :D
Title: Re: [WIP - Converter] IPB 3.2
Post by: Robert. on May 17, 2012, 05:18:09 PM
Nice work Emanuele :)
Title: Re: [WIP - Converter] IPB 3.2
Post by: fhsds on May 18, 2012, 05:28:01 AM
IPB 3.2.2 -> SMF 2.0.2 UTF :

QuoteConverting settings...
Warning: filemtime() [function.filemtime]: stat failed for /Settings.php in \localhost\www\forum\Sources\Subs-Admin.php on line 249

Warning: file_get_contents(/Settings.php) [function.file-get-contents]: failed to open stream: No such file or directory in \localhost\www\forum\Sources\Subs-Admin.php on line 252
Successful.
Recalculating forum statistics... Successful.
Title: Re: [WIP - Converter] IPB 3.2
Post by: Herman's Mixen on May 18, 2012, 07:31:12 AM
Nice job :P

sometimes PHP wont let do things ask your host about it .. they can limit sometimes ;)
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on May 18, 2012, 08:43:26 AM
Quote from: fhsds on May 18, 2012, 05:28:01 AM
QuoteConverting settings...
Warning: filemtime() [function.filemtime]: stat failed for /Settings.php in \localhost\www\forum\Sources\Subs-Admin.php on line 249

Warning: file_get_contents(/Settings.php) [function.file-get-contents]: failed to open stream: No such file or directory in \localhost\www\forum\Sources\Subs-Admin.php on line 252
Successful.
Recalculating forum statistics... Successful.
Wrong path for Settings.php?...
Title: Re: [WIP - Converter] IPB 3.2
Post by: carlospok on May 18, 2012, 08:52:47 AM
I made my coverter and... convert all but wen i look the forum not appears the members, posts, topic :S
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on May 18, 2012, 09:31:24 AM
Can you please create a new SMF install, update the converter and send me a PM so that I can check the conversion process?
Title: Re: [WIP - Converter] IPB 3.2
Post by: fhsds on May 18, 2012, 12:46:16 PM
Quote from: emanuele on May 18, 2012, 08:43:26 AM
Wrong path for Settings.php?...
no.
& users'passwords not converted too

can you publish instructions for the conversion with this converter?
mysql bases of ipb and smf should be shared?
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on May 18, 2012, 01:18:58 PM
Basic instructions are:
1) install SMF (in a different directory and in the database you prefer, it can be the same or another one[1])
2) upload the two files of converter to the SMF directory
3) go to http://yourforum.tld/SMF_forum/convert.php
4) follow the instructions
5) happy ending...hopefully! :P

I feel I left some debug informations into the file...if you see many errors it could simply be that...or not...will check later.



[1] Regarding the database you can use two different databases only if they share the same MySQL user or if the two users can execute these SQL commands on both databases: SELECT, INSERT, REPLACE and DELETE.
If you are unsure you can simply install SMF in the same database as IPB, that will cut down any db-user related problem. ;)
Title: Re: [WIP - Converter] IPB 3.2
Post by: carlospok on May 18, 2012, 05:12:22 PM
I edit the 3.0 converter to 3.3.0, and all rules, but i can viwe the posts and users it's the bad part u.u
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on May 18, 2012, 05:23:33 PM
This converter *should* work with IPB 3.2, at the moment I have no idea of the differences between IPB 3.2 and 3.3...
If you can show me the database of an IPB 3.3 forum I can try to imagine what it should be changed to make it work with the new version...
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on May 22, 2012, 02:41:54 PM
Okay, here it is a second attempt.

Fixes from the first one:
1) now board moderators are properly converted without generate any error
2) members' post count is restored.
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on May 22, 2012, 04:38:13 PM
I don't have IPB 3.2 but I tried it with 3.3.2 -

Converting attachments...
Fatal error: Call to undefined function getAttachmentFilename() in C:\Program Files (x86)\Ampps\www\smfipb2\convert.php(1251) : eval()'d code on line 18


Anyway, I can login, with my IPB password and i guess it seems to work fine, except this error :)

Great job! :)
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on May 22, 2012, 05:02:07 PM
Cool... :D

I was going to install your backup and see what were the differences with 3.2.

BTW the error seems strange...
I'm wondering if the attachments are converted properly...
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on May 22, 2012, 05:07:49 PM
Quote from: emanuele on May 22, 2012, 05:02:07 PM
I'm wondering if the attachments are converted properly...
No - "There are currently no attachments."
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on May 22, 2012, 05:10:45 PM
ehh...

If you want to try again, at line 330 you find:
require_once($sourcedir . '/Load.php');

add after or before it:
require_once($sourcedir . '/Subs.php');
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on May 23, 2012, 03:50:27 AM
Now it works perfect :D Of course, converter needs more testers but it's almost done :)

And as always there are problems with charset (because my IPB was in ISO...) :)
Title: Re: [WIP - Converter] IPB 3.2
Post by: ssullivan on May 23, 2012, 06:39:52 AM
Quote from: phantomm on May 23, 2012, 03:50:27 AM
Now it works perfect :D Of course, converter needs more testers but it's almost done :)

And as always there are problems with charset (because my IPB was in ISO...) :)
Shouldn't that be solved using the same charset in both tables?
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on May 23, 2012, 06:45:48 AM
Have no idea, but this isn't related to converter, I'm sure that I messed up something in my db.
There are some glitches after changing language from English ISO to Polish UTF8, but I think that this is for another topic, and besides that I am testing converter for IPB 3.2 with IPB 3.3, so some errors are expected :)
Title: Re: [WIP - Converter] IPB 3.2
Post by: Elizabeth II on May 23, 2012, 12:22:32 PM
ok works good but 1 thing how do i get rid of all this?

http://****************/forum//public/style_emoticons/<#EMO_DIR#>/smile.png\' class=\'bbc_emoticon\' alt=\'\' />

it shows that when a emoticons are used
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on May 23, 2012, 01:06:59 PM
mmm that would require a lot of work to fix...in fact the converter should parse each and every message to fix the smiley...I don't even know if the result would work.
Title: Re: [WIP - Converter] IPB 3.2
Post by: Elizabeth II on May 23, 2012, 01:21:13 PM
Quote from: emanuele on May 23, 2012, 01:06:59 PM
mmm that would require a lot of work to fix...in fact the converter should parse each and every message to fix the smiley...I don't even know if the result would work.

So I guess it didnt :( So how do I fix it or remove all this??
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on May 23, 2012, 01:58:44 PM
Let me play a bit more with the converter, and let's see...
Title: Re: [WIP - Converter] IPB 3.2
Post by: Elizabeth II on May 23, 2012, 02:52:18 PM
is there anyway without re-converting? I've reorganized my board and all and I really dont wanna do it all again :(
Title: Re: [WIP - Converter] IPB 3.2
Post by: Sefket on May 23, 2012, 06:06:56 PM
I got this:

    SELECT
    m.member_id AS id_member, SUBSTRING(m.name, 1, 80) AS member_name,
    SUBSTRING(m.members_display_name, 1, 255) AS real_name, m.email AS email_address,
    SUBSTRING(m.members_pass_hash, 1, 64) AS passwd, SUBSTRING(m.members_pass_salt, 1, 8) AS password_salt,
    m.title AS usertitle, m.last_visit AS last_login,
    m.joined AS date_registered, SUBSTRING(pc.field_3, 1, 255) AS website_url,
    SUBSTRING(pc.field_3, 1, 255) AS website_title,
    SUBSTRING(pc.field_4, 1, 255) AS icq, SUBSTRING(pc.field_1, 1, 16) AS aim,
    SUBSTRING(pc.field_8, 1, 32) AS yim, SUBSTRING(pc.field_2, 1, 255) AS msn,
    SUBSTRING(pp.signature, 1, 65534) AS signature, m.ip_address AS member_ip, m.ip_address AS member_ip2, '0' AS total_time_logged_in,
    IF (m.bday_year IS NULL, '0001-01-01', IF (m.bday_year = 0 AND m.bday_month != 0 AND m.bday_day != 0, CONCAT('0004-', m.bday_month, '-', m.bday_day), CONCAT_WS('-', IF(m.bday_year <= 4, '0001', m.bday_year), IF(m.bday_month = 0, '01', IF(m.bday_month < 10, CONCAT('0', m.bday_month), m.bday_month)), IF(m.bday_day = 0, '01', IF(m.bday_day < 10, CONCAT('0', m.bday_day), m.bday_day))))) AS birthdate,
    CASE
    WHEN (m.member_group_id = '4') THEN 1
    WHEN (m.member_group_id = '2') THEN -1
    WHEN (m.member_group_id = '6') THEN 2
    ELSE 0
    END AS id_group,
    CASE
    WHEN (pc.field_5 = 'm') THEN 1
    WHEN (pc.field_5 = 'f') THEN 2
    ELSE 0
    END AS gender
    FROM `dbhidden`.members AS m
    LEFT JOIN `dbhidden`.pfields_content AS pc ON (pc.member_id = m.member_id)
    LEFT JOIN `dbhidden`.profile_portal AS pp ON (pp.pp_member_id = m.member_id)
    LIMIT 0, 500;

Caused the error:

    Unknown column 'pc.field_4' in 'field list'
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on May 24, 2012, 05:33:33 AM
Quote from: Mod Mark on May 23, 2012, 02:52:18 PM
is there anyway without re-converting? I've reorganized my board and all and I really dont wanna do it all again :(
Well...yes, I think a script can be created to handle this.

@Sefket
The only think I can suggest you is to open the .sql file, find:
SUBSTRING(pc.field_4, 1, 255) AS icq, SUBSTRING(pc.field_1, 1, 16) AS aim,
and replace it with:
SUBSTRING(pc.field_1, 1, 16) AS aim,
or remove it entirely.
Title: Re: [WIP - Converter] IPB 3.2
Post by: Sefket on May 24, 2012, 08:25:49 PM
Removed it. Got this now:

Converting members... Unsuccessful!
This query:

    SELECT
    m.member_id AS id_member, SUBSTRING(m.name, 1, 80) AS member_name,
    SUBSTRING(m.members_display_name, 1, 255) AS real_name, m.email AS email_address,
    SUBSTRING(m.members_pass_hash, 1, 64) AS passwd, SUBSTRING(m.members_pass_salt, 1, 8) AS password_salt,
    m.title AS usertitle, m.last_visit AS last_login,
    m.joined AS date_registered, SUBSTRING(pc.field_3, 1, 255) AS website_url,
    SUBSTRING(pc.field_3, 1, 255) AS website_title,
    SUBSTRING(pc.field_4, 1, 255) AS icq,
    SUBSTRING(pc.field_8, 1, 32) AS yim, SUBSTRING(pc.field_2, 1, 255) AS msn,
    SUBSTRING(pp.signature, 1, 65534) AS signature, m.ip_address AS member_ip, m.ip_address AS member_ip2, '0' AS total_time_logged_in,
    IF (m.bday_year IS NULL, '0001-01-01', IF (m.bday_year = 0 AND m.bday_month != 0 AND m.bday_day != 0, CONCAT('0004-', m.bday_month, '-', m.bday_day), CONCAT_WS('-', IF(m.bday_year <= 4, '0001', m.bday_year), IF(m.bday_month = 0, '01', IF(m.bday_month < 10, CONCAT('0', m.bday_month), m.bday_month)), IF(m.bday_day = 0, '01', IF(m.bday_day < 10, CONCAT('0', m.bday_day), m.bday_day))))) AS birthdate,
    CASE
    WHEN (m.member_group_id = '4') THEN 1
    WHEN (m.member_group_id = '2') THEN -1
    WHEN (m.member_group_id = '6') THEN 2
    ELSE 0
    END AS id_group,
    CASE
    WHEN (pc.field_5 = 'm') THEN 1
    WHEN (pc.field_5 = 'f') THEN 2
    ELSE 0
    END AS gender
    FROM `dbhhiden`.members AS m
    LEFT JOIN `dbhhiden`.pfields_content AS pc ON (pc.member_id = m.member_id)
    LEFT JOIN `dbhhiden`.profile_portal AS pp ON (pp.pp_member_id = m.member_id)
    LIMIT 0, 500;

Caused the error:

    Unknown column 'pc.field_4' in 'field list'
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on May 25, 2012, 02:42:03 AM
Remove also
   SUBSTRING(pc.field_4, 1, 255) AS icq,
Title: Re: [WIP - Converter] IPB 3.2
Post by: Sefket on May 25, 2012, 12:32:52 PM
Yup. Now I got this:

Converting members... Unsuccessful!
This query:

    SELECT
    m.member_id AS id_member, SUBSTRING(m.name, 1, 80) AS member_name,
    SUBSTRING(m.members_display_name, 1, 255) AS real_name, m.email AS email_address,
    SUBSTRING(m.members_pass_hash, 1, 64) AS passwd, SUBSTRING(m.members_pass_salt, 1, 8) AS password_salt,
    m.title AS usertitle, m.last_visit AS last_login,
    m.joined AS date_registered, SUBSTRING(pc.field_3, 1, 255) AS website_url,
    SUBSTRING(pc.field_3, 1, 255) AS website_title,
    SUBSTRING(pc.field_8, 1, 32) AS yim, SUBSTRING(pc.field_2, 1, 255) AS msn,
    SUBSTRING(pp.signature, 1, 65534) AS signature, m.ip_address AS member_ip, m.ip_address AS member_ip2, '0' AS total_time_logged_in,
    IF (m.bday_year IS NULL, '0001-01-01', IF (m.bday_year = 0 AND m.bday_month != 0 AND m.bday_day != 0, CONCAT('0004-', m.bday_month, '-', m.bday_day), CONCAT_WS('-', IF(m.bday_year <= 4, '0001', m.bday_year), IF(m.bday_month = 0, '01', IF(m.bday_month < 10, CONCAT('0', m.bday_month), m.bday_month)), IF(m.bday_day = 0, '01', IF(m.bday_day < 10, CONCAT('0', m.bday_day), m.bday_day))))) AS birthdate,
    CASE
    WHEN (m.member_group_id = '4') THEN 1
    WHEN (m.member_group_id = '2') THEN -1
    WHEN (m.member_group_id = '6') THEN 2
    ELSE 0
    END AS id_group,
    CASE
    WHEN (pc.field_5 = 'm') THEN 1
    WHEN (pc.field_5 = 'f') THEN 2
    ELSE 0
    END AS gender
    FROM `dbhidden`.members AS m
     LEFT JOIN `dbhhiden`.pfields_content AS pc ON (pc.member_id = m.member_id)
    LEFT JOIN `dbhhiden`.profile_portal AS pp ON (pp.pp_member_id = m.member_id)
    LIMIT 0, 500;

Caused the error:

    Unknown column 'pc.field_8' in 'field list'
Title: Re: [WIP - Converter] IPB 3.2
Post by: Sefket on May 25, 2012, 01:58:00 PM
Okay, I removed that. Now here is what I get:

Converting...
Converting members...
Incomplete.
Not quite done yet!
This conversion has paused to avoid overloading your server, and hence not working properly.
Don't worry though, nothing's wrong - simply click the continue button below to start the converter from where it left off.

Edit: Seems to be going good so far.
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on May 25, 2012, 02:19:48 PM
It's possible you don't have some instant messaging fields, remove:
SUBSTRING(pc.field_8, 1, 32) AS yim,
should do the trick.
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on May 25, 2012, 03:21:31 PM
And here it is another try.

Things fixed:
1) the smiley are now converted from links to only the code (I hope this wont break any other image...)
2) the quotes are now properly converted to SMF format.

@Mod Mark now that this version is up, I'm working on a way to fix your smiley! ;)
Title: Re: [WIP - Converter] IPB 3.2
Post by: Sefket on May 25, 2012, 08:31:52 PM
@eman - if I provide you a database for IPB 3.3, would you able to make a converter from it?
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on May 26, 2012, 08:41:55 AM
@Sefket, did you try current version? I converted my IPB 3.3.2 to SMF 2.0.2 few days ago :)
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on May 26, 2012, 11:11:45 AM
I have one from phantomm, but since he confirmed it was working I didn't touch it.

It seems you have indeed something different...if you want to give me the db feel free, I'll check at the differences.
Title: Re: [WIP - Converter] IPB 3.2
Post by: Sefket on May 26, 2012, 01:59:35 PM
Quote from: phantomm on May 26, 2012, 08:41:55 AM
@Sefket, did you try current version? I converted my IPB 3.3.2 to SMF 2.0.2 few days ago :)

Oh really? Interesting. It worked with this converter?
Title: Re: [WIP - Converter] IPB 3.2
Post by: Sefket on May 26, 2012, 05:34:29 PM
I got this from 3.3.1:

Converting...

Notice: Undefined index: convert_script in /home/pitbull/public_html/smf/convert.php on line 969

Warning: Invalid argument supplied for foreach() in /home/hidden/public_html/smf/convert.php on line 972

Notice: Undefined index: convert_script in /home/hidden/public_html/smf/convert.php on line 984
Successful.
Recalculating forum statistics...
Notice: Undefined variable: result in /home/hidden/public_html/smf/convert.php on line 2491

Notice: Undefined variable: result in /home/hidden/public_html/smf/convert.php on line 2492

Notice: Undefined index: db_fetch_assoc in /home/hidden/public_html/smf/convert.php on line 1383

Fatal error: Function name must be a string in /home/hidden/public_html/smf/convert.php on line 1383
Title: Re: [WIP - Converter] IPB 3.2
Post by: Sefket on May 27, 2012, 03:41:24 PM
That part got fixed as I just restarted the convert.

After a day, I got this:

Fatal error: Wrong value type sent to the database. Integer expected. (id_pm)(convert.php-2636) in /home/hidden/public_html/smf/Sources/Subs-Db-mysql.php on line 684
Title: Re: [WIP - Converter] IPB 3.2
Post by: Sefket on May 27, 2012, 05:07:12 PM
Okay, I managed to fix it by raising the number at the end of the URL.

Now I get this:

Converting...
Converting personal messages (step 1)...
Successful.
Converting personal messages (step 2)...Duplicate entry '555-4' for key 1
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on May 28, 2012, 03:47:17 AM
From time to time I encountered similar errors, to mitigate the problem I lowered the number of records elaborated at each step, in that last case, for example you could open ipb3_to_smf.sql, find:
Code (find) Select
/******************************************************************************/
--- Converting personal messages (step 2)...
/******************************************************************************/

TRUNCATE {$to_prefix}pm_recipients;

---* {$to_prefix}pm_recipients
---{
$no_add = true;


and replace it with:
/******************************************************************************/
--- Converting personal messages (step 2)...
/******************************************************************************/

TRUNCATE {$to_prefix}pm_recipients;

---* {$to_prefix}pm_recipients 20
---{
$no_add = true;


See the 20 after ---* {$to_prefix}pm_recipients?
If you encounter again the problem try with a lower number...
Title: Re: [WIP - Converter] IPB 3.2
Post by: Ventic on June 06, 2012, 09:33:21 AM
Notice: Undefined index: convert_script in /home/gamingp1/public_html/gp/convert.php on line 969

Warning: Invalid argument supplied for foreach() in /home/gamingp1/public_html/gp/convert.php on line 972

Notice: Undefined index: convert_script in /home/gamingp1/public_html/gp/convert.php on line 984
Successful.
Recalculating forum statistics...
Notice: Undefined variable: result in /home/gamingp1/public_html/gp/convert.php on line 2491

Notice: Undefined variable: result in /home/gamingp1/public_html/gp/convert.php on line 2492

Notice: Undefined index: db_fetch_assoc in /home/gamingp1/public_html/gp/convert.php on line 1383

Fatal error: Function name must be a string in /home/gamingp1/public_html/gp/convert.php on line 1383


?

edit:fixed
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on June 06, 2012, 10:24:18 AM
So it works now?
Title: Re: [WIP - Converter] IPB 3.2
Post by: Ventic on June 06, 2012, 10:28:42 AM
yes but why it takes many time in topics and after 5 minutes it stuck?
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on June 06, 2012, 10:53:38 AM
Well, the converter doesn't take *everything* in one go and do the conversion, it goes step by step with few topics/messages/PMs at a time and convert those.

I'm not sure: did you finish successfully the conversion or are you stuck somewhere? (and if so, where?)
Title: Re: [WIP - Converter] IPB 3.2
Post by: Ventic on June 06, 2012, 04:24:21 PM
while converting topics,it get stucked

Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on June 06, 2012, 04:49:15 PM
Is there any error? (Those you reported above should be from the last step, the recounting of the totals)
Title: Re: [WIP - Converter] IPB 3.2
Post by: Ventic on June 06, 2012, 04:51:26 PM
Quote from: emanuele on June 06, 2012, 04:49:15 PM
Is there any error? (Those you reported above should be from the last step, the recounting of the totals)
those errors plus a DUPLICATE SQL ERROR
Title: Re: [WIP - Converter] IPB 3.2
Post by: Abdel on June 07, 2012, 08:08:59 AM
Hello,
my converter stops at post:
http://smf.forum.mage.pl/convert.php?step=1&substep=9&start=18400
without any error.

Any clues for solve?
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on June 07, 2012, 08:15:24 AM
Quote from: Ventic on June 06, 2012, 04:24:21 PM
while converting topics,it get stucked
That seems to be a server load problem...I got it around topic 2500, I had to skip few substeps by hand. For now I incresed the timeout and is going on...let's wait.

Quote from: Abdel on June 07, 2012, 08:08:59 AM
Hello,
my converter stops at post:
http://smf.forum.mage.pl/convert.php?step=1&substep=9&start=18400
without any error.

Any clues for solve?
Honestly no idea, but the moment I clicked on the link you provided the process completed recalculating all the statistics.
Check if the forum is fine, could be a curious bug in upgrade.php
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on June 07, 2012, 08:22:08 AM
Quote from: Abdel on June 07, 2012, 08:08:59 AM
Hello,
my converter stops at post:

I had this couple times, and what I remember this is problem on big boards, converter needs more time to move posts from old to new db.
I think that somewhere in this board as solution was given increasing execution time for php scripts
Title: Re: [WIP - Converter] IPB 3.2
Post by: Abdel on June 07, 2012, 08:23:02 AM
Quote from: Abdel on June 07, 2012, 08:08:59 AM
Hello,
my converter stops at post:
http://smf.forum.mage.pl/convert.php?step=1&substep=9&start=18400
without any error.

Any clues for solve?
Honestly no idea, but the moment I clicked on the link you provided the process completed recalculating all the statistics.
Check if the forum is fine, could be a curious bug in upgrade.php
[/quote]

Unluckily many post were not converted. I tried it secound time and got stuck in the same place. Also what is quite weird no topics are avaliable on any board after conversion.

Quote
I think that somewhere in this board as solution was given increasing execution time for scripts
I am on VPS with max execution time 300 secdounds and 300 MB RAM. Did many conversion before and never execution time was problem.
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on June 07, 2012, 12:50:24 PM
Update for  Ventic: there is a basic problem with your host that from time to time hangs due to server load.
I tried lower the number of topics conversion per step down to 1 but still it presents this issue. Now I'm downloading a dump of your database and I'll try the conversion on my machine, if successful I'll upload the converted database.
Title: Re: [WIP - Converter] IPB 3.2
Post by: Ventic on June 07, 2012, 04:09:00 PM
ok thanks
Title: Re: [WIP - Converter] IPB 3.2
Post by: Ventic on June 07, 2012, 05:13:58 PM
Converting members...Field 'buddy_list' doesn't have a default value

my problem while trying to convert it in localhost
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on June 10, 2012, 03:59:11 AM
just to be sure, does it convert all child boards correctly (with structure from IPB)?
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on June 10, 2012, 04:21:30 AM
If (there is still a glitch sometime) it end correctly without error the recount of the statistics it should convert everything correctly, including the sub-boards structure.

For the "glitch" the workaround could be to change:
// If we have $convert_script then set it to the session.
if (!empty($convert_script))
$_SESSION['convert_script'] = $convert_script;
if (isset($_SESSION['convert_script']) && file_exists(dirname(__FILE__) . '/' . $_SESSION['convert_script']) && preg_match('~_to_smf\.(php|sql)$~', $_SESSION['convert_script']) != 0)
{
if (substr($_SESSION['convert_script'], -4) == '.php')
preparse_php(dirname(__FILE__) . '/' . $_SESSION['convert_script']);
else
preparse_sql(dirname(__FILE__) . '/' . $_SESSION['convert_script']);
}
else
unset($_SESSION['convert_script']);


to
// If we have $convert_script then set it to the session.
if (!empty($convert_script))
$_SESSION['convert_script'] = $convert_script;
if (isset($_SESSION['convert_script']) && file_exists(dirname(__FILE__) . '/' . $_SESSION['convert_script']) && preg_match('~_to_smf\.(php|sql)$~', $_SESSION['convert_script']) != 0)
{
if (substr($_SESSION['convert_script'], -4) == '.php')
preparse_php(dirname(__FILE__) . '/' . $_SESSION['convert_script']);
else
preparse_sql(dirname(__FILE__) . '/' . $_SESSION['convert_script']);
}
else
findConvertScripts();
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on June 10, 2012, 05:00:36 AM
still only few child boards are in structure, others are moved to 'general category' as regular boards :|
anyway, forum with more than 300 000 post is converted successfully (IPB 3.3.0 => SMF 2.0.2) :)

//edit:

I noticed that some of 'child child boards' are converted, but normal 'child boards' are not
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on June 11, 2012, 02:58:13 AM
On the forum I used for test the result seemed to be exactly as expected, but honestly I'm not 100% sure...
Title: Re: [WIP - Converter] IPB 3.2
Post by: Luc-i on June 11, 2012, 07:49:35 AM
Does it works for 3.2.3 also?

I tried but always get the error


...the database connection information used in the specifed installation of smf cannot access the installation of IPB 3.2
this may either mean that the installation doesnt exist or that the database account used does not have permission to access it.
"SELECT COMMAND DENIED TO USER "xxxyyyy" for table members.


i have installed the SMF on subdomain using another SQL database with same database password like the mysql ipb password.

Maybe someone could gimme a hint.

Thank you.
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on June 11, 2012, 08:54:45 AM
It was written for 3.2.x series.
You have to use the same user and password in db from IPB and SMF.
Title: Re: [WIP - Converter] IPB 3.2
Post by: Luc-i on June 12, 2012, 01:26:41 AM
Quote from: phantomm on June 11, 2012, 08:54:45 AM
It was written for 3.2.x series.
You have to use the same user and password in db from IPB and SMF.

Thank you.

Then i need to install SMF in the same Database as IPB. I couldnt change DB-Username at my hoster or it is possible over Phpmyadmin?

Thanks again
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on June 12, 2012, 02:13:57 AM
honestly I don't know, never tried it (I change users in DirectAdmin...), but if you make backup and IPB will have different table prefix than SMF tables there shouldn't be any problems ;)
Title: Re: [WIP - Converter] IPB 3.2
Post by: Ventic on June 14, 2012, 10:06:06 AM
problem with login and posts will get fixed? :/
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on June 14, 2012, 10:45:19 AM
Quote from: Ventic on June 14, 2012, 10:06:06 AM
problem with login
As I said somewhere this is not a problem that can be fixed by any converter: the password saved into the database is encrypted both on IPB side(I hope at least) and SMF side, most likely with two different methods.
Convert the password would mean: decrypt the IPB user's password and re-encrypt it in SMF.
The problem is: it's not possible to decrypt the password (well, it could be possible but it would take years for each password, I don't think you want to have a conversion that last 1 year for each of your members).
So this is not something that can be fixed.
Although if you know how IPB does the encryption you can copy the password too during the conversion and then write a sort of internal bridge that uses the IPB password and encryption method to log into SMF.
(I'm not going to code something similar, so if anyone wants to do it feel free).

Quote from: Ventic on June 14, 2012, 10:06:06 AM
and posts will get fixed? :/
What's the problem with posts?
Title: Re: [WIP - Converter] IPB 3.2
Post by: Ventic on June 14, 2012, 11:53:51 AM
it shows i got 23000 posts.though i never had such posts
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on June 25, 2012, 12:57:35 PM
It took a while...

Try these files, same procedure as the converter:
* upload both into SMF's directory
* point to convert.php (if it asks for a IPB config file just pu a dummy one in the same directory of SMF)
* start the procedure.

It should recount the users' posts.
Title: Re: [WIP - Converter] IPB 3.2
Post by: mileni on June 26, 2012, 10:05:51 PM
I get this while trying to convert:

Duplicate entry '5844' for key 'PRIMARY'

Can this be solved in any way? I'm using latest converter in this topic, and ipb 3.2.3.

Thx in advance :)
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on June 27, 2012, 03:41:34 AM
The only solution I found is to reduce the number of "things" (topics in that case) at each step.
Have a look at this post:
http://www.simplemachines.org/community/index.php?topic=477019.msg3342593#msg3342593
and instead of ---* {$to_prefix}pm_recipients search for ---* {$to_prefix}topics
Title: Re: [WIP - Converter] IPB 3.2
Post by: mileni on June 27, 2012, 12:37:32 PM
That helped... But now i get to this part and I'm stuck:
"Recounting post counts... "

No errors are shown...
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on June 27, 2012, 01:23:13 PM
Okay, I think I forgot to update the original package...
Can you try the instructions present in this post:
http://www.simplemachines.org/community/index.php?topic=477019.msg3349839#msg3349839
and see if it works?

If so I'll update the script.
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on June 28, 2012, 06:15:06 AM
Quote from: emanuele on June 25, 2012, 12:57:35 PM
It took a while...

What does this fix? When I have to apply it?

nevermind... can't convert properly Polish letters and emoticons from 3.3.3... :/
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on June 28, 2012, 01:47:42 PM
The file above was for ventic.

Letters in names are a problem, letters in the posts I didn't notice problems, but it could be I didn't actually see the error.
Are you using UTF8?
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on June 28, 2012, 02:00:28 PM
IPB is in ISO (latin1), SMF in UTF8.

But Polish characters can be easily fixed in Notepad++. Bigger problem are this broken emoticons links.
In IPB database it is saved as:
<img src='http://example.com/public/style_emoticons/<#EMO_DIR#>/125.gif' class='bbc_emoticon' alt=':)' />
after conversion:
<img src=\\''http://example.com/public/style_emoticons/<#EMO_DIR#>/125.gif\\'' class=\\''bbc_emoticon\\'' alt=\\'':)\\'' />

or links in signature (after finished conversion):

<p>[center][url=\\\\\\\"http://example.com\\\\\\\"][img]http://img803.imageshack.us/img803/4601/smfpluserbarv3.png[/img][/url]<br />
<br />
[url=\\\\\\\"http://example.com\\\\\\\"][img]https://www.unixstorm.org/images/UNIXSTORM-banner7.png[/img][/url][/center]</p>

Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on June 28, 2012, 02:02:52 PM
mmm...I'd avoid such conversion...
Try ISO => ISO and then convert SMF to UTF8 if you want to have it in UTF8.
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on June 28, 2012, 02:22:25 PM
it's even worse when i try to convert it to ISO

This is really hopeless situation, there is no way to move this site to SMF :|
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on June 28, 2012, 03:52:27 PM
Is it the one you sent me?
Maybe I still have it around...
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on June 29, 2012, 02:36:48 AM
yes, it's the same db, but with more posts (8000)
Title: Re: [WIP - Converter] IPB 3.2
Post by: mileni on June 29, 2012, 09:25:43 PM
Quote from: emanuele on June 27, 2012, 01:23:13 PM
Okay, I think I forgot to update the original package...
Can you try the instructions present in this post:
http://www.simplemachines.org/community/index.php?topic=477019.msg3349839#msg3349839
and see if it works?

If so I'll update the script.

Just skipped those steps manually via adress bar (step=11, I just entered step=12, etc.). And all went rather well. Couldn't convert avatars, but that's just a small problem and not a big thing to me at all.

Anyway, I really appreciate your help and effort you put in this converter. Thank you (Y)
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on June 30, 2012, 04:20:04 PM
I fixed emoticons with this query:
UPDATE `smf_messages` SET body = replace(`body`, '<img src=\\''http://example.pl/public/style_emoticons/<#EMO_DIR#>/21.png\\'' class=\\''bbc_emoticon\\'' alt=\\'':21:\\'' />',':21:');

This needs to be done for each emoticon... I have more than 200 :)

the same thing for private messages, but don't know if wouldn't be better to change it into regular images (in img BBC)
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on July 01, 2012, 03:36:22 AM
Okay...looking again at the last file I posted, it seems I took the wrong file...

If you can wait few hours as soon as I'll be in front of the computer where I work on these things I'll post the correct file...

I'm so sorry for this mistake... :-[
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on July 01, 2012, 07:17:09 AM
Try the attached file, you need convert.php to run it (it works like a converter) and it should only fix the smiley.
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on July 01, 2012, 01:40:15 PM
thanks for fix, now I have another error...
Quote
Converting members... Successful.
Converting categories... Successful.
Converting boards... Successful.
Converting topics...Duplicate entry '644' for key 'PRIMARY'

I changed:
---* {$to_prefix}topics 20
to
---* {$to_prefix}topics 1

but no difference :|
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on July 01, 2012, 02:32:25 PM
There must be some error in IPB db, now works perfectly :D
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on July 01, 2012, 02:51:46 PM
Ohh...well I've seen some random things with the converted...lol

Regarding the chars encoding I can't do much because the backup you sent me last time doesn't have the chars properly encoded, for example:
'You''re almost there!', 'Już prawie!',
so it wouldn't be a meaningful test.
If you can obtain a properly encoded backup I'd be happy to test it. ;D
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on July 01, 2012, 02:53:46 PM
This is how IPB works :) I cant get proper characters in any format... :|
to fix it I have to run this:


UPDATE `smf_messages` SET body = replace(`body`, 'Ä...','ą');
UPDATE `smf_messages` SET body = replace(`body`, 'ć','ć');
UPDATE `smf_messages` SET body = replace(`body`, 'Ä™','ę');
UPDATE `smf_messages` SET body = replace(`body`, 'ó','ó');
UPDATE `smf_messages` SET body = replace(`body`, 'Å,','ł');
UPDATE `smf_messages` SET body = replace(`body`, 'Å,,','ń');
UPDATE `smf_messages` SET body = replace(`body`, 'Å›','ś');
UPDATE `smf_messages` SET body = replace(`body`, 'ź','ź');
UPDATE `smf_messages` SET body = replace(`body`, 'ż','ż');

UPDATE `smf_messages` SET body = replace(`body`, 'Ä,,','Ą');
UPDATE `smf_messages` SET body = replace(`body`, 'Ć','Ć');
UPDATE `smf_messages` SET body = replace(`body`, 'A,','Ę');
UPDATE `smf_messages` SET body = replace(`body`, 'Ã"','Ó');
UPDATE `smf_messages` SET body = replace(`body`, 'Ł','Ł');
UPDATE `smf_messages` SET body = replace(`body`, 'Ń','Ń');
UPDATE `smf_messages` SET body = replace(`body`, 'Åš','Ś');
UPDATE `smf_messages` SET body = replace(`body`, 'Ź','Ź');
UPDATE `smf_messages` SET body = replace(`body`, 'Å»','Ż');

Title: Re: [WIP - Converter] IPB 3.2
Post by: Luc-i on July 02, 2012, 07:11:00 AM
Hi,

i got IPB 3.2.3
and tried the converter.

i got following ERROR:

Fatal error: Call to undefined function getAttachmentFilename() in /www/***/convert.php(1251) : eval()'d code on line 18

Anyone know how to fix it ? thank you!
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on July 02, 2012, 07:12:07 AM
@Luc-i, http://www.simplemachines.org/community/index.php?topic=477019.msg3339519#msg3339519 :)
Title: Re: [WIP - Converter] IPB 3.2
Post by: Luc-i on July 02, 2012, 07:27:52 AM
Quote from: phantomm on July 02, 2012, 07:12:07 AM
@Luc-i, http://www.simplemachines.org/community/index.php?topic=477019.msg3339519#msg3339519 :)

Thanks, that works.

But now i get instead of "ä,ü,ö,ß, etc" just things like "ü"

Anyone know how to fix it?

Thanks, my english isnt the best, sorry :)
Title: Re: [WIP - Converter] IPB 3.2
Post by: emanuele on July 02, 2012, 07:36:23 AM
Please find attached another version of the converter.

Fixes:
1) (really) added the smiley conversion code
2) recount of members' posts

Regarding the characters: what encoding are you using for SMF? (also what languages are you using)
And what encoding do you select in the dropdown of the converter?
Title: Re: [WIP - Converter] IPB 3.2
Post by: Adrek on July 02, 2012, 07:37:12 AM
Well,  I have the same problem with Polish characters.
Only thing that I can sugegst for you is to find out how in database is saved every character and replace it with SQL query.

If  "ä" is saved as "ü" you have to run something like this:
UPDATE `smf_messages` SET body = replace(`body`, 'ü','&#228;');

And the same thing for other characters. Here you have few tips http://webdesign.about.com/od/localization/l/blhtmlcodes-de.htm
Replace all characters to "Numerical Code", and if yo uwant later use in SMF UTF8 encoding, then just use Convert the database and data to UTF-8 in Administration Center » Forum Maintenance » Database

Hope you understand :E
Title: Re: [WIP - Converter] IPB 3.2
Post by: strom73 on July 09, 2012, 03:53:02 AM
Hey,

I ran the command in the SQL query in my PhpMyAdmin. It says it changed something, but when I look at the posts, the missing characters are still there?

I'm using the Estonian language (we have Ä-s here too) and this is the command I ran:

UPDATE `smf_messages` SET body = replace(`body`, '?¤','&#228;');
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: .Vapor on September 03, 2012, 09:48:58 PM
I have a 3.3.4 db if you need it ?
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: .Vapor on September 03, 2012, 09:53:55 PM
Error -

Converting members... Unsuccessful!
This query:

    SELECT
    m.member_id AS id_member, SUBSTRING(m.name, 1, 80) AS member_name,
    SUBSTRING(m.members_display_name, 1, 255) AS real_name, m.email AS email_address,
    SUBSTRING(m.members_pass_hash, 1, 64) AS passwd, SUBSTRING(m.members_pass_salt, 1, 8) AS password_salt,
    m.title AS usertitle, m.last_visit AS last_login,
    m.joined AS date_registered, SUBSTRING(pc.field_3, 1, 255) AS website_url,
    SUBSTRING(pc.field_3, 1, 255) AS website_title,
    SUBSTRING(pc.field_4, 1, 255) AS icq, SUBSTRING(pc.field_1, 1, 16) AS aim,
    SUBSTRING(pc.field_8, 1, 32) AS yim, SUBSTRING(pc.field_2, 1, 255) AS msn,
    SUBSTRING(pp.signature, 1, 65534) AS signature, m.ip_address AS member_ip, m.ip_address AS member_ip2, '0' AS total_time_logged_in,
    IF (m.bday_year IS NULL, '0001-01-01', IF (m.bday_year = 0 AND m.bday_month != 0 AND m.bday_day != 0, CONCAT('0004-', m.bday_month, '-', m.bday_day), CONCAT_WS('-', IF(m.bday_year <= 4, '0001', m.bday_year), IF(m.bday_month = 0, '01', IF(m.bday_month < 10, CONCAT('0', m.bday_month), m.bday_month)), IF(m.bday_day = 0, '01', IF(m.bday_day < 10, CONCAT('0', m.bday_day), m.bday_day))))) AS birthdate,
    CASE
    WHEN (m.member_group_id = '4') THEN 1
    WHEN (m.member_group_id = '2') THEN -1
    WHEN (m.member_group_id = '6') THEN 2
    ELSE 0
    END AS id_group,
    CASE
    WHEN (pc.field_5 = 'm') THEN 1
    WHEN (pc.field_5 = 'f') THEN 2
    ELSE 0
    END AS gender
    FROM `versa33_fodipb334`.ipb_members AS m
    LEFT JOIN `xxxxxxxxx`.ipb_pfields_content AS pc ON (pc.member_id = m.member_id)
    LEFT JOIN `xxxxxxxxx`.ipb_profile_portal AS pp ON (pp.pp_member_id = m.member_id)
    LIMIT 0, 500;

Caused the error:

    Unknown column 'pc.field_1' in 'field list'
[\code]
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on September 04, 2012, 11:51:37 AM
http://www.simplemachines.org/community/index.php?topic=477019.msg3340337#msg3340337
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: .Vapor on September 05, 2012, 12:01:37 AM
Thanks
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: pzoido on September 10, 2012, 01:01:14 PM
Converting members... Successful.
Converting categories... Successful.
Converting boards... Successful.
Converting topics... Successful.
Converting posts (this may take some time)... Successful.
Recounting post counts...


And i tried this:

Quote from: emanuele on June 27, 2012, 01:23:13 PM
Okay, I think I forgot to update the original package...
Can you try the instructions present in this post:
http://www.simplemachines.org/community/index.php?topic=477019.msg3349839#msg3349839
and see if it works?

If so I'll update the script.

No success =/

My ipb-Version ist 3.2.3
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on September 10, 2012, 05:22:20 PM
That's a really weird error, I can't understand where it comes from... :(

I just repeated a conversion of an old database I found around and it went all good, no errors.
It could be a problem with a query, but no idea which problem. ::)
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Miigli on September 22, 2012, 09:20:32 AM

Converting posts (this may take some time)...
Successful.
Recounting post counts... Successful.
Converting polls... Successful.
Converting poll options... Successful.
Converting poll votes... Successful.
Converting personal messages (step 1)...
Fatal error: Wrong value type sent to the database. Integer expected. (id_pm)(convert.php-2636) in /home/u9747/public_html/c/Sources/Subs-Db-mysql.php on line 684


How can i pass this one ?
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Ventic on September 22, 2012, 11:14:58 AM
Notice: Undefined index: convert_script in C:\xampp\htdocs\forum\convert.php on line 969

Warning: Invalid argument supplied for foreach() in C:\xampp\htdocs\forum\convert.php on line 972

Notice: Undefined index: convert_script in C:\xampp\htdocs\forum\convert.php on line 984

Warning: file(C:\xampp\htdocs\forum/) [function.file]: failed to open stream: No such file or directory in C:\xampp\htdocs\forum\convert.php on line 984

Warning: Invalid argument supplied for foreach() in C:\xampp\htdocs\forum\convert.php on line 996
Successful.
Recalculating forum statistics...
Notice: Undefined variable: result in C:\xampp\htdocs\forum\convert.php on line 2491

Notice: Undefined variable: result in C:\xampp\htdocs\forum\convert.php on line 2492

Notice: Undefined index: db_fetch_assoc in C:\xampp\htdocs\forum\convert.php on line 1383

Fatal error: Function name must be a string in C:\xampp\htdocs\forum\convert.php on line 1383


error -.-
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on September 22, 2012, 11:46:44 AM
Hello Miigli and welcome to sm.org! :)

Quote from: Miigli on September 22, 2012, 09:20:32 AM

Converting posts (this may take some time)...
Successful.
Recounting post counts... Successful.
Converting polls... Successful.
Converting poll options... Successful.
Converting poll votes... Successful.
Converting personal messages (step 1)...
Fatal error: Wrong value type sent to the database. Integer expected. (id_pm)(convert.php-2636) in /home/u9747/public_html/c/Sources/Subs-Db-mysql.php on line 684


How can i pass this one ?
mmm...good question.
Some issue with the id of the PMs...though I'm not sure what the issue is, let's try a workaround, in ipb3_to_smf.sql, find this:
Code (find) Select
WHERE mt.mt_is_draft = 0;
and replace it with:
Code (replace with) Select
WHERE mt.mt_is_draft = 0
AND pm.msg_id REGEXP '^[0-9]+$'
AND pm.msg_id > 0;

then, find:
Code (find) Select
WHERE mt.mt_is_draft != 1;
and replace with:
Code (replace with) Select
WHERE mt.mt_is_draft = 0
AND pm.msg_id REGEXP '^[0-9]+$'
AND pm.msg_id > 0;

not sure if it will work, but worth a try...

@Ventic: are you sure you put both the convert.php and the ipb3_to_smf.sql files in the same directory?
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Ventic on September 22, 2012, 12:00:06 PM
yes dude i applied both of them in smf folder
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on September 22, 2012, 12:19:14 PM
Which file did you download?
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Ventic on September 22, 2012, 12:23:11 PM
http://www.simplemachines.org/community/index.php?topic=477019.msg3364303#msg3364303

this one
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Ventic on September 22, 2012, 01:28:41 PM
got this error now Duplicate entry '10567' for key 'PRIMARY'
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: ThorstenE on September 23, 2012, 02:09:08 AM
Quote from: Ventic on September 22, 2012, 01:28:41 PM
got this error now Duplicate entry '10567' for key 'PRIMARY'
Wich step? Please post the full error message, thank you.
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Ventic on September 23, 2012, 08:00:02 AM
Quote from: Thorsten Eurich on September 23, 2012, 02:09:08 AM
Quote from: Ventic on September 22, 2012, 01:28:41 PM
got this error now Duplicate entry '10567' for key 'PRIMARY'
Wich step? Please post the full error message, thank you.
this was the msg
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Ventic on September 23, 2012, 11:33:49 AM
after finishing members,topics,boards and went to posts it converted the 150.000 from 300.000 posts and i got this error

Converting posts (this may take some time)...
MySQL server has gone away

i use localhost

//edit

tried to re - convert only posts and again

Converting posts (this may take some time)...
MySQL server has gone away
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: ThorstenE on September 23, 2012, 12:21:43 PM
in ipb3_to_smf.sql find:
---* {$to_prefix}messages 200
---{


replace with:
---* {$to_prefix}messages 25
---{
$ignore =  true;


then re-run the converter.
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Ventic on September 23, 2012, 12:50:21 PM
why that happens

edit:new error

Converting posts (this may take some time)...
Got a packet bigger than 'max_allowed_packet' bytes
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: ThorstenE on September 23, 2012, 01:00:20 PM
Quote from: Ventic on September 23, 2012, 12:50:21 PM
Got a packet bigger than 'max_allowed_packet' bytes
Do you have access to the mysql configuration file my.cnf? then you could modify the parameter max_allowed_packet_size...

Elsewise we can try to decrease the amount of concurrent imported posts to avoid this error.

find
---* {$to_prefix}messages 25
change to
---* {$to_prefix}messages 10
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Ventic on September 23, 2012, 01:01:46 PM
cause it's converting slower the posts now i am able to change any configuration in order not to get the same error for mysql?
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Ventic on September 23, 2012, 04:10:04 PM
all fine but now i got problem with posts and names

example of post:γειά..  <- its greek characters

edit:tried greek iso but same problem
Title: Re: [WIP - Converter] IPB 3.2
Post by: Ventic on September 23, 2012, 07:26:04 PM
Quote from: phantomm on June 28, 2012, 02:00:28 PM
IPB is in ISO (latin1), SMF in UTF8.

But Polish characters can be easily fixed in Notepad++. Bigger problem are this broken emoticons links.
In IPB database it is saved as:
<img src='http://example.com/public/style_emoticons/<#EMO_DIR#>/125.gif' class='bbc_emoticon' alt=':)' />
after conversion:
<img src=\\''http://example.com/public/style_emoticons/<#EMO_DIR#>/125.gif\\'' class=\\''bbc_emoticon\\'' alt=\\'':)\\'' />

or links in signature (after finished conversion):

<p>[center][url=\\\\\\\"http://example.com\\\\\\\"][img]http://img803.imageshack.us/img803/4601/smfpluserbarv3.png[/img][/url]<br />
<br />
[url=\\\\\\\"http://example.com\\\\\\\"][img]https://www.unixstorm.org/images/UNIXSTORM-banner7.png[/img][/url][/center]</p>


got the same problem.what to do
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: ThorstenE on September 24, 2012, 02:13:36 AM
character issues are mostly related to the source forum's character set. I suspect your IPB was installed with UTF-8. Please try to install SMF with UTF-8 (you can choose that in install.php) and use UTF-8 as character set for the converter.
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Ventic on September 24, 2012, 06:16:32 AM
from the converter i used utf - 8 character
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: ThorstenE on September 24, 2012, 06:33:48 AM
Quote from: Ventic on September 24, 2012, 06:16:32 AM
from the converter i used utf - 8 character
SMF needs to be installed with UTF-8 support too,or we have a mixed structure which results in charset issues.
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Ventic on September 24, 2012, 06:56:31 AM
i did that again

same problem again.greek chars appears like chinese
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: ThorstenE on September 24, 2012, 07:07:58 AM
mhh, please go to admin - maintenance - database and use the maintenance task "convert HTML entities to UTF8-Characters".. hopefully that one fixes your charset issues.
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Ventic on September 24, 2012, 07:23:17 AM
Quote from: Thorsten Eurich on September 24, 2012, 07:07:58 AM
mhh, please go to admin - maintenance - database and use the maintenance task "convert HTML entities to UTF8-Characters".. hopefully that one fixes your charset issues.
did it too :)

edit:lol fixeddd :d

now i got one problem with post counts.it counts posts from boards that i have disabled the ability of getting posts
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: ThorstenE on September 24, 2012, 08:51:57 AM
should be fixable via this mod:
http://custom.simplemachines.org/mods/index.php?mod=2324
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Ventic on September 24, 2012, 08:55:12 AM
couldnt be better  :)

now what about emoticons?and all my problems will get solved :)
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: ThorstenE on September 24, 2012, 09:13:49 AM
you need phpMyAdmin in order to fix that issue, a simple find and replace will do the trick:

UPDATE messages SET body = REPLACE(body,'<#EMO_DIR#>','valid_diretory');

<#EMO_DIR#> is a IPB variable and needs to be replaced with a existing folder name, in this example we replace <#EMO_DIR#> with a folder named "valid_directory"
Then copy all smiley graphics to that new folder and you're done.
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Ventic on September 24, 2012, 09:22:33 AM
Quote from: Thorsten Eurich on September 24, 2012, 09:13:49 AM
you need phpMyAdmin in order to fix that issue, a simple find and replace will do the trick:

UPDATE messages SET body = REPLACE(body,'<#EMO_DIR#>','valid_diretory');

<#EMO_DIR#> is a IPB variable and needs to be replaced with a existing folder name, in this example we replace <#EMO_DIR#> with a folder named "valid_directory"
Then copy all smiley graphics to that new folder and you're done.
can you give me an example please cause i didnt understand it?
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: xbc971 on September 24, 2012, 10:11:12 AM
Hey guys I'm going back to SMF but have a huge problem converting my forum IPB 3.2.3 :x
I Installed SMF 2.0.2 with utf-8 uploaded the convertor files.After I execute conveter.php and run the converter with utf-8 I Get this error :X
Converting...
Converting members... Successful.
Converting categories... Successful.
Converting boards... Successful.
Converting topics...Duplicate entry '638' for key 'PRIMARY'


any ideas how to fix it?
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on September 24, 2012, 11:25:38 AM
The best idea I have is rewrite convert.php... lol sorry.

Hello xbc971 and welcome at sm.org.

Usually this is an error that comes up when you "restart" the conversion (for example with a refresh of the page), at the moment I only know about two options to workaround it:
1) restart the conversion
2) increment one at a time the value of "start" (in the browser address bar, you should have something like http://www.yoursite.tld/forum/convert.php?step=3;substep=17;start=123, increment the value of start one by one: 124, 125, etc.) until the error disappears...
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: xbc971 on September 24, 2012, 11:38:57 AM
Quote from: emanuele on September 24, 2012, 11:25:38 AM
The best idea I have is rewrite convert.php... lol sorry.

Hello xbc971 and welcome at sm.org.

Usually this is an error that comes up when you "restart" the conversion (for example with a refresh of the page), at the moment I only know about two options to workaround it:
1) restart the conversion
2) increment one at a time the value of "start" (in the browser address bar, you should have something like http://www.yoursite.tld/forum/convert.php?step=3;substep=17;start=123, increment the value of start one by one: 124, 125, etc.) until the error disappears...


So I delete my smf Installation multiple times with the database and etc.I tried restarting conversion also same error ... :/ In Adress bar I have only http://mysite.com/community/convert.php?step=1
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: ThorstenE on September 24, 2012, 01:47:32 PM
Quote from: Ventic on September 24, 2012, 09:22:33 AM
can you give me an example please cause i didnt understand it?
ok,
create a folder named ipb_smileys and upload all the smiley image files from your ipb there.
then via phpMyAdmin:
UPDATE messages SET body = REPLACE(body,'<#EMO_DIR#>','ipb_smileys');
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: ThorstenE on September 24, 2012, 01:49:53 PM
Quote from: xbc971 on September 24, 2012, 10:11:12 AM
Hey guys I'm going back to SMF but have a huge problem converting my forum IPB 3.2.3 :x
I Installed SMF 2.0.2 with utf-8 uploaded the convertor files.After I execute conveter.php and run the converter with utf-8 I Get this error :X
Converting...
Converting members... Successful.
Converting categories... Successful.
Converting boards... Successful.
Converting topics...Duplicate entry '638' for key 'PRIMARY'


any ideas how to fix it?
Edit ipb3_to_smf.sql and replace
---* {$to_prefix}topics 5
with
---* {$to_prefix}topics 5
---{
$ignore = true;
---}

Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: xbc971 on September 24, 2012, 02:11:18 PM
10x I converted my forum but still there are those "chinese" symbols I installed SMF 2.0.2 with utf-8 and covnerted with utf-8 and I run the thing for database from maintenance menu half of my forum is in my language other is chinese ...
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: ThorstenE on September 25, 2012, 01:16:39 PM
Quote from: xbc971 on September 24, 2012, 02:11:18 PM
10x I converted my forum but still there are those "chinese" symbols I installed SMF 2.0.2 with utf-8 and covnerted with utf-8 and I run the thing for database from maintenance menu half of my forum is in my language other is chinese ...
I'm relatively sure your IPB database is already mixed, thus the converter can't fix this issues. Don't know much about IPB but is there a similar task for fixing charset issues inside the admin interface?
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: xbc971 on September 25, 2012, 04:23:09 PM
I have searched the admin panel for this kind of option but I didn't found anything.
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: ThorstenE on September 26, 2012, 12:44:21 AM
Quote from: xbc971 on September 25, 2012, 04:23:09 PM
I have searched the admin panel for this kind of option but I didn't found anything.
Would you mind sending me a backup from your database? I've made an import tool which can fix charset issues in all variants, even if there's a mixed string inside the database (UTF-8 and latin/other characters in a single string). That tool is not designed to import IPB to SMF but I could modify it for proper SMF import. It's not publically available, still in alpha stage and I'd need some days to modify it but there's a good chance to import your "broken" database.

I've added you to my buddy list, feel free to contact me via PM.
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: xbc971 on September 26, 2012, 04:36:13 AM
I have sent you backup check your PM's :)
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: joe9494t on November 17, 2012, 06:03:55 PM
Hi I've converted my forum (very successively, thanks) to smf.

Although I have one error, in all the content of posts (smf_messages in the database) every time a ' mark is used, it has replaced it with \'  (e.g. don't turns to don'\t). Now the problem is I can't exactly run a query for replacing it, which would be like this: UPDATE smf_messages SET body = REPLACE ( body, '\','' );
However it gets confused by the ' marks so I can't exactly fix it.

Can anyone suggest a fix for this?
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: ThorstenE on November 19, 2012, 02:10:29 PM
UPDATE smf_messages SET body = REPLACE ( body, "\'","'" );
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Vlada87 on November 26, 2012, 04:03:41 PM
I have IPB installation to shared hosting, and i have SMF fresh installation on VPS, can this script convertp from server to server or is this one of the kids script that must be used only on same server?!
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Uzocu on November 27, 2012, 05:42:25 PM
I have a problem:

Converting members...
Fatal error: Call to undefined function getattachmentfilename() in /home/iroxman/public_html/convert.php on line 2339
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on November 28, 2012, 02:25:22 PM
Hello Uzocu and welcome to sm.org.

ETA: the function is part of a normal SMF install, so if it doesn't work it would mean it is not loading properly SMF at all...
Where did you put the convert.php and the .sql files? Into the same directory as SSI.php?
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Uzocu on December 01, 2012, 10:15:16 AM
Hello, I put the convert.php in the root directory and the forum is in a subdomain.
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on December 01, 2012, 11:13:15 AM
And is in the same directory as Settings.php?
That's the most important thing, since convert.php takes the "important" data from Settings.php itself.
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Uzocu on December 01, 2012, 02:41:51 PM
Ahh.. ok

But now I have this error:

Unknown column 'pc.field_3' in 'field list'
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on December 01, 2012, 02:58:50 PM
Search:
        m.joined AS date_registered, SUBSTRING(pc.field_3, 1, 255) AS website_url,
SUBSTRING(pc.field_3, 1, 255) AS website_title,

and change it to:
        m.joined AS date_registered,
you may get more similar errors, same procedure: remove the piece of query that refers to that missing column...

/me wonders if there is a better way to handle this kind of things...
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Uzocu on December 01, 2012, 03:55:19 PM
Ah, ok you're all right now I have to ask just send me the password right?
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on December 01, 2012, 03:59:10 PM
???
Not sure what you mean...
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: Uzocu on December 01, 2012, 04:02:31 PM
No nothing and everything works correctly, really thank you very much  :)
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: artpop on December 08, 2012, 09:55:41 AM
Hi,

I was trying to convert ipb 3.3.3 with smf 2.0.2 and i got this error

Converting members... Successful.
Converting categories... Successful.
Converting boards...
Fatal error: Wrong value type sent to the database. Integer expected. (id_parent)(convert.php-2636) in /home/propagag/public_html/projects/artpop/Sources/Subs-Db-mysql.php on line 684

What should i change??
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: artpop on December 10, 2012, 12:44:51 PM
??
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on December 10, 2012, 01:09:13 PM
...I didn't notice the topic popping up in the unread replies...

mmm...you probably have some corrupted data...
Try open the IPB forums table and check the "parent_id" column: what type is it?
Does it contain anything that is not a number?
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: artpop on December 10, 2012, 03:07:53 PM
it contains numbers but there are 3 that was -1 in the parent id listed

(this is the query i found in phpmyadmin: SELECT * FROM `forums` ORDER BY `forums`.`parent_id`  ASC )

(http://i48.tinypic.com/2n8vmf5.png)
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on December 12, 2012, 08:19:39 AM
The -1 is perfectly fine...it should be a case taken in consideration and converted to 0.
IF (p.parent_id = -1, 0, p.parent_id) AS id_parent

Try this query:
SELECT parent_id
FROM `forums`
WHERE parent_id NOT
REGEXP '^[0-9]+$'

does the result contain only -1s?

Try checking in the "structure" view if the type of the column is int or mediumint or something with "int" in there (just to be sure).
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: artpop on December 16, 2012, 04:26:01 AM
didnt work! everything seem to be correct...
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on December 16, 2012, 04:48:34 AM
Did you run from phpmyadmin the query I posted?
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: artpop on December 29, 2012, 03:06:14 PM
yes i did!
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on December 29, 2012, 04:47:18 PM
And maybe report the result of the query?
That would help... ;)
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: inukablaze on December 31, 2012, 01:57:33 PM
I've tried it. Mine keeps hanging on Private Messages (Step 1). It just stops and there is no "Continue" button at the bottom of the page. It just stops there. I don't know how to get past it or skip private message conversion so I'd at least have a working smf version of the board.
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on January 04, 2013, 07:04:22 AM
Try enabling the "debug" at the beginning of the conversion and see if the converter shows some more useful error message.
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: hhristov on January 09, 2013, 04:58:31 PM
Greetings ,
I am new in this forum convertors and php , and my question is :
Is there anyway i can buypass forum attachments and avatars convert . I want all of them to be wiped for the new forum?
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on January 10, 2013, 05:47:35 AM
mmm...
I would simply do the conversion, then go to admin > forum > attachments and avatars > file maintenance and use the attachment pruning tool to just remove attachments older than...1 day (I'd guess using 0 would fail), and the same for avatars using "remove avatars from members not active for more than...", using 1 day again.
I think it's safer than change the converter (I think).

If you want to change the converter, there are two sections, one starting with:
/******************************************************************************/
--- Converting attachments...
/******************************************************************************/


and the other starting with:
/******************************************************************************/
--- Converting user avatars...
/******************************************************************************/


remove them entirely (up to the successive "header" (i.e. the block "converting settings"))
Remember, when you finish to remove everything, to go to admin > maintenance > forum maintenance > routing and run "find and repair any errors" and "recount all forum totals and statistics", then go to admin > forum > attachments and avatars > file maintenance and run "attachment integrity check".



Unrelated: please note that solicit an answer by PM less than one hour after you've posted is not considered polite by most of the people here around. ;)
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: mikemastercorp on January 17, 2013, 12:33:55 PM
Emanuele, last evening I just started playing with the converter out of curiosity how difficult would that be to FINALLY ESCAPE from IPB and guess what.. I almost did it... And by ALMOST I mean that I have noticed few small things that need tweaking, but all in one the images were properly imported, the smileys (in the topics) work just fine, the message counting is perfect, the users number is properly set.

I just allowed myself to make the long story short in case somebody like me would ran into my problems that were solved THANKS TO YOU and I really appreciate your work:


ipb3_to_smf.sql & convert.php downloaded from here:
http://www.simplemachines.org/community/index.php?topic=477019.msg3364303#msg3364303


Wrong Value Type Fix
http://www.simplemachines.org/community/index.php?topic=477019.msg3410131#msg3410131

Smileys fixup try:

Quote from: Ventic on September 24, 2012, 09:22:33 AM
can you give me an example please cause i didnt understand it?
ok,
create a folder named ipb_smileys and upload all the smiley image files from your ipb there.
then via phpMyAdmin:
Code: [Select]
UPDATE messages SET body = REPLACE(body,'<#EMO_DIR#>','ipb_smileys');

http://www.simplemachines.org/community/index.php?topic=477019.msg3411141#msg3411141



Now back to the small things that if possible to get fixed you would be an ANGEL!

I did notticed that instead of Forums/SubForums and topics now all the topics are in one main forum after the conversion. It does not bother me that much as it would take me probably 15-30 minutes to fix up all the structures etc, however just to mention the things I notticed.

The smileys in the topics work perfectly fine, however in the private messages they are still showing like this:

yourdomain.com/forum/public/style_emoticons/<#EMO_DIR#>/tongout.gif\' class=\'bbc_emoticon\' alt=\'\' /> instead of just the regular " :) " etc.

As I said, I do not really mind having that in the personal messages as all our users will understand the amount of work that needs to be done to fix all the major problems in the conversion so as far as the users still have their messages (even with such errors) they should be thankful ;)

One other thing that is strange is the fact that the imported topics are more in numbers as the original count in the IPB. I did my homework and it turns out that even having posts/topics erased because of a spam etc. the import somehow did import them too (as well as the spam users). I know it sounds weird as I did several times checked to make sure that the posts in question are deleted (spam users too!) but the import found them somehow and added them to the new board.

As far as our forum is for a small community having less than 400 users and bout 7000 topics, I would not mind walking around and deleting users/topics of question, so please consider this as a report of a 95% successful conversion, not as a critique or something... ;)

One last thing (also simple to be fixed in my case but probably can cause troubles with large forum boards) - the manually added smileys in IPB are not imported neither with images, nor with the bbcode and they appear like this:

I know you are my friend angel (where angel is the bbcode for an angel hugging image etc.)

To be honest, I did not applied your last tweak for the smileys and I know I would go simply and add those smileys myself in the newly converted SMF board but if someone has more emoticons/smileys, than I do not wish to be in their shoes.

Having all that said, so far all is perfectly fine and my wife (my main admin) is investigating any other problems that needs a fixup but to be honest I am FULLY (about 1000%) satisfied by the conversion and I know that you put a lot of efforts so after the final conversion I would like to do a small donation as a tiny reward for your hard work helping strangers to have their problems solver. I would also encourage everyone else to "buy a coffee" to this brave man that started fulfilling our dreams and let them come true...

Will keep you posted when I am done for accepted donation ways ;)
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: mikemastercorp on January 17, 2013, 01:03:44 PM
Oh, and one more thing - the already read topics by users are all marked as unread instead of the proper import of the Read/New topics/posts. I guess everybody should do their homework too and have some surfing around to fix this issue personally, however if there is a way to fix that by a query or something, I am here as a betta tester (please remember that any tries would do no harm to my actual board as so far it is only a testing conversion so even if I have to redo it a dozen of times I am prepared for it).

Strange situation arises with some users passwords - if someone used a simple word as a password (for example 'password') a message appear during the log in time: "Security permissions have recently changes" Please log in again. After few unsuccessful log ins, the board is offering to recover the passwords.

Any ideas or thoughts about fix-up are welcome ;)

Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on January 17, 2013, 06:25:32 PM
Quote from: mikemastercorp on January 17, 2013, 12:33:55 PM
I just allowed myself to make the long story short in case somebody like me would ran into my problems that were solved THANKS TO YOU and I really appreciate your work:
You are welcome! :)

Quote from: mikemastercorp on January 17, 2013, 12:33:55 PM
I did notticed that instead of Forums/SubForums and topics now all the topics are in one main forum after the conversion. It does not bother me that much as it would take me probably 15-30 minutes to fix up all the structures etc, however just to mention the things I notticed.
I think this is something tricky to set up properly.
I remember at some point I did a conversion for another user and I had to tweak the code because IPB was considering its "categories" the same as we call "boards" and the conversion was failing because the converter was converting a category into a category, but since SMF cannot contain topics in categories, but only boards it was impossible to see any topic...
It seems IPB can be configured in several ways...

Quote from: mikemastercorp on January 17, 2013, 12:33:55 PM
The smileys in the topics work perfectly fine, however in the private messages they are still showing like this:
Argh!
I probably applied the fix to the messages body, but not PMs...
/me takes note.

Quote from: mikemastercorp on January 17, 2013, 12:33:55 PM
One other thing that is strange is the fact that the imported topics are more in numbers as the original count in the IPB. I did my homework and it turns out that even having posts/topics erased because of a spam etc. the import somehow did import them too (as well as the spam users). I know it sounds weird as I did several times checked to make sure that the posts in question are deleted (spam users too!) but the import found them somehow and added them to the new board.
mmm...I think I know the answer.

Quote from: mikemastercorp on January 17, 2013, 12:33:55 PM
One last thing (also simple to be fixed in my case but probably can cause troubles with large forum boards) - the manually added smileys in IPB are not imported neither with images, nor with the bbcode and they appear like this:
Do you mean empty?
Yes, smiley are not imported...I'll look into it, but not in the next days...feel free to bump the topic next week. ;)

Quote from: mikemastercorp on January 17, 2013, 12:33:55 PM
I would like to do a small donation as a tiny reward for your hard work helping strangers to have their problems solver. I would also encourage everyone else to "buy a coffee" to this brave man that started fulfilling our dreams and let them come true...
Thank you very much, very appreciated! But the fact that my code helped a bit is more than enough for me. ;)
And, by the way, I cannot even say it's all my work, because in fact I didn't do much, I just tweaked what others before me did for IPB 3.0. :)

ETA: of course, thank you very much for the detailed report.
Title: Re: [WIP - Converter] IPB 3.2/3.3
Post by: emanuele on February 15, 2013, 10:18:10 AM
I just attached a new version to the first message with some of the fixes proposed in the topic and some new one.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: Cassino on May 15, 2013, 03:42:07 PM
I have been getting hundreds of errors like this one:

Warning: copy(/monthly_10_2012/post-61-0-23558500-1350081511.jpg): failed to open stream: No such file or directory in D:\xampp\htdocs\smf_forum\convert.php(1252) : eval()'d code on line 24

So none of the attachments were copied over.

The attachment from my ipb board would be located here: D:/xampp/htdocs/forum/uploads/monthly_10_2012/post-61-0-23558500-1350081511.jpg

In the ipb database the upload_dir conf_value is empty.
Manually adding the absolute system path to the directory there fixes the error for the script and the attachments work.

However shouldn't the script default to the /uploads/ directory relative to the ipb path? Where is/was the problem?
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on May 16, 2013, 04:55:44 AM
Hi Cassino and welcome at sm.org.

Quote from: Cassino on May 15, 2013, 03:42:07 PM
However shouldn't the script default to the /uploads/ directory relative to the ipb path? Where is/was the problem?
The script reads the value from the db, and uses that, if that is empty the result is the absolute path you have experienced:
copy($oldAttachmentDir . '/' . $row['attach_location'], $attachmentUploadDir . '/' . $physical_filename)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: evilservo on June 04, 2013, 02:39:37 PM
sorry i may sound stupid but is the conversion done?
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: ElKompaAndres on June 07, 2013, 03:28:01 AM
just converted from IPB 3.4.4 and everything seems really good, thank you!
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: Mauricee on June 26, 2013, 10:24:51 AM
Could someone to show me an tutorial please ? I don't get it, what I must do ?
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: Viox on August 25, 2013, 12:16:53 PM
Quote from: emanuele on May 16, 2013, 04:55:44 AM
Hi Cassino and welcome at sm.org.

Hi Emanuele, i have this problem:

Converting members...
Fatal error: Call to undefined function getAttachmentFilename() in /home/adminlj/public_html/forotest/convert.php on line 2339

My DB is not Empty
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: pols1337 on August 25, 2013, 09:19:39 PM
Hi I am converting from IPB 3.4.5 to SMF 2.0.5

Gave access of my SMF database user to my IPB database, and started the installation.  Got stuck on Step 1 Convert Members.  See attachment.

Can you advise? 
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: pols1337 on August 25, 2013, 09:25:08 PM
If it helps, I can attach my IPB SQL backup.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on August 26, 2013, 04:40:51 AM
Quote from: Viox on August 25, 2013, 12:16:53 PM
Hi Emanuele, i have this problem:

Converting members...
Fatal error: Call to undefined function getAttachmentFilename() in /home/adminlj/public_html/forotest/convert.php on line 2339

My DB is not Empty
http://www.simplemachines.org/community/index.php?action=search2;search=getAttachmentFilename;topic=477019

http://www.simplemachines.org/community/index.php?topic=477019.msg3339519#msg3339519

Quote from: pols1337 on August 25, 2013, 09:25:08 PM
If it helps, I can attach my IPB SQL backup.
NO! NO! NO! NO! NO!
Never ever post a backup of your forum to a public place! Never!

That said:
Quote from: pols1337 on August 25, 2013, 09:19:39 PM
Gave access of my SMF database user to my IPB database, and started the installation.  Got stuck on Step 1 Convert Members.  See attachment.

Can you advise? 
Never seen anything like this (that I can remember)...

Try enabling the "debug" option in the first screen of the converter and see if you get some more details...
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: pols1337 on August 27, 2013, 01:03:23 AM
Hi I don't see an option to debug at all on the initial setup screen.  See attached. 
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on September 02, 2013, 04:22:01 AM
Darn, I completely lost track of these topics...sorry! :-[

Oh yes, my fault, the debug is enabled adding "debug=1" to the url, so if your url is:
http://localhost/forum/convert.php
you should start with:
http://localhost/forum/convert.php?debug=1
it will take care by itself of the rest.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: brunob on September 03, 2013, 10:41:33 AM
Hello,

I've tried this convert with Ipboard 3.4.5 but it does not work.
Does anyone have good experiences with ipboard 3.4.5 and this convert?

Is there perhaps a possibility to transfer only the members?

Before i convert i check with /convert.php?debug=1 i get this error:
Notice: Function set_magic_quotes_runtime() is deprecated in /home/******/public_html/******/convert.php on line 70Warning: session_start() [function.session-start]: Cannot send session cache limiter - headers already sent (output started at /home/******/public_html/******/convert.php:3163) in /home/******/public_html/******/convert.php on line 79

I hope someone can help me/us.

Greating,

Bruno  ;)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on September 04, 2013, 08:04:16 AM
If you can say exactly what is not working it may be possible to understand how to fix it. ;)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: brunob on September 04, 2013, 09:21:21 AM
Hello Emanuele,

It's a lot to fix :(

- Passwords no longer works for the members and also for administrators and the other groups.
- All statastieken to zero. A member with 200 post now stands at zero.
- In topics i can not see the images any more.
- Suboards are not in the right place.
- All rights of the groups are also zero.
- Between the line/texts is a lot of space.

Thanks very much for your help.

Greatings,

Bruno  :)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on September 04, 2013, 11:20:30 AM
Quote from: brunob on September 04, 2013, 09:21:21 AM
- Passwords no longer works for the members and also for administrators and the other groups.
This is "normal", you can read through this discussion and you will find the same answer all the other times it has been asked: changing the system, also the encryption method changes. Since I have no idea what IPB uses I cannot provide any fallback.
SMF tries to handle some, but not IPB 3.x.

Quote from: brunob on September 04, 2013, 09:21:21 AM
- All statastieken to zero. A member with 200 post now stands at zero.
Do a recount from admin > maintenance > routin
And while you are recounting do also a fix all errors.

Quote from: brunob on September 04, 2013, 09:21:21 AM
- In topics i can not see the images any more.
What does the bbcode for images look like in IPB?

Quote from: brunob on September 04, 2013, 09:21:21 AM
- Suboards are not in the right place.
Seems strange because the code is there...
Though, extrema ratio, unless you have 20,000 boards it shouldn't be *that* difficult to put them in the right place. ;)

Quote from: brunob on September 04, 2013, 09:21:21 AM
- All rights of the groups are also zero.
Never even tried to convert the membergroups.
You have to set them up from scratch, sorry.

Quote from: brunob on September 04, 2013, 09:21:21 AM
- Between the line/texts is a lot of space.
I'd need to at least see the content of the database fields before and after the conversion to understand what the problem is...
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: brunob on September 07, 2013, 07:53:24 PM
Hello,

Quote from: emanuele on September 04, 2013, 11:20:30 AM
Quote from: brunob on September 04, 2013, 09:21:21 AM
- Passwords no longer works for the members and also for administrators and the other groups.
QuoteThis is "normal", you can read through this discussion and you will find the same answer all the other times it has been asked: changing the system, also the encryption method changes. Since I have no idea what IPB uses I cannot provide any fallback.
SMF tries to handle some, but not IPB 3.x.
That password don't work is normal okay thats not so good. I must go to see how I'm going to fix that

Quote from: brunob on September 04, 2013, 09:21:21 AM
- All statastieken to zero. A member with 200 post now stands at zero.
QuoteDo a recount from admin > maintenance > routin
And while you are recounting do also a fix all errors.
I've done that and work for general statastieken but a member with 200 post has still 0 posts.

Quote from: brunob on September 04, 2013, 09:21:21 AM
- In topics i can not see the images any more.
QuoteWhat does the bbcode for images look like in IPB?
[img=http://www.google.com/intl/en_ALL/images/logo.gif]

Quote from: brunob on September 04, 2013, 09:21:21 AM
- Suboards are not in the right place.
QuoteSeems strange because the code is there...
Though, extrema ratio, unless you have 20,000 boards it shouldn't be *that* difficult to put them in the right place. ;)
subboard en rights are good so!

Quote from: brunob on September 04, 2013, 09:21:21 AM
- All rights of the groups are also zero.
QuoteNever even tried to convert the membergroups.
You have to set them up from scratch, sorry.
subboard en rights are good so!

Quote from: brunob on September 04, 2013, 09:21:21 AM
- Between the line/texts is a lot of space.
QuoteI'd need to at least see the content of the database fields before and after the conversion to understand what the problem is...
Lots of space between line/text is á code problem. Some people copy a text from another sites and i I think that gives the problem.

Greatings Bruno  ;)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: mentalist on September 08, 2013, 07:12:23 AM
IIRC IPB encrypts passwords via md5(md5($salt).md5($password))
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on September 08, 2013, 12:40:27 PM
Quote from: Dexter Morgan on September 08, 2013, 07:12:23 AM
IIRC IPB encrypts passwords via md5(md5($salt).md5($password))
mmm...the same as IPB2?
Then in theory it should work out of the box since this is already included in SMF and both the password and the salt are transferred by the converter.
It should ask to reintroduce the password, but it should work.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: brunob on September 08, 2013, 06:58:04 PM
Password issue is resolved.
The password reminder mail came in my spambox.
When you click on that link the link does not work.
You will need to approve the mail so it is not spam and the problem is solved!

Greating Bruno :)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: mentalist on September 09, 2013, 02:36:00 AM
Quote from: emanuele on September 08, 2013, 12:40:27 PM
mmm...the same as IPB2?
Then in theory it should work out of the box since this is already included in SMF and both the password and the salt are transferred by the converter.
It should ask to reintroduce the password, but it should work.
yep, but IPB passwords use 8 characters salt, the SMF salt is by default limited to 4 characters..
SUBSTRING(m.members_pass_salt, 1, 8) AS password_salt,
You'd need to extend the column password_salt to 8 characters in order get get it working..
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on September 09, 2013, 12:23:05 PM
From phpMyAdmin:
password_salt varchar(255)
So there is space to properly store the salt.
The converter migrates it "properly" (i.e. the entire salt should be in smf's table).
As far as I remember SMF generates a 4 chars salt, but doesn't shorten it when retrieved from the db.
Not sure why it doesn't work.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: brunob on September 09, 2013, 04:31:52 PM
Hello,

Before and after the url of the image is automatically added this -> \ "
When I remove them the image suddenly does it.

Where can i find that script?

Greating Bruno :)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: brunob on September 10, 2013, 05:10:16 AM
Hello,

The text problem is still there.

Emanuele which database fields you want to see exactly?

Greatings Bruno  ;D

See also image <p> and <br> between the line/text
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: brunob on September 14, 2013, 10:50:02 AM
Hello,

we have decided to start all over again  :(

Itself we have looked if we could fix the problems, but that's what too much for us.

Greetings,

Bruno  ;)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on September 17, 2013, 05:59:37 AM
I'm really sorry, the topic was buried under several other topics and I lost track of it... :-[

The image problem should be "easy" to solve, the other one...no, it seems that your IPB adds random paragraphs inside the text, I should read the text of a message stored in the database in order to try to understand what is going on, but I'm not sure I could fix it.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: Dan Claimant on September 17, 2013, 07:08:08 AM
Hi.
Something wrong at the beginning of convertation:
Quote
Notice: Undefined index: substep in /usr/local/www/***/media3/convert.php on line 975Converting members...ErrorNotice: Undefined index: cache_enable in /usr/local/www/***/media3/Sources/Subs-Db-mysql.php on line 438You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ' 0, 2), (820, 'KsuSha', 'KsuSha', 'ksuffka067@mail.ru', '', '', '', 125061719' at line 325Warning: Unknown: write failed: No space left on device (28) in Unknown on line 0Warning: Unknown: Failed to write session data (files). Please verify that the current setting of session.save_path is correct () in Unknown on line 0
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on September 17, 2013, 09:07:17 AM
Hello Dan and welcome to sm.org.

QuoteUnknown: write failed: No space left on device (28) in Unknown on line 0
You problem seems to be that you don't have enough space.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: Dan Claimant on September 18, 2013, 01:51:58 AM
Quote from: emanuele on September 17, 2013, 09:07:17 AM
Hello Dan and welcome to sm.org.
Thanks a lot =)
Quote from: emanuele on September 17, 2013, 09:07:17 AM
You problem seems to be that you don't have enough space.
After restart of DB-server (20 Gb free space):
Quote
Notice: Undefined index: substep in /usr/local/www/***/media3/convert.php on line 975Converting members...ErrorNotice: Undefined index: cache_enable in /usr/local/www/***/media3/Sources/Subs-Db-mysql.php on line 438You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ' 0, 2), (820, 'KsuSha', 'KsuSha', 'ksuffka067@mail.ru', '', '', '', 125061719' at line 325
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: Softovick on October 05, 2013, 08:02:26 AM
I ran the script for converting forum IP.Bord 3.3.4.
More than 38,000 users
More than 268,000 messages.

And in the migration of posts each time an error occurs.
It looks like this:
QuoteConverting...
Converting posts (this may take some time)...
You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'ORDER BY null' at line 503
URL while such convert.php?step=1&substep=9&start=96500
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: mentalist on October 05, 2013, 09:27:22 AM
Seems your MySQL version's having issues with ORDER BY NULL, check:
http://www.simplemachines.org/community/index.php?topic=218449.msg3496221#msg3496221
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on October 05, 2013, 11:13:51 AM
Quote from: Dan Claimant on September 18, 2013, 01:51:58 AM
Quote
Notice: Undefined index: substep in /usr/local/www/***/media3/convert.php on line 975Converting members...ErrorNotice: Undefined index: cache_enable in /usr/local/www/***/media3/Sources/Subs-Db-mysql.php on line 438You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ' 0, 2), (820, 'KsuSha', 'KsuSha', 'ksuffka067@mail.ru', '', '', '', 125061719' at line 325
It may be something broken in the birthdate, if the field is not important you may try removing the line:
IF (m.bday_year IS NULL, '0001-01-01', IF (m.bday_year = 0 AND m.bday_month != 0 AND m.bday_day != 0, CONCAT('0004-', m.bday_month, '-', m.bday_day), CONCAT_WS('-', IF(m.bday_year <= 4, '0001', m.bday_year), IF(m.bday_month = 0, '01', IF(m.bday_month < 10, CONCAT('0', m.bday_month), m.bday_month)), IF(m.bday_day = 0, '01', IF(m.bday_day < 10, CONCAT('0', m.bday_day), m.bday_day))))) AS birthdate,
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: Softovick on October 05, 2013, 11:16:31 AM
Quote from: Dexter Morgan on October 05, 2013, 09:27:22 AM
Seems your MySQL version's having issues with ORDER BY NULL, check:
http://www.simplemachines.org/community/index.php?topic=218449.msg3496221#msg3496221
Thank you very much, it solved the problem
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: eddie1973 on October 20, 2013, 05:59:46 PM
Anyone have luck with IPB 3.4.5?
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on October 20, 2013, 06:36:20 PM
http://www.simplemachines.org/community/index.php?topic=477019.msg3557208#msg3557208

I suppose is basically the same. ;)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: eddie1973 on October 20, 2013, 06:47:31 PM
Does the original converter have all your fixes?
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on October 20, 2013, 06:53:53 PM
TBH I lost track of what was fixed and what not...
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: Dan Claimant on October 21, 2013, 01:10:25 PM
Quote from: emanuele on October 05, 2013, 11:13:51 AM
It may be something broken in the birthdate, if the field is not important you may try removing the line:

Thanx a lot. Now it's working almost well.
At the end of converting, at "Recalculating forum statistics... ":
Fatal error: Call to undefined function getAttachmentFilename() in /usr/local/www/***/media3/convert.php on line 1954
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on October 26, 2013, 11:42:56 AM
Already answered few posts before:
http://www.simplemachines.org/community/index.php?action=search2;search=getAttachmentFilename;topic=477019
;)

P.S.
Sorry for the late reply.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: sorensonfan41 on December 16, 2013, 10:41:41 PM
Good day!  I'm helping a friend convert his IPB 3.4.6 board to SMF 2.0.6.  I ran the converter and it seems like it was successful in converting the users, passwords, messages, posts, forums, etc.  All looks well....but with one issue....

On the IPB board, there's over 300,000 posts and over 23,000 topics.  When I finish the conversion process (which looks to be successful), I only find 18,246 posts and 1,259 topics were actually converted.  It adds up to almost a year's worth of posts and topics along with older topics that were "sticked" or "pinned".

I'd really like to be able to convert all 300,000+ posts and the 23,000+ topics successfully.  I think the script is somehow timing out and causing the script to advance to the next step....but it's not throwing any kind of error message (and the script runs really fast and completes really fast).

How would I be able to convert the rest of the posts?  There are two separate databases in use, one for IPB and one for SMF (but with same user with appropriate permissions on both databases).

Thank you for your hard work and thank you for any help you may be able to provide!
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: mentalist on December 16, 2013, 10:47:04 PM
QuoteIt adds up to almost a year's worth of posts and topics along with older topics that were "sticked" or "pinned".
Mhh, that sounds like you converted an older database instead of the live forum.. Are you sure you converted the proper database?
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: sorensonfan41 on December 16, 2013, 11:18:56 PM
Quote from: TE on December 16, 2013, 10:47:04 PM
QuoteIt adds up to almost a year's worth of posts and topics along with older topics that were "sticked" or "pinned".
Mhh, that sounds like you converted an older database instead of the live forum.. Are you sure you converted the proper database?

It was the live IPB forum that was converted to SMF.  (and it's still live and going as I type this)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: mentalist on December 17, 2013, 03:33:37 PM
that's odd...  the members have been fully converted?
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: chris319 on December 17, 2013, 04:11:08 PM
It seems the threads "archived" by the IPB software is the problem. Unfortunately we have over 22,000 such "archived" threads.

Does anyone know enough about IPB archiving to know if the converter scripts can be made to unarchive these threads? It seems to take forever if you let the Invision software do it.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on December 17, 2013, 04:21:06 PM
Nope, never had a chance to see it, but... well, I suspect that if IPB gives you the tool to archive and "unarchive", it's better to let the creator of the script handle this part of the job for the best result. ;)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: sorensonfan41 on December 22, 2013, 03:01:10 PM
Ok, we've got everything converted over.  It was a success for the most part.  All the posts and topics are now there.  We had to manually clean up and reorganize a couple of things (no big deal).

Here's is one minor annoyance, though.....and it affects a great deal of posts.

Anywhere there's a quotation mark or an apostrophe, the converter added a \ before the respective symbol.  I looked through this thread and someone suggested a SQL command for such a problem on one of the previous pages.  I tried it in phpMyAdmin and it didn't do anything (no rows were modified....and it didn't mess anything up....but it also didn't fix anything).  Here's an example.....

QuoteI caught an interview the other night from CBS This Morning circa 1990-1991. Mark Goodson was talking about his company legacy, and how some games didn\'t seem to have the pizazz necessary to survive the 90s, but To Tell the Truth was going to try.



What game shows of the past have the hardest time finding relevancy today? The right star and venue could make anything a success, sure, but I don\'t imagine we\'ll see You Bet Your Life make a comeback anywhere near the form it was originally successful in.



As you start to go forward in the overall game show timeline, the question gets muddier. Is To Tell the Truth itself past the diminishing point of audience attention spans? For me personally, it\'s a show I run hot and cold on. Sometimes I\'m in the mood to play along, other times the questioning makes me reach for the remote.



We\'ve also talked about Password before. The last time it was on TV, it was jazzed up significantly from the earlier versions. But a lot of us respond to Jimmy Fallon\'s late night Password skits, and they do them with some regularity. Could a form of that work in the same vain as @midnight, perhaps?

Is there any easy way to fix that?  If there's nothing that can be done about it.....it's not like the forum is going to implode, quit working, or whatever.  If it can be fixed easily, though (without messing up the forum)....it definitely would be great.  Also, is there any way the extra space in between the paragraphs can be fixed?  If not, no big deal.

Thank you for your help so far and for all of your hard work in creating a usable conversion script for IPB to SMF!
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on December 23, 2013, 09:12:21 AM
From phpMyAdmin:
UPDATE smf_messages SET body = REPLACE ( body, "\'","'" );
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: sorensonfan41 on December 23, 2013, 04:47:37 PM
Quote from: emanuele on December 23, 2013, 09:12:21 AM
From phpMyAdmin:
UPDATE smf_messages SET body = REPLACE ( body, "\'","'" );

I tried that in phpMyAdmin and it says 0 rows were updated (and the posts are still showing up like that).
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: ToVarg on January 04, 2014, 04:57:29 AM
Hi! ipb v.3.3.3, smf 2.0.6 using сonverter shows the error "Unknown system variable 'SQL_MAX_JOIN_SIZE'". XAMPP on Mac OS X
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on January 06, 2014, 03:10:31 PM
Quote from: sorensonfan41 on December 23, 2013, 04:47:37 PM
Quote from: emanuele on December 23, 2013, 09:12:21 AM
From phpMyAdmin:
UPDATE smf_messages SET body = REPLACE ( body, "\'","'" );

I tried that in phpMyAdmin and it says 0 rows were updated (and the posts are still showing up like that).
That's odd...
Pick a random message (for example the one you posted above), take note of the id (it's the number after msg in the link of the post, for example in http://www.simplemachines.org/community/index.php?topic=477019.msg3650014#msg3650014 the id is 3650014), go to phpmyadmin, find that message and post a screenshot of the result with (if possible) the entire message showing (or at least a piece including a \').
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on January 06, 2014, 03:16:22 PM
Quote from: ToVarg on January 04, 2014, 04:57:29 AM
Hi! ipb v.3.3.3, smf 2.0.6 using сonverter shows the error "Unknown system variable 'SQL_MAX_JOIN_SIZE'". XAMPP on Mac OS X
No idea about the consequences, you can remove this block from convert.php:
// Attempt to allow big selects, only for mysql so far though.
if ($smcFunc['db_title'] == 'MySQL')
{
$results = $smcFunc['db_query']('', "SELECT @@SQL_BIG_SELECTS, @@SQL_MAX_JOIN_SIZE", array('security_override' => true));
list($big_selects, $sql_max_join) = $smcFunc['db_fetch_row']($results);

// Only waste a query if its worth it.
if (empty($big_selects) || ($big_selects != 1 && $big_selects != '1'))
$smcFunc['db_query']('', "SET @@SQL_BIG_SELECTS = 1", array('security_override' => true));

// Lets set MAX_JOIN_SIZE to something we should
if (empty($sql_max_join) || ($sql_max_join == '18446744073709551615' && $sql_max_join == '18446744073709551615'))
$smcFunc['db_query']('', "SET @@SQL_MAX_JOIN_SIZE = 18446744073709551615", array('security_override' => true));
}
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: sorensonfan41 on January 06, 2014, 03:39:58 PM
Quote from: emanuele on January 06, 2014, 03:10:31 PM
That's odd...
Pick a random message (for example the one you posted above), take note of the id (it's the number after msg in the link of the post, for example in http://www.simplemachines.org/community/index.php?topic=477019.msg3650014#msg3650014 the id is 3650014), go to phpmyadmin, find that message and post a screenshot of the result with (if possible) the entire message showing (or at least a piece including a \').

Here you go....(server names, complete database names, poster info/IP/email/etc. are blacked out)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on January 06, 2014, 05:18:49 PM
meh... that's SMF trying to be smart...
Use the query in this gist:
https://gist.github.com/emanuele45/8290814

raw version:
https://gist.github.com/emanuele45/8290814/raw/4cb7896e91930d7dc26c16ee5700a7cc772a72fc/gistfile1.sql
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: sorensonfan41 on January 06, 2014, 06:13:14 PM
Quote from: emanuele on January 06, 2014, 05:18:49 PM
meh... that's SMF trying to be smart...
Use the query in this gist:
https://gist.github.com/emanuele45/8290814

raw version:
https://gist.github.com/emanuele45/8290814/raw/4cb7896e91930d7dc26c16ee5700a7cc772a72fc/gistfile1.sql

I tried that a moment ago.  It affected 138,597 rows (and took 5.6446 seconds) -- that's between 1/3 and 1/2 of our messages table (307,788 as of the time of typing this).  I've been randomly going through the threads and it seems like it only affected the very old threads and didn't do anything for the newer threads.  I ran it again and it said 0 rows affected.

It also didn't fix the \s on quotation marks.

I wonder why it only affected the older posts and not the newer ones?
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on January 07, 2014, 07:42:58 AM
Pick a "recent" message that has not been affected by the query and see what the db values look like.
With quotation marks you mean double quotes? "?
That requires a different query, but let's solve one at a time. ;)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: sorensonfan41 on January 07, 2014, 12:54:07 PM
Quote from: emanuele on January 07, 2014, 07:42:58 AM
Pick a "recent" message that has not been affected by the query and see what the db values look like.
With quotation marks you mean double quotes? "?
That requires a different query, but let's solve one at a time. ;)

Yes, double quotes as in "s.

Here's a pic of another message that wasn't affected after that SQL query that you gave me and I tried yesterday (after backing up the database, of course).  The message was from Nov. 2013.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: brubsyoo on January 07, 2014, 02:05:01 PM
QuoteSorry, the database connection information used in the specified installation of SMF cannot access the installation of Invision Power Board 3.2. This may either mean that the installation doesn't exist, or that the Database account used does not have permissions to access it.

The error that was received from the Database was: SELECT command denied to user '[databaseprefix]_simplu'@'localhost' for table '[databaseprefix]members'

I got this, the converter doesn't run.
Also, i'm converting a 3.3.x board, is that the problem?
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on January 07, 2014, 02:31:11 PM
Quote from: sorensonfan41 on January 07, 2014, 12:54:07 PM
Here's a pic of another message that wasn't affected after that SQL query that you gave me and I tried yesterday (after backing up the database, of course).  The message was from Nov. 2013.
mmm... okay, so it seems that some of the single quotes were converted from \' to \&# 039;
Try this query:
https://gist.github.com/emanuele45/8290814/raw/eaec53760d227964a9bdc1ef632814b66b06ddaf/gistfile1.sql
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on January 07, 2014, 02:32:26 PM
Quote from: brubsyoo on January 07, 2014, 02:05:01 PM
QuoteSorry, the database connection information used in the specified installation of SMF cannot access the installation of Invision Power Board 3.2. This may either mean that the installation doesn't exist, or that the Database account used does not have permissions to access it.

The error that was received from the Database was: SELECT command denied to user '[databaseprefix]_simplu'@'localhost' for table '[databaseprefix]members'

I got this, the converter doesn't run.
Also, i'm converting a 3.3.x board, is that the problem?
As explained in the error there is a problem with the mysql users, the one you have used for SMF doesn't have access to the IPB installation, you should be able to give permissions (at least SELECT) from the control panel of your host.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: sorensonfan41 on January 07, 2014, 03:48:22 PM
Quote from: emanuele on January 07, 2014, 02:31:11 PM
mmm... okay, so it seems that some of the single quotes were converted from \' to \&# 039;
Try this query:
https://gist.github.com/emanuele45/8290814/raw/eaec53760d227964a9bdc1ef632814b66b06ddaf/gistfile1.sql

Just tried that SQL query and it affected 0 rows and did nothing.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: strano on January 23, 2014, 11:24:56 AM
Hi,
i tried this tool with a big database - 1,2 Gib - and it stops when try to convert posts. I think because of timeout or similiar.

In the SMF forum, after the converting process, i found the oldest posts. It's possible to process the converting process, from the newest post to oldest?

In the .sql file i didn't understand the syntax...i don't know so well the forum's databases.

Sorry for the bad english :)

I'm italian but i've posted here for all.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: margarett on January 23, 2014, 12:19:23 PM
Are you on a shared host? It's not uncommon to timeout in the conversion process. It is a quite heavy operation and PHP can get disconnected when MySQL is "hammered".

I usually try conversions (and even large upgrades in SMF) in my local machine as I often found this issue...

And no, you can't proceed from where you stopped. The converter usually truncates the destination tables before writing in them.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: strano on January 23, 2014, 01:11:01 PM
Maybe i didn't explained me :D
I don't want restart the process from the last stop, i would start, from the start, from the newest post to oldest. The reverse.
:)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: margarett on January 23, 2014, 01:16:03 PM
Oh, that :P

I am not sure of the implications, but you can edit the .sql file, find

FROM {$from_prefix}posts AS p
LEFT JOIN {$from_prefix}topics AS t ON (t.tid = p.topic_id)
LEFT JOIN {$from_prefix}members AS m ON (m.member_id = p.author_id)
WHERE t.forum_id IS NOT NULL;

And replace with:

FROM {$from_prefix}posts AS p
LEFT JOIN {$from_prefix}topics AS t ON (t.tid = p.topic_id)
LEFT JOIN {$from_prefix}members AS m ON (m.member_id = p.author_id)
WHERE t.forum_id IS NOT NULL
ORDER BY p.pid DESC;

Not tested in any way, so be sure to keep a copy of the original file ;)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: strano on January 24, 2014, 10:30:32 AM
Thanks a lot for your help!
I successfully completed in the normal way, after that i changed and optimized many tables in the database. Has reduced itself  the dimension about of 100mib, and it's gone well.

I don't know if it is for this or not, but now it's all ok!
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: emanuele on January 28, 2014, 05:39:12 PM
Hey strano, welcome around.

If you prefer Italian, don't be shy, I usually don't bite. :P (there is a board "somewhere (http://www.simplemachines.org/community/index.php?board=15.0)" lol)

As a general idea, I think that start from the beginning or from the end should not make much difference, just because the process *has* to finish correctly, if it doesn't something is broken and should be repeated or fixed.

If you start from the end and the conversion doesn't end properly, it would mean all the topics are missing some piece at the beginning, SMF *should* be able to fix the errors with a bit of maintenance, but again I would prefer to have a clean conversion than a totally messy forum...
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: NeBeDab on March 08, 2014, 07:38:01 AM
I have Version: IP.Board 3.3.4

I downloaded files from this link ----> http://www.simplemachines.org/community/index.php?topic=477019.0 (http://www.simplemachines.org/community/index.php?topic=477019.0)

and i have this error:

Sorry, the database connection information used in the specified installation of SMF cannot access the installation of Invision Power Board 3.2. This may either mean that the installation doesn't exist, or that the Database account used does not have permissions to access it.

The error that was received from the Database was: SELECT command denied to user 'user_smf754'@'localhost' for table 'members'

I follow all instructions but it stil doesn't work.. How can i fix this?!?
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: margarett on March 08, 2014, 09:53:54 AM
The MySQL user that SMF uses to connect to its database has no permission to access IPB database. You need to fix that in cPanel/phpmyadmin or maybe install SMF in the same database as IPB (different prefixes, of course) ;)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: brubsyoo on April 27, 2014, 03:36:51 PM
I get the same error and I don't know how to fix it, could you explain to me? I can't use a different prefix
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: margarett on April 27, 2014, 07:20:01 PM
I don't see why you can't use a different prefix, since that option is offered to you at SMF install...
Nevertheless, you need to make sure that the user you configured to use with IPB database can access SMF's database or vice-versa.

How to explain it in another way... No idea, really...
The converter runs with the database details of SMF (remember, it's a SMF converter...) so it can't access IPB's details (well, it could, but it would have to be so much difficult to handle for little to none profit).
For this reason, whatever database user SMF uses, it has to be able to read IPB database.

If you really don't know how to do it, please address your host about it. Just tell them: I need the user that accesses SMF's database is also able to access IPB's database...
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: brubsyoo on April 28, 2014, 03:50:35 PM
Quote from: margarett on April 27, 2014, 07:20:01 PM
I don't see why you can't use a different prefix, since that option is offered to you at SMF install...
Nevertheless, you need to make sure that the user you configured to use with IPB database can access SMF's database or vice-versa.

How to explain it in another way... No idea, really...
The converter runs with the database details of SMF (remember, it's a SMF converter...) so it can't access IPB's details (well, it could, but it would have to be so much difficult to handle for little to none profit).
For this reason, whatever database user SMF uses, it has to be able to read IPB database.

If you really don't know how to do it, please address your host about it. Just tell them: I need the user that accesses SMF's database is also able to access IPB's database...

Consegui, obrigada :D
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: virus191 on June 18, 2014, 05:18:44 AM
It doesnt work with 3.4.6 ?
Converting...
Converting members...
Unsuccessful!
This query:
SELECT
m.member_id AS id_member, SUBSTRING(m.name, 1, 80) AS member_name,
SUBSTRING(m.members_display_name, 1, 255) AS real_name, m.email AS email_address,
SUBSTRING(m.members_pass_hash, 1, 64) AS passwd, SUBSTRING(m.members_pass_salt, 1, 8) AS password_salt,
SUBSTRING(pp.pp_bio_content, 1, 255) AS usertitle, m.last_visit AS last_login,
m.joined AS date_registered, SUBSTRING(pc.field_3, 1, 255) AS website_url,
SUBSTRING(pc.field_3, 1, 255) AS website_title,
SUBSTRING(pc.field_4, 1, 255) AS icq, SUBSTRING(pc.field_1, 1, 16) AS aim,
SUBSTRING(pc.field_8, 1, 32) AS yim, SUBSTRING(pc.field_2, 1, 255) AS msn,
SUBSTRING(pp.signature, 1, 65534) AS signature, m.ip_address AS member_ip, m.ip_address AS member_ip2, '0' AS total_time_logged_in,
IF (m.bday_year IS NULL, '0001-01-01', IF (m.bday_year = 0 AND m.bday_month != 0 AND m.bday_day != 0, CONCAT('0004-', m.bday_month, '-', m.bday_day), CONCAT_WS('-', IF(m.bday_year <= 4, 0001, m.bday_year), IF(m.bday_month = 0, 01, IF(m.bday_month < 10, CONCAT('0', m.bday_month), m.bday_month)), IF(m.bday_day = 0, 01, IF(m.bday_day < 10, CONCAT('0', m.bday_day), m.bday_day))))) AS birthdate, m.email_pm AS pm_email_notify,
CASE
WHEN (m.member_group_id = '4') THEN 1
WHEN (m.member_group_id = '2') THEN -1
WHEN (m.member_group_id = '6') THEN 2
ELSE 0
END AS id_group,
CASE
WHEN (pc.field_5 = 'm') THEN 1
WHEN (pc.field_5 = 'f') THEN 2
ELSE 0
END AS gender
FROM `vrsnet_tibipb`.ibf_members AS m
LEFT JOIN `vrsnet_tibipb`.ibf_pfields_content AS pc ON (pc.member_id = m.member_id)
LEFT JOIN `vrsnet_tibipb`.ibf_profile_portal AS pp ON (pp.pp_member_id = m.member_id)
LIMIT 0, 500;
Caused the error:
Unknown column 'pp.pp_bio_content' in 'field list'
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: darkden on July 04, 2014, 03:22:21 AM
Great job! (http://www.ultima-ru.com/wp-includes/images/smilies/icon_wink.gif)
Thx alot convert my ipb 3.3 into smf2, all work fine.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: punjabizone on July 11, 2014, 05:09:35 PM
hello i am using ipboard 3.4.6 i getting error while i am converting

QuoteSorry, the database connection information used in the specified installation of SMF cannot access the installation of Invision Power Board 3.2. This may either mean that the installation doesn't exist, or that the Database account used does not have permissions to access it.

The error that was received from the Database was: SELECT command denied to user 'punjabi_smf'@'localhost' for table 'members'

Please anyone help me how to fix this error please
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: punjabizone on July 11, 2014, 05:44:08 PM
plz anyone help me i keep getting this while i tring to convert my board to smf

Sorry, the database connection information used in the specified installation of SMF cannot access the installation of Invision Power Board 3.2. This may either mean that the installation doesn't exist, or that the Database account used does not have permissions to access it.

The error that was received from the Database was: SELECT command denied to user 'punjabi_smf'@'localhost' for table 'members'
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: punjabizone on July 13, 2014, 01:18:56 AM
Hello i fix the above error !but now i am facing this error when i started to converting

how i can fix this please help me



Converting...
Converting members...
Unsuccessful!
This query:
SELECT
m.member_id AS id_member, SUBSTRING(m.name, 1, 80) AS member_name,
SUBSTRING(m.members_display_name, 1, 255) AS real_name, m.email AS email_address,
SUBSTRING(m.members_pass_hash, 1, 64) AS passwd, SUBSTRING(m.members_pass_salt, 1, 8) AS password_salt,
m.title AS usertitle, m.last_visit AS last_login,
m.joined AS date_registered, SUBSTRING(pc.field_3, 1, 255) AS website_url,
SUBSTRING(pc.field_3, 1, 255) AS website_title,
SUBSTRING(pc.field_4, 1, 255) AS icq, SUBSTRING(pc.field_1, 1, 16) AS aim,
SUBSTRING(pc.field_8, 1, 32) AS yim, SUBSTRING(pc.field_2, 1, 255) AS msn,
SUBSTRING(pp.signature, 1, 65534) AS signature, m.ip_address AS member_ip, m.ip_address AS member_ip2, '0' AS total_time_logged_in,
IF (m.bday_year IS NULL, '0001-01-01', IF (m.bday_year = 0 AND m.bday_month != 0 AND m.bday_day != 0, CONCAT('0004-', m.bday_month, '-', m.bday_day), CONCAT_WS('-', IF(m.bday_year <= 4, '0001', m.bday_year), IF(m.bday_month = 0, '01', IF(m.bday_month < 10, CONCAT('0', m.bday_month), m.bday_month)), IF(m.bday_day = 0, '01', IF(m.bday_day < 10, CONCAT('0', m.bday_day), m.bday_day))))) AS birthdate,
CASE
WHEN (m.member_group_id = '4') THEN 1
WHEN (m.member_group_id = '2') THEN -1
WHEN (m.member_group_id = '6') THEN 2
ELSE 0
END AS id_group,
CASE
WHEN (pc.field_5 = 'm') THEN 1
WHEN (pc.field_5 = 'f') THEN 2
ELSE 0
END AS gender
FROM `punjabi_s`.members AS m
LEFT JOIN `punjabi_s`.pfields_content AS pc ON (pc.member_id = m.member_id)
LEFT JOIN `punjabi_s`.profile_portal AS pp ON (pp.pp_member_id = m.member_id)
LIMIT 0, 500;
Caused the error:
Unknown column 'pc.field_3' in 'field list'
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: margarett on July 14, 2014, 05:36:12 AM
It seems that your database layout is different from the one used to build the converter... Since those are minor user details, you can just delete this content:
SUBSTRING(pc.field_3, 1, 255) AS website_url,
SUBSTRING(pc.field_3, 1, 255) AS website_title,
SUBSTRING(pc.field_4, 1, 255) AS icq, SUBSTRING(pc.field_1, 1, 16) AS aim,
SUBSTRING(pc.field_8, 1, 32) AS yim, SUBSTRING(pc.field_2, 1, 255) AS msn,

From the converter...
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: punjabizone on July 14, 2014, 01:51:51 PM
Thank You sir :)

I will try again  and delete these contents
Quote from: margarett on July 14, 2014, 05:36:12 AM
It seems that your database layout is different from the one used to build the converter... Since those are minor user details, you can just delete this content:
SUBSTRING(pc.field_3, 1, 255) AS website_url,
SUBSTRING(pc.field_3, 1, 255) AS website_title,
SUBSTRING(pc.field_4, 1, 255) AS icq, SUBSTRING(pc.field_1, 1, 16) AS aim,
SUBSTRING(pc.field_8, 1, 32) AS yim, SUBSTRING(pc.field_2, 1, 255) AS msn,

From the converter...
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: punjabizone on July 14, 2014, 02:26:02 PM
Thank sir so much finally my  board is successfully convert to smf
but user posts count is zero now i can fix this, i was make around 22,000 posts on my profile its 0 post count how i can fix this
thank you everybody


Quote from: margarett on July 14, 2014, 05:36:12 AM
It seems that your database layout is different from the one used to build the converter... Since those are minor user details, you can just delete this content:
SUBSTRING(pc.field_3, 1, 255) AS website_url,
SUBSTRING(pc.field_3, 1, 255) AS website_title,
SUBSTRING(pc.field_4, 1, 255) AS icq, SUBSTRING(pc.field_1, 1, 16) AS aim,
SUBSTRING(pc.field_8, 1, 32) AS yim, SUBSTRING(pc.field_2, 1, 255) AS msn,

From the converter...
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: margarett on July 14, 2014, 02:31:56 PM
Go to your ACP --> maintenance --> Recount forum totals.

You can also use this MOD
https://github.com/Spuds/SMF-Admin-Toolbox

That allows to recount user totals
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: punjabizone on July 15, 2014, 02:22:27 AM
i am use the mod its work now , its show the total post count

thank yo so sososo much margarett you help me a lot
you are good supporter thank you so much Margarett
Quote from: margarett on July 14, 2014, 02:31:56 PM
Go to your ACP --> maintenance --> Recount forum totals.

You can also use this MOD
https://github.com/Spuds/SMF-Admin-Toolbox

That allows to recount user totals
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: margarett on July 15, 2014, 11:58:41 AM
;)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: nayson on July 15, 2014, 12:58:40 PM
Just tried this.
When the converter was converting posts, this happened:

Converting posts (this may take some time)...

Notice: Undefined variable: result in public_html/smf/convert.php on line 2491

Notice: Undefined variable: result in public_html/smf/convert.php on line 2492

Warning: get_resource_type() expects parameter 1 to be resource, null given in public_html/smf/convert.php on line 2733

Notice: Undefined index: db_fetch_assoc in public_html/smf/convert.php on line 2737

Fatal error: Function name must be a string in public_html/smf/convert.php on line 2737
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: margarett on July 15, 2014, 01:36:36 PM
I found this topic
http://www.simplemachines.org/community/index.php?topic=510153.msg3599822#msg3599822

It's not related to the same converter, but it might apply, dunno, you need to test (let me know if you need help in doing it)

In either case, it has to be something specific to your setup as this didn't occur before with this converter...
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: piratx on April 13, 2015, 09:28:46 PM
Hello guys and what a nice community, glad I made it to SMF.
I am an angry IPB user, and now I feel a happy and lucky to move to SMF.

Still trying to find a way to get my old users/topics etc etc
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: margarett on April 14, 2015, 05:58:38 AM
Hi and welcome to sm.org.

Quote from: piratx on April 13, 2015, 09:28:46 PM
Still trying to find a way to get my old users/topics etc etc
Well, this is what the converter is for. Did you try to use it? Are you struggling, don't know what to do? Can we help you somehow?
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: vampiretrix on May 18, 2015, 12:20:33 PM
I've got an IPB 4 board, but I'm really sick of IPB and how it works (it breaks constantly, for the most laughable reasons).

I'd like to convert it to SMF, but is there any way to do so with this converter or does it require a completely new converter?
If so, is there any converter already available?

Thanks for the help,

Kevin
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: margarett on May 18, 2015, 02:19:53 PM
Hi

I believe that this is the most updated converter for IPB and it covers 3.x.
It is possible that it works for IPB 4, or not, really. It depends on the database changes that existed.

We can only tell by trying :P
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: mm21xx on May 28, 2015, 12:55:51 PM
Hiya!!

I'm pretty new to all this, but I've been trying to get through the conversion of IPBoard 3.4.7 to the latest SMF, but right away at the conversion, I get this:
Converting members... Successful.
Converting categories...Duplicate entry '255' for key 'PRIMARY'

Any help on this to continue the conversion?

Thanks!
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: margarett on May 28, 2015, 02:29:18 PM
Yes, there is an easy fix for that. I'll explain later when I'm at the computer ;)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: mm21xx on May 28, 2015, 02:35:17 PM
Excellent, I'll be waiting impatiently for you reply!  ;D

Thanks for your time you take to help us out!
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: margarett on May 28, 2015, 05:15:55 PM
OK, so...
Categories are stored in a table... you guessed it, smf_categories ;D
The ID of the categories is an unsigned tinyint, which means that it stores a maximum value of 255. When fetching data from other platforms, original IDs are kept and your origin IPB must have a category bigger than 255, which makes it be stored as 255 (the upper limit). Do that twice and you get a duplicate error.

So, we need to fix that.
Go to phpmyadmin, table smf_categories, then SQL tab. Write the following:
ALTER TABLE smf_categories CHANGE id_cat id_cat SMALLINT(4) UNSIGNED NOT NULL AUTO_INCREMENT;

This will change the column to be an unsigned small integer, which stores a maximum of 65536.
Then restart the converter and this problem should be gone ;)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: mm21xx on May 29, 2015, 12:31:24 PM
Thanks, that worked out well.

Welp... After some hefty time of converting, I stumbled accross this error now:
Converting posts (this may take some time)...
Got a packet bigger than 'max_allowed_packet' bytes

I'm assuming that this is a setting that can be adjusted somewhere in the script?

Thanks in advance.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: margarett on May 29, 2015, 01:12:11 PM
Uh, that is new to me :o

Gave it a quick search and it seems a MySQL configuration that prevents a maximum amount of information to be sent to it at once. If you can access your MySQL configuration, set max_allowed_packet to a greater value and restart it.

You can also try to lower the number of posts that the converter tries to send at once (although this will make your conversion much, much slower).
In your .sql file you should find this:
---* {$to_prefix}messages
Add after a number of posts to do at once after it. If nothing is given the converter uses 500 (IIRC, not totally sure). So try, eg:
---* {$to_prefix}messages 100
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: postpar on June 12, 2015, 04:46:09 PM
There is supposed to be a 3.2-3.4 converter at http://www.simplemachines.org/community/index.php?topic=477019.msg3363755#msg3363755 but I can't seem to dowload it? I found the other file as the first post. I would love to have this since I have to bring ina  WebWizForums database and the only way I can do it is through IPB!
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: Illori on June 12, 2015, 06:26:39 PM
that attachment had been removed.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: postpar on June 13, 2015, 11:46:47 AM
Ummm... any reason? (Note: for me it was part of a two step process to get out of WebWiz Forums. However I wasn't able to do step 1 since the IPB converter doesn't work.)
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: Illori on June 13, 2015, 11:52:54 AM
for some reason the author of that post removed it. no idea why.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: postpar on June 13, 2015, 01:51:18 PM
Oh - thanks. Odd, he kept the original script up!
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: EricGagne on July 02, 2015, 11:14:34 AM
Hello,

I am having issues with a conversion.

First, the environment.  I am moving from IPB Hosted community to SMF on my own VPS.   Not having access to phpMyAdmin on Invision's side, I had to use the "SQL Backup" option in the admin control panel which creates a SQL file.

I created a database on my server and ran the SQL file to import the data.  This seems to have worked but I cannot check its validity because I can't install IPB on this server to "test" the database.

I created a local version of conf_global.php with the correct information for the converter to get the IPB database connection info. 

First time I ran the converter, I received Unknown system variable 'SQL_MAX_JOIN_SIZE' errors.  It seems to be related to the version of mysql so I edited the conver.php file and changed all those to MAX_JOIN_SIZE.

That seems to have fixed this problem but now, right at the start, the converter gives me

Converting members...Field 'buddy_list' doesn't have a default value

and stops there.  I searched this topic for "buddy_list" but I seem to be the first one reporting such a problem.   

I would appreciate any help.


Edit:  And now I just realized the converter title says IPB 3.2 to SMF Converter.  I am converting from 3.4.7.   I downloaded the files from the first post in this topic, is there a newer version ?
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: postpar on July 02, 2015, 01:35:55 PM
If there is not a newer version, can you use PHPMySQL? It';s standard in CPanel installations. You could use that to give buddy_list a default value. Or you could go into the converter, and comment out any references to buddy_list. I don't think your members will object to its loss or reset.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: EricGagne on July 02, 2015, 06:19:14 PM
Problem fixed.  It has to do with the way MySQL 5.x handles TEXT columns with no default values.   I only needed to disable strict mode.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: CrazyTech on July 24, 2015, 04:09:32 PM
Nevermind. Think I got it, thanks!
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: CrazyTech on July 24, 2015, 05:36:42 PM
Well, I got past my earlier error, but there were so many errors with this conversion that I don't know where to start. All accounts came over as guests and topics didn't make it. I'm now unable to login so I don't see me having the knowledge to get this converted over. SMF was worth a shot, but oh well.

This is with IPB 3.4.8.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: margarett on July 25, 2015, 08:52:16 AM
Several people already used this with much success so I would guess that we should try again?
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: CrazyTech on July 28, 2015, 03:15:06 PM
Quote
Fatal error: Call to undefined function getAttachmentFilename() in /home/adonai/public_html/smf/convert.php on line 2339

That's the first error, because the usernames aren't coming over. It looks like the actual topics have, but none of the accompanying data linking them to the individual forums, etc. I tried to work through a couple of the errors, but I saw stuff like this on almost every page.

I can delete everything out and start afresh I suppose, but it seems like a lot of issues that might be a bit beyond my coding knowledge.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: Bigdesaster on January 30, 2016, 05:02:38 PM
Hello everybody,

I tried to convert my board from IPB3.4.7 to SMF2.0.11

Just got an errror converting  personal messagess but i can skip this error by increasing start in URL
QuoteConverting personal messages (step 2)...Duplicate entry '555-4' for key 1
.

The real problem i got is that the most boards are moved to "general caterory"
Some categorys were created but empty, others were even not created.
What could be the reason for this and how to fix?

thank you
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: Bigdesaster on January 31, 2016, 11:05:19 AM
Hello again,
i was able to fix it myself

Just open ipb3_to_smf.sql and search for:
/******************************************************************************/
--- Converting boards...
/******************************************************************************/
Replace
SELECT
b.id AS id_board, SUBSTRING(b.name, 1, 255) AS name,
SUBSTRING(b.description, 1, 65534) AS description, b.position AS board_order,
b.posts AS num_posts, IF (p.parent_id = -1, 0, p.parent_id) AS id_parent, b.inc_postcount AS count_posts,
        '-1,0' AS member_groups
FROM {$from_prefix}forums AS b
        LEFT JOIN {$from_prefix}forums AS p ON (b.parent_id = p.id)
WHERE b.parent_id != -1;
---*


i replaced it with:

SELECT
b.id AS id_board, SUBSTRING(b.name, 1, 255) AS name,
SUBSTRING(b.description, 1, 65534) AS description, b.position AS board_order,
b.posts AS num_posts, IF (b.parent_id = -1, 0, b.parent_id) AS id_parent, b.inc_postcount AS count_posts,
        '-1,0' AS member_groups
FROM {$from_prefix}forums AS b
        LEFT JOIN {$from_prefix}forums AS p ON (b.parent_id = p.id)
WHERE b.parent_id != -1;
---*

Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: Immort on July 26, 2016, 03:16:48 AM
Hi,

I would like to know if this project is still ongoing, and if newer versions of this converter will be coming up?

I am very interested to convert an IPB 3.4.3 into Simple Machines. 3.4.x is the latest IPB board that is available for people with perpetual licences, so there are many of us already who are interested in another good forum software.

Many thanks,
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: jack208 on August 27, 2017, 04:11:47 AM
I am looking to convert IPB 3.4.5. Is this still active or no further progress? Thanks in advance.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: d3vcho on August 27, 2017, 09:38:30 AM
I believe there has been no progress on this for too long.
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: Qunir on August 12, 2018, 01:44:38 PM
I used IPB 3.4.6
Please help me. What i can do?

Converting members...
Notice: Undefined property: mysqli_result::$EOF in /usr/home/Qunir/domains/qunir.usermd.net/public_html/convert.php on line 2718 Notice: Undefined property: mysqli_result::$Fields in /usr/home/Qunir/domains/qunir.usermd.net/public_html/convert.php on line 2722 Notice: Trying to get property of non-object in /usr/home/Qunir/domains/qunir.usermd.net/public_html/convert.php on line 2723 Fatal error: Call to undefined method mysqli_result::MoveNext() in /usr/home/Qunir/domains/qunir.usermd.net/public_html/convert.php on line 2728
Title: Re: [WIP - Converter] IPB 3.2/3.3/3.4
Post by: d3vcho on August 12, 2018, 06:23:35 PM
Hello,

Sorry but currently we don't have any member working on the converters, so your issue will likely remain unsolved...