Simple Machines Community Forum

SMF Support => Converting to SMF => Topic started by: emanuele on October 26, 2013, 12:01:46 PM

Title: [SMF Converter] UBB.threads 7.5
Post by: emanuele on October 26, 2013, 12:01:46 PM
Here it is an hopefully working converter for UBB.threads 7.5.

Thanks to Sea Mac (http://www.simplemachines.org/community/index.php?action=profile;u=81988) and his collaborators that provided the database and support to fix the converter.

I hope it will be helpful to others as well.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Sea Mac on October 26, 2013, 12:55:55 PM
1,000,000 thanks for helping us out!

Our forum had 12 years at UBB Classic/Threads: with OVER 247,000 posts in more than 22,200 topics. Famous people - Like John Morley and (I think) Terence McKenna - have posted (and since died) and we REALLY Wanted to preserve what they wrote to us ....

But it seems that UBB Threads is not being updated, or developed, much (if at all) and is now becoming practically unusable - requiring older versions of PHP and the like. I've been a SMF user (and beta tester of 2) for 7 years: and had WANTED to get my Home forum "Up to Date" and SECURE since 2007. But NO ONE has (until today) a viable converter for UBB Threads 7.5.7 to ANY open source PHP BBS ... so we were "Stuck" in that old UBB Threads - stranded actually!

You Saved our "Gold" for Us!!!! WE are eternally grateful!!! (And SMF users 4ever ...
:laugh: )

I suppose I should report the problems with the WYSIWYG editing (leaving 'extra' BBC tags scattered throughout posts and the like) these New SMF users are reporting to me
::) .... (Sigh). And Posts in GrandChildren Boards are not showing up in "Last Post" item on front page ... (Whaaaa. big whoop ::) )

But most of them have never SEEN detailed Stats before - or so many ways to add expression to posting - and are as delighted as children at Christmas with the NEW forum.

You do magnificent work - Thank You!!

Sea Mac and the Gang ..
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: emanuele on October 26, 2013, 01:06:15 PM
Glad to be able to help. :)

Quote from: Sea Mac on October 26, 2013, 12:55:55 PM
I suppose I should report the problems with the WYSIWYG editing (leaving 'extra' BBC tags scattered throughout posts and the like) these New SMF users are reporting to me ::)
It's a known bug.
I think I tried to fix some of those errors while working on 2.1 (the fixes should still be around in the "fixes or bogus bug" board and should be possible to find them), but then I stopped when a brand new editor was used to replace the current one (And the second option is that you can install the SCEditor mod (http://custom.simplemachines.org/mods/index.php?mod=3594) that brings the editor that will be used on SMF 2.1 to SMF 2.0).

Quote from: Sea Mac on October 26, 2013, 12:55:55 PM
And Posts in GrandChildren Boards are not showing up in "Last Post" item on front page ... (Whaaaa. big whoop ::) )
And this is done like that by design, in order to keep the performance impact of such operations at an acceptable level.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on October 26, 2013, 01:08:58 PM
The grand children "thing" is normal, as you may know.
There is a MOD to solve that, but with a performance hit attached...

kudos emanuele, you're the conversion master :P
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Ichinen on October 26, 2013, 01:57:24 PM
I'm echoing what Sea Mac wrote:

Quote1,000,000 thanks for helping us out!

Our forum had 12 years at UBB Classic/Threads: with OVER 247,000 posts in more than 22,200 topics. Famous people - Like John Morley and (I think) Terence McKenna - have posted (and since died) and we REALLY Wanted to preserve what they wrote to us ....
But it seems that UBB Threads is not being updated, or developed, much (if at all) and is now becoming practically unusable - requiring older versions of PHP and the like. I've been a SMF user (and beta tester of 2) for 7 years: and had WANTED to get my Home forum "Up to Date" and SECURE since 2007. But NO ONE has (until today) a viable converter for UBB Threads 7.5.7 to ANY open source PHP BBS ... so we were "Stuck" in that old UBB Threads - stranded actually!

You Saved our "Gold" for Us!!!! WE are eternally grateful!!! (And SMF users 4ever ... :laugh: )

"Famous people - Like John Morley and (I think) Terence McKenna - have posted (and since died) and we REALLY Wanted to preserve what they wrote to us ...."

Not to mention Karl Hanes (who worked with Salvia divinorum for depression, when it was legal in Australia); there are others, but I will respect their privacy.

I must say, though, that we were becoming a bit frantic, being 'stuck' at UBB Classic (then Threads), because many of us ONLY post our research and reports of findings at WorldEyes, and it would have been tragic to have lost all that, since much of our work cannot be found anyplace else on the internet...

I am deeply grateful to Sea Mac for all his tinkering with SMF at his other websites, to make sure SMF fits our WorldEyes community like a glove.

And emanuele, you have no idea what a service you've provided in creating that converter for us - and WE got to help with getting the bugs out, so the next "UBB refugees" will have a squeaky clean converter. Thank you, so much.

*bowing Respect and Appreciation*

Ichinen / anna
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 07, 2013, 12:57:54 PM
Hi there
Never done converting before, but the process seemed straight forward and I gave it a go.

This is how far I got :D

QuoteConverting members... Successful.
Converting categories... Successful.
Converting boards...Wrong value type sent to the database. Integer expected. (board_order)

I'm converting from Ubbthreads 7.5 to smf 2.0.6
Any clue what I can do to get things running further?
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Sea Mac on November 07, 2013, 01:30:06 PM
Quote from: forumfjott on November 07, 2013, 12:57:54 PM
Hi there
Never done converting before, but the process seemed straight forward and I gave it a go.

This is how far I got :D

QuoteConverting members... Successful.
Converting categories... Successful.
Converting boards...Wrong value type sent to the database. Integer expected. (board_order)

I'm converting from Ubbthreads 7.5 to smf 2.0.6
Any clue what I can do to get things running further?
This might depend on what version of UBB Threads you are running.

The UBB Threads database we gave to the development team here was for UBB Threads 7.5.7 (the "latest" version of UBB Threads). What version of UBB Threads are you running?

(If it is a version of 7.5 BEFORE 7.5.7 I would recommend that you upgrade your version of UBB Threads to version 7.5.7 first. It seems UBB makes significant changes to their databases even between 'minor' 0.0.X releases so I wouldn't think an earlier version would convert without a hitch.)

Hope this helps!
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: emanuele on November 07, 2013, 02:55:02 PM
I don't have any more the db, so I can't be sure, though you can try adding:

$row['board_order'] = (int) $row['board_order'];

just after the line:
$row['description'] = str_replace("\"", """, $row['description']);
this won't fix the issue, but at least it should let you continue.
Some boards may be in the wrong order after the conversion.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 07, 2013, 04:26:24 PM
managed to get past this one, but is now stuck on the next part.

QuoteConverting topics...
Wrong value type sent to the database. Integer expected. (id_last_msg)

This one I don't see a solution to. Will try to update to 7.5.7 during the weekend if you cannot help me on this one.

Thanks a lot for your attention
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: emanuele on November 07, 2013, 06:11:16 PM
O_o

No idea, sorry. I'd have to have a look at the database to know what could be wrong on that one...
It may be something related to polls, but it's difficult to guess.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 08, 2013, 08:02:48 AM
I don't even know where to start looking...
Fingers crossed for the update to fix it
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 08, 2013, 08:45:05 AM
Update did not fix it :(

I've googled the issue, but cannot find any other having asked the same question.
Mind me asking... Is it related to the newly installed forum or the old one?
Can it be skipped?
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Oldiesmann on November 08, 2013, 11:58:19 AM
The only way to fix that issue is to either figure out what's causing it to begin with, or add code to force that value to be an integer, which will cause more problems later on (after the conversion, information about the last post in a particular topic may not be displayed properly).

Without access to the database, it's difficult to say what could be causing that.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: emanuele on November 09, 2013, 10:55:47 AM
The ubb db schema has TOPIC_LAST_POST_ID as int, a LEFT JOIN should not cause problems with the first table (AFAIK), and it cannot be skipped because IIRC SMF has an index on (id_last_msg, id_board) that would prevent throw in "random" numbers...
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: StanJ on November 09, 2013, 07:34:23 PM
so do I install a fresh SMF  ie myforum.com/smf/ and the put the import gizmo myforum.com/smf/convert.php
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Colin on November 10, 2013, 01:04:44 AM
Have a read through this before doing any of it, if you will. It will explain what to do, step by step.

http://wiki.simplemachines.org/smf/Converting
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 10, 2013, 02:41:32 PM
OK.
Deleted the last forum and try again.
I now have clean install smf v2.0.6.
Database is set to the same as the present ubbthreads database. The prefix is set to smf_.

Forum up and running OK

........

uploaded the two files:
ubbt7-5_to_smf.sql
convert.php

run convert.php
................

Same error

Converting topics...
Wrong value type sent to the database. Integer expected. (id_last_msg)

.................

I have seen through the database and cannot even find any tables or other data mentioning id_last_msg, so I'm 100% stuck.
I'll grant access to the PHPMyAdmin for emanuelle if you think you can help me get things going...
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: mentalist on November 10, 2013, 04:45:43 PM
in ubbthreads75_to_smf.sql find:
---* {$to_prefix}topics
---{


add after
$row['id_last_msg'] = (int) $row['id_last_msg'];
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 11, 2013, 07:17:34 AM
Thanks Dexter

New error msg:

Converting topics...
Wrong value type sent to the database. Integer expected. (id_member_updated)

:-\

Found it in
/******************************************************************************/
--- Converting topics...
/******************************************************************************/

TRUNCATE {$to_prefix}topics;
TRUNCATE {$to_prefix}log_topics;
TRUNCATE {$to_prefix}log_boards;
TRUNCATE {$to_prefix}log_mark_read;

---* {$to_prefix}topics
---{
$row['id_last_msg'] = (int) $row['id_last_msg'];
$ignore = true;
---}
SELECT
t.TOPIC_ID AS id_topic, t.TOPIC_IS_STICKY AS is_sticky, t.FORUM_ID AS id_board,
t.POST_ID AS id_first_msg, t.TOPIC_LAST_POST_ID AS id_last_msg,
t.USER_ID AS id_member_started, t.TOPIC_LAST_POSTER_ID AS [b]id_member_updated[/b],
IFNULL(ps.POLL_ID, 0) AS id_poll,
t.TOPIC_REPLIES AS num_replies, t.TOPIC_VIEWS AS num_views,
t.TOPIC_STATUS = 'C' AS locked, t.TOPIC_IS_APPROVED as approved
FROM {$from_prefix}TOPICS AS t
LEFT JOIN {$from_prefix}POLL_DATA as ps ON (ps.POST_ID = t.POST_ID);
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 11, 2013, 07:26:04 AM
You should try the same principle:

$row['id_member_updated'] = (int) $row['id_member_updated'];


Although the main concern would be to understand WHY are those fields not interpreted as integers in the first place.
Can you check in SMF "smf_topics" table if the "id_last_msg" was correctly converted in your last run?
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 11, 2013, 07:32:22 AM
error:
QuoteConverting members... Successful.
Converting categories... Successful.
Converting boards... Successful.
Converting topics... Unsuccessful!
This query:
SELECT
t.TOPIC_ID AS id_topic, t.TOPIC_IS_STICKY AS is_sticky, t.FORUM_ID AS id_board,
t.POST_ID AS id_first_msg, t.TOPIC_LAST_POST_ID AS id_last_msg,
t.USER_ID AS id_member_started, t.TOPIC_LAST_POSTER_ID AS id_member_updated,
$row['id_member_updated'] = (int) $row['id_member_updated']
LIMIT 0, 500;
Caused the error:
You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '['id_member_updated'] = (int) $row['id_member_updated']
LIMIT 0, 500' at line 5

edited xxx.sql:
/******************************************************************************/
--- Converting topics...
/******************************************************************************/

TRUNCATE {$to_prefix}topics;
TRUNCATE {$to_prefix}log_topics;
TRUNCATE {$to_prefix}log_boards;
TRUNCATE {$to_prefix}log_mark_read;

---* {$to_prefix}topics
---{
$row['id_last_msg'] = (int) $row['id_last_msg'];
$ignore = true;
---}
SELECT
t.TOPIC_ID AS id_topic, t.TOPIC_IS_STICKY AS is_sticky, t.FORUM_ID AS id_board,
t.POST_ID AS id_first_msg, t.TOPIC_LAST_POST_ID AS id_last_msg,
t.USER_ID AS id_member_started, t.TOPIC_LAST_POSTER_ID AS id_member_updated,
$row['id_member_updated'] = (int) $row['id_member_updated'];
IFNULL(ps.POLL_ID, 0) AS id_poll,
t.TOPIC_REPLIES AS num_replies, t.TOPIC_VIEWS AS num_views,
t.TOPIC_STATUS = 'C' AS locked, t.TOPIC_IS_APPROVED as approved
FROM {$from_prefix}TOPICS AS t
LEFT JOIN {$from_prefix}POLL_DATA as ps ON (ps.POST_ID = t.POST_ID);
---*
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 11, 2013, 07:45:56 AM
Not like that :P

---* {$to_prefix}topics
---{
$row['id_last_msg'] = (int) $row['id_last_msg'];
$row['id_member_updated'] = (int) $row['id_member_updated'];

$ignore = true;
---}
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 11, 2013, 07:47:39 AM
I moved the last entry to the line under tha last one like you show, and now things are happening :D... I think

GEt one msg:
QuoteConverting...
Converting posts (this may take some time)...
Duplicate entry '143276' for key 1

but it looks like it's working with something.
A progress bar or icon would be usefull.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 11, 2013, 08:13:50 AM
Yes, you've past topics conversion ;)

That error can also be bypassed with:

/******************************************************************************/
--- Converting posts (this may take some time)...
/******************************************************************************/

TRUNCATE {$to_prefix}messages;

---* {$to_prefix}messages 200
---{
$row['subject'] = str_replace(array("'", '"'), array("'", """), $row['subject']);
$row['body'] = strtr(str_replace(array("'", '"'), array("'", "&quot;"), $row['body']), array("\n" => '<br />'));
$ignore = true;
---}

(note the new "$ignore=true" line ;) )
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 11, 2013, 08:24:28 AM
It looks like it's stuck.
I'll add this last line and run again.

EDIT: I see the count rising in the URL adress bar! 288200 and counting... 585000 all together :D
Thanks a lot for your help so far
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 11, 2013, 10:00:25 AM
will the converter continue working if I take my PC offline? I have to leave to take the train home and PC will be offline for 45 minutes... and it still have to count 140.000 posts + all the next processes
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 11, 2013, 10:02:51 AM
No, it won't :( The only way to do that is via CLI (server side) but:
- not sure if it works (probably no one uses that for a long time)
- you need to have SSH access to do do that (and you probably don't)
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 11, 2013, 10:05:56 AM
hope it picks up from where it left then ;)
If I leave it here, it will go to sleep mode anyway.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 11, 2013, 10:11:37 AM
You can disable sleep mode in power options ;)

I will restart. You see that every database operation starts with "TRUNCATE" to the destination table, which means empty it.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 11, 2013, 01:08:24 PM
cannot change properties for sleep mode on my company computer ;)
had to restart, but the first 200.000 post went quick. Now it counts 600 post pr. cycle, but ony 120.000 to go before next step of the convertion
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 11, 2013, 02:28:19 PM
QuoteConverting posts (this may take some time)...
Successful.
Recounting post counts...Wrong value type sent to the database. Integer expected. (date_registered)

:D
Nothing is straight forward with this convert

EDIT: tried to insert a line like those above, and it started counting posts again...cr@p
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 11, 2013, 02:37:23 PM
Following same logics:

/******************************************************************************/
--- Recounting post counts...
/******************************************************************************/

---* {$to_prefix}members 20
---{
$type = 'replace';
---}

Replace with:

/******************************************************************************/
--- Recounting post counts...
/******************************************************************************/

---* {$to_prefix}members 20
---{
$type = 'replace';
$row['date_registered'] = (int) $row['date_registered'];
---}


Quote from: forumfjott on November 11, 2013, 02:28:19 PM
Nothing is straight forward with this convert
Eeeeexactly! :P
Converters are really complicated pieces of software, dealing with *very* different server setups, databases, etc etc... Unfortunately it is, most of the times, difficult...
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 11, 2013, 02:48:43 PM
hehehe... I see the light in the end of the tunnel, so I bear with it.

I did see the similarity in the script, so I inserted that line, but over the $type line. does it matter? hope not.
I also want to increse the amount of posts since it will be a lot of counting i presume.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 11, 2013, 02:52:13 PM
It shouldn't matter, no.

Yes, you should be able to do that, yes. Maybe that "200" in "---* {$to_prefix}messages 200"
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 11, 2013, 02:58:47 PM
i set 600 and forum still seems quick and OK.
I also raised the members counting to 35. It has about 5500 members.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 11, 2013, 03:01:11 PM
Please note that you can increase that as much as you want. It will only stop when you hit some limit (memory, timeout, max connections, etc) or if your MySQL "dies" due to excessive connections and the converter hangs.
In any case, just decrease and retry ;)
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 11, 2013, 03:57:32 PM
QuoteConverting posts (this may take some time)...
Successful.
Recounting post counts...Wrong value type sent to the database. Integer expected. (id_group)

This is just the second of the list for the current process:
SELECT m.id_member, mem.member_name, mem.date_registered, COUNT(*) as posts, mem.id_group, mem.lngfile, mem.last_login, mem.real_name, mem.instant_messages, mem.unread_messages,

mem.new_pm, mem.buddy_list, mem.pm_ignore_list, mem.pm_prefs, mem.mod_prefs, mem.message_labels, mem.passwd, mem.openid_uri, mem.email_address, mem.personal_text, mem.gender,

mem.birthdate, mem.website_title, mem.website_url, mem.location, mem.icq, mem.aim, mem.yim, mem.msn, mem.hide_email, mem.show_online, mem.time_format, mem.signature,

mem.time_offset, mem.avatar, mem.pm_email_notify, mem.karma_bad, mem.karma_good, mem.usertitle, mem.notify_announcements, mem.notify_regularity, mem.notify_send_body,

mem.notify_types, mem.member_ip, mem.member_ip2, mem.secret_question, mem.secret_answer, mem.id_theme, mem.is_activated, mem.validation_code, mem.id_msg_last_visit,

mem.additional_groups, mem.smiley_set, mem.id_post_group, mem.total_time_logged_in, mem.password_salt, mem.ignore_boards, mem.warning, mem.passwd_flood, mem.pm_receive_from
FROM {$to_prefix}messages as m


Could just as well make new lines for every item?
I cannot run through all posts so many times as there is values :'(
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 11, 2013, 04:03:01 PM
Well, we're still to find out why is it triggering that error! Because the origin fields are, for sure, integers... And, surprisingly enough, it is now in SMF tables already...

Anyway, you can do that for the integer fields only.

I would advise you to skip that part and have, later, SMF itself to recount totals.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 11, 2013, 04:12:17 PM
aaaand how to set a skip command?
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 11, 2013, 05:27:14 PM
Now isn't that the 1.000.000$ question? :P

I'm not sure, TBH, but I *think* that you just need to remove all of this (DO BACKUP your .sql file as you have already some changes to the one from here):

/******************************************************************************/
--- Recounting post counts...
/******************************************************************************/

---* {$to_prefix}members 20
---{
$type = 'replace';
---}

SELECT m.id_member, mem.member_name, mem.date_registered, COUNT(*) as posts, mem.id_group, mem.lngfile, mem.last_login, mem.real_name, mem.instant_messages, mem.unread_messages, mem.new_pm, mem.buddy_list, mem.pm_ignore_list, mem.pm_prefs, mem.mod_prefs, mem.message_labels, mem.passwd, mem.openid_uri, mem.email_address, mem.personal_text, mem.gender, mem.birthdate, mem.website_title, mem.website_url, mem.location, mem.icq, mem.aim, mem.yim, mem.msn, mem.hide_email, mem.show_online, mem.time_format, mem.signature, mem.time_offset, mem.avatar, mem.pm_email_notify, mem.karma_bad, mem.karma_good, mem.usertitle, mem.notify_announcements, mem.notify_regularity, mem.notify_send_body, mem.notify_types, mem.member_ip, mem.member_ip2, mem.secret_question, mem.secret_answer, mem.id_theme, mem.is_activated, mem.validation_code, mem.id_msg_last_visit, mem.additional_groups, mem.smiley_set, mem.id_post_group, mem.total_time_logged_in, mem.password_salt, mem.ignore_boards, mem.warning, mem.passwd_flood, mem.pm_receive_from
FROM {$to_prefix}messages as m
LEFT JOIN {$to_prefix}members as mem ON (m.id_member = mem.id_member)
WHERE m.id_member != 0
GROUP BY m.id_member;
---*'


emanuele? :P
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: emanuele on November 11, 2013, 06:36:34 PM
Quote from: margarett on November 11, 2013, 03:01:11 PM
Please note that you can increase that as much as you want. It will only stop when you hit some limit (memory, timeout, max connections, etc) or if your MySQL "dies" due to excessive connections and the converter hangs.
In any case, just decrease and retry ;)
Well, it's not really like that.
The converter pauses only in case of timeouts, but increasing the number could lead you to hit a memory limit or the max_allowed_packet limit.
And use ignore with caution, it's not always *so* good.

REPLACE should be the default option (otherwise I wouldn't be able to use that "trick" in both this and the IPB converter (even though I'm not sure why I actually used that recount at all since it should be part of the task at the end)).
I'm still a bit surprised by all the errors you are encountering, I'd suspect some bigger issue somewhere with your server configuration, though... heh
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 11, 2013, 06:40:24 PM
Yes, I was referring to those limits, that why I said that it "hangs". Bad wording, I suppose :P

Quote from: emanuele on November 11, 2013, 06:36:34 PM
I'm still a bit surprised by all the errors you are encountering, I'd suspect some bigger issue somewhere with your server configuration, though... heh
Yes, my thoughts too...
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 12, 2013, 06:35:59 AM
Thanks.
I'll just place \xxxxx\ in lines and hope it works.

I edited the sql file and went for a last run yesterday. I only had notepad and a crappy mousepad available, so I only inserted a few of the lines:


/******************************************************************************/
--- Recounting post counts...
/******************************************************************************/

---* {$to_prefix}members 50
---{
$type = 'replace';
$row['date_registered'] = (int) $row['date_registered'];
$row['lngfile'] = (int) $row['lngfile'];
$row['last_login'] = (int) $row['last_login'];
$row['real_name'] = (int) $row['real_name'];
$row['instant_messages'] = (int) $row['instant_messages'];
$row['unread_messages'] = (int) $row['unread_messages'];
$row['new_pm'] = (int) $row['new_pm'];
$row['buddy_list'] = (int) $row['buddy_list'];
---}

SELECT m.id_member, mem.member_name, mem.date_registered, COUNT(*) as posts, mem.id_group, mem.lngfile, mem.last_login, mem.real_name, mem.instant_messages, mem.unread_messages,

mem.new_pm, mem.buddy_list, mem.pm_ignore_list, mem.pm_prefs, mem.mod_prefs, mem.message_labels, mem.passwd, mem.openid_uri, mem.email_address, mem.personal_text, mem.gender,

mem.birthdate, mem.website_title, mem.website_url, mem.location, mem.icq, mem.aim, mem.yim, mem.msn, mem.hide_email, mem.show_online, mem.time_format, mem.signature,

mem.time_offset, mem.avatar, mem.pm_email_notify, mem.karma_bad, mem.karma_good, mem.usertitle, mem.notify_announcements, mem.notify_regularity, mem.notify_send_body,

mem.notify_types, mem.member_ip, mem.member_ip2, mem.secret_question, mem.secret_answer, mem.id_theme, mem.is_activated, mem.validation_code, mem.id_msg_last_visit,

mem.additional_groups, mem.smiley_set, mem.id_post_group, mem.total_time_logged_in, mem.password_salt, mem.ignore_boards, mem.warning, mem.passwd_flood, mem.pm_receive_from
FROM {$to_prefix}messages as m
LEFT JOIN {$to_prefix}members as mem ON (m.id_member = mem.id_member)
WHERE m.id_member != 0
GROUP BY m.id_member;
---*'


Still it gave the same error when finishing counting posts:
QuoteConverting posts (this may take some time)...
Successful.
Recounting post counts...Wrong value type sent to the database. Integer expected. (id_group)
EDIT...new error

I'll \delete\ the lines and give it another go right now.

I've encountered the memory limit when setting 6000 posts. I now run it with 1500 and it's OK.
When I wrote "it hangs", I had'nt noticed the count rising in the URL address line. It seemd like the 3,2,1,0 Continue button down counted over and over again without getting on with the process. Thats why I wrote that a progress bar or active Icon would be nice to have to inform users that the process is running.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 12, 2013, 07:13:27 AM
QuoteConverting posts (this may take some time)...
Error in convert script - line 176!
Successful.
Converting polls... Unsuccessful!
This query:
/--- Recounting post counts...
/
/---* `ubbthreads2`.smf_members 50/
/---{/
/$type = 'replace';/
/$row['date_registered'] = (int) $row['date_registered'];/
/$row['lngfile'] = (int) $row['lngfile'];/
/$row['last_login'] = (int) $row['last_login'];/
/$row['real_name'] = (int) $row['real_name'];/
/$row['instant_messages'] = (int) $row['instant_messages'];/
/$row['unread_messages'] = (int) $row['unread_messages'];/
/$row['new_pm'] = (int) $row['new_pm'];/
/$row['buddy_list'] = (int) $row['buddy_list'];/
/---}/
/SELECT m.id_member, mem.member_name, mem.date_registered, COUNT(*) as posts, mem.id_group, mem.lngfile, mem.last_login, mem.real_name, mem.instant_messages, mem.unread_messages,/ /mem.new_pm, mem.buddy_list, mem.pm_ignore_list, mem.pm_prefs, mem.mod_prefs, mem.message_labels, mem.passwd, mem.openid_uri, mem.email_address, mem.personal_text, mem.gender, //mem.birthdate, mem.website_title, mem.website_url, mem.location, mem.icq, mem.aim, mem.yim, mem.msn, mem.hide_email, mem.show_online, mem.time_format, mem.signature,//mem.time_offset, mem.avatar, mem.pm_email_notify, mem.karma_bad, mem.karma_good, mem.usertitle, mem.notify_announcements, mem.notify_regularity, mem.notify_send_body,/ /mem.notify_types, mem.member_ip, mem.member_ip2, mem.secret_question, mem.secret_answer, mem.id_theme, mem.is_activated, mem.validation_code, mem.id_msg_last_visit,/ /mem.additional_groups, mem.smiley_set, mem.id_post_group, mem.total_time_logged_in, mem.password_salt, mem.ignore_boards, mem.warning, mem.passwd_flood, mem.pm_receive_from/
/FROM `ubbthreads2`.smf_messages as m/
/   LEFT JOIN `ubbthreads2`.smf_members as mem ON (m.id_member = mem.id_member)/
/WHERE m.id_member != 0/
/GROUP BY m.id_member;/
/---*'/
TRUNCATE `ubbthreads2`.smf_polls;
Caused the error:
You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '/--- Recounting post counts...
/
/---* `ubbthreads2`.smf_members 50/
/---{/
/$ty' at line 1
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 12, 2013, 07:20:58 AM
That is wrong... Just delete that part ;)
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 12, 2013, 07:24:40 AM
I deleted the whole section and "got through"

QuoteConverting posts (this may take some time)...
Successful.
Converting polls... Successful.
Converting poll options...Duplicate entry '66-255' for key 1

than it DO hang. Nothing happens.
When starting the convert.php again, it have to count the posts once more. FU*K.

Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 12, 2013, 07:27:47 AM
I deleted everything with polls and restart the convert.php.

Whats next ;)?
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 12, 2013, 07:33:09 AM
Don't delete the polls (if you have polls in your actual forum)

Use the "ignore" trick ;)
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 12, 2013, 07:45:48 AM
Quote from: margarett on November 12, 2013, 07:33:09 AM


Use the "ignore" trick ;)

Ignore trick?

THere havent been polls for a long long time, so I guess it won't be missed if they do not convert, but we need the function later on once in a while.
I deleted the lines and put them in another file, sql_outtakes" and run again. It counts pretty fast now, but still it's no fun that particular part :D

The forum is still clean as a babys bum regarding topics and forums, but i have to log in using the "old" login info.
Still it states the forum only got 1 member.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 12, 2013, 07:53:17 AM
Did you finish?

Now you need to login with your admin account, go to Maintenance -> Recount totals

Everything should be corrected, then ;)
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 12, 2013, 07:59:54 AM
It went past and straight to the personal msgs part 1... :D

but looks like I'm not admin anymore... Hope the global admin can log in and set my permissions.

EDIT: Converting personal messages (step 2)...   :D
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 12, 2013, 08:34:34 AM
Next error:
QuoteConverting personal messages (step 2)...
Successful.
Converting censored words... Successful.
Converting moderators...Duplicate entry '19-651' for key 1

What to do to get past this one?...
I hope the process in front now is saved
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 12, 2013, 08:46:01 AM
You can admin yourself in the database ;)

I'm on the phone now, can't show you how to bypass that error...
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 13, 2013, 05:14:49 AM
Quote from: margarett on November 12, 2013, 07:53:17 AM
Did you finish?

Now you need to login with your admin account, go to Maintenance -> Recount totals

Everything should be corrected, then ;)

hmmmm... managed to make me an Admin
Also all forums state i.e. 22689 posts, 0 topics, so something with topic convertions went wrong?
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 13, 2013, 05:18:56 AM
Administration Center » Maintenance » Forum Maintenance » Routine
Click the button under "Recount all forum totals and statistics"
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 13, 2013, 05:19:37 AM
:D got it
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 13, 2013, 05:20:25 AM
And? :P
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 13, 2013, 05:33:38 AM
JIPPI!!!

Run all tasks and all posts, members, msgs +++ is up and running.

Will invite a few members to start betatesting it looking for snag/bugs and customizing this and that.
All polls are in it's own category (Salvaged posts), but that process was deleted by me. Hope new polls will work, but the old ones can be deleted permanently. Will keep them still though.

The support from you guys are outstanding!
I hope you get the converter to work better for others in time to come, but I'm glad I didn't gave up.

I will post findings here... if there is any.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Sea Mac on November 13, 2013, 09:04:25 PM
Congratulations on your successful struggle to escape what we laughingly wound up calling "UBB Gulag"! I, myself, couldn't offer ANY coding advice but you, apparently, are no stranger to PHP ...  ;D

You are right: support here is the best. It seems you had 3 times as many members and twice as many posts as we did: valuable freight indeed!

(
and searching Google for "UBB 7.5 converter" brings this topic up to the top ... SMF is the ONLY escape  ;D ! )
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Ichinen on November 14, 2013, 12:18:29 AM
I offer my congratulations as well, for another UBB refugee making your escape from the "UBB Gulag"! WE couldn't be happier with our new SMF home - we couldn't have done it without the wonderful support here.

I hope you enjoy YOUR new SMF home!
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 14, 2013, 02:02:58 PM
:D
I did this convert for my fav forum, althoug it isn't mine, because I have so good experience with smf from 2 other forums I have installed and admined.
5000+ members will hopefully also be pleased.
We are doing betatesting now and have really only run into one problem, but this is a rather major problem...

No screenshots tags have been transferred.

There is tens of thousands pages without screenshots :(
I cannot release the forum with 14 years of missing pictures.
Any thoughts?
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: emanuele on November 14, 2013, 02:24:58 PM
What are screenshots tags?
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 14, 2013, 02:33:59 PM
(http://www.pichosting.com/xxx)
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 14, 2013, 04:10:54 PM
I'm sorry but I just see a gray square...

Can you take a print screen in the original context?
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Sea Mac on November 14, 2013, 08:56:24 PM
I discovered that if you replace the colon with an equals sign    that SMF honors UBB Threads UBB Codes tags like font/color/size.

When we converted over - the IMG tags were working fine: that is, any absolute URL to an Image that was still Available showed up OK.
Were these screenshots perhaps as relative links, or Attachments?

If attachments make sure that you moved them into the attachments folder and their permissions are correct. The Url for the image in your last post is "http://www.pichosting.com/xxx" (which doesn't link to any photo).
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 15, 2013, 01:52:23 AM
Im sorry. Went kinda quick yesterday.
The tag to linked pics is ofcause code :) could be like this

[img] www.url.com/pic.jpg[/img]


No posts have the img tag or the url reference.
I will check the attatchments, but these pics were never uploaded, only linked to.

Betatesters is else VERY happy

EDIT:
I took a look in some other posts regarding hardware, not plain screenshots, and found a img tag. I remember that UBBthreads use an option to insert pics as left/right/floating etc. and the code can look like this in topics:

[img:left]http://www.komplett.no/img/p/200/774726.jpg[/img] Corsair Obsidian 900D Big Tower Sort

The post showed the line like the code exemple, but when I edited the post removing ":left", the img show as normal in the post.

In the screenshots forums there is no such line at all.

EDIT II:
I activated the converted child forums, screenshots archive and pictures archive, and they have all pis intact  :o

straaaaange
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 15, 2013, 04:32:49 AM
I can only help you about this:

QuoteEDIT:
I took a look in some other posts regarding hardware, not plain screenshots, and found a img tag. I remember that UBBthreads use an option to insert pics as left/right/floating etc. and the code can look like this in topics:

[img:left]http://www.komplett.no/img/p/200/774726.jpg[/img] Corsair Obsidian 900D Big Tower Sort

The post showed the line like the code exemple, but when I edited the post removing ":left", the img show as normal in the post.

You can go to phpmyadmin, to your SMF database, and use the following SQL query (after you backup, of course :P ):

update smf_messages set body = replace(body, '[img:left]', '[img]')
Repeat for right/floating

For the rest, I'm sorry but that is out of my league :-[
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Sea Mac on November 15, 2013, 08:59:12 AM
So, it winds up that you didn't lose a single image after all? And all the people who see the converted forum are very VERY happy? It "Fixed itself", huh?  ;D

Here's a thought ... instead of that forum spending $99 for Access to updates and "Support" from Groupee next year: I recommend a subscription to to this Forum's Helpdesk for $50 instead. "Half the Price and Twice the Support." and you may Quote me on that.  I WILL be renewing my Charter Membership because it has been worth EVERY Penny! IF they have any technical Issue the Support Staff will respond RIGHT Away: it is the ultimate in Support.

As an Example ... this Converter. It is MOSTLY a Labor of Love by the Excellent Development Staff: but it has the potential to allow hundreds or thousands of UBB Threads forums an "Escape" to a DECENT, really Modern, open source forum! And I believe in my heart that - eventually - they are all gonna rush over here and upgrade for free! All of them are already forced to shell out $99 a year for ACCESS to the Support Forum at UBB Threads anyway. And I can tell you from personal experience that ALL my questions were answered swiftly - even though they COULD get away with just using these Free Support Forums (Just as you did.).

I know how your beta testers feel. We are 4 weeks into using the new software and my UBB Threads users are getting adjusted to SMF2 now. And they ALL are acting like Children at Christmas - or in a Candy Warehouse: Ultra Delighted! They have NEVER seen such comprehensive statistics or so many ways to add color and expression to their posts: It's a riot festival in there!

They have been "Set FREE" ... and we are VERY grateful to SMF and the Excellent Staff here! I'm hoping that the NEW Converter gets a little more polished and easier to use in time ... and that lots of other forums "Make their Escape" too.

Hats Off (http://softwaresanta.com/sssmf2/Smileys/old/hatoff.gif)to SMF!
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 15, 2013, 10:23:01 AM
The thing is that UBBthreads have an option to have a forum category to show pics in some silly gallery view, albums.
This way, the picture tags don't show in the post where the text is written, but added as a kind of attachment. I have asked the forum owner to see if there is a way to merge the main screenshots (with the silly gallery) and the child board (regular posts with screenshots) to see if this result in posts with pictures tagged in.
If that works, I can run a recount from within the smf forum or, if I have to, reconvert once more, getting all the posts showing "normal" posts.

The posts did not magically reappear with pics  ;) but the converter have not taken into account this perticular way of posting topics, called "albums".
I now have about 7500 posts without pictures in the new smf forum, not 55000 as feared.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Sea Mac on November 15, 2013, 12:39:32 PM
I used to use a MOD for Photos: Aeva Media 1.4w
http://custom.simplemachines.org/mods/index.php?mod=977
But it seems you Still have a lot of work to put Humpty Dumpty back together again ...
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 16, 2013, 02:50:55 AM
Quotean go to phpmyadmin, to your SMF database, and use the following SQL query (after you backup, of course :P ):

Code: [Select]
update smf_messages set body = replace(body, '[img:left]', '[img]')
Repeat for right/floating

Thanks a lot M!
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 18, 2013, 04:06:10 AM
I get an error when trying to parse this line in sql query. I have tried clicking on the smf_messages db before parsing but no luck. I do need it to be fixed though.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 18, 2013, 04:13:03 AM
Is your SMF table prefix "smf_" ?
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 18, 2013, 04:37:58 AM

update smf_messages set body = replace(body, '[img:left]', '[img]')

Note the usage of

'

and NOT

`   ´


I just tested in my local phpmyadmin and it works...
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 18, 2013, 08:50:03 AM
Yes it did indeed! Thanks
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Sea Mac on November 19, 2013, 10:06:39 AM
Well, forumfjott (http://www.simplemachines.org/community/index.php?action=profile;u=267480), did you get most of your issues worked out?
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 19, 2013, 10:43:36 AM
Yepp. I have one user that cannot enter his profile and a few other requests, but ppl are happy :D

BUT... I have several members stating they have PMs that don't belong to them. Havent got a clue how to sort it out. With over 5000 members I cannot get a full overview of the problem, and deleting them all will cause a riot.

Title: Re: [SMF Converter] UBB.threads 7.5
Post by: emanuele on November 19, 2013, 02:06:35 PM
PMs is one of the most important things to check before going live...
I would be quite upset knowing that my PMs may be visible to others.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on November 19, 2013, 03:49:21 PM
true true...
No such findings from beta testers though. It shouldnt be possible to get such a error during convertion to.
Big red flag there.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on November 19, 2013, 03:57:19 PM
Do you still have the old database? Did you see that happening?

Ask one of the affected users to give you a "wrong" PM ID, check the current SMF database who's the author and destinations and compare that with the old database.
The IDs are all kept, be it users, posts, PMs, etc, so that shouldn't really happen...
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Sea Mac on December 26, 2013, 12:11:15 PM
Thanks for all the hard work on this! We have been at SMF2, from UBB Threads 7.5.7, for 2 months now and everyone is getting used to all the statistics and new smilies and better posting options at last.

It was well worth it, from our point of view, to switch over from UBB Threads: at the very least because SMF2 is so So MUCH Faster!!! 

I plan to stay a Charter Member and be as supportive as I can be in these forums.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: StanJ on January 05, 2014, 12:08:15 PM
I do not think this error was covered...
QuoteNotice: Undefined index: convert_script in /home/clubadve/public_html/forums/convert.php on line 974

Warning: Invalid argument supplied for foreach() in /home/clubadve/public_html/forums/convert.php on line 977

Notice: Undefined index: convert_script in /home/clubadve/public_html/forums/convert.php on line 989
Successful.
Recalculating forum statistics...
Notice: Undefined variable: result in /home/clubadve/public_html/forums/convert.php on line 2496

Notice: Undefined variable: result in /home/clubadve/public_html/forums/convert.php on line 2497

Notice: Undefined index: db_fetch_assoc in /home/clubadve/public_html/forums/convert.php on line 1388

Fatal error: Function name must be a string in /home/clubadve/public_html/forums/convert.php on line 1388

Thoughts?  Using UBB 7.5.8
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Sea Mac on January 05, 2014, 01:44:21 PM
I'm curious: when did UBB release the 7.5.7 to 7.5.8 update?

If I remember correctly we gave a database dump for version 7.5.7 ... UBB sometimes makes major changes to database structures with even minor (0.0.x) version updates!

This one fact alone could account for any and all errors from a version 7.5.8 database conversion ....
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: StanJ on January 05, 2014, 05:14:44 PM
I did find a fix,  just by going to another browser..
I do get the same error you did, and I did modify it, I would have thought the file would have been updated to reflect the changes you found that you needed..

Here is where I am..
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: StanJ on January 05, 2014, 06:47:30 PM
Sorry, I thought I had answered this, the .8 came out a few weeks ago.  Not long
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: StanJ on January 06, 2014, 06:55:37 PM
Quote from: emanuele on November 07, 2013, 02:55:02 PM
I don't have any more the db, so I can't be sure, though you can try adding:

$row['board_order'] = (int) $row['board_order'];

just after the line:
$row['description'] = str_replace("\"", "&quot;", $row['description']);
this won't fix the issue, but at least it should let you continue.
Some boards may be in the wrong order after the conversion.

If I have this issue
>>>>Converting topics...Wrong value type sent to the database. Integer expected. (id_member_updated)

Where would i place a similar fix?
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on January 17, 2014, 07:52:17 AM
Quote from: margarett on November 19, 2013, 03:57:19 PM
Do you still have the old database? Did you see that happening?

Ask one of the affected users to give you a "wrong" PM ID, check the current SMF database who's the author and destinations and compare that with the old database.
The IDs are all kept, be it users, posts, PMs, etc, so that shouldn't really happen...

What happened was that all users got EVERY SINGLE PM EVER sent, also the deleted by past space restrictions into their inbox.
The person reporting getting others PM, just did'nt remember what he was writing 11 years ago.
All OK
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: margarett on January 17, 2014, 07:59:06 AM
Uff, that's good, then :)
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: emanuele on January 17, 2014, 10:02:30 AM
Quote from: forumfjott on January 17, 2014, 07:52:17 AM
The person reporting getting others PM, just did'nt remember what he was writing 11 years ago.
I can't blame him, I don't remember what I wrote half an hour ago... xD
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Sea Mac on January 22, 2014, 09:04:38 PM
Quote from: forumfjott on January 17, 2014, 07:52:17 AM


What happened was that all users got EVERY SINGLE PM EVER sent, also the deleted by past space restrictions into their inbox.
The person reporting getting others PM, just did'nt remember what he was writing 11 years ago.
All OK

Yeah, should've warned ya .... ALL deleted PM's will resurrect ... Do consider that a FEATURE and not a Bug ...
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on January 24, 2014, 09:54:39 AM
Would be OK to know beforehand.
Another "Feature" is that all 5000+ members got their original info in their profile. Remember wich mail address you had 10-12-14 years ago?
...just something to think about
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: emanuele on January 24, 2014, 10:08:26 AM
That looks weird.
Honestly I built the converter using as reference a single database. Since I don't like to look into personal informations I didn't check more than the minimum amount of things possible (I didn't go around verifying that old PMs were resurrected, both because I didn't want to go and read peoples' personal discussions and because anyway I couldn't know they were deleted, and the same is true for emails).

TL;DR: I had to "guess" several things.
Some I got right, some I got wrong.
If you can identify how UBB.threads stores the personal informations the converter can be fixed. ;)
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: forumfjott on January 28, 2014, 02:39:25 AM
All in all I'm very pleased!! If my experience can gain others going the same route, it's all worth it :D
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Ruben Rocha on October 30, 2017, 02:18:38 PM
I have a ubbclassic forum with 2.9 million posts.
This importer works fine with no errors.

Now I did have to convert to UBBthreads before I could use it.
And even though I tweaked the numbers to speed it up.
7 days for both conversions.
It works fine.

However I have a issue with the inline images posted ,not attachments.
where  due to a modification in classic to control display size.
The links were imported as:
<img src="http://i91.photobucket.com/albums/k313/wcocke/5FCC709D-5AC0-4F03-BFB3-548BB780A072_zpsmfv5zkzq.jpg" width="600" height="800" alt=" - " />
instead of say:
[img]http://i91.photobucket.com/albums/k313/wcocke/5FCC709D-5AC0-4F03-BFB3-548BB780A072_zpsmfv5zkzq.jpg" width="600" height="800" alt=" - " [/img]

Which varies in width and height size per post.
So they don't display in the post.

So where do I go from here?
I can change the prefix and suffix tags to [img] [/img] or [html] [/html].
But deleting the height and width tags I have had no success.
But even if I could delete the size tags then goto the cp and change the display size it will not update existing posts.
So the big images will blow out the page and cause scrolling to view.
The other issue is some posts  are stored in the database as say <img src =" and some are stored as <img src=&quot; same goes for the end tag
Or any other  combination of  escaped  or normal characters are placed in the database.
Possibly due to experimenting on the mod over they years.
Another item is the alt tag  is used but some are blank and some have values which vary.
And some are embedded as [url] bla ba<img src=;bla blas height width alt />[/url]

Any suggestions on what would be best method to follow to make the images appear again in smf.

BTW, they work fine in ubbthreads after importing from ubb classic.
Any suggestions on what to do.

Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Ruben Rocha on February 22, 2018, 02:32:40 PM
I know this topic is old but will try anyway for a reply.

Still working on a test run of this importer.
Getting very close to a last run.
Got the image tags worked out.

But my dilemma is user titles did not import to smf. Which I really need.
The converter does not even address the field.
In ubb it is table  user_profile
the field is USER_TITLE

In the converter it does query the user_profile table but only for the password.

Can somebody help me modify this importer to  allow member titles to import from UBBthreads to smf?
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Ruben Rocha on February 22, 2018, 03:39:14 PM
well I guess ignore this post I figured out how to do it by adding a line in the query.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: petergariepy on April 23, 2018, 05:50:42 PM
I have a 7.6.1.1 install of UBBThreads.   https://www.vccachat.org
I have a 2.0.15 install of SMF.  http://smf.vccachat.org/

I tried to install converter package without success.  https://download.simplemachines.org/index.php?converters;id=11

I got the error found below.

So I followed the recommendations after the error and uploaded the 2 files manually to smf/Packages/converter and set the permissions to the folder and files are recommended.  Unfortunately the Package Manager doesn't recognize that its there.

Any help is appreciated.

Peter

-----


An Error Has Occurred!
Package upload failed due to the following error:
"Although the package was downloaded to the server it appears to be empty. Please check the Packages directory, and the "temp" sub-directory are both writable. If you continue to experience this problem you should try extracting the package on your PC and uploading the extracted files into a subdirectory in your Packages directory and try again. For example, if the package was called shout.tar.gz you should:
1) Download the package to your local PC and extract it into files.
2) Using an FTP client create a new directory in your "Packages" folder, in this example you may call it "shout".
3) Upload all the files from the extracted package to this directory.
4) Go back to the package manager browse page and the package will be automatically found by SMF."
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: petergariepy on April 23, 2018, 06:58:56 PM
I moved the smf test site to:  http://vccaforums.org/
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Ruben Rocha on May 02, 2018, 05:11:12 PM
I started another conversion from UBB to smf from another site
This site has a lot of image attachments not inline images.
But it appears that this importer and the public one does not import them.
Is there some way to do so?
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Ruben Rocha on May 27, 2018, 03:34:24 PM
This importer still works with ubb 7.6.1
To a degree.
I have modded this to import more data than the default  but there are still some intervention query's that I run to import custom groups and custom fields. and attachments in a gallery forum.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: GigaWatt on May 27, 2018, 07:30:37 PM
Quote from: petergariepy on April 23, 2018, 05:50:42 PM
An Error Has Occurred!
Package upload failed due to the following error:
"Although the package was downloaded to the server it appears to be empty. Please check the Packages directory, and the "temp" sub-directory are both writable. If you continue to experience this problem you should try extracting the package on your PC and uploading the extracted files into a subdirectory in your Packages directory and try again. For example, if the package was called shout.tar.gz you should:
1) Download the package to your local PC and extract it into files.
2) Using an FTP client create a new directory in your "Packages" folder, in this example you may call it "shout".
3) Upload all the files from the extracted package to this directory.
4) Go back to the package manager browse page and the package will be automatically found by SMF."

Did you do what was proposed in the error?
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Ruben Rocha on June 04, 2018, 03:01:41 PM
importing ip ban lists.
For the sake of argument.
Ubb uses % not * which I can run a update query to fix that.
But the issue goes from
the ban list has bans like
192.168.0.*
192.168.*.*
or even 192.*.*.*

It always fails in the importer.
What would be the proper format to edit the existing ip ban list.
for ones that have a top level ip ban.
that will be accepted.

There are like 5000 ip bans so it is hard to manually preview them.


Title: Re: [SMF Converter] UBB.threads 7.5
Post by: GigaWatt on June 04, 2018, 08:24:54 PM
Quote from: Ruben Rocha on June 04, 2018, 03:01:41 PM
But the issue goes from
the ban list has bans like
192.168.0.*
192.168.*.*
or even 192.*.*.*

???... who in their right mind would put that range in a ban list ???... it's a reserved range for private LANs, no one can have a public IP starting with 192.168.

Why not add 127.0.0.1 to the list as well ::).

Quote from: Ruben Rocha on June 04, 2018, 03:01:41 PM
What would be the proper format to edit the existing ip ban list.

Empty out the entire column with the IP bans. IP bans are pointless anyway. Exceptions are some rare cases with bot spam and or DDoS attacks... but a more efficient way to handle them would be through htaccess, not by IP ban lists in the forum itself.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Ruben Rocha on June 05, 2018, 12:23:18 PM
The 192.168.0 was an example to show only where the wildcards are placed not actual ip's in the ban list.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: GigaWatt on June 05, 2018, 06:28:05 PM
Oh, good... for a moment there I thought someone actually banned 192.16.*.* ::) ;D.

Did you empty out the IP bans column?

UPDATE table_name SET column_name = ''

Do a database backup first.

Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Ruben Rocha on June 07, 2018, 12:41:29 PM
Even before your reply I did that and it runs successfully .
I have been using a backup copy for a beta run.
By my question still remains what would be the proper format for a wildcard in a ip?
92.XXX.XXX.XXX
what would I replace the x with?

I am doing the conversion not the owner and I think they want it so.
I mean I could just delete the banned ip's with a wild card. But.....
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: GigaWatt on June 08, 2018, 06:59:19 AM
Quote from: Ruben Rocha on June 07, 2018, 12:41:29 PM
By my question still remains what would be the proper format for a wildcard in a ip?
92.XXX.XXX.XXX
what would I replace the x with?

In SMF or UBB.threads? If it's in SMF, I can do a test IP ban and check what's written in the database if you want ;).
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Ruben Rocha on June 18, 2018, 01:39:12 PM
I am not going to worry about it I deleted all the ip's with wildcards in the ban list and it works.
For what it is worth I found one mis configured ip while doing so.
But I am not going to revisit it.
I am moving on.
Thanks anyway.
Title: Re: [SMF Converter] UBB.threads 7.5
Post by: Ruben Rocha on June 18, 2018, 01:48:26 PM
FYI,
This importer works fine all the way to ubb 7.6.1.1
I have done three different versions in ubb 7.5.7 7.6.0 and 7.6.1.1 all working

However the errors some users have reported is due to corrupted data in ubb, which happens.

I have figured out how to fix the errors plus with manual queries import almost everything from ubb using this version.

Polls however are hit and miss.

PS,
This version should be on the converter page with some caveats.
The current version in the converters page is for wwwThreads only the precursor to ubbThreads.