Methods to speed up convertion process.

Started by evgenydeep, May 27, 2008, 11:16:47 AM

Previous topic - Next topic

evgenydeep

Alternative way of convertion big forum is special settings for the server.
Please write your thoughts and how possible to speed up

it looks that CPU is not so important for convertion

My thoughts for this moment:
1) increase memory, available for PHP
2) opimize MySQL working (how?)
3) may be use php accelerators like ion cube or zend opimizer
4) in code, e.g in step 12 exist such:
         // We need a time out.
         sleep(5);
Is decreasing value will speed up process?
5) in code(row 64) exist string
   // Memory, please!!
   @ini_set('memory_limit', '128M');
Is increasing to 1042M  will speed up process greatly?
6) Is increasing LIMIT NUM will speed up converting?

convertStep8:
         $result = convert_query("
            SELECT ID_TOPIC, tempID
            FROM {$to_prefix}topics
            WHERE tempID != ID_TOPIC
            LIMIT $_GET[substep], 150");
...
         $_GET['substep'] += 150;
is 150 increase to... 500, is it will speed up the 8 Step?
The same in 9 step.
The same in 10 step (now there limit 100)

The same on step 11:
            UPDATE {$to_prefix}messages
            SET ID_MSG = (@msg := @msg + 1)
            WHERE ID_MSG = 0
            LIMIT 150");

         $_GET['substep'] += 150;
         if (mysql_affected_rows() < 150)
            break;
if 150 increse to 500? is it help?

The same on step 12 (limit 250)
....
and on other steps.

7) what steps in convertion could be selected to independent program and runned after convertion?
8) what steps in convertion is not too much important and can be commented?

SleePy

They may work.
It just depends on how much your server will allow you to handle.

Increasing limits may help, but it could also bring your server to its knees with such large data that is being requested.
Also note that some SQL servers won't allow large data to be selected and you will get a error about setting SQL_BIG_SELECTS to 1. You may need to do that. I plan on attempting to fix it for the 2.0 converter (hopefully less errors then).
Jeremy D ~ Site Team / SMF Developer ~ GitHub Profile ~ Join us on IRC @ Libera.chat/#smf ~ Support the SMF Support team!

Advertisement: