News:

SMF 2.1.4 has been released! Take it for a spin! Read more.

Main Menu

Database is getting large

Started by Paul123, July 15, 2009, 12:22:24 PM

Previous topic - Next topic

Paul123

My forum is full of messages.  I wonder if affects the speed of loading.  Should I create a new database file? and how to migrate those very recent messages and same boards (about 6 months) ?

I don't want to lose any messages for education purposes and thinking to maintain the forum from now to 20 years later. 

Any suggestion would be appreciated.

Thank you,

P.S.  Also is there any software that I can read all my forum messages off from the server?  More clearly, I can download the forum backup file (.sql) and use a software that I see exact on the server?
Thanks a lot

Reflection

As far as I'm aware, this won't be a problem. I've seen plenty of large SMF forums with tons of messages and users and they go about the same speed as mine would (which has like 500 members).

Though this really depends on your hosting package.
Good "SMF" Portals
Tiny Portal [SMF 1.1.x only]
Simple Portal [SMF 1.1.x and 2.0]


Good "SMF" Theme Sites
SMF Themes [SMF 1.1.x and 2.0]
Dziner Studio [SMF 1.1.x and 2.0]

Arantor

Well, having lots of messages will affect performance but you have to be into the tens of thousands before a decent host will even really notice.

This forum, for example, has over 2m posts, others have up to 7m posts - but they run specialised configuration and notes on how to tweak it are given in the forums.

As for browsing posts, you could take a backup, open it into a copy of MySQL on your personal PC and browse through it with one or more clients, but generally the forum is the best structure for viewing forum posts.

Tristan Perry

It won't affect you. As long as you run/install the necessary improvements as you go along (see the performance board, the stickies), you'll be fine.

Obviously if you are very active (and using mid xx+ bandwidth per month), you will want to look at moving off shared hosting (if indeed you currently are on shared), but other than that I wouldn't worry.

Paul123

Thanks for your replies.  If I'd like to create another database, how can I migrate all the most recent messages and boards to the new database base?  Is there an easy way to do this?

Thanks again.

Norv

#5
You can make a full backup of the forum. Or two of them. Make sure the backup is complete. For example, if you make it with the Forum maintenance > backup, make sure it has structure and that the file you download ends with something like:

-- --------------------------------------------------------

-- Done



Then, restore this backup in another "test forum" database, and you can remove the old messages by using (in the second forum):
Admin > Forum maintenance > Topics > Remove old posts (if you're using 2.x)
Admin > Forum maintenance > Remove old posts (if you're using 1.1.x).
Please note that only the backup can help you keep the posts safe, there is no way to undo the deletion of messages, except restoring a backup that has them saved.
To-do lists are for deferral. The more things you write down the later they're done... until you have 100s of lists of things you don't do.

File a security report | Developers' Blog | Bug Tracker


Also known as Norv on D* | Norv N. on G+ | Norv on Github

metallica48423

Generally speaking, unless it is a matter of disk space availability, you should not consider messing directly with the database.  It is far too easy to mess something up, especially in a database that is as complex and relational as SMF's.  Databases will grow as forums grow.  This is natural and is not a sign of anything wrong.

you would be much better off carrying out the log maintenance inthe maintenance section of the admin CP, and emptying the error log, and using SMF's post/topic deleting functions.

Some common log tables you can empty to clear space:

log_errors
log_search
log_search_results

*DO NOT* empty log_topics.  *DO NOT* empty log_boards.  *DO NOT* empty log_mark_read.  In fact, i'd only empty the 3 above, and leave the rest alone :P
Justin O'Leary
Ex-Project Manager
Ex-Lead Support Specialist

QuoteMicrosoft wants us to "Imagine life without walls"...
I say, "If there are no walls, who needs Windows?"


Useful Links:
Online Manual!
How to Help us Help you
Search
Settings Repair Tool

Jessikard

Quote*DO NOT* empty log_topics.  *DO NOT* empty log_boards.

can you tell me please what kind of information in these tables are ans why it isn't good to truncate these tables ?

i only want to understand the meaning of this

thx Jessi

Tristan Perry

Quote from: Jessikard on July 22, 2009, 05:01:19 AM
Quote*DO NOT* empty log_topics.  *DO NOT* empty log_boards.

can you tell me please what kind of information in these tables are ans why it isn't good to truncate these tables ?

i only want to understand the meaning of this

thx Jessi
Those two keep a log of which topics go in which boards, and which posts go in which topics. So if they were deleted, the forums would crash.

Jessikard


greyknight17

Paul123, is this issue resolved now?

Paul123

Quote from: greyknight17 on July 31, 2009, 07:19:45 PM
Paul123, is this issue resolved now?

Thanks Grey.  I just created a new database and copied the old database to the new one.  Therefore, I have two same databases :)

Thanks,

Advertisement: