Advertisement:

Author Topic: Exporting of database with PHPMyAdmin stops at 1GB  (Read 1820 times)

Offline Sono

  • Semi-Newbie
  • *
  • Posts: 83
Exporting of database with PHPMyAdmin stops at 1GB
« on: December 04, 2018, 02:39:17 AM »
I have a problem exporting my database from my hosting account. I have an account at one.com. On exporting, the download process stops exactly at 1GB every time. Google Chrome reports "download failed - network error", Firefox just stops downloading and outputs a .php file.

My database is 3.3GB. How can I export it in full? I tried to reach the one.com support, but they actually couldn't help (that really disappointed me because I expected much more expertise from the staff). When I select gzip compression on exporting, I can download a 260Mb file that extracts to about 2.7GB, so it is still not the full database.

Offline radu81

  • Jr. Member
  • **
  • Posts: 321
  • Gender: Male
    • Skoda Club Italia
Re: Exporting of database with PHPMyAdmin stops at 1GB
« Reply #1 on: December 04, 2018, 08:13:24 AM »
do you have SSH access? if not try to export using MysqlDumper https://sourceforge.net/projects/mysqldumper/
sorry for my bad english

Offline Sono

  • Semi-Newbie
  • *
  • Posts: 83
Re: Exporting of database with PHPMyAdmin stops at 1GB
« Reply #2 on: December 04, 2018, 09:31:21 AM »
I tried with SSH, the result is a 2.7 GB SQL file, still not 3.3GB.

I cannot install MySQLDumper because I have no access to the root on my hostin space, and can only place the installer inside the forum folder, however that way I cannot access it when Maintenance mode is on.

Offline vbgamer45

  • Customizer
  • SMF Super Hero
  • *
  • Posts: 21,673
    • smfhacks on Facebook
    • VBGAMER45 on GitHub
    • @createaforum on Twitter
    • SMF For Free
Re: Exporting of database with PHPMyAdmin stops at 1GB
« Reply #3 on: December 04, 2018, 09:33:30 AM »
Are you using the gzip option on phpmyadmin?
Make sure you clear your smf_error_log
Community Suite for SMF - Take your forum to the next level built for SMF, Gallery,Store,Classifieds,Downloads,more!

SMFHacks.com -  Paid Modifications for SMF

Mods:
EzPortal - Portal System for SMF
SMF Gallery Pro
SMF Store SMF Classifieds Ad Seller Pro

Offline Sono

  • Semi-Newbie
  • *
  • Posts: 83
Re: Exporting of database with PHPMyAdmin stops at 1GB
« Reply #4 on: December 04, 2018, 10:00:14 AM »
If I try phpmyadmin with gzip, it downloads a 260mb file that can be extracted to a 2.7GB one. In case I omit gzip, just download the pure SQL, the download stucks at 1GB.

I managed to install mysqldumper somehow. The problem is, it starts dumping, then it writes after a while: too many requests. And freezes.

Offline drewactual

  • Sr. Member
  • ****
  • Posts: 702
    • College Football Fan Site CFB51
Re: Exporting of database with PHPMyAdmin stops at 1GB
« Reply #5 on: December 04, 2018, 02:23:25 PM »
i once had a host disallow me to do the same.... so...

check this out: https://www.phpclasses.org/package/8904-PHP-Dump-MySQL-tables-in-chunks-of-limited-size.html

pull it out in chunks.  it starts where the last dump stopped, and until it reaches the timeout or the size/traffic.  there are other php scripts to run out there too...

Offline Sono

  • Semi-Newbie
  • *
  • Posts: 83
Re: Exporting of database with PHPMyAdmin stops at 1GB
« Reply #6 on: December 04, 2018, 03:22:53 PM »
Is it useful in case one table (the one used by prettyurl) is 3 GB?

Offline Sir Osis of Liver

  • SMF Hero
  • ******
  • Posts: 9,479
Re: Exporting of database with PHPMyAdmin stops at 1GB
« Reply #7 on: December 04, 2018, 04:14:56 PM »
Uninstall pretty urls mod (if you can - good luck :P), drop the table.  If 90% of your database is from a mod, you shouldn't be using it.


Online shawnb61

  • Developer
  • SMF Hero
  • *
  • Posts: 1,591
    • sbulen on GitHub
Re: Exporting of database with PHPMyAdmin stops at 1GB
« Reply #8 on: December 05, 2018, 12:56:28 AM »
Maybe 2.7gb is correct.  The different SQL export options can result in pretty dramatic size differences.  E.g, whether column names are included.

One quick check  - the beginning & end usually save off & restore some system settings.  If the end restores the settings saved in the beginning, it is complete.

Have you tried restoring it?
Address the process rather than the outcome.  Then, the outcome becomes more likely.   - Fripp

Offline Sono

  • Semi-Newbie
  • *
  • Posts: 83
Re: Exporting of database with PHPMyAdmin stops at 1GB
« Reply #9 on: December 05, 2018, 01:02:28 AM »
I would have liked to, but problems arised.

1. At the recent host, I am only offered 1 database. I don't want to import the sql back to it, because I fear it will mess up the original tables.

2. I opened another account at Mochahost, and tried to restore the database there. The probelm is, Filezilla closes the FTP connection after every 1 GB upload, and thus I cannot upload the big file to the server, to restore it from SSH.

So at the moment I am stuck with verifying the sql file.

By the way, what can be the reson that MSQLDumper didn't work for me? In the instruction video they put it to the directory that contains the directory of the forum. But at my host I am not allowed the copy things there, so I copied the SQLDumper directory inside the forum directory. Can it be the source of problems?
« Last Edit: December 05, 2018, 01:18:07 AM by Sono »

Offline Sir Osis of Liver

  • SMF Hero
  • ******
  • Posts: 9,479
Re: Exporting of database with PHPMyAdmin stops at 1GB
« Reply #10 on: December 05, 2018, 11:00:09 AM »
MySQLDumper should run from directory in forum root.  Some hosts block external script from dumping database.

Offline Aleksi "Lex" Kilpinen

  • A Peculiar Finn
  • Lead Support Specialist
  • SMF Super Hero
  • *
  • Posts: 18,737
  • Gender: Male
  • Don't worry, I'm n00b friendly
    • Aleksi.Kilpinen on Facebook
    • LexArma on GitHub
    • aleksi-kilpinen on LinkedIn
    • There's No Place Like 127.0.0.1
Re: Exporting of database with PHPMyAdmin stops at 1GB
« Reply #11 on: December 05, 2018, 11:29:19 AM »
I cannot install MySQLDumper because I have no access to the root on my hostin space, and can only place the installer inside the forum folder, however that way I cannot access it when Maintenance mode is on.
Can you create additional folders within the forum folder? I would suggest trying to add a new folder for dumper, and running it from there.
A Finnish Support Specialist
 Happily running multiple SMF 2.0 installations.
  Fooling around with an i7 990X @ 3,47Ghz / 12Gb / Win 10 x64 / 3840x2160


How you can help SMF

"Before you allow people access to your forum, especially in an administrative position, you must be aware that that person can seriously damage your forum.
 Therefore, you should only allow people that you trust, implicitly, to have such access." -Douglas

Offline Sono

  • Semi-Newbie
  • *
  • Posts: 83
Re: Exporting of database with PHPMyAdmin stops at 1GB
« Reply #12 on: December 05, 2018, 03:38:14 PM »
Yeah, that is exactly what I do. Create a folder in the forum directory and run it from there. But it has issues, reports Unspecified index or what, and stops on exporting reporting Too many requests. It doesn't find the database automatically either.

Offline Aleksi "Lex" Kilpinen

  • A Peculiar Finn
  • Lead Support Specialist
  • SMF Super Hero
  • *
  • Posts: 18,737
  • Gender: Male
  • Don't worry, I'm n00b friendly
    • Aleksi.Kilpinen on Facebook
    • LexArma on GitHub
    • aleksi-kilpinen on LinkedIn
    • There's No Place Like 127.0.0.1
Re: Exporting of database with PHPMyAdmin stops at 1GB
« Reply #13 on: December 05, 2018, 11:52:28 PM »
As I remember (it's been a while) you can change much of dumper's behavior through it's settings - try to make it intentionally slower, the too many requests error would suggest you are trying to get too much too fast.
A Finnish Support Specialist
 Happily running multiple SMF 2.0 installations.
  Fooling around with an i7 990X @ 3,47Ghz / 12Gb / Win 10 x64 / 3840x2160


How you can help SMF

"Before you allow people access to your forum, especially in an administrative position, you must be aware that that person can seriously damage your forum.
 Therefore, you should only allow people that you trust, implicitly, to have such access." -Douglas

Offline Sono

  • Semi-Newbie
  • *
  • Posts: 83
Re: Exporting of database with PHPMyAdmin stops at 1GB
« Reply #14 on: December 08, 2018, 07:42:43 AM »
The 2,7GB file exported through SSH extracts to the original 3,3 GB database when importing. So that way it works, no need to fragment the export.