My server is crashing with the following messages in the /var/log/mysql/error.log file. It happens when i call a stored procedure that is inserting records into a table that has about 700K records. The size of this table is aobut 19MiB.
here are the server details..
* Server: Localhost via UNIX socket
* Server version: 5.1.41-3ubuntu12.6
* Protocol version: 10
* User: root@localhost
* MySQL charset: UTF-8 Unicode (utf8)
Web server
* nginx
* MySQL client version: 5.1.41
* PHP extension: mysqli
here is my.cnf file - http://pastie.org/1148412
I am newbie, not sure where do I even start troubleshooting this.
nnoDB: Some operating system error numbers are described at
InnoDB: http://dev.mysql.com/doc/refman/5.1/en/operating-system-error-codes.html
InnoDB: File operation call: 'read'.
InnoDB: Cannot continue operation.
100909 9:25:00 [Note] Plugin 'FEDERATED' is disabled.
InnoDB: Log scan progressed past the checkpoint lsn 0 654904637
100909 9:25:00 InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer...
InnoDB: Doing recovery: scanned up to log sequence number 0 654905158
100909 9:25:00 InnoDB: Starting an apply batch of log records to the database...
InnoDB: Progress in percents: 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99
InnoDB: Apply batch completed
100909 9:25:01 InnoDB: Started; log sequence number 0 654905158
100909 9:25:01 [Note] Event Scheduler: Loaded 0 events
100909 9:25:01 [Note] /usr/sbin/mysqld: ready for connections.
Version: '5.1.41-3ubuntu12.6' socket: '/var/run/mysqld/mysqld.sock' port: 3306 (Ubuntu)
InnoDB: Error: tried to read 262144 bytes at offset 0 116391936.
InnoDB: Was only able to read 114688.
100909 9:30:44 InnoDB: Operating system error number 0 in a file operation.
InnoDB: Error number 0 means 'Success'.
InnoDB: Some operating system error numbers are described at
InnoDB: http://dev.mysql.com/doc/refman/5.1/en/operating-system-error-codes.html
InnoDB: File operation call: 'read'.
InnoDB: Cannot continue operation.
100909 9:30:44 [Note] Plugin 'FEDERATED' is disabled.
InnoDB: The log sequence number in ibdata files does not match
InnoDB: the log sequence number in the ib_logfiles!
100909 9:30:44 InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer...
100909 9:30:44 InnoDB: Started; log sequence number 0 654905207
100909 9:30:44 [Note] Event Scheduler: Loaded 0 events
100909 9:30:44 [Note] /usr/sbin/mysqld: ready for connections.
Version: '5.1.41-3ubuntu12.6' socket: '/var/run/mysqld/mysqld.sock' port: 3306 (Ubuntu)
here are the server details..
* Server: Localhost via UNIX socket
* Server version: 5.1.41-3ubuntu12.6
* Protocol version: 10
* User: root@localhost
* MySQL charset: UTF-8 Unicode (utf8)
Web server
* nginx
* MySQL client version: 5.1.41
* PHP extension: mysqli
here is my.cnf file - http://pastie.org/1148412
I am newbie, not sure where do I even start troubleshooting this.
nnoDB: Some operating system error numbers are described at
InnoDB: http://dev.mysql.com/doc/refman/5.1/en/operating-system-error-codes.html
InnoDB: File operation call: 'read'.
InnoDB: Cannot continue operation.
100909 9:25:00 [Note] Plugin 'FEDERATED' is disabled.
InnoDB: Log scan progressed past the checkpoint lsn 0 654904637
100909 9:25:00 InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer...
InnoDB: Doing recovery: scanned up to log sequence number 0 654905158
100909 9:25:00 InnoDB: Starting an apply batch of log records to the database...
InnoDB: Progress in percents: 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99
InnoDB: Apply batch completed
100909 9:25:01 InnoDB: Started; log sequence number 0 654905158
100909 9:25:01 [Note] Event Scheduler: Loaded 0 events
100909 9:25:01 [Note] /usr/sbin/mysqld: ready for connections.
Version: '5.1.41-3ubuntu12.6' socket: '/var/run/mysqld/mysqld.sock' port: 3306 (Ubuntu)
InnoDB: Error: tried to read 262144 bytes at offset 0 116391936.
InnoDB: Was only able to read 114688.
100909 9:30:44 InnoDB: Operating system error number 0 in a file operation.
InnoDB: Error number 0 means 'Success'.
InnoDB: Some operating system error numbers are described at
InnoDB: http://dev.mysql.com/doc/refman/5.1/en/operating-system-error-codes.html
InnoDB: File operation call: 'read'.
InnoDB: Cannot continue operation.
100909 9:30:44 [Note] Plugin 'FEDERATED' is disabled.
InnoDB: The log sequence number in ibdata files does not match
InnoDB: the log sequence number in the ib_logfiles!
100909 9:30:44 InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer...
100909 9:30:44 InnoDB: Started; log sequence number 0 654905207
100909 9:30:44 [Note] Event Scheduler: Loaded 0 events
100909 9:30:44 [Note] /usr/sbin/mysqld: ready for connections.
Version: '5.1.41-3ubuntu12.6' socket: '/var/run/mysqld/mysqld.sock' port: 3306 (Ubuntu)