recently while working on MySQL cluster 7.3.5, we came across this error
Forced node shutdown completed. Caused by error 2341: 'Internal program error (failed ndbrequire)(Internal error, programming error or missing error message, please report a bug). Temporary error, restart node'.
The management nodes would start up but
the data nodes would complete phase 1 & shutdown, some times at phase 2 and some times at phase 5.
The error one would see in the trace file would be as follows:
Status: Temporary error, restart node Message: Internal program error (failed ndbrequire) (Internal error, programming error or missing error message, please report a bug) Error: 2341 Error data: CREATE_TABLE_REF Error object: NDBCNTR (Line: 2493) 0x00000003 Program: ndbd
How did we resolve it ?
First, few of our data nodes had an incorrect connect-string
Second, we had pre-assigned NodeGroups for the data …
[Read more]