mysql错误9001_ERROR 9001 (HY000): Max connect timeout reached while reaching hostgroup 0 after 10000ms...
Hi,
I have a question.
We have an instance of proxysql 1.3.7. when we login database per 6033 and try to run any command, it's failed and show the error information:
ERROR 9001 (HY000): Max connect timeout reached while reaching hostgroup 0 after 10000ms
the proxysql.log show the following warning message:
2018-04-27 14:11:35 MySQL_Session.cpp:2667:handler(): [WARNING] Error during query on (0,192.168.25.4,3306): 1213, Dead lock found when trying to get lock; try restarting transaction 2018-04-27 14:11:35 MySQL_Session.cpp:2667:handler(): [WARNING] Error during query on (0,192.168.25.4,3306): 1213, Dead lock found when trying to get lock; try restarting transaction 2018-04-27 14:11:36 MySQL_Session.cpp:2667:handler(): [WARNING] Error during query on (0,192.168.25.4,3306): 1213, Dead lock found when trying to get lock; try restarting transaction 2018-04-27 14:11:37 MySQL_Session.cpp:2667:handler(): [WARNING] Error during query on (0,192.168.25.4,3306): 1213, Dead lock found when trying to get lock; try restarting transaction 2018-04-27 14:11:38 MySQL_Session.cpp:2667:handler(): [WARNING] Error during query on (0,192.168.25.4,3306): 1213, Dead lock found when trying to get lock; try restarting transaction 2018-04-27 14:12:03 MySQL_Session.cpp:2667:handler(): [WARNING] Error during query on (0,192.168.25.4,3306): 1213, Deadlock found when trying to get lock; try restarting transaction 2018-04-27 14:12:13 MySQL_Session.cpp:2667:handler(): [WARNING] Error during query on (0,192.168.25.4,3306): 1213, Deadlock found when trying to get lock; try restarting transaction 2018-04-27 14:12:13 MySQL_Session.cpp:2667:handler(): [WARNING] Error during query on (0,192.168.25.4,3306): 1213, Deadlock found when trying to get lock; try restarting transaction 2018-04-27 14:12:13 MySQL_Session.cpp:2667:handler(): [WARNING] Error during query on (0,192.168.25.4,3306): 1213, Deadlock found when trying to get lock; try restarting transaction 2018-04-27 14:12:58 MySQL_Session.cpp:2667:handler(): [WARNING] Error during query on (0,192.168.25.4,3306): 1213, Deadlock found when trying to get lock; try restarting transaction
Then we found actually have a dead lock but has been killed and mysql can normally run command but proxysql still stuck:
`------------------------
LATEST DETECTED DEADLOCK
2018-04-27 16:07:21 0x7f2769615700
*** (1) TRANSACTION:
TRANSACTION 3698443560, ACTIVE 0 sec inserting
mysql tables in use 1, locked 1
LOCK WAIT 2 lock struct(s), heap size 1136, 1 row lock(s), undo log entries 1
MySQL thread id 119766644, OS thread handle 139761761388288, query id 2213943399 192.168.25.4 mbd-mysql update
REPLACE INTO crawler_phrases_status(last_status, phrase_id, id, last_scan_time, crawler_name) values('没有得到数据下一时间段重试(有个别天抓取998错误):采集失败', 107605, 21335455, '2018-04-27 16:06:27', 'crawl_records_movie_searchd_and_idx_v2')
*** (1) WAITING FOR THIS LOCK TO BE GRANTED:
RECORD LOCKS space id 101557 page no 411 n bits 336 index phrase_id of table online_yuqing_data.crawler_phrases_status trx id 3698443560 lock_mode X waiting
*** (2) TRANSACTION:
TRANSACTION 3698443559, ACTIVE 0 sec updating or deleting, thread declared inside InnoDB 4998
mysql tables in use 1, locked 1
4 lock struct(s), heap size 1136, 4 row lock(s), undo log entries 2
MySQL thread id 119766452, OS thread handle 139807248439040, query id 2213943398 192.168.25.4 mbd-mysql update
REPLACE INTO crawler_phrases_status(last_status, phrase_id, id, last_scan_time, crawler_name) values('没有得到数据下一时间段重试(有个别天抓取998错误):采集失败', 107605, 21335458, '2018-04-27 16:06:27', 'crawl_records_movie_searchd_and_idx_v2')
*** (2) HOLDS THE LOCK(S):
RECORD LOCKS space id 101557 page no 411 n bits 336 index phrase_id of table online_yuqing_data.crawler_phrases_status trx id 3698443559 lock_mode X
*** (2) WAITING FOR THIS LOCK TO BE GRANTED:
RECORD LOCKS space id 101557 page no 411 n bits 336 index phrase_id of table online_yuqing_data.crawler_phrases_status trx id 3698443559 lock_mode X locks gap before rec insert intention waiting
*** WE ROLL BACK TRANSACTION (1)`
Until we manually restart proxysql, the service is back to normal.
Best regards,
Marya Zhao
魔乐社区(Modelers.cn) 是一个中立、公益的人工智能社区,提供人工智能工具、模型、数据的托管、展示与应用协同服务,为人工智能开发及爱好者搭建开放的学习交流平台。社区通过理事会方式运作,由全产业链共同建设、共同运营、共同享有,推动国产AI生态繁荣发展。
更多推荐


所有评论(0)