节点无法启动(国密版本 v0.24.2)

1、节点报错,服务停止,chain的报错信息如下:
Thread panicked at db get failed, key: [2, 0, 0, 2, 222, 183], err: “IO error: While open a file for random read: ./data/nosql/000637.sst: Too many open files in system”, cita-chain/types/src/db.rs:274

2、删除docker,重新setup,重新start,仍然无法启动,forever的日志如下:
2020-12-23 - 14:12:14 | cita_forever - 91 | INFO - Version: v0.24.0
2020-12-23 - 14:12:14 | cita_forever - 95 | INFO - config_file: ForeverConfig { name: Some(“cita-forever”), command: Some(“cita-forever”), args: None, pidfile: Some(".cita-forever.pid"), process: Some([ProcessConfig { name: Some(“cita-auth”), command: Some(“cita-auth”), args: Some(["-c", “auth.toml”]), pidfile: Some(".cita-auth.pid"), respawn: Some(3), pid: None, respawns: None }, ProcessConfig { name: Some(“cita-network”), command: Some(“cita-network”), args: Some(["-c", “network.toml”]), pidfile: Some(".cita-network.pid"), respawn: Some(3), pid: None, respawns: None }, ProcessConfig { name: Some(“cita-bft”), command: Some(“cita-bft”), args: Some(["-c", “consensus.toml”, “-p”, “privkey”]), pidfile: Some(".cita-bft.pid"), respawn: Some(3), pid: None, respawns: None }, ProcessConfig { name: Some(“cita-jsonrpc”), command: Some(“cita-jsonrpc”), args: Some(["-c", “jsonrpc.toml”]), pidfile: Some(".cita-jsonrpc.pid"), respawn: Some(3), pid: None, respawns: None }, ProcessConfig { name: Some(“cita-chain”), command: Some(“cita-chain”), args: Some(["-c", “chain.toml”]), pidfile: Some(".cita-chain.pid"), respawn: Some(3), pid: None, respawns: None }, ProcessConfig { name: Some(“cita-executor”), command: Some(“cita-executor”), args: Some(["-c", “executor.toml”]), pidfile: Some(".cita-executor.pid"), respawn: Some(3), pid: None, respawns: None }]) }
2020-12-23 - 14:12:14 | cita_forever::proces - 133 | WARN - cita-forever not started
2020-12-23 - 14:12:14 | cita_forever::proces - 286 | INFO - .cita-forever.pid not found.
2020-12-23 - 14:12:14 | cita_forever::proces - 133 | WARN - cita-chain not started
2020-12-23 - 14:12:14 | cita_forever::proces - 286 | INFO - .cita-chain.pid not found.
2020-12-23 - 14:12:14 | cita_forever::proces - 133 | WARN - cita-executor not started
2020-12-23 - 14:12:14 | cita_forever::proces - 286 | INFO - .cita-executor.pid not found.
2020-12-23 - 14:12:14 | cita_forever::proces - 133 | WARN - cita-network not started
2020-12-23 - 14:12:14 | cita_forever::proces - 286 | INFO - .cita-network.pid not found.

3、删除.cita-bft.pid和.cita-jsonrpc.pid,重新setup,start,chain的报错日志如下

Thread main panicked at failed to open url amqp://guest:guest@localhost/mba-mainnet/4 : Protocol(“Connection reset by peer (os error 104)”), /opt/.cargo/git/checkouts/cita-common-1aad419f3e80ba17/73402b5/pubsub_rabbitmq/src/lib.rs:60

This is a bug. Please report it at:

https://github.com/cryptape/cita/issues/new?labels=bug&template=bug_report.md

查看一下目录下的/data/nosql/ 多少个文件

我用了recover工具,但也不好使

有过磁盘满的情况吗?

应该不是磁盘满了,我上去看了,磁盘还有剩余

rabbitmqctl stop_app
rabbitmqctl reset
rabbitmqctl start_app

看上去是rabbitmq没连上,先清除一下

然后再setup,start

不行,还是报哪个mq的错误

5672 这个端口能连接上吗?

rabbitmqctl status

rabbitmqctl list_vhosts

tomcat@ubuntu-03:/opt/export/app/cita_sm2_sm3$ sudo rabbitmqctl status
Status of node ‘rabbit@ubuntu-03’ …
[{pid,547},
{running_applications,
[{rabbitmq_management,“RabbitMQ Management Console”,“3.5.7”},
{rabbitmq_web_dispatch,“RabbitMQ Web Dispatcher”,“3.5.7”},
{webmachine,“webmachine”,“1.10.3-rmq3.5.7-gite9359c7”},
{mochiweb,“MochiMedia Web Server”,“2.7.0-rmq3.5.7-git680dba8”},
{rabbitmq_management_agent,“RabbitMQ Management Agent”,“3.5.7”},
{rabbit,“RabbitMQ”,“3.5.7”},
{mnesia,“MNESIA CXC 138 12”,“4.13.3”},
{os_mon,“CPO CXC 138 46”,“2.4”},
{amqp_client,“RabbitMQ AMQP Client”,“3.5.7”},
{xmerl,“XML parser”,“1.3.10”},
{inets,“INETS CXC 138 49”,“6.2”},
{sasl,“SASL CXC 138 11”,“2.7”},
{stdlib,“ERTS CXC 138 10”,“2.8”},
{kernel,“ERTS CXC 138 10”,“4.2”}]},
{os,{unix,linux}},
{erlang_version,
“Erlang/OTP 18 [erts-7.3] [source] [64-bit] [smp:2:2] [async-threads:64] [kernel-poll:true]\n”},
{memory,
[{total,46167104},
{connection_readers,0},
{connection_writers,0},
{connection_channels,0},
{connection_other,5424},
{queue_procs,2712},
{queue_slave_procs,0},
{plugins,362704},
{other_proc,13362736},
{mnesia,61136},
{mgmt_db,168928},
{msg_index,46736},
{other_ets,1088792},
{binary,13304},
{code,20374583},
{atom,711569},
{other_system,9968480}]},
{alarms,[]},
{listeners,[{clustering,25672,"::"},{amqp,5672,“127.0.0.1”}]},
{vm_memory_high_watermark,0.4},
{vm_memory_limit,1657413632},
{disk_free_limit,50000000},
{disk_free,73440505856},
{file_descriptors,
[{total_limit,65436},
{total_used,3},
{sockets_limit,58890},
{sockets_used,1}]},
{processes,[{limit,1048576},{used,177}]},
{run_queue,0},
{uptime,9868}]

tomcat@ubuntu-03:/opt/export/app/cita_sm2_sm3$ sudo rabbitmqctl list_vhosts
Listing vhosts …
/

然后进行setup,setup成功后 list_vhosts 会显示新增的vhost

setup 后没有增加

那是setup没有成功啊,mq是在docker内部还是外部?