admin管理员组

文章数量:1642235

flume启动一直报错ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:158)] Unable to deliver event. Exception follows.,报错详情如下

2021-12-27 20:41:52,509 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:158)] Unable to deliver event. Exception follows.
org.apache.flume.EventDeliveryException: Failed to send events
	at org.apache.flume.sink.AbstractRpcSink.process(AbstractRpcSink.java:398)
	at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
	at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.flume.FlumeException: NettyAvroRpcClient { host: bdc112, port: 4141 }: RPC connection error
	at org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:177)
	at org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:115)
	at org.apache.flume.api.NettyAvroRpcClient.configure(NettyAvroRpcClient.java:598)
	at org.apache.flume.api.RpcClientFactory.getInstance(RpcClientFactory.java:90)
	at org.apache.flume.sink.AvroSink.initializeRpcClient(AvroSink.java:114)
	at org.apache.flume.sink.AbstractRpcSink.createConnection(AbstractRpcSink.java:217)
	at org.apache.flume.sink.AbstractRpcSink.verifyConnection(AbstractRpcSink.java:277)
	at org.apache.flume.sink.AbstractRpcSink.process(AbstractRpcSink.java:353)
	... 3 more
Caused by: java.io.IOException: Error connecting to bdc112/192.168.10.112:4141
	at org.apache.avro.ipc.NettyTransceiver.getChannel(NettyTransceiver.java:261)
	at org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:203)
	at org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:152)
	at org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:165)
	... 10 more
Caused by: java.ConnectException: 拒绝连接: bdc112/192.168.10.112:4141
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
	at org.jbossty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152)
	at org.jbossty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105)
	at org.jbossty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79)
	at org.jbossty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337)
	at org.jbossty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42)
	at org.jbossty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
	at org.jbossty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more
2021-12-27 20:41:52,509 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:158)] Unable to deliver event. Exception follows.
org.apache.flume.EventDeliveryException: Failed to send events
	at org.apache.flume.sink.AbstractRpcSink.process(AbstractRpcSink.java:398)
	at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
	at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.flume.FlumeException: NettyAvroRpcClient { host: bdc112, port: 4142 }: RPC connection error
	at org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:177)
	at org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:115)
	at org.apache.flume.api.NettyAvroRpcClient.configure(NettyAvroRpcClient.java:598)
	at org.apache.flume.api.RpcClientFactory.getInstance(RpcClientFactory.java:90)
	at org.apache.flume.sink.AvroSink.initializeRpcClient(AvroSink.java:114)
	at org.apache.flume.sink.AbstractRpcSink.createConnection(AbstractRpcSink.java:217)
	at org.apache.flume.sink.AbstractRpcSink.verifyConnection(AbstractRpcSink.java:277)
	at org.apache.flume.sink.AbstractRpcSink.process(AbstractRpcSink.java:353)
	... 3 more
Caused by: java.io.IOException: Error connecting to bdc112/192.168.10.112:4142
	at org.apache.avro.ipc.NettyTransceiver.getChannel(NettyTransceiver.java:261)
	at org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:203)
	at org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:152)
	at org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:165)
	... 10 more
Caused by: java.ConnectException: 拒绝连接: bdc112/192.168.10.112:4142
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
	at org.jbossty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152)
	at org.jbossty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105)
	at org.jbossty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79)
	at org.jbossty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337)
	at org.jbossty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42)
	at org.jbossty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
	at org.jbossty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

原因,启动顺序出了问题,严格按照启动顺序即可,我的是一下启动顺序:

#第一个窗口
[lqs@bdc112 flume-1.9.0]$ bin/flume-ng agent --conf conf/ --name a1 --conf-file job/group2/flume03 -Dflume.root.logger=INFO,console

#第二个窗口
[lqs@bdc112 flume-1.9.0]$ bin/flume-ng agent --conf conf/ --name a1 --conf-file job/group2/flume02 -Dflume.root.logger=INFO,console

#第三个窗口
[lqs@bdc112 flume-1.9.0]$ bin/flume-ng agent --conf conf/ --name a1 --conf-file job/group2/flume01 -Dflume.root.loggeINFO,console
#注意,以上三条命令表示的都是同一个意思

本文标签: flumeSinkRunnerPollingRunnerErrororg