Could not configure sink k1 due to: Channel c1 not in active set.

来源:3-4 -Flume架构及核心组件

慕运维7479159

2018-03-05

2018-03-05 13:30:06,673 (conf-file-poller-0) [WARN - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.validateSinks(FlumeConfiguration.java:698)] Could not configure sink  k1 due to: Channel c1 not in active set.

org.apache.flume.conf.ConfigurationException: Channel c1 not in active set.

at org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.validateSinks(FlumeConfiguration.java:685)

at org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.isValid(FlumeConfiguration.java:347)

at org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.access$000(FlumeConfiguration.java:213)

at org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:127)

at org.apache.flume.conf.FlumeConfiguration.<init>(FlumeConfiguration.java:109)

at org.apache.flume.node.PropertiesFileConfigurationProvider.getFlumeConfiguration(PropertiesFileConfigurationProvider.java:189)

at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:89)

at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

at java.lang.Thread.run(Thread.java:748)


配置文件如下 

a1.sources = r1

a1.channels = c1 c2 

a1.sinks = k1 k2 


a1.sources.r1.type = thrift

a1.sources.r1.bind = hadoop2

a1.sources.r1.port = 9090

a1.sources.r1.threads = 50

#a1.sources.r1.kafka.consumer.timeout.ms = 100


a1.channels.c1.type = memory

a1.channels = c1

a1.channels.c1.capacity = 1000000

a1.channels.c1.transactionCapacity = 1000000

a1.channels.c1.byteCapacityBufferPercentage = 20

a1.channels.c1.byteCapacity = 80000000

a1.channels.c1.keep-alive = 10


a1.channels.c2.type = memory

a1.channels = c2

a1.channels.c2.capacity = 1000000

a1.channels.c2.transactionCapacity = 1000000

a1.channels.c2.byteCapacityBufferPercentage = 20

a1.channels.c2.byteCapacity = 80000000

a1.channels.c2.keep-alive = 10



a1.sinks.k1.type=org.apache.flume.sink.kafka.KafkaSink

a1.sinks.k1.topic = FanucServer

a1.sinks.k1.brokerList =hadoop1:9092,hadoop2:9092,hadoop3:9092

a1.sinks.k1.requiredAcks = 1

a1.sinks.k1.batchSize = 1000


a1.sinks.k2.type=org.apache.flume.sink.kafka.KafkaSink

a1.sinks.k2.topic = FanucServerParquetAndMongo

a1.sinks.k2.brokerList =hadoop1:9092,hadoop2:9092,hadoop3:9092

a1.sinks.k2.requiredAcks = 1

a1.sinks.k2.batchSize = 1000



a1.sources.r1.channels = c1 c2

a1.sinks.k1.channel = c1

a1.sinks.k2.channel = c2 

a1.sources.r1.selector.type = replicating

 

请问老师 一对多配置总是报这个错误是什么事情

写回答

1回答

Michael_PK

2018-03-05

两channel的source好像没看到

0
0

Spark Streaming实时流处理项目实战

Flume+Kafka+Spark Streaming 构建通用实时流处理平台

1404 学习 · 571 问题

查看课程