flume 环境部署

flume 环境部署

1. -解压

略

2. 设置环境变量

略

3. 修改配置

conf/flume-env.sh.template   复制一份flume-env.sh，然后修改下JAVA_HOME即可

4. 例子

# Define a memory channel called ch1 on agent1agent1.channels.ch1.type = memoryagent1.channels.ch1.capacity = 1000agent1.channels.ch1.transactionCapacity = 100 # Define an Avro source called avro-source1 on agent1 and tell it# to bind to 0.0.0.0:41414. Connect it to channel ch1.agent1.sources.avro-source1.channels = ch1agent1.sources.avro-source1.type = netcatagent1.sources.avro-source1.bind = localhostagent1.sources.avro-source1.port = 41414 # Define a logger sink that simply logs all events it receives# and connect it to the other end of the same channel.agent1.sinks.log-sink1.channel = ch1agent1.sinks.log-sink1.type = logger # Finally, now that we've defined all of our components, tell# agent1 which ones we want to activate.agent1.channels = ch1agent1.sources = avro-source1agent1.sinks = log-sink1

保存到conf/sample.conf

5. 运行

bin/flume-ng agent --conf $FLUME_HOME/conf --conf-file $FLUME_HOME/conf/sample.conf --name agent1 -Dflume.root.logger=INFO,console

6. 测试

telnet localhost 41414

版权声明：本文内容由网络用户投稿，版权归原作者所有，本站不拥有其著作权，亦不承担相应法律责任。如果您发现本站中有涉嫌抄袭或描述失实的内容，请联系我们jiasou666@gmail.com 处理，核实后本网站将在24小时内删除侵权内容。