flume 1.8 安裝部署
環境
centos:7.2
JDK:1.8
Flume:1.8
一、Flume 安裝
1) 下載
wget http://mirrors.tuna.tsinghua.edu.cn/apache/flume/1.8.0/apache-flume-1.8.0-bin.tar.gz
2) 解壓
tar –zxvf apache-flume-1.8.0-bin.tar.gz
mv apache-flume-1.8.0-bin /usr/local/flume
3) 設置環境變數
Vim /etc/profile.d/flume.sh
Source /etc/profile
4) 配置java_home
cp flume-env.sh.template flume-env.sh
vim flume-env.sh
spoolingDirectory Source
a1.sources = r1
a1.sinks = k1 a1.channels = c112345
6789101112131415
16171819202122232425<br><br>a1.sources.r1.type = spooldir
#a1.sources.r1.channels = c1#a2.sources.r1.spoolDir = /opt/apache-flume-1.8.0-bin/logs#a1.sources.r1.fileHeader = true## # Describe the sink#
a1.sinks.k1.type = logger
## # Use a channel which buffers events in memory#a1.channels.c1.type = memory#a1.channels.c1.capacity = 1000#a1.channels.c1.transactionCapacity = 100#
# # Bind the source and sink to the channel
#a1.sources.r1.channels = c1#a1.sinks.k1.channel = c1啟動 :
../bin/flume-ng agent -c /opt/apache-flume-1.8.0-bin/conf -f /opt/apache-flume-1.8.0-bin/conf/spool1.conf --name a1 -Dflume.root.logger=INFO,console
推薦閱讀:
※數據之路(Hadoop)我該如何打好基礎?
※yarn中的事件驅動模型
※穩定和性能如何兼顧?58大數據平台的技術演進與實踐
※大數據那些事(28):卡夫卡們的故事
※Ubuntu搭建Hadoop的踩坑之旅(三)

