Skip to content

In this project we will fetch tweets using Apache Flume. We will also use the memory channel to buffer these tweets and HDFS sink to push these tweets into the HDFS.

License

Notifications You must be signed in to change notification settings

gurpreetsahni/Data-Fetching-using-Flume

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Data-Fetching-using-Flume

Flume is the technology of Hadoop.

Flume is a highly reliable, distributed, and configurable tool. It is principally designed to copy streaming data (log data) from various web servers to HDFS.

I will explain how to fetch data from Twitter service and store it in HDFS using Apache Flume.

There are various Linux commmands which we will you to perform this project.

About

In this project we will fetch tweets using Apache Flume. We will also use the memory channel to buffer these tweets and HDFS sink to push these tweets into the HDFS.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published