Getting Live Data from Twitter and Storing in Azure Blob Storage

Hi Friends,

In this section, I am going to talk about Logic Apps available in Azure. Here, I’ll be pulling Live data from twitter and dumping the same in Azure Blob Storage. You can do tons of things with these data, means you can get these data and apply Machine Learning on the same and many more things. You can also setup a simple .NET app where you can project the twitter data analysis region wise. By, the way this is not the app talk. This is just to showcase how to setup Logic Apps upfront in Azure.

As you can see in the below screen-shot, I am in azure portal. This is Preview portal. Here, you can see that I already have different resource groups.

1st

2nd

3rd

Then, I have clicked on the browse button as shown below and searched for storage account and created the same with required stuffs. Here, I Have chosen all the default settings.

4th

5th

6th

7th

8th

9th

10th

Then, I have setup the new container for the storage.

11th

12th

13th

14th

After that, I have setup Blob Connector for Azure Blob 1st from the MarketPlace option with the container complete URI in there.

15th

16th

17th

18th

19th

20th

21th

Now, I repeat the same steps, but this time I setup Twitter Connector. And, here I have also setup an app in Twitter API. Once, I created the Twitter API, I got consumer key and private key. This key I have mentioned below. And then after creating Twitter connector, I also copied the URL and pasted the in twitter API in callback and site URL by editing the same.

22nd

23rd

24th

After completing above steps, I created Logic Apps as shown below in the screenshot.

25th

26th

Here, I have selected the option, create from scratch. You can obviously select whatever template you want.

27th

28th

29th

30th

Then, finally I have selected two more templates; Recurrence Template and Azure Blob Connector. Here, Recurrence Template is nothing but reflects the time-period. It is currently set for 1 hour which means, this will job will run every hour and pull the data from Twitter. Second thing is Twitter command which I have set in the drop down.

/tweet_@{first(body(‘twitterconnector’)).Tweeted_By}@{first(body(‘twitterconnector’)).Tweeted_By}.txt . This will give Tweeted by data in the above format.

Then, I have Azure Blob Connector, where this LIVE data is getting pushed.

31th

32nd

33rd

34th

Now, in the Logic App Run section, when I click on the input link, it shows the query input. Here, you can see that I am
querying #azure.

35th

And, below is the set of Live Data getting fetched from Twitter.

36th

37th

Thanks for joining me. I hope, you would have enjoyed this post. We’ll see more stuffs around the same in coming section. Till then, stay tuned and Happy Coding.

Thanks,
Rahul Sahay
Happy Coding

2,048 total views, 1 views today

3 thoughts on “Getting Live Data from Twitter and Storing in Azure Blob Storage

Comments are closed.