Twitter and facebook social media data ingestion with Azure cloud

Anshal 2,251 Reputation points
2023-03-01T15:28:37.2133333+00:00

hi friends we need to prepare a prototype of a solution that ingest data from social media site Twitter and Facebook comments as source please suggest high level architecture link so that help me understand the process

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
720 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
{count} votes

1 answer

Sort by: Most helpful
  1. PRADEEPCHEEKATLA 90,646 Reputation points Moderator
    2023-03-03T07:35:45.55+00:00

    @Anshal Thanks for the question and using MS Q&A platform.

    To ingest data from social media sites like Twitter and Facebook, you can use Azure Stream Analytics and Azure Event Hubs. The Twitter client application can get tweet events directly from Twitter using the Twitter Streaming APIs. You can then configure the client application to use the Twitter API credentials when it makes API calls.

    To learn more about how to use Stream Analytics for social media analysis using the Twitter client API, you can refer to this article: Social media analysis with Azure Stream Analytics

    Using other Azure Services:

    Data ingestion, stream processing and sentiment analysis pipeline using Twitter data example
    Build and deploy a social media analytics solution

    For Facebook, you can use the Facebook Graph API to extract data from Facebook. You can then use Azure Event Hubs to collect the data and Azure Stream Analytics to process the data in real-time.

    You can also use Azure Cosmos DB to store the data from both Twitter and Facebook. Azure Cosmos DB is a globally distributed, multi-model database service designed for use cases such as social media, gaming, and e-commerce. You can learn more about the design pattern for social media apps using Azure Cosmos DB here: Going social with Azure Cosmos DB.

    Hope this helps. Do let us know if you any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    1 person found this answer helpful.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.