Sentiment analysis

Real-time sentiment analysis pipeline template project.

Sentiment analysis is performed on chat messages. The project includes a chat UI, where you can type chat messages. You can also connect to Twitch and perform sentiment analysis on large volumes of messages.

The completed application is illustrated in the following screenshot:

Live demo

You can see the project running live on Quix.

The pipeline

This is the message processing pipeline for this project:

The main services in the pipeline are:

1. UI - provides the chat UI, and shows the sentiment being applied to the chat messages.

2. Sentiment analysis - uses the Hugging Face model to perform sentiment analysis on the chat messages. There is also a Drafts sentiment analysis service for messages being typed, but not yet sent.

3. Twitch data source - An alternative to typing chat messages - you select a Twitch channel and then perform sentiment analysis on Twitch messages.

See the pipeline running

See the pipeline running without needing to sign up to Quix.

Technologies used

Some of the technologies used by this template project are listed here.

Infrastructure:

• Quix
• Docker
• Kubernetes

Backend:

• Apache Kafka
• Quix Streams
• Flask
• pandas

Sentiment analysis:

• Hugging Face

Frontend:

• Angular
• Typescript
• Microsoft SignalR

Data warehousing:

• BigQuery

Prerequisites

To get started make sure you have a free Quix account.

If you are new to Quix it is worth reviewing the recent changes page, as that contains very useful information about the significant recent changes, and also has a number of useful videos you can watch to gain familiarity with Quix.

Twitch API key

You'll also need an API key for the Twitch service (optional), if you want to try Twitch-related features.

BigQuery credentials

If you want to use the Quix BigQuery service (optional), you'll need to provide your credentials for accessing BigQuery.

Git provider

You also need to have a Git account. This could be GitHub, Bitbucket, GitLab, or any other Git provider you are familar with, and that supports SSH keys. The simplest option is to create a free GitHub account.

While this project uses an external Git account, Quix can also provide a Quix-hosted Git solution using Gitea for your own projects. You can watch a video on how to create a project using Quix-hosted Git.

Tutorial

Work through the tutorial.

Getting help

If you need any assistance while following the tutorial, we're here to help in the Quix forum.