Live stream of comment sentiment for r/CryptoCurrency


July 15, 2023


Rough explanation

Three microservices:

  1. Comment streaming using Python and PRAW

  2. Sentiment prediction using Python and a huggingface Transformer model

  3. Middleware to for connecting the frontend to the Kafka stream via websocket (using Rust+tokio

All services communicate event-driven via Kafka.

The dashboard is built using React, exported as a single .js file with Parcel. Then, the .js-file can be loaded in an html-cell via Quarto Markdown.