Event streaming of earthquake data
Event streaming of earthquake data
Global earthquake events streamed end to end: Apache NiFi ingests the USGS feed, Apache Kafka transports it, Apache Druid stores it for real-time OLAP, and Superset shows it live on a map.
HOW TO START
With a Kubernetes cluster, run a single command:
Key Features
What this demo shows
Real event feed
Live global earthquake events from the USGS feed.
Real-time OLAP
Druid serves instant aggregations over the event stream.
Replayable
Kafka retains the event log for reprocessing.
End-to-end streaming
NiFi to Kafka to Druid, fully automated.
Live map
Quakes plotted on a map as they arrive in Superset.
Independently scalable
Each stage of the pipeline scales on its own.
Demo Components
The stack under the hood
Apache NiFi
Ingestion
Ingests the USGS earthquake feed and publishes events to Kafka.
Apache Kafka
Streaming
Durable event log transporting the seismic events.
Apache Druid
Real-time OLAP
Consumes Kafka and serves fast queries over the events.
Apache Superset
Dashboards
Live map and charts of earthquakes as they happen.
Demo Workflow
From seismic feed to live map
Installation
One command installs NiFi, Kafka, Druid and Superset.
Ingest the USGS feed
NiFi pulls the earthquake feed and publishes to Kafka.
Stream through Kafka
Kafka transports and retains the seismic events.
Ingest into Druid
Druid consumes the topic for real-time analytics.
Watch the map
See earthquakes appear live on the Superset map.
Ready to run it yourself?
Build an event-streaming analytics stack on real seismic data.