Intelligent content discovery & real-time behavioural analytics with AWS OpenSearch for a leading learning experience platform
Client
A global AI-powered learning platform used by enterprises and governments, handling over a billion user events daily to drive personalized learning and engagement.
Project Context
The client required real-time analytics on user behavior for a 1B+ daily event stream, driven by engagement goals and personalized learning.
Project Objectives
Enable real-time content discovery and user analytics.
Process over 1 billion events per day.
Integrate data from RDBMS, InfluxDB, and partner systems.
Challenges
Need for real-time analytics with minimal latency.
Complex multi-source ingestion and deduplication for event tracking.
Legacy data migration from PostgreSQL and MySQL.
Solution
Migrated 1TB+ historical data to AWS.
Built a 100% serverless architecture using AWS Glue and OpenSearch.
Handled 30GB/day ingestion and 2000+ queries/sec across a 6TB cluster.
