Analytics Pipeline

Summary

Client The BBC
Project online More Info
Tech used nodejs | aws lambda | aws kinesis | aws s3 | google big query
Date Jan 2018

Project Details

Analytics pipeline allows BBC Voice applications to push analytics data to AWS Kinesis data stream then process the data and send it to various destinations.

The solution consists of 3 main components:

  • An sdk for other applications to use. This sdk is published on the BBC npm account
  • Kinesis data stream which accepts analytics messages through the sdk.
  • Various adapters to consume the data stream. These adaptors are NodeJS AWS Lambdas. We created 2 adaptors namely: ati adaptor and GCP BigQuery adaptor. The ati adaptor sends data to ati whereas the GCP BigQuery sends data to various BigQuery tables

Client Details

The British Broadcasting Corporation (BBC) is a British public service broadcaster. Its headquarters are at Broadcasting House in Westminster, London, and it is the world's oldest national broadcasting organisation and the largest broadcaster in the world by number of employees.

Screenshots

  • project screenshot