Analytics Pipeline

Summary

ClientThe BBC
Project onlineMore Info
Tech usednodejs|aws lambda|aws kinesis|aws s3|google big query|google data studio|
DateFeb 2018

Project Details

Analytics pipeline allows BBC Voice applications to push analytics data to AWS Kinesis data stream then process the data and send it to various destinations.

The solution consists of 3 main components:

  • An sdk for other applications to use. This sdk is published on the BBC npm account
  • Kinesis data stream which accepts analytics messages through the sdk.
  • Various adapters to consume the data stream. These adaptors are NodeJS AWS Lambdas. We created 2 adaptors namely: ati adaptor and GCP BigQuery adaptor. The ati adaptor sends data to ati whereas the GCP BigQuery sends data to various BigQuery tables

Client Details

The British Broadcasting Corporation (BBC) is a British public service broadcaster. Its headquarters are at Broadcasting House in Westminster, London, and it is the world's oldest national broadcasting organisation and the largest broadcaster in the world by number of employees.