DATA PROCESSING LAYER
OPTIMIZATION IN AN RTB PLATFORM

An RTB platform with a particular layer for preprocessing data to be used in subsequent OLAP cube preparation.

GET FREE CONSULTATION
About the Client

The client was a worldwide Internet media company that provided services for media market players: ad buyers, ad sellers, and content creators. Apart from a leading ad ecosystem, the company had one of the most advanced agile prediction based RTB systems.

Technologies Used
Goal

Initially, the client used Microsoft SQL Server, which requires yearly license payments per CPU core. As a result, the total cost of ownership was increasing because of the increase in volume. The client wanted to optimize, spend, and migrate to Hadoop. It entailed a grounds-up reengineering of the data processing layer.

Work Description

As our first step, we explored the way the original system worked. We examined the Bid Data pipeline operations on both high- and low-levels and analyzed the ETL process between input and output servers. Then we developed a migration plan based on the accumulated data, which comprised two main tasks: 

  • Rewrite the data processing code to use Hadoop and create required Hadoop Jobs
  • Carry out data migration from SQL servers to the Hadoop ecosystem.

Our team closely interacted with the client, conducting daily meetings via Skype, and providing weekly builds through the TeamCity CI server. We employed TDD practices ensuring high-quality standards. 

Work Stages
  1. Examine the existing architecture
  2. Draw up a migration plan
  3. Rework the existing code
  4. Execute data migration
  5. Provide Quality Assurance
  6. Deploy in production
Results

As a result, the client was able to cut down the total costs of ownership several times. Moreover, the new system introduced greater scalability and decreased batch processing time.

RECOMMENDED CASES
Case Studies
Big Data Chemistry

A system to optimize the entire ad serving system that allowed for collecting, processing, and reporting on, billions of transactions every month.

View
RTB Platform Logging System Optimization

A solution designed to reconsider the client’s existing system and to improve data storage and processing.

View
Amazon Web Services in Video Ad Network

A perfect programmatic video-distribution platform for content owners that maximized monetization and personalization.

View
Advertising Automation

Powering up a unique independent marketplace to automate the entire advertising ecosystem across all inventory.

View
Brand-Safe Advertising Platform

Our Advertising Platform was a fully operational system with Facebook integration that allowed for the creation of advertising campaigns.

View
In-House Digital AdTech Platform

Adoppler was a system comprising DSP, SSP, and Ad Exchange that allowed all market parties to transact directly.

View
01
/
05
CONTACT
Let Us Contact You Group 6 Created with Sketch.

Fill out the form below and we’ll get in touch within 24 hours

Tell us about your project in your own words (only 200 words) *

I agree to  the  Privacy policy