Tuesday, September 17, 2019

USPA.tech - the Open Source Framework to build your owned Customer Data Platform (CDP)


Core ideas of USPA framework 

High-level concept of USPA framework

USPA framework - Logical Data Flow
Conceptual Data Models of USPA framework

What is USPA framework ?

The USPA framework is the Hybrid Open Source Software, to develop Customer Data Platform (CDP) simpler and faster. The primary target is Media Agency, Digital Company, Tech Startup, E-commerce platform, marketing scientist and software developer. I hope my work could help anyone want to build CDP in predictable way.

Another reason is my online course "Introduction to Big Data, Marketing Science, CDP and Ad Tech". This course is built for IT student and digital marketer, who can code and want to learn more Big Data with practical projects (E-commerce and Retails).
All details of the course is at this link https://www.bigdatavietnam.org/p/digital-marketing-customer-da.html

This technical architecture can be scale up 10 million daily active users (DAUs) or more, depends on how you setup it in the Cloud Providers (AWS, Google Cloud,...)

Source code : https://github.com/bigdatavietnam-org/USPA.tech

First of all, you have to build Owned Digital Media Hub first (E.g: a simple website with useful content, Social Media Channels,...)

There are 9 modules in USPA framework:

Open Source Modules:

  • (1) Data Collector: JavaScript code to track events (pageview, click, heatmap,...) and SDK for mobile apps (iOS, Android, Smart TV)
  • (2) Unified Data System: The module is built to collect data from multiple sources
  • (3) Data Processing System: core logic of CDP
  • (4) Database Systems
    • (4.1) Log Database: storing event log (pageview, click, play,...)
    • (4.2) Context Data Enrichment: enrich context data (IP to location, web URL to topic models) 
    • (4.3) Profile Database: storing all customer profiles
    • (4.4) Profile Data Enrichment : enrich customer data with Persona Prediction, Lifestyle, Demographics,..
  • (5) API Gateway: control the security and how another systems can pull customer data for business
  • (6) Operations Dashboard: the main tool for Digital Marker, Data Analyst and Business Manager

Closed Source Modules:

  • (7) Predictive Analytics: The data mining system for profile learning, using Machine Learning to classify and cluster data into useful segments (Ideas https://github.com/dmis-lab/demographic-prediction )
  • (8) Personalization System: build customer interest graph and matching product metadata with customer profile ( Ideas https://www.bigdatavietnam.org/2019/09/how-to-build-personalized-news.html )
  • (9) Personalized Content Delivery System:  micro-target marketing with personalized content  for Customer Engagement (No need for coding, just use Cloud API for SMS Messaging, Email Marketing and Programmatic Ad Tech )
Author & Copyright by Trieu Nguyen https://www.facebook.com/tantrieuf31 

Featured Post

USPA.tech - the Open Source Framework to build your owned Customer Data Platform (CDP)

Core ideas of USPA framework  High-level concept of USPA framework USPA framework - Logical Data Flow Conceptual Data Mo...