FROM BI TO BIG DATA
ABED AJRAOU
JUNE 5TH 2015
1
How Big Data is transforming Business
Intelligence
WHAT DO YOU ABOUT SOLOCAL GROUP?
WHAT DO YOU ABOUT FRENCH YELLOW PAGES ?
4
AND WHAT ABOUT ME?
Still at school, I am Business Intelligence
Professor at “Paris Sud” University
With over 15 years experience in Business
Intelligence Practice, I am the head of
Business Intelligence in Solocal group.
Sharing knowledge : I am VP Education at DAMA
France and author in the media www.decideo.fr.
THE AIM OF THE BUSINESS INTELLIGENCE
5
Business Intelligence is an complete environment
which should create intelligence with the data.
Actually, Business Intelligence have to give the right
data, to the right person, with the right tool at the
right time.
Business Intelligence is NOT a tool, is NOT a report,
is NOT a database …
BUSINESS INTELLIGENCE FRAMEWORK
6
Data Sources
Business Scope
CRM Finance Supply Chain Sales HR Operations Logistics
Business
Alignement
Change
Management
General Fees Others
Business Plan
Performance
Management
Others
Strategies
Operationnal
Alignement
Skills
Management
Progress
Strategy
Supply
Chain
FinanceSalesStock
Files
HR CRM
Data Architecture
Datamart
Cubes
Data Transformation
ETL/ELT EAI EII
Staging
Area
DWH
Data Quality
Cleaning Enrichment
Detection and
Analysis
Meta Data Master Data
Data Access & Final User
Data Access Definition
Data Mining Dashboard
Weh Access
Standard
Rapports
OLAP Analyses Extractions
Search &
Navigation
Alertes et
Notifications
Users ServicesUsers Training Help Desk
Requirements
Management
Animation
Foundations
Methodology
Rules &
Principals
Competency
Management
Technical
Training
Technology
Watch
Others
Fonctional
Meta Datal
Technical
Meta Data
Repository
Access/Roles
Compatibility
Rules
Workflow
Business
Repository
Profiling
THE PAINS OF THE BUSINESS INTELLIGENCE
7
So what are the pains of the Business Intelligence?
Mostly come from the Digital Transformation & Big Data paradigm:
 We aware that a DataWarehouse with more that 50 Tb is
very complicated to maintain
 We never consider unstructured data, which come from
every where (logs, blogs, social network …)
 The batch treatment is not anymore compatible with
business need => we are now educate to have the data
quick and in real time
BUSINESS INTELLIGENCE FRAMEWORK
8
Data Sources
Business Scope
CRM Finance Supply Chain Sales HR Operations Logistics
Business
Alignement
Change
Management
General Fees Others
Business Plan
Performance
Management
Others
Strategies
Operationnal
Alignement
Skills
Management
Progress
Strategy
Supply
Chain
FinanceSalesStock
Files
HR CRM
Data Architecture
Datamart
Cubes
Data Transformation
ETL/ELT EAI EII
Staging
Area
DWH
Data Quality
Cleaning Enrichment
Detection and
Analysis
Meta Data Master Data
Data Access & Final User
Data Access Definition
Data Mining Dashboard
Weh Access
Standard
Rapports
OLAP Analyses Extractions
Search &
Navigation
Alertes et
Notifications
Users ServicesUsers Training Help Desk
Requirements
Management
Animation
Foundations
Methodology
Rules &
Principals
Competency
Management
Technical
Training
Technology
Watch
Others
Fonctional
Meta Datal
Technical
Meta Data
Repository
Access/Roles
Compatibility
Rules
Workflow
Business
Repository
Profiling
FROM TRADITIONAL BI TO BIG DATA ARCHITECTURE
Traditional BI
Enterprise Structured Data
ETL Data Transformation
ERP FilesCRM SCM
Data MartsCubes
OLAP
Databases
Departmental BI
In Memory
Dashboar
ding
Predictive
analytics
Data
Warehouse
Mobility
Data
Association
Data
Visualisation
Unstructured Data
Exploitation and analysis of all
Information
Image, VidéoIntranet / Content
Management
MPP/ Data Integretion
Real Time
Analytics
Column
oriented
Index
Text Agent Mining
Text Analytics Native Search
Social Network
MATURITY LEVEL OF ENTERPRISE DATA ARCHITECTURE
9
10
OUR CONVICTION: OPENSOURCE WOULD SOLVE
MOST OF BI PAINS
The Enterprise Data Hub of Cloudera would be
the « Extended DataWarehouse »
The NoSql « Column Database » is the simple way to give access to the
end user and ensure good performance
The end of the Batch, and the welcome of the Streaming
and real time data
Performance ETL for the data transformation on top of
Hadoop
New Data Visualization / Data Story Telling, which is very
quick to install/deploy, and simple to use
Functionnal Data Mart / Data Sets
11
Open Data Group
(Operational Data)
Enterprise Structure Data
Web
site logs
Stock FinanceMobile
logs
Unstructured Data
Image, VidéoIntranet / Content
Management
Social NetworkRH Supply
Chaine
CRM
Data Visualisation
NEW DATA ARCHITECTURE WHICH SUPPORT
THE 3V OF BIGDATA
12
BIG DATA THE NEW AGE OF THE
BUSINESS INTELLIGENCE
Data Gathering & Transformation
KPI and Business Answers
Finance
Marketing Supply ChainCRM
Which new product will have the
biggest chance to be a
successful one?
Is my supply chain is sufficiently
rapid and effective? What are
the optimization factors?
Which one of key employee is
going to leave the
company?
How to send much more targeted
offers based on the opinions and
tastes of customers or prospects?
What transaction is at risk or
fraudulent?
Human
Resources
Enterprise Data
External Data
13
OUR REALISATION 2014 – REAL TIME BUSINESS
Real Time Business
14
OUR REALISATION 2014/2015 – POWER SELECTOR
Search Power Selector
HOW IT WORK IN SOLOCAL?
Idea
Build
Test &
Learn
LET'S PASSIONATE!
DARING!
INVENTIONS AND SIMPLIFY!
STRIVE THE EXCELLENCE!
Extract of the « charte de valeur »
Where are we in the transformation?
The top management is using Hadoop without
knowing that!
The first application using was:
• Sales revenue in real time => refresh very 5
minutes
• Solocal is a B2B company, so we are using the
external Data to understand what is the growth of
our clients …
15
ADVICES: HOW TO ACTIVATE BIG DATA PROJECT AND
HOW START THE BI TRANSFORMATION?
Be the data pilgrim:
•Explain,
•Demonstrate,
•Give sense
With data, we can find lot of new idea,
and business area to explore
Find a sponsor with the company with should:
• understand the importance of this transformation
• highlight your vision
• give you some keys within the organization
• help you in your approach
Get started! We have all the technological
maturity to finally realize all our desires in
terms of data!
16

How big data is transforming BI

  • 1.
    FROM BI TOBIG DATA ABED AJRAOU JUNE 5TH 2015 1 How Big Data is transforming Business Intelligence
  • 2.
    WHAT DO YOUABOUT SOLOCAL GROUP?
  • 3.
    WHAT DO YOUABOUT FRENCH YELLOW PAGES ?
  • 4.
    4 AND WHAT ABOUTME? Still at school, I am Business Intelligence Professor at “Paris Sud” University With over 15 years experience in Business Intelligence Practice, I am the head of Business Intelligence in Solocal group. Sharing knowledge : I am VP Education at DAMA France and author in the media www.decideo.fr.
  • 5.
    THE AIM OFTHE BUSINESS INTELLIGENCE 5 Business Intelligence is an complete environment which should create intelligence with the data. Actually, Business Intelligence have to give the right data, to the right person, with the right tool at the right time. Business Intelligence is NOT a tool, is NOT a report, is NOT a database …
  • 6.
    BUSINESS INTELLIGENCE FRAMEWORK 6 DataSources Business Scope CRM Finance Supply Chain Sales HR Operations Logistics Business Alignement Change Management General Fees Others Business Plan Performance Management Others Strategies Operationnal Alignement Skills Management Progress Strategy Supply Chain FinanceSalesStock Files HR CRM Data Architecture Datamart Cubes Data Transformation ETL/ELT EAI EII Staging Area DWH Data Quality Cleaning Enrichment Detection and Analysis Meta Data Master Data Data Access & Final User Data Access Definition Data Mining Dashboard Weh Access Standard Rapports OLAP Analyses Extractions Search & Navigation Alertes et Notifications Users ServicesUsers Training Help Desk Requirements Management Animation Foundations Methodology Rules & Principals Competency Management Technical Training Technology Watch Others Fonctional Meta Datal Technical Meta Data Repository Access/Roles Compatibility Rules Workflow Business Repository Profiling
  • 7.
    THE PAINS OFTHE BUSINESS INTELLIGENCE 7 So what are the pains of the Business Intelligence? Mostly come from the Digital Transformation & Big Data paradigm:  We aware that a DataWarehouse with more that 50 Tb is very complicated to maintain  We never consider unstructured data, which come from every where (logs, blogs, social network …)  The batch treatment is not anymore compatible with business need => we are now educate to have the data quick and in real time
  • 8.
    BUSINESS INTELLIGENCE FRAMEWORK 8 DataSources Business Scope CRM Finance Supply Chain Sales HR Operations Logistics Business Alignement Change Management General Fees Others Business Plan Performance Management Others Strategies Operationnal Alignement Skills Management Progress Strategy Supply Chain FinanceSalesStock Files HR CRM Data Architecture Datamart Cubes Data Transformation ETL/ELT EAI EII Staging Area DWH Data Quality Cleaning Enrichment Detection and Analysis Meta Data Master Data Data Access & Final User Data Access Definition Data Mining Dashboard Weh Access Standard Rapports OLAP Analyses Extractions Search & Navigation Alertes et Notifications Users ServicesUsers Training Help Desk Requirements Management Animation Foundations Methodology Rules & Principals Competency Management Technical Training Technology Watch Others Fonctional Meta Datal Technical Meta Data Repository Access/Roles Compatibility Rules Workflow Business Repository Profiling
  • 9.
    FROM TRADITIONAL BITO BIG DATA ARCHITECTURE Traditional BI Enterprise Structured Data ETL Data Transformation ERP FilesCRM SCM Data MartsCubes OLAP Databases Departmental BI In Memory Dashboar ding Predictive analytics Data Warehouse Mobility Data Association Data Visualisation Unstructured Data Exploitation and analysis of all Information Image, VidéoIntranet / Content Management MPP/ Data Integretion Real Time Analytics Column oriented Index Text Agent Mining Text Analytics Native Search Social Network MATURITY LEVEL OF ENTERPRISE DATA ARCHITECTURE 9
  • 10.
    10 OUR CONVICTION: OPENSOURCEWOULD SOLVE MOST OF BI PAINS The Enterprise Data Hub of Cloudera would be the « Extended DataWarehouse » The NoSql « Column Database » is the simple way to give access to the end user and ensure good performance The end of the Batch, and the welcome of the Streaming and real time data Performance ETL for the data transformation on top of Hadoop New Data Visualization / Data Story Telling, which is very quick to install/deploy, and simple to use
  • 11.
    Functionnal Data Mart/ Data Sets 11 Open Data Group (Operational Data) Enterprise Structure Data Web site logs Stock FinanceMobile logs Unstructured Data Image, VidéoIntranet / Content Management Social NetworkRH Supply Chaine CRM Data Visualisation NEW DATA ARCHITECTURE WHICH SUPPORT THE 3V OF BIGDATA
  • 12.
    12 BIG DATA THENEW AGE OF THE BUSINESS INTELLIGENCE Data Gathering & Transformation KPI and Business Answers Finance Marketing Supply ChainCRM Which new product will have the biggest chance to be a successful one? Is my supply chain is sufficiently rapid and effective? What are the optimization factors? Which one of key employee is going to leave the company? How to send much more targeted offers based on the opinions and tastes of customers or prospects? What transaction is at risk or fraudulent? Human Resources Enterprise Data External Data
  • 13.
    13 OUR REALISATION 2014– REAL TIME BUSINESS Real Time Business
  • 14.
    14 OUR REALISATION 2014/2015– POWER SELECTOR Search Power Selector
  • 15.
    HOW IT WORKIN SOLOCAL? Idea Build Test & Learn LET'S PASSIONATE! DARING! INVENTIONS AND SIMPLIFY! STRIVE THE EXCELLENCE! Extract of the « charte de valeur » Where are we in the transformation? The top management is using Hadoop without knowing that! The first application using was: • Sales revenue in real time => refresh very 5 minutes • Solocal is a B2B company, so we are using the external Data to understand what is the growth of our clients … 15
  • 16.
    ADVICES: HOW TOACTIVATE BIG DATA PROJECT AND HOW START THE BI TRANSFORMATION? Be the data pilgrim: •Explain, •Demonstrate, •Give sense With data, we can find lot of new idea, and business area to explore Find a sponsor with the company with should: • understand the importance of this transformation • highlight your vision • give you some keys within the organization • help you in your approach Get started! We have all the technological maturity to finally realize all our desires in terms of data! 16