Breaking Down the Last Bastion of IT Cost - IBM's DB2 Cobra Project

Breaking D
B ki Down th L t Bastion of IT Cost
the Last B ti f C t
IBM’s DB2 Cobra Project
Scott Abbott
Certified IT Architect, Data Management Software

IBM Insight Forum 09 Make change work for you
®

Context
C t t

IBM Insight Forum 09
2 Make change work for you
®

Inertia

Even in the best of times we
struggle to move forwards

Especially if there are
those who are afraid of
the unknown

“It is not because
i tb
things are difficult
we do not dare;

It is because
we do not dare
that they are difficult”

-Seneca
Seneca

®

Tough Times
Remove B i
R Barriers

We,
We the unwilling, led by the
unwilling
unknowing, are doing the
impossible for the ungrateful.
We have do e so much, for
e a e done uc , o
so long, with so little, we are
now qualified to do anything
with nothing.
g
Mother Teresa

“The mind opens doors
the hand cannot reach.”
Jon-Henri Damski

So Change is Good

®

Information Technology Challenges
I f ti T h l Ch ll

Lower the cost of managing
data

Improve service levels:
Availability
Performance
Security

Leverage existing
investments in skills and
code

®

Lowering IT Costs
L i C t

®

Lowering IT Costs
L i C t
A Diff
Different O ti
t Option

®

®

Tough Times
Remove B i
R Barriers

“Not Business
As Usual…”

“Game
Game
Changing
Technology…
Technology ”

So is time to
consider DB2?
®

Lowering IT Costs
L i C t
Compression
C i

®

Lowering IT Costs – DB2 Compression
Why is it important?
Saving Storage
Usually the most expensive component of a database solution
Saves floor space and personal cost for managing storage
Saving storage saves power and cooling!

Improving I/O Efficiency
Fewer I/O operations needed to retrieve same amount of data

Quicker Access to Data from Disk
Accessing data from disk is the slowest database operation

“DB2 9 compression capabilities are key in helping reduce the
size of our databases—in one case by up to 83%.”
—Jean Holley CIO Tellabs Inc
Jean Holley, CIO, Inc.

“We observed a 70% compression ratio.”
—Ellen Reys-Klebaner, Chief Database Architect, Visa

®

So how does it work?
Repeating patterns within the data (and just within each row) is
the key to good compression Text data tends to compress well
compression.
because of reoccurring strings as well as data with lots of
repeating characters, leading or trailing blanks

®

Storing more in less

Uncompressed Row PLANO TX 24355
Common sequences of
Compressed Row x 01C
x’01C’ consecutive bytes in row
replaced with 12 bit symbol

Data page with Data page with
uncompressed rows compressed rows

x’01C’

®

How much can I compress?

INDEX - M lti l algorithms f automatic
Multiple l ith for t ti
index compression
TEMP DATA
33% 34%

INDEX
33%

TEMPORARY TABLES - Automatic
compression for temporary tables

®

Some examples of compression rates

®

The Financial impact – DB2 9 5
9.5
(NZ client)
SAP Database Comparison
3 Year TCO Analysis

®

The Financial impact – DB2 9 7
9.7
(NZ client)
SAP Database Comparision
3 Year TCO Analysis

®

Lowering IT Costs
L i C t
Administration
Ad i i t ti

®

Lowering IT Costs – Reducing Administration
Autonomic Computing Attributes

Increased Business
Responsiveness Resiliency
Adapt to dynamically Discover, diagnose
Discover diagnose,
changing environments and act to prevent
e.g. Configuration Advisor, disruptions
Design Advisor e.g.
e g Health Monitor
Monitor,
Fault Monitor
Operational Reduced Manual
Efficiency Administration
Ad i i t ti
Tune resources and balance Automatic management of
workloads to maximize use of IT database objects and
resources administrative tasks
e.g. Self-configuring/optimizing utilities, e.g. Automatic storage
Adaptive utility throttling, STMM!! management

®

Self-Configuring
Self Configuring Example ... Configuration Advisor
Automatic environment characteristic detection

User description of basic operational questions

Combined with mathematical model of each configuration p
g parameter, based on
expert heuristics
Inside DB2

Autonomically sensed
system characteristics

User specification of the Configuration Configuration
database environment model settings

Expert
E t
heuristics

®

Self-Configuring
Self Configuring ... Configuration Advisor GUI

Configuration Advisor GUI

®

Self-Healing
Self Healing ... Heath Monitor
Checks healthiness of all active database
objects as frequently as deemed necessary
Generates alerts based on a health indicator
exceeding a threshold or being in non-normal
state
Sends notifications to the DB2 Administration
Notification Log, and also sends emails and
pages to contacts on its notification list
Advises on severity of condition, and suggests
resolutions
Runs corrective actions (scripts or tasks) defined
for health alerts
Easy up and running process: provide email or
up-and-running
pager address information for notification at
install time

®

Self-Managing ... Automatic Object Maintenance
Enabled/disabled through database configuration
parameter hierarchy
AUTO_MAINT Auto Backup
AUTO_DB_BACKUP *
AUTO_TBL_MAINT Auto Runstats
AUTO_RUNSTATS *
Auto Reorg
AUTO_REORG *
AUTO_STATS_PROF
Auto Stats Profiling
AUTO_PROF_UPD

Hierarchy allows turning all automatic maintenance on
or off without affecting the respective activity settings
Customizable
Completely transparent to users
Integrated with Health Monitoring
ith

®

Self-Tuning ... Memory Tuning in DB2 - STMM
g y g
DB2 9 introduced a revolutionary memory tuning system called the
Self-Tuning Memory Manager (
g y g (STMM) )
Works on main database memory parameters
Buffer pools, sort, locklist, package cache, and total database
memory
Hands-off online memory tuning
Requires no DBA intervention
Senses the underlying workload and tunes the memory based on
need
Can adapt quickly to workload shifts that require memory
redistribution

Enhanced in DB2 9.5 with greater capability and more automatic
configuration settings

®

Self-Tuning ... STMM in action – Dropping a key index
g pp g y

Runtime is reduced by 63% in a few cycles through STMM reacting to
environment changes
i t h TPCH Query 21 - After drop index - Average times for the 10 streams

7000

avg = 6206

6000

Reduce 63%
5000

Some
4000
indexes
Tim in seconds

avg = 2285
dropped
me

3000

2000

avg = 959

1000

0
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34

Order of execution

®

Self-Tuning ... STMM in action: Compare to hand-tuned
g p
70000

STMM also edges
63302 out benchmark 63796

tuned system
60000

50000
Transactions Per Minute

40000

STMM beats default
configuration by nearly
4x
30000

16713

20000

10000

0
Default (No tuning) Benchmark Tuned STMM Tuned
Configura tion

®

Lowering IT Costs
L i C t
High A il bilit
Hi h Availability

®

Lowering IT Costs – Cost of Providing High Availability
DB2 High Availability Data Replication (HADR)
g y p ( )

Works over standard
networks & h d
t k hardware

Free of charge
Free-of-charge with
all non-Express
editions

®

DB2 Maintenance w/ HADR - Rolling Fixpack Example
g p p

Reduced outages
g

®

HADR Read Accessible Standby
y
HADR now supports read-on-standby reporting
Turn your HA or DR hardware investment from seldom used servers to
a reporting server - giving you more insight and cost effectiveness
Offload reporting work from your primary, giving it better performance
During failover, DB2 seamlessly turns the read-on-standby into a
primary read / write server

®

Getting
G tti
There

®

Lowering IT Costs – Breaking Down the Oracle Barriers
Oracle – The Last Bastion of IT Cost

Businesses and developers are locked into Oracle
Complex databases servers requiring expensive DBA skills
Proprietary SQL syntax
Proprietary code
Rollback segments

Oracle
Database

Your Applications
Y A li ti You
Y Your Databases

®

Why So Afraid of Migrating?
y g g

Impedance mismatch between source and
target database features
Data types, locking model, weak typing,
packages, … Oracle

Workarounds Poor performance

THIS IS ALL HISTORY NOW!

LOOK INTO THE FUTURE:
DB2 COBRA
Lack of skills in development team

ORACLE DB2

®

Openbravo migration to DB2
p g

DB2 9.5: ~2 YEARS
1. Map schema and data types
• Different datatype behavior. Eg: DATE
• Different DDL

2. Move data

3. Translate PL/SQL code
(Triggers/Procedures/Functions)
• Missing built-in functions & packages
Mi i b ilt i f ti k
• Missing functionality: REF CURSORs, %TYPE, …

4. Translate SQL in application logic
(manual)
• Untyped expressions (thousands of occurences)

5. Debugging
• Hard to fix concurrency problems

6. T t and Tuning
Test d T i

®

A Radically aggressive design goal…
y gg g g

Porting?? I meant ENABLING!!!
Changes to applications are the exception. Not the rule.
exception rule

Oracle SQL
PL/SQL
Concurrency Control DB2
Packages
Built-in packages NO CHANGE
JDBC
SQL Plus
SQL*Plus Scripts

®

Barrier #1 – PL/SQL only runs on Oracle
y

Solution
A 2nd Compiler for PL/SQL!
DB2 Server

DB2 DB2 Engine
SQL PL Compiler

PL/SQL X PL/SQL
Compiler

DB2 9.7 Compatibility Features
Registry
R i t variable: DB2 COMPATIBILITY VECTOR
i bl DB2_COMPATIBILITY_VECTOR
Optional: SET SQLCOMPAT PLSQL

Barrier #2 – Oracle custom data types not supported
yp pp
Traditionally, DB2 has supported strict typing:
In accordance with SQL standard
Trend towards weak typing in programming:
For PERL, RUBY, PHP, etc.

Solution
Flexible Typing!

DB2 now supports:
Automatic casting between data types
Great performance with or without parameter markers

Easy for your application to use DB2
Easy for your developers to use DB2
E.g., no changes for applications with Oracle Database “DATE”

®

Changes to applications are the exception. Not the
rule.
Compatibility f t
C tibilit features DB2 9 7
9.7
Concurrency models Native support
SQL dialects Native support
Data types Native support
Functions Native support
Procedural languages Native support
Packages Native support
Built-in packages Native support
JDBC Native support
Online schema changes Native support
Scripting languages Native support

IBM can rapidly assess your application to confirm level of compatibility

®

Integrated Data Management
g g
Unified solution across DB2, Informix, and Oracle
Load Oracle Edit database objects
catalog
Design – InfoSphere Data Architect
Design logical models, physical models, privilege
models, privacy models
Generate platform-specific physical objects
Develop – Optim Development Studio
Create, alter, and drop database objects
Run commands via CLPPLUS e.g. START, STOP
Copy/paste objects between DB2 and Oracle
Generate data access layers
Develop SQL, PL/SQL procedures, and functions
Capture SQL from executing application
Trace SQL back to original source
Test - Optim Test Data Manager and Data Privacy
Solutions
Invoke Optim TDM from Developer
Use relationship and privacy definitions from
InfoSphere Data Architect
oSp e e a a c ec
Create right-sized, fictionalized, production-like test
databases
Deploy – Optim pureQuery Runtime Take context- View SQL and
Replace SQL without altering application sensitive actions execution results
Restrict SQL to eliminate injection risk

®

Increase Collaboration with Integrated Tools

“Our development will operate up to 20% to 50% faster than before.”
p p p
—Janick Bernet, Developer, Swiss ASP

Integrated data management tools
IBM InfoSphere Data Architect,
IBM Data Studio, IBM Optim solutions, IBM
InfoSphere Mashup Hub Design
All phases of data lifecycle
Collaboration across roles
Business analyst, database architect, DBA, Optimize Develop
application developer etc
developer, etc. Models
Policies
Support all major database platforms
Metadata
IBM DB2, IBM Informix, Oracle Database,
Microsoft SQL Server, etc.

Operate Deploy

®

Doing Oracle better than Oracle

Concurrency Models to Fit
Your Needs
Support for multiple “concurrent access” models
Optimize thro ghp t
Optimi e throughput for mi ed workloads
mixed orkloads
Increased performance
Reads don’t block writes
Writes don’t block reads
don t
Log-based control eliminates overhead
Much simpler approach than Oracle Database
g
rollback segments
Easy for developers to work with DB2

®

No more restrictions on toolsets & languages…

DB2: A History of Faster and
Easier Development
Easy application development and deployment
Support for all the latest languages and versions
Support for all the l
S f ll h latest environments, i l di
i including
Visual Studio 2008, Eclipse, and pureQuery
Support for multiple SQL dialects and procedural languages
Accelerate development with custom and built-in packages
built in
Easy Web services
Choice of query languages and APIs
SQL, XQuery, XPath, CLPPlus, JDBC, SQLJ, ODBC, ADO,
, y, , , , , , ,
.NET, CLI, OLE-DB, and more

Univar increased developer productivity by 25-50%
25 50%
...reduced development costs by 35-45%.

®

Drag-and-drop migration

Easily Import Oracle
Database Schemas with
D t b S h ith
Optim Solutions

Connect to and explore Oracle
database objects
Move database objects and data
between Oracle and DB2
b t O l d
Edit, deploy, run and debug
PL/SQL procedures on Oracle and
DB2
Build Java applications with
pureQuery data access methods
on Oracle
Use
U productivity features for
d ti it f t f
tracing SQL to source, host spot
analysis, and impact analysis for
Oracle applications

®

Openbravo migration to DB2 9.7
p g

DB2 9.5: ~2 YEARS DB2 9.7: 1 WEEK
1. Map schema and data types 1. Map schema and data types
• Different datatype behavior. Eg: DATE • Native support
• Different DDL • 99% of SQL – no change
2. Move data • 156 of 158 procedures- no change

3. Translate PL/SQL code • PL/SQL – no change

(Triggers/Procedures/Functions) 2. Move data

• Missing built-in functions & packages
Mi i b ilt i f ti k 3. Run th shared code
3 R the h d d
• Missing functionality: REF CURSORs, %TYPE, …
• Native support
4. Translate SQL in application logic – NO EMULATION!!

(manual) • Minor adjustments
(triggers needed tune up)
• Untyped expressions (thousands of occurences)
4. Test and Tuning
5. Debugging
• Hard to fix concurrency problems No porting effort for future releases of the
6. T t and Tuning
Test d T i application

®

Feedback
F db k

®

What people worldwide are saying about DB2 9.7
97
Two years … One week!

"To move our application to DB2 9.5 would have taken an estimated two-year effort. We were thrilled to see it
took only one week to move it to DB2 9.7. This represents a terrific opportunity to expand our international
community of users, partners and developers, and we’re very excited to partner with IBM to make new
deployment options available.”
p y p
Paolo Juvara, CTO of Openbravo (Spain)

Significantly lower overall costs
Si ifi tl l ll t
"These features drastically reduce the time required for migration efforts
and significantly lower overall costs.“
Axel Puerner, Managing consultant, Puerner Unternehmensberatung

Paradigm shift

"The new IBM DB2 offers true ENABLEMENT and not mere PORTING.
This feature is a paradigm shift in the very concept of database migration!"
Godson Retna, Senior Architect, Cognizant Technology Solutions

®

What people worldwide are saying about DB2 9.7
97
Amazing!

“DB2's
“DB2' PL/SQL compatibility i excellent. W ’ l ki f
tibilit is ll t We’re looking forward t i t
d to integrating th current d l source
ti the t dual
code base into a single one. This will increase our development and testing productivity. In addition, SQL
compatibility is significantly improved. We ran an Oracle Database program as is on DB2, and the test
result was more than we expected.
The compatibility level that DB2 9.7 achieved is also amazing We can integrate a lot of
97 amazing.
incompatible queries into the same one. Now we can stop our program’s different behaviors,
which comes from DBMS’s differences, and this will help us improve the quality of our package.”
Masato Kudo, Developer for Platform Development Group, Works Applications

Porting time 1/6 the original estimate

“As we expand, we consistently see a requirement to support DB2 within large government
departments. We specifically chose to take part in the IBM DB2 early access program because of the
program's goal to run much of Oracle Database applications without modification. This allows us to
reduce the time to port our stored p
p produce p
persistence layer from Oracle Database to DB2 from 450 days down
y y
to 75 days. With what we regard as excellent support from the IBM DB2 team, we believe that IBM has
achieved these goals.”
David Moody - Senior Vice President of Product and Founding Director, Lagan Technologies Ltd.

®

DB2 9.7 Early Adopter Partner References

®

University of Auckland: DB2 Migration – High Level Risk Assessment: - Background

DB2 Cobra ISV Clinics – NZ ISV Feedback
WhereScape is an ISV providing warehouse life cycle
management software. They are a fresh new partner as
software
of mid-late 2008 and have become very involved with the
IM team ever since. They have achieved the "Ready for
IBM DB2 data server software" validation and the "Accredited
for IBM Information On Demand Specialty" mark. They are a
mark
DB2 9.7 beta participant that is extremely active and
pleased with the program. They are willing to be a
reference but would also like to be included in our launch
activities.
activities

“The PL/SQL compatibility in DB2 9.7 is great. WhereScape RED is rapid data warehouse
Q p y g p p
building software, and we like anything that speeds up development. When our customers
use WhereScape RED for converting databases, we can move tables and data very quickly.
This new functionality provides a really fast way to move and convert Oracle PL/SQL to
run in DB2. It also allows us to more easily develop new functionality in WhereScape RED as
DB2
we can now use more common commands between Oracle and DB2.”

Michael Whitehead, CEO, mikew@wherescape.com
, , @ p

®

DB2 Early Access Program Study

“The compatibility level that DB2 9.7 achieved is amazing.”
—Masato Kudo, Works Applications

Code from 18 EAP
Participants analyzed
Range of industries, solutions,
countries
Range of sizes: 2,000 –
185,000 SQL statements
90-99% of statements
immediately transferable to IBM DB2
Over 750,000 lines tested
750 000
90-99% of lines immediately
transferable to DB2

®

An Unusual Situation

No-one is questioning IF

Everyone is asking
WHAT IT MEANS

The image cannot be display ed. Your computer may not hav e enough memory to open the image, or the image may hav e been corrupted. Restart y our computer, and then open the file again. If the red x still appears, y ou may hav e to delete the image and then insert it again.

®

Proving It
P i

®

Conducting a DB2 Cobra Migration BVA
DB2 Cobra Migration BVA starts with a Discovery Process
What are the customer’s Key Business Requirements?
What are customer’s challenges to meeting the Key Business Requirements?
What are the consequences of not meeting the Key Business Requirements?
The solution is DB2 Cobra with Deep Compression now including indexes and
temp

Key Business Need to reduce IT operating costs

Requirement

Oracle Application
Challenge Costs are too high

DB2 Cobra
Solutions
Consequences Spending more Spending more
administration
maintenance

®

BVA Methodology
gy

Document Value Deliver
Qualification Define To- Financial
As-Is
A I Analysis Business
B siness
Be Solution Analysis
Environment Case

Account
planning
session Conduct
discovery using
the BVA
questionnaire Solution
S l ti
(BVA discovery Definition
framework) mapped to
potential Identify hard
benefits and soft
Q
Quantifyy
business
b siness
Business
benefits
Value in hard
dollars using
the Alinean Presentation
Platform.
Platform to Client
t Cli t
Calculate ROI, Executives /
NPV, IRR. Decision
Validate with Makers
client

®

Questionnaire – P t 1 – C
Q ti i Part Current E i
t Environment
t

®

Questionnaire – Storage Costs

®

Questionnaire – P t 1 –Migration D t il
Q ti i Part Mi ti Details

®

Questionnaire – P t 1 – G
Q ti i Part Growth Projections
th P j ti

®

Questionnaire – Staff, Hardware and Software
Resources

®

Questionnaire – High Availability and Down Time

®

Results – Customer Deliverables

®

TCO Analysis
A l i

®

Investment Summary

®

Investment Drill Down – DB2 Licenses

®

Results – ROI Analysis

®

Summary

®

DB2 9 7 Compatibility Features Summary
9.7 Proven
Results
Differences are the exception, not the rule
Leverage existing skills and code
Applications moved to DB2
run with full native execution
Deliver high performance
Simple drag and drop of schemas to DB2
Achieve high productivity
Integrated, cross-platform tools
IBM can rapidly assess your application
idl li ti
DB2 Early Access Program available
http://www-01.ibm.com/software/data/db2/technology-sandbox/

®

“The journey of
a thousand
miles begins
with a step ..”
-Lao Tzu

®

71

Thank
Th k you

Questions?

®

Breaking Down the Last Bastion of IT Cost - IBM's DB2 Cobra Project

More Related Content

What's hot (11)

Similar to Breaking Down the Last Bastion of IT Cost - IBM's DB2 Cobra Project (20)

More from Vincent Kwon (20)

Recently uploaded (20)

Breaking Down the Last Bastion of IT Cost - IBM's DB2 Cobra Project