WSO2 Enterprise Integrator 101
Nandika Jayawardana
Architect - Integration Team
2
Digital Transformation
Digital transformation leverages digital technologies to offer new digital
products and services, enable innovation, improve customer experience,
and optimize processes.
https://medium.com/@sanjiva.weerawarana/wso2-digital-transformation-f
f5b93292395
3
Digital products, services, and business models, along with consumer demands
are reshaping the landscape of many industries
Focus on
customer
experience
2
Using analytics to better
understand and serve
customers, and optimizing
the customer experience
across multiple channels.
3 Optimizing
operations
Using technology to
empower workers with
improved communications,
and moving toward
data-driven decision
making.
Creating new digital
products or delivering new
digital services based on
data related to the physical
product.
Evolving
business
models
1
The Digital Business Landscape
Integration makes
up more than 60%
of a digital
platform
4
MOM
Data
Integration
ESB
Suites
iPaaS
B2B
Managed File
WSO2 Enterprise Integrator
WSO2 Enterprise Integrator (WSO2 EI) is an open source, hybrid
integration platform, which allows developers quick, iterative integration of
any application, data, or system.
5
A Hybrid Integration Platform
6
Connectivity / Integration: anything-to-anything
WSO2 EI
Connectors
Web services
APIs
Filesystems
Messaging
systems
Business
Applications
Partners’
systems
Data
Typical Use Cases
• A system of systems: connect multiple
systems together.
• Better consumer experience with
connected data and business processes.
• Digitize legacy systems: mediate legacy
with modern architecture paradigms.
• Hybrid integration by taking on-premise
data and processes into the cloud and
back.
From ESB to Enterprise
Integrator
• A combination of products if often required to address complex
integration problems
• Difficulty in identifying the correct combinations of products to be
used
• Complexity in maintenance and support
8
Integration Solutions Observations
Integration Platform Components
● WSO2 Enterprise Integrator encapsulates the functionality from
○ WSO2 Enterprise Service Bus (ESB)
○ WSO2 Data Services Server (DSS)
○ WSO2 Business Process Server (BPS)
○ WSO2 Message Broker (MB)
○ Microservices Framework for Java (MSF4J)
○ Eclipse IDE-based Tooling
○ Analytics
9
● Integrator - Systems and data integration
● Business Process - Long running processes and workflows with
human interactions
● Message Broker - Standard compliant, portable, interoperable
message broker
● Microservices - Host microservices implemented using Java and
MSF4J
● Analytics - Analyze data flowing through WSO2 Enterprise Integrator
10
WSO2 Enterprise Integrator Profiles
WSO2 Enterprise Integrator Capabilities
11
Service Integration
and Messaging
is based on open standards and
integration patterns
12
Enterprise Integration Patterns (EIP)
13
Best Practices in Mediation and Integration
• EIPs are enabled using individual building
blocks called Mediators
• There are many types of out of box
mediators that provide common capabilities
such as filtering, aggregating, switching etc.
• These mediators are available via the
tooling component to build the various EIPs
● EIPs cover a wide spectrum of common integration scenarios
● 100% coverage for all published EIPs with source configs
● https://docs.wso2.com/display/IntegrationPatterns
Connectors to Connect The Enterprise
14
The Connector Store
Connectors
• Salesforce
• SAP
• Google
• PeopleHR
• SugarCRM
• Twilio
• Youtube
• eBay
• Bugzilla
• Zuora
• Nest
• And more...
● To connect and integrate with common systems and platforms
● No additional cost. Download and Install.
● https://store.wso2.com/store/assets/esbconnector/list
Data Integration
Data as a Service
15
Existing Data Sources
16
Scattered, Irregular Logic of Create, Read, Update, Delete
Application
R
Application
C
U
Application N
C
UD
Application α
CR
UD
Application β CR
UD
Internal / external data in many
forms.
(i.e. databases, spreadsheets)
Data Integration with WSO2 EI
17
All Create, Read, Update, Delete Operations as Services
Application
Application
Application N
Application α
Application β
Internal / external data in many
forms.
(i.e. databases, spreadsheets)
CRUD as a Service
WSO2 EI
Business Processes
Connect Humans and Processes
18
Business Process Execution with
WSO2 EI
19
Processes/Workflows with BPMN, BPEL, Human Tasks
Application α
Application β
Defined processes and workflows
which may also consist of human
tasks
Business Process Execution
as a Service
WSO2 EI
Application N
Process Initiation
Results/Decisions
Tooling and Analytics
Develop, Debug and Monitor
20
Graphical Tooling with Mediation
Debugging and Data Mapping
21
WSO2 Developer Studio
• Provides graphical and source view
editing of integration artifacts
• Debugging support on mediation flows
• Eclipse based
• Packaging / archiving artifacts for
deployment
Integration Analytics
22
Dashboards for Transaction Analytics and Monitoring
Overall setup
• Overall Throughput (in TPS)
• Overall Message Count
APIs, proxies, endpoints specific
• Request Count
• Message Count
• Message Latency
• Explore Messages
• Explore Message Flows
Supporting Standards
23
Integration Standards Supported
Open Interoperability
• HTTP(S)
• JMS-1.1/ 2.0, AMQP, MQ, MSMQ
• WebSockets
• VFS
• TCP, UDP
• FIX, HL7
• BPMN 2.0, WS-BPEL 2.0
• JSON, SOAP-1.1 / 2.0
• XSLT, XPath
• JDBC, NO-SQL, CSV, OData-v4
• UT, OAuth, SAML, XACML,
WS-Sec
• and more ….
Deployment Choices
25
● Deployment for Availability
Recommendation is a minimum of 2
active nodes for a high availability
deployment
● Deployment for Scalability
TPS based scaling (EI benchmarks at
2000-4000 TPS each with 200+
concurrency and 10ms latency. EI
support a pass through of 1000+
concurrency with 0.5 ms latency with
non-blocking transport)
Elastic scaling via AWS/cloud platforms
like K8S/Docker
26
Deployment and Scalability
Data centre A Data centre B
WSO2 (JVM)
instance
WSO2 (JVM)
instance
LB LB
27
Deployment and Scalability - Integrator
● Clustering
○ Stateless clustering - No shared state, HTTP
○ Stateful clustering with leader election : For polling transports, tasks
etc., caching, throttling.
○ Artifacts synchronizing - push model or shared file system/rsync
model
Stateless Stateful
28
Continuous Integration and Continuous
Delivery
Continuous Integration
Server
Source Control
System
WSO2 EI
WSO2 EI
Environment 1
WSO2 EI
WSO2 EI
Environment 2
Continuous Test
Server
Integration
artifacts
IDE IDEIDE
THANK YOU
wso2.com
THANK YOU
wso2.com

WSO2 Enterprise Integrator 101

  • 1.
    WSO2 Enterprise Integrator101 Nandika Jayawardana Architect - Integration Team
  • 2.
    2 Digital Transformation Digital transformationleverages digital technologies to offer new digital products and services, enable innovation, improve customer experience, and optimize processes. https://medium.com/@sanjiva.weerawarana/wso2-digital-transformation-f f5b93292395
  • 3.
    3 Digital products, services,and business models, along with consumer demands are reshaping the landscape of many industries Focus on customer experience 2 Using analytics to better understand and serve customers, and optimizing the customer experience across multiple channels. 3 Optimizing operations Using technology to empower workers with improved communications, and moving toward data-driven decision making. Creating new digital products or delivering new digital services based on data related to the physical product. Evolving business models 1 The Digital Business Landscape
  • 4.
    Integration makes up morethan 60% of a digital platform 4 MOM Data Integration ESB Suites iPaaS B2B Managed File
  • 5.
    WSO2 Enterprise Integrator WSO2Enterprise Integrator (WSO2 EI) is an open source, hybrid integration platform, which allows developers quick, iterative integration of any application, data, or system. 5
  • 6.
    A Hybrid IntegrationPlatform 6 Connectivity / Integration: anything-to-anything WSO2 EI Connectors Web services APIs Filesystems Messaging systems Business Applications Partners’ systems Data Typical Use Cases • A system of systems: connect multiple systems together. • Better consumer experience with connected data and business processes. • Digitize legacy systems: mediate legacy with modern architecture paradigms. • Hybrid integration by taking on-premise data and processes into the cloud and back.
  • 7.
    From ESB toEnterprise Integrator
  • 8.
    • A combinationof products if often required to address complex integration problems • Difficulty in identifying the correct combinations of products to be used • Complexity in maintenance and support 8 Integration Solutions Observations
  • 9.
    Integration Platform Components ●WSO2 Enterprise Integrator encapsulates the functionality from ○ WSO2 Enterprise Service Bus (ESB) ○ WSO2 Data Services Server (DSS) ○ WSO2 Business Process Server (BPS) ○ WSO2 Message Broker (MB) ○ Microservices Framework for Java (MSF4J) ○ Eclipse IDE-based Tooling ○ Analytics 9
  • 10.
    ● Integrator -Systems and data integration ● Business Process - Long running processes and workflows with human interactions ● Message Broker - Standard compliant, portable, interoperable message broker ● Microservices - Host microservices implemented using Java and MSF4J ● Analytics - Analyze data flowing through WSO2 Enterprise Integrator 10 WSO2 Enterprise Integrator Profiles
  • 11.
  • 12.
    Service Integration and Messaging isbased on open standards and integration patterns 12
  • 13.
    Enterprise Integration Patterns(EIP) 13 Best Practices in Mediation and Integration • EIPs are enabled using individual building blocks called Mediators • There are many types of out of box mediators that provide common capabilities such as filtering, aggregating, switching etc. • These mediators are available via the tooling component to build the various EIPs ● EIPs cover a wide spectrum of common integration scenarios ● 100% coverage for all published EIPs with source configs ● https://docs.wso2.com/display/IntegrationPatterns
  • 14.
    Connectors to ConnectThe Enterprise 14 The Connector Store Connectors • Salesforce • SAP • Google • PeopleHR • SugarCRM • Twilio • Youtube • eBay • Bugzilla • Zuora • Nest • And more... ● To connect and integrate with common systems and platforms ● No additional cost. Download and Install. ● https://store.wso2.com/store/assets/esbconnector/list
  • 15.
  • 16.
    Existing Data Sources 16 Scattered,Irregular Logic of Create, Read, Update, Delete Application R Application C U Application N C UD Application α CR UD Application β CR UD Internal / external data in many forms. (i.e. databases, spreadsheets)
  • 17.
    Data Integration withWSO2 EI 17 All Create, Read, Update, Delete Operations as Services Application Application Application N Application α Application β Internal / external data in many forms. (i.e. databases, spreadsheets) CRUD as a Service WSO2 EI
  • 18.
  • 19.
    Business Process Executionwith WSO2 EI 19 Processes/Workflows with BPMN, BPEL, Human Tasks Application α Application β Defined processes and workflows which may also consist of human tasks Business Process Execution as a Service WSO2 EI Application N Process Initiation Results/Decisions
  • 20.
    Tooling and Analytics Develop,Debug and Monitor 20
  • 21.
    Graphical Tooling withMediation Debugging and Data Mapping 21 WSO2 Developer Studio • Provides graphical and source view editing of integration artifacts • Debugging support on mediation flows • Eclipse based • Packaging / archiving artifacts for deployment
  • 22.
    Integration Analytics 22 Dashboards forTransaction Analytics and Monitoring Overall setup • Overall Throughput (in TPS) • Overall Message Count APIs, proxies, endpoints specific • Request Count • Message Count • Message Latency • Explore Messages • Explore Message Flows
  • 23.
  • 24.
    Integration Standards Supported OpenInteroperability • HTTP(S) • JMS-1.1/ 2.0, AMQP, MQ, MSMQ • WebSockets • VFS • TCP, UDP • FIX, HL7 • BPMN 2.0, WS-BPEL 2.0 • JSON, SOAP-1.1 / 2.0 • XSLT, XPath • JDBC, NO-SQL, CSV, OData-v4 • UT, OAuth, SAML, XACML, WS-Sec • and more ….
  • 25.
  • 26.
    ● Deployment forAvailability Recommendation is a minimum of 2 active nodes for a high availability deployment ● Deployment for Scalability TPS based scaling (EI benchmarks at 2000-4000 TPS each with 200+ concurrency and 10ms latency. EI support a pass through of 1000+ concurrency with 0.5 ms latency with non-blocking transport) Elastic scaling via AWS/cloud platforms like K8S/Docker 26 Deployment and Scalability Data centre A Data centre B WSO2 (JVM) instance WSO2 (JVM) instance LB LB
  • 27.
    27 Deployment and Scalability- Integrator ● Clustering ○ Stateless clustering - No shared state, HTTP ○ Stateful clustering with leader election : For polling transports, tasks etc., caching, throttling. ○ Artifacts synchronizing - push model or shared file system/rsync model Stateless Stateful
  • 28.
    28 Continuous Integration andContinuous Delivery Continuous Integration Server Source Control System WSO2 EI WSO2 EI Environment 1 WSO2 EI WSO2 EI Environment 2 Continuous Test Server Integration artifacts IDE IDEIDE
  • 29.