Smashing Through Big Data Barriers with Tableau and Snowflake
- 1. Smashing Through Big Data Barriers with Tableau and Snowflake Saikat Basu – Senior Solutions Architect, Kyligence
- 2. Agenda Trends in Big Data Analytics Challenges Faced by Traditional BI Kyligence + Tableau Solutions Case Study Demo
- 3. © Kyligence Inc. 2021 Greater Innovation Multi-Dimensional Analysis Ad-Hoc Queries Interactive Dashboards Forecasting Queries Ever Increasing Demands on Enterprise Analytics
- 4. © Kyligence Inc. 2021 Greater Innovation Multi-Dimensional Analysis Ad-Hoc Queries Interactive Dashboards Forecasting Queries Ever Increasing Demands on Enterprise Analytics • Reporting • Dashboard • OLAP • Detail Query • Ad-hoc • Self-Analysis • Data mining • Real Time • AI / ML
- 5. © Kyligence Inc. 2021 Data Analysts Increased Data Volume More Concurrent Users More Artificial Intelligence More Automation Machine Learned Decision Making Partners/Clients Business Users Analysts Satisfied Users Only 20% of requirements are served Mgmt. • Reports • Dashboards • Self-Service • Data Mining • Self-Service • Real-Time • Reports • Self-Service Ever Increasing Demands From Analysts/Users
- 6. © Kyligence Inc. 2021 Augmented Analytics Gartner’s 2021 Top Strategic Technology Trends From terminal to hand-held - device agnostic • Cloud native distributed platform • Cyber secured • Location independent • Resilient and agile Evolution of Analysis Technologies
- 7. © Kyligence Inc. 2021 Challenges Faced by Traditional BI in the Big Data Era $$$ • Long SDLC • High TCO • Lack of flexibility • Lack of scalability • Limited concurrency • No elasticity and cloud storage • Manual effort intensive • Lack of AI and ML • Not capable of predictive or prescriptive analysis • Slow query performance • Long development cycle • Neither agile nor resilient
- 8. © Kyligence Inc. 2021 360 Degree Single Source of Truth Interactive Dashboards with Real-Time Data Refresh Business Analytics Cloud Native Optimized Pay-Per-Use Price Cyber Secured Resilient & Location Independent IT Infrastructure Data Analysis Self-Service Sub-Second Response AI-Augmented OLAP Machine Learned Decision Making Industry Is Waiting for a New Disruptive Solution
- 9. © Kyligence Inc. 2021 Kyligence: Flexible & Scalable Architecture • Easy to install, provision, configure • Automated cluster formation in the cloud Automated Deployment • Fault tolerant • Cost-optimized & scalable Resilient • Intelligent query analyzer • Automated modeling & reduced SDLC AI Augmentation • Secured SSO, robust RLS • User & group level ACL Multi-Tenancy
- 10. © Kyligence Inc. 2021 Kyligence + Tableau Self-Service Analytics Solution Fast Query Response Time • Tableau Live mode for sub-second response on PB scale data, with high concurrency AI-Augmented Modeling • Automates model design and cube building with the Kyligence algorithm Self-Service Analysis • For business users and data analysts Universal Semantic Layer • Model is synchronized with Tableau with the click of a button
- 11. © Kyligence Inc. 2021 Data Prep ETL Scheduling Developers Deposits TopN Wealth Mgmt. Cube Asset Mgmt. Cube Analysts • Data Preparation • Model Design • Model Publish • Self-Service Analysis Business Modelers Model Design Resource Mgmt. Self-Service Analysis Tableau Server Tableau Desktop Enterprise Account Cube Risk Cube User Analysis Self-Service Analysis Asset Analysis Publish Self-Service Dashboard Subscription/Share Enhancements tds tds SQL SQL Kyligence + Tableau – Combined Ecosystem
- 12. © Kyligence Inc. 2021 TDS Kyligence + Tableau: 3 Steps to Self-Service Analysis Create Model / Cube Export TDS File Open TDS with Tableau Download in one click • Synchronizes model and semantic definitions with Tableau with the click of a button • Supports Tableau generated queries • Reduces time and resource needed to develop BI reports and dashboards TDS
- 13. Use Cases
- 14. © Kyligence Inc. 2021 Tableau Analysis Platform Analysis/Report Legacy DB Dashboard Retail CRM B2B Analysis OLAP Cube Hadoop Migration - Architectural Changes for a Retailer Architecture Evolution • From Legacy RDBMS + Traditional BI to Hadoop + open standard analytic platform Benefits • Saved cost significantly • Fast query response time • Agile development environment • Quick and informed business decision One Stop Info Mgmt. Analysis for Retail Customers Analysis for Business Customers Data Layer: Migrated from DB to Hadoop OLAP Layer: From Cognos Cubes to Kyligence Presentation: From Cognos to Tableau Migration Traditional BI Platform
- 15. © Kyligence Inc. 2021 Tableau Analysis Platform Cognos Analysis/Report DB2 Dashboard Retail CRM B2B Analysis Cognos Cube Hadoop Migration - Architectural Changes for a Bank Architecture Evolution • From DB2 + Cognos Cubes to Hadoop + Kyligence Benefits • 90%+ of queries finish in < 2 seconds • More time-based analysis options (Daily -> Hourly) • Seamless integration with Tableau • Improved efficiency with Kyligence’s auto-modeling • Improved efficiency building cubes on Hadoop One Stop Info Mgmt. Analysis for Retail Customers Analysis for Business Customers Data Layer: Migrated from DB to Hadoop OLAP Layer: From Cognos Cubes to Kyligence Presentation: From Cognos to Tableau Migration Analysis Platform
- 16. © Kyligence Inc. 2021 Traditional BI Platform vs. Self-Service BI Platform Cognos + DB2 Tableau + Kyligence + Hadoop Cluster Size 11 Cognos Servers + 9 DB2 Servers 40 Hadoop Nodes HW/SW Cost $Millions $100,000s OLAP Performance Minutes ~ Hours Seconds Self-Service Analysis Not Supported Supported Detailed Queries Not Supported Supported Daily Delta Load Time 10 Hours 1.5 Hours Concurrency < 10 100s ~ 1,000s 150 million daily new records, 160+ dimensions
- 17. Demo
- 18. © Kyligence Inc. 2021 Data Prep ETL Scheduling Developers Deposits TopN Wealth Mgmt. Cube Asset Mgmt. Cube Analysts • Data Preparation • Model Design • Model Publish • Self-Service Analysis Business Modelers Model Design Resource Mgmt. Self-Service Analysis Tableau Server Tableau Desktop Enterprise Account Cube Risk Cube User Analysis Self-Service Analysis Asset Analysis Publish Self-Service Dashboard Subscription/Share Enhancements tds tds SQL SQL Kyligence + Tableau – Combined Ecosystem
- 19. © Kyligence Inc. 2021 Founded in 2016 by the creators of Apache Kylin Enhances Kylin with AI-assisted auto-modeling, Unified Semantic Layer for leading BI tools CRN Top-10 big data startups in 2018 VCs: Fidelity International, Shunwei Capital, Broadband Capital, Redpoint, Cisco, Coatue Kyligence: Kylin + Intelligence 2016 Pre-A Redpoint Cisco 2017 Series A CBC Shunwei 2018 Series B 8Roads 2019 Series C Coatue 2021 Series D SPDB Top-10 big data startups 2018 Commercial open-source model Industry recognition
- 20. © Kyligence Inc. 2021 Kyligence Architecture Unified Semantic Layer Multi-dimensional Modeling Security & Governance Acceleration Layer Aggregate & Table Indexes AI Augmented Engine Any Cloud Data Warehouse Data Lake Streaming Data Any Data Platform Any BI Tool Machine Learning SaaS & Apps CRM HCM SCM SQL, MDX, REST SQL, MDX, REST SQL, MDX, REST
- 21. © Kyligence Inc. 2021 Experience It Yourself
- 22. © Kyligence Inc. 2021 Contact Us Kyligence Inc http://kyligence.io [email protected] Twitter: @Kyligence Apache Kylin http://kylin.apache.org [email protected] Twitter: @ApacheKylin
- 23. Thank You
- 24. © Kyligence Inc. 2021