MT30 Best practices for data lake adoption
0 likes651 views
The document outlines best practices for data lake adoption, focusing on two models for big data: exploratory analytics and operationalization. It discusses anti-patterns, best practices, and provides guidance on getting started, including stakeholder interviews and defining architecture. The content is intended for internal use at Dell and emphasizes confidentiality.
MT30 Best practices for data lake adoption
- 1. MT30 Best practices: Data lake adoption Matt Maccaux, Global Big Data Practice Lead
- 2. 2 Dell - Internal Use - Confidential Agenda • Two models for big data • Big data anti-patterns • Big data best practice • How to get started? • Your questions
- 3. 3 Dell - Internal Use - Confidential Two models for big data Exploratory analytics • Full data set – batch • Explore, test, refine, iterate • The output is an algorithm that will be integrated into new or existing applications. Operationalization • Limited data set – Streaming • The algorithm is integrated into applications that drive business decisions.
- 5. Dell - Internal Use - Confidential © Copyright 2016 EMC Corporation. All rights reserved.
- 6. Dell - Internal Use - Confidential © Copyright 2016 EMC Corporation. All rights reserved.
- 7. Dell - Internal Use - Confidential © Copyright 2016 EMC Corporation. All rights reserved.
- 8. Dell - Internal Use - Confidential © Copyright 2016 EMC Corporation. All rights reserved.
- 9. Dell - Internal Use - Confidential © Copyright 2016 EMC Corporation. All rights reserved.
- 10. Big data best practices
- 11. Dell - Internal Use - Confidential © Copyright 2016 EMC Corporation. All rights reserved. me:~>_ CONTINUUM
- 12. Dell - Internal Use - Confidential © Copyright 2016 EMC Corporation. All rights reserved. Hadoop Spark Tableau Python TOOL CATALOG Customer Alert Bills Social DATA CATALOG Duration Performance Normal Analytics Request Portal NON Sample Data Sample Data
- 13. Dell - Internal Use - Confidential © Copyright 2016 EMC Corporation. All rights reserved. Data Lake Discover/Map Transform Organize/Tag CATALOG AND PROVISION ENTERPRISE LOG ANALYSIS Virtualisation
- 14. Dell - Internal Use - Confidential © Copyright 2016 EMC Corporation. All rights reserved. Virtualised Compute Pool
- 15. Dell - Internal Use - Confidential © Copyright 2016 EMC Corporation. All rights reserved. Data Pool Meta-dataTagging G o v e r n a n c e A n o n y m i s e E n c r y p t i o n Pooln Pooln Pooln Copy
- 16. Dell - Internal Use - Confidential © Copyright 2016 EMC Corporation. All rights reserved. Virtualised Compute Pool
- 17. Dell - Internal Use - Confidential © Copyright 2016 EMC Corporation. All rights reserved. CD >_ CONTINUUM Data Pool G o v e r n a n c e A n o n y m i s e E n c r y p t i o n Pooln Pooln Pooln Copy Virtualised Compute Pool
- 18. 18 Dell - Internal Use - Confidential How to get started? Big Data Technology Advisory • Interview stakeholders including business users and technical/functional experts • Document requirements and gaps • Define a future-state reference architecture • Provide a plan/roadmap for implementation
- 19. Q&A