Abstract image of a woman sitting on books and studying on a laptop

Data Science in 2016: Moving up by Paco Nathan at Big Data Spain 2015

Big Data Spain, profile picture
Big Data Spain

This document discusses trends in data science in 2016, including how data science is moving into new use cases such as medicine, politics, government, and neuroscience. It also covers trends in hardware, generalized libraries, leveraging workflows, and frameworks that could enable a big leap ahead. The document discusses learning trends like MOOCs, inverted classrooms, collaborative learning, and how O'Reilly Media is embracing Jupyter notebooks. It also covers measuring distance between learners and subject communities, and the importance of both people and automation working together.

Technology
Related topics:
Data Science Insights
1 of 67
Downloaded 33 times
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
Data Science in 2016: Moving up by Paco Nathan at Big Data Spain 2015
Data Science in 2016: Moving Up 2015-10-15 • Madrid • http://bigdataspain.org/ Paco Nathan, @pacoid
 O’Reilly Media
• general patterns • trends and analysis: the discipline, the jobs • some good examples: moving up into use cases • glimpses ahead: an emerging content • a proposed theme Data Science 2016: Moving Up
Design Patterns
Design Patterns Methodology for cloud-computing architecture
 (2008-06-29) http://ceteri.blogspot.com/2008/06/methodology-for- cloud-computing.html
cluster scheduler data pipes some cloud containers analytics search/index elastic compute elastic storage Design Patterns
Design Patterns some cloud
Design Patterns some cloud DataStax $189.7M Confluent $30.9M Databricks $47M Jupyter $6M Elastic $104M Docker $162MMesosphere $48.75M
Design Patterns: Issues some cloud • integration could be better • that implies sharing markets • VCs in SiliconValley dislike that • customers need integration
some cloud Design Patterns: Where?
Design Patterns: Where? some cloud
Design Patterns: Where? some cloud
Design Patterns: Where? some cloud
Design Patterns: Where? some cloud
Design Patterns: Where? some cloud • that playing field becomes overly crowded, soon… • what happens at that point?
• so much emphasis on plumbing: `data engineering` • not enough on domain expertise, which trumps all Much activity in Big Data seems awkwardly focused at the bottom of the tech stack: infrastructure, not domain However, that may be changing… Design Patterns: Opinion
Interesting Trends
Interesting Trends There are many possible trends to discuss, but let’s 
 concentrate on four of these going into 2016: • leveraging multicore and large memory spaces • generalized libraries for frequently repeated work • workflows blend the best of people and computing • framework for a big leap ahead, not just incremental
Original definitions for what became relational databases had less to do with dedicated SQL products, more similarity with something like 
 Spark SQL Interesting Trend #1: Contemporary Hardware A relational model of data 
 for large shared data banks
 Edgar Codd
 Communications of the ACM (1970)
 dl.acm.org/citation.cfm?id=362685
Python Java/Scala RSQL … DataFrame Logical Plan LLVMJVM GPU NVRAM Unified API, One Engine, Automatically Optimized Tungsten backend language frontend … from Databricks Interesting Trend #1: Contemporary Hardware
Deep Dive into ProjectTungsten: 
 Bringing Spark Closer to Bare Metal
 Josh Rosen
 spark-summit.org/2015/events/deep-dive-into-project- tungsten-bringing-spark-closer-to-bare-metal/ Set Footer from Insert Dropdown Menu Physical Execution: CPU Efficient Data Structures Keep data closure to CPU cache Interesting Trend #1: Contemporary Hardware from Databricks
Interesting Trend #2: Generalized Libraries Tensors are a good way to handle time-series 
 geo-spatially distributed linked data with lots 
 of N-dimensional attributes In other words, nearly a general case for handling much of the data that we’re likely to encounter That’s better than attempting to shoehorn data into matrix representation, then writing lots of custom code to support it
Tensor factorization may be problematic, but probabilistic solutions seem to provide relatively general case solutions: TheTensor Renaissance in Data Science
 Anima Anandkumar @UC Irvine
 radar.oreilly.com/2015/05/the-tensor- renaissance-in-data-science.html Spacey RandomWalks and 
 Higher Order Markov Chains
 David Gleich @Purdue
 slideshare.net/dgleich/spacey-random- walks-and-higher-order-markov-chains Interesting Trend #2: Generalized Libraries
Interesting Trend #3: Leveraging Workflows evaluationoptimizationrepresentationcirca 2010 ETL into cluster/cloud data data visualize, reporting Data Prep Features Learners, Parameters Unsupervised Learning Explore train set test set models Evaluate Optimize Scoring production data use cases data pipelines actionable results decisions, feedback bar developers foo algorithms APIs, algorithms, developer-centric template thinking – 
 these only go so far; the overall context is a workflow…
evaluationoptimizationrepresentationcirca 2010 ETL into cluster/cloud data data visualize, reporting Data Prep Features Learners, Parameters Unsupervised Learning Explore train set test set models Evaluate Optimize Scoring production data use cases data pipelines actionable results decisions, feedback bar developers foo algorithms look beyond an API, beyond a code repo … think of people and machines working together Interesting Trend #3: Leveraging Workflows APIs, algorithms, developer-centric template thinking – these only
Chris Ré, @Stanford
 https://www.macfound.org/fellows/943/ Drugs, DNA, and Dinosaurs: Building High Quality Knowledge Bases with DeepDive
 Strata CA (2015) TheThorn in the Side of Big Data: too few artists
 Strata CA (2014) Interesting Trend #4: A Leap Ahead
Chris Ré https://www.macfound.org/fellows/943/ Drugs, DNA, and Dinosaurs: Building High Quality Knowledge Bases with DeepDive Strata CA (2015) TheThorn in the Side of Big Data: too few artists Strata CA (2014) Interesting Trend #4: A Leap Ahead cognitive computing “flywheel”: probabilistic reasoning about complex data and predictions together
Chris Ré https://www.macfound.org/fellows/943/ Drugs, DNA, and Dinosaurs: Building High Quality Knowledge Bases with DeepDive Strata CA (2015) TheThorn in the Side of Big Data: too few artists Strata CA (2014) Interesting Trend #4: A Leap Ahead
Data Scientists
William Cleveland 
 “Data Science: an Action Plan for Expanding 
 the Technical Areas of the Field of Statistics,” 
 International Statistical Review (2001), 69, 21-26 http://www.stat.purdue.edu/~wsc/papers/ datascience.pdf Leo Breiman
 “Statistical modeling: the two cultures”, 
 Statistical Science (2001), 16:199-231 http://projecteuclid.org/euclid.ss/1009213726 …also good to mention John Tukey Data Scientists: Primary Sources
Data Scientists: Five Years of Strata Conference
One 2015 report (RJMetrics) tallied a minimum of 
 11,400 data scientists worldwide by scraping LinkedIn So many suddenly, really? Perhaps that’s doubtful… Comparing surveys: O’Reilly Media conducts salary surveys 
 for data scientists, along with exploring about the tools used 2013 – tools, trends, not all data is “Big”, coding scripts! 2014 – correlation of tools and skills, rapid evolution 2015 – divide blurring between open source and proprietary Data Scientists: Everywhere, all the time?
http://radar.oreilly.com/2015/09/2015-data-science-salary-survey.html John King, Roger Magoulas Data Scientists: 2015 Survey
Data Scientists: 2015 Survey
Moving Up
Enlitic http://www.enlitic.com/ deep learning to assist doctors treating cancer Moving Up: Medicine
Moving Up: Medicine “Whatever the models might discover or predict, Howard isn’t suggesting they’ll do away with a doctor’s judgment. Rather, artificially intelligent computers could provide strong, unbiased second opinions, or perhaps lead a doctor down 
 a path of investigation she other wouldn’t have considered.” With Enlitic, a veteran data scientist plans 
 to fight disease using deep learning
 GigaOM (2014-08-22)
 https://gigaom.com/2014/08/22/with-enlitic-a-veteran- data-scientist-plans-to-fight-disease-using-deep-learning/
Moving Up: Political Platform http://www.predikon.ch/en/voting-patterns/residents
Moving Up: Political Platform Mining Democracy
 Matthias Grossglauser @EPFL
 ICT Labs (2015)
 http://ictlabs-summer-school.sics.se/ slides/mining%20democracy.pdf What if a political candidate could cluster political positions in a multi-dimensional data space, to optimize for being recommended to voters? http://www.predikon.ch/en/voting-patterns/residents
Moving Up: Government Ethics TheWhite House has a plan to help society through data analysis
 Fortune (2018-09-30)
 http://fortune.com/2015/09/30/dj-patil-white-house-data/
Moving Up: Government Ethics TheWhite House has a plan to help society through data analysis
 Fortune (2018-09-30)
 http://fortune.com/2015/09/30/dj-patil-white-house-data/ “Opening up government data about child labor to concerned data scientists; recruiting folks to help analyze data about suicide prevention, social injustice and incarceration; a call for mandatory and `intrinsic` ethics instruction in every course teaching students data science; and an effort to help the transgender community create its own census of sorts, so that members and society can get a better grasp on the issues that matter to the group.”
Moving Up: Neuroscience Analytics +Visualization for Neuroscience: Spark,Thunder, Lightning Jeremy Freeman
 2015-01-29 youtu.be/cBQm4LhHn9g?t=28m55s
For excellent examples of Science and Data together see CodeNeuro, particularly for 
 use of Jupyter notebooks + Apache Spark Moving Up: Neuroscience
Learning
Learning: What About MOOCs?
Massive Open Online Courses – 
 seven year trend, beginning with: Connectivism and Connective Knowledge
 George Siemens, Stephen Downes
 University of PEI (2008)
 http://cck11.mooc.ca/ Learning: What About MOOCs? Adios EdTech. Hola something else
 George Siemens (2015-09-09)
 http://www.elearnspace.org/blog/2015/09/09/ adios-ed-tech-hola-something-else/
Online education: MOOCs taken by educated few
 Ezekiel Emanuel, Nature 503, 342 (2013-11-21) • 80% students already have an advanced degree • 80% come from the richest 6% of the population Michael Shanks @Stanford: “retrenchment around traditional disciplines will make disparities even more pronounced” An Early Report Card on Massive Open Online Courses
 Geoffrey Fowler, WSJ (2013-10-08) Amherst, Duke, etc., have rejected edX Learning: What About MOOCs?
Online education: MOOCs taken by educated few Ezekiel Emanuel • 80% students already have an advanced degree • 80% come from the richest 6% of the population Michael Shanks disciplines will make disparities even more pronounced” An Early Report Card on Massive Open Online Courses Geoffrey Fowler Amhers Learning: What About MOOCs? So then, what else works better?
How to Flip a Class 
 CTL @UT/Austin
 http://ctl.utexas.edu/teaching/flipping-a-class/how 1. identify where the flipped classroom model makes 
 the most sense for your course 2. spend class time engaging students in application activities with feedback 3. clarify connections between inside and outside 
 of class learning 4. adapt your materials for students to acquire course content in preparation of class 5. extend learning beyond class through individual 
 and collaborative practice Learning: Inverted Classroom
Scalable Learning
 David Black-Schaffer @Uppsala
 Sverker Janson @KTH SICS https://www.scalable-learning.com/ • active learning: Flipped Classroom and Just-in-timeTeaching • exams built directly into specific diagrams within videos • metrics for where in video+code that students get stuck • instructor can customize subsequent classroom discussions 
 (active teaching phase) based on stuck/unstuck metrics Learning: Inverted Classroom
Learning programming at scale Philip Guo 
 O’Reilly Radar (2015-08-13) http://radar.oreilly.com/2015/08/learning- programming-at-scale.html • PythonTutor • Codechella Tutors could keep an eye on around 
 50 learners during a 30-minute session, 
 start 12 chat conversations, and 
 concurrently help 3 learners at once Learning: Collaborative Learning
Data-driven Education and the Quantified Student Lorena Barba @GWU PyData Seattle (2015) https://youtu.be/2YIZ2SY9mW4 • keynote talk: abstract, slides • homepage • Open edX Universities Symposium, DC 2015-11-11 Learning: If you study just one link from this talk…
If by some bizarre chance you haven’t used 
 it already, go to https://jupyter.org/ • 50+ different language kernels • new funding 2015-07 • UC Berkeley, Cal Poly • nbgrader autograder by Jess Hamrick • jupyterhub multi-user server • curating a list of examples • repeatable science! see also:
 Teaching with Jupyter Notebooks
 http://tinyurl.com/scipy2015-education Learning: Jupyter Project
Embracing Jupyter Notebooks at O'Reilly
 Andrew Odewahn
 O’Reilly Media (2015-05-07) https://beta.oreilly.com/ideas/jupyter-at-oreilly O’Reilly Media is using our Atlas platform 
 to make Jupyter Notebooks a first class authoring environment for our publishing program Jupyter, Thebe, Atlas, Docker, etc. Learning: O’Reilly Media
Learning: O’Reilly Media https://beta.oreilly.com/
in-person blended on-demand Mostly Synchronous Mostly Asynch Inverted Classroom Subscription Free Content Learning: Audience Patterns
Is it possible to measure “distance” between 
 a learner and a subject community? From Amateurs to Connoisseurs:
 Modeling the Evolution of User 
 Expertise through Online Reviews
 Julian McAuley, Jure Leskovec
 http://i.stanford.edu/~julian/pdfs/www13.pdf Learning: Machine Learning about People Learning
Learning,Assessment,Team Building, Diversity – these can be accomplished together, in situ Collective Intelligence in Human Groups
 Anita Williams Woolley @CMU
 https://youtu.be/Bz1dDiW2mvM • balance of participation (no one dominates) • 2+ women engaging within the group • group size < 9 • diversity of formal backgrounds Learning: Machine Learning about People Learning
People + Automation
Data Science teams apply machine learning (automation) to help arrive at key insights, to learn what is important 
 in data sets – finding the proverbial needle in the haystack Cognitive Computing exhibits people + automation 
 as a process, in a learning context That’s also a basic tenet of workflows in general: 
 people + automation And a key aspect of the emerging gig economy too… People + Automation
People + Automation: Gig Economy
People + Automation: Gig Economy http://orchestra.unlimitedlabs.com/ “Workflows with humans and machines”
People + Automation: Gig Economy Workers in aWorld of Continuous Partial Employment Tim O’Reilly Medium (2015-08-31)
 https://medium.com/the-wtf-economy/workers-in-a- world-of-continuous-partial-employment-4d7b53f18f96 http://conferences.oreilly.com/next-economy
Learning is key. Effective use of Data Science in these new economic conditions requires people + automation, learning together – albeit in different ways. Plus, there’s an excellent framework for that: Autopoiesis and Cognition
 Humberto Maturana, FranciscoVarela
 Springer (1973) https://books.google.es/books?id=nVmcN9Ja68kC People + Automation
I’d like to leave this as a theme for you to consider about 
 Data Science 2016, Moving Up into use cases… We see an intersection of key points in both the emerging Cognitive Computing context and the Gig Economy in general: systems of people + automation, learning together It posits an interesting duality for use to leverage With that I wish you a great conference here at Big Data Spain! People + Automation
Gracias
contact: Just Enough Math O’Reilly (2014) justenoughmath.com
 preview: youtu.be/TQ58cWgdCpA monthly newsletter for updates, 
 events, conf summaries, etc.: liber118.com/pxn/ Intro to Apache Spark
 O’Reilly (2015)
 shop.oreilly.com/product/ 0636920036807.do

More Related Content

PPTX
Intro to Data Science Concepts
University of Washington
 
PPTX
MMDS 2014: Myria (and Scalable Graph Clustering with RelaxMap)
University of Washington
 
PPTX
The Other HPC: High Productivity Computing
University of Washington
 
PPTX
Data Science, Data Curation, and Human-Data Interaction
University of Washington
 
PPTX
Big Data Talent in Academic and Industry R&D
University of Washington
 
PPTX
Data, Responsibly: The Next Decade of Data Science
University of Washington
 
PPTX
Democratizing Data Science in the Cloud
University of Washington
 
PPTX
Science Data, Responsibly
University of Washington
 
Intro to Data Science Concepts
University of Washington
 
MMDS 2014: Myria (and Scalable Graph Clustering with RelaxMap)
University of Washington
 
The Other HPC: High Productivity Computing
University of Washington
 
Data Science, Data Curation, and Human-Data Interaction
University of Washington
 
Big Data Talent in Academic and Industry R&D
University of Washington
 
Data, Responsibly: The Next Decade of Data Science
University of Washington
 
Democratizing Data Science in the Cloud
University of Washington
 
Science Data, Responsibly
University of Washington
 

What's hot (20)

PPTX
Urban Data Science at UW
University of Washington
 
PPT
Broad Data
James Hendler
 
PPTX
Data Science and Urban Science @ UW
University of Washington
 
PDF
DSSG Speaker Series: Paco Nathan
Paco Nathan
 
PDF
Introduction to Data Science and Large-scale Machine Learning
Nik Spirin
 
PDF
Designing a second generation of open data platforms
Yannis Charalabidis
 
PPTX
Data Science: Not Just For Big Data
Revolution Analytics
 
PPTX
Roger hoerl say award presentation 2013
Roger Hoerl
 
PPTX
Keynote - An overview on Big Data & Data Science - Dr Gregory Piatetsky-Shapiro
Data ScienceTech Institute
 
PPTX
Data Science: Past, Present, and Future
Gregory Piatetsky-Shapiro
 
PDF
Data Science Introduction - Data Science: What Art Thou?
Gregg Barrett
 
PDF
An Obligatory Introduction to Data Science
Wesley Eldridge
 
PDF
How it works- Data Science
Edureka!
 
PDF
A New Year in Data Science: ML Unpaused
Paco Nathan
 
PDF
Introduction on Data Science
Edureka!
 
PPTX
Big Data in NATO and Your Role
Jay Gendron
 
PPT
Broad Data (India 2015)
James Hendler
 
PPTX
Thoughts on Knowledge Graphs & Deeper Provenance
Paul Groth
 
PPTX
Introduction to Big Data and Data Science
Feyzi R. Bagirov
 
PDF
From Web Data to Knowledge: on the Complementarity of Human and Artificial In...
Stefan Dietze
 
Urban Data Science at UW
University of Washington
 
Broad Data
James Hendler
 
Data Science and Urban Science @ UW
University of Washington
 
DSSG Speaker Series: Paco Nathan
Paco Nathan
 
Introduction to Data Science and Large-scale Machine Learning
Nik Spirin
 
Designing a second generation of open data platforms
Yannis Charalabidis
 
Data Science: Not Just For Big Data
Revolution Analytics
 
Roger hoerl say award presentation 2013
Roger Hoerl
 
Keynote - An overview on Big Data & Data Science - Dr Gregory Piatetsky-Shapiro
Data ScienceTech Institute
 
Data Science: Past, Present, and Future
Gregory Piatetsky-Shapiro
 
Data Science Introduction - Data Science: What Art Thou?
Gregg Barrett
 
An Obligatory Introduction to Data Science
Wesley Eldridge
 
How it works- Data Science
Edureka!
 
A New Year in Data Science: ML Unpaused
Paco Nathan
 
Introduction on Data Science
Edureka!
 
Big Data in NATO and Your Role
Jay Gendron
 
Broad Data (India 2015)
James Hendler
 
Thoughts on Knowledge Graphs & Deeper Provenance
Paul Groth
 
Introduction to Big Data and Data Science
Feyzi R. Bagirov
 
From Web Data to Knowledge: on the Complementarity of Human and Artificial In...
Stefan Dietze
 
Ad

Viewers also liked (20)

PDF
IAd-learning: A new e-learning platform by José Antonio Omedes at Big Data Sp...
Big Data Spain
 
PDF
Big Data, analytics and 4th generation data warehousing by Martyn Jones at Bi...
Big Data Spain
 
PDF
Analyzing organization e-mails in near real time using hadoop ecosystem tools...
Big Data Spain
 
PDF
Essential ingredients for real time stream processing @Scale by Kartik pParam...
Big Data Spain
 
PDF
A new streaming computation engine for real-time analytics by Michael Barton ...
Big Data Spain
 
PDF
Geospatial and bitemporal search in C* with pluggable Lucene index by Andrés ...
Big Data Spain
 
PDF
How to integrate Big Data onto an analytical portal, Big Data benchmarking fo...
Big Data Spain
 
PDF
Apache flink: data streaming as a basis for all analytics by Kostas Tzoumas a...
Big Data Spain
 
PDF
Begin at the beginning: Feature selection for Big Data by Amparo Alonso at Bi...
Big Data Spain
 
PDF
Big Data as a game-changer of clinical research strategies by Rafael San Migu...
Big Data Spain
 
PDF
Building graphs to discover information by David Martínez at Big Data Spain 2015
Big Data Spain
 
PDF
Predicting failures on complex machines by Ion Marqués at Big Data Spain 2015
Big Data Spain
 
PDF
Euclid & Big Data from dark space by Guillermo Buenadicha at Big Data Spain 2015
Big Data Spain
 
PDF
The top five questions to ask about NoSQL. JONATHAN ELLIS at Big Data Spain 2012
Big Data Spain
 
PDF
ToroDB: Scaling PostgreSQL like MongoDB by Álvaro Hernández at Big Data Spain...
Big Data Spain
 
PDF
State of Play. Data Science on Hadoop in 2015 by SEAN OWEN at Big Data Spain ...
Big Data Spain
 
PDF
Intro to the Big Data Spain 2014 conference
Big Data Spain
 
PDF
Big Data Web applications for Interactive Hadoop by ENRICO BERTI at Big Data...
Big Data Spain
 
PDF
Data warehouse modernization programme by TOBY WOOLFE at Big Data Spain 2014
Big Data Spain
 
PDF
Dataflows: The abstraction that powers Big Data by Raul Castro Fernandez at ...
Big Data Spain
 
IAd-learning: A new e-learning platform by José Antonio Omedes at Big Data Sp...
Big Data Spain
 
Big Data, analytics and 4th generation data warehousing by Martyn Jones at Bi...
Big Data Spain
 
Analyzing organization e-mails in near real time using hadoop ecosystem tools...
Big Data Spain
 
Essential ingredients for real time stream processing @Scale by Kartik pParam...
Big Data Spain
 
A new streaming computation engine for real-time analytics by Michael Barton ...
Big Data Spain
 
Geospatial and bitemporal search in C* with pluggable Lucene index by Andrés ...
Big Data Spain
 
How to integrate Big Data onto an analytical portal, Big Data benchmarking fo...
Big Data Spain
 
Apache flink: data streaming as a basis for all analytics by Kostas Tzoumas a...
Big Data Spain
 
Begin at the beginning: Feature selection for Big Data by Amparo Alonso at Bi...
Big Data Spain
 
Big Data as a game-changer of clinical research strategies by Rafael San Migu...
Big Data Spain
 
Building graphs to discover information by David Martínez at Big Data Spain 2015
Big Data Spain
 
Predicting failures on complex machines by Ion Marqués at Big Data Spain 2015
Big Data Spain
 
Euclid & Big Data from dark space by Guillermo Buenadicha at Big Data Spain 2015
Big Data Spain
 
The top five questions to ask about NoSQL. JONATHAN ELLIS at Big Data Spain 2012
Big Data Spain
 
ToroDB: Scaling PostgreSQL like MongoDB by Álvaro Hernández at Big Data Spain...
Big Data Spain
 
State of Play. Data Science on Hadoop in 2015 by SEAN OWEN at Big Data Spain ...
Big Data Spain
 
Intro to the Big Data Spain 2014 conference
Big Data Spain
 
Big Data Web applications for Interactive Hadoop by ENRICO BERTI at Big Data...
Big Data Spain
 
Data warehouse modernization programme by TOBY WOOLFE at Big Data Spain 2014
Big Data Spain
 
Dataflows: The abstraction that powers Big Data by Raul Castro Fernandez at ...
Big Data Spain
 
Ad

Similar to Data Science in 2016: Moving up by Paco Nathan at Big Data Spain 2015 (20)

PPTX
Real-time applications of Data Science.pptx
shalini s
 
PDF
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
Mihai Criveti
 
PDF
High Performance Data Analytics and a Java Grande Run Time
Geoffrey Fox
 
PPTX
Biomedical Data Science: We Are Not Alone
Philip Bourne
 
PDF
Python's Role in the Future of Data Analysis
Peter Wang
 
PPTX
Big Data Day LA 2016/ Data Science Track - The Evolving Data Science Landscap...
Data Con LA
 
PDF
Data Science in Future Tense
Paco Nathan
 
PPTX
NYC Open Data Meetup-- Thoughtworks chief data scientist talk
Vivian S. Zhang
 
PPTX
Data_Science_Applications_&_Use_Cases.pptx
ssuser1a4f0f
 
PPTX
Data_Science_Applications_&_Use_Cases.pptx
wahiba ben abdessalem
 
PDF
Data_Science_Applications_&_Use_Cases.pdf
vishal choudhary
 
PDF
AI for Marking Industry application for.pdf
jdcil1975
 
PDF
Data Center Computing for Data Science: an evolution of machines, middleware,...
Paco Nathan
 
PPTX
Data Science presentation for explanation of numpy and pandas
spmf313
 
PDF
Top 10 Trends to Watch for In Data Science.pdf
Edtech Learning
 
PDF
Data in Action
Natalino Busa
 
PDF
Data Science with Spark
Krishna Sankar
 
PDF
The Future of Data Science: Emerging Trends and Technologies
Vaishali Pal
 
PDF
Data Science: Notes and Toolkits
Babis Marmanis
 
PDF
Data Science at Scale - The DevOps Approach
Mihai Criveti
 
Real-time applications of Data Science.pptx
shalini s
 
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
Mihai Criveti
 
High Performance Data Analytics and a Java Grande Run Time
Geoffrey Fox
 
Biomedical Data Science: We Are Not Alone
Philip Bourne
 
Python's Role in the Future of Data Analysis
Peter Wang
 
Big Data Day LA 2016/ Data Science Track - The Evolving Data Science Landscap...
Data Con LA
 
Data Science in Future Tense
Paco Nathan
 
NYC Open Data Meetup-- Thoughtworks chief data scientist talk
Vivian S. Zhang
 
Data_Science_Applications_&_Use_Cases.pptx
ssuser1a4f0f
 
Data_Science_Applications_&_Use_Cases.pptx
wahiba ben abdessalem
 
Data_Science_Applications_&_Use_Cases.pdf
vishal choudhary
 
AI for Marking Industry application for.pdf
jdcil1975
 
Data Center Computing for Data Science: an evolution of machines, middleware,...
Paco Nathan
 
Data Science presentation for explanation of numpy and pandas
spmf313
 
Top 10 Trends to Watch for In Data Science.pdf
Edtech Learning
 
Data in Action
Natalino Busa
 
Data Science with Spark
Krishna Sankar
 
The Future of Data Science: Emerging Trends and Technologies
Vaishali Pal
 
Data Science: Notes and Toolkits
Babis Marmanis
 
Data Science at Scale - The DevOps Approach
Mihai Criveti
 

More from Big Data Spain (20)

PDF
Big Data, Big Quality? by Irene Gonzálvez at Big Data Spain 2017
Big Data Spain
 
PDF
Scaling a backend for a big data and blockchain environment by Rafael Ríos at...
Big Data Spain
 
PDF
AI: The next frontier by Amparo Alonso at Big Data Spain 2017
Big Data Spain
 
PDF
Disaster Recovery for Big Data by Carlos Izquierdo at Big Data Spain 2017
Big Data Spain
 
PDF
Presentation: Boost Hadoop and Spark with in-memory technologies by Akmal Cha...
Big Data Spain
 
PDF
Data science for lazy people, Automated Machine Learning by Diego Hueltes at ...
Big Data Spain
 
PDF
Training Deep Learning Models on Multiple GPUs in the Cloud by Enrique Otero ...
Big Data Spain
 
PDF
Unbalanced data: Same algorithms different techniques by Eric Martín at Big D...
Big Data Spain
 
PDF
State of the art time-series analysis with deep learning by Javier Ordóñez at...
Big Data Spain
 
PDF
Trading at market speed with the latest Kafka features by Iñigo González at B...
Big Data Spain
 
PDF
Unified Stream Processing at Scale with Apache Samza by Jake Maes at Big Data...
Big Data Spain
 
PDF
The Analytic Platform behind IBM’s Watson Data Platform by Luciano Resende a...
Big Data Spain
 
PDF
Artificial Intelligence and Data-centric businesses by Óscar Méndez at Big Da...
Big Data Spain
 
PDF
Why big data didn’t end causal inference by Totte Harinen at Big Data Spain 2017
Big Data Spain
 
PDF
Meme Index. Analyzing fads and sensations on the Internet by Miguel Romero at...
Big Data Spain
 
PDF
Vehicle Big Data that Drives Smart City Advancement by Mike Branch at Big Dat...
Big Data Spain
 
PDF
End of the Myth: Ultra-Scalable Transactional Management by Ricardo Jiménez-P...
Big Data Spain
 
PDF
Attacking Machine Learning used in AntiVirus with Reinforcement by Rubén Mart...
Big Data Spain
 
PDF
More people, less banking: Blockchain by Salvador Casquero at Big Data Spain ...
Big Data Spain
 
PDF
Make the elephant fly, once again by Sourygna Luangsay at Big Data Spain 2017
Big Data Spain
 
Big Data, Big Quality? by Irene Gonzálvez at Big Data Spain 2017
Big Data Spain
 
Scaling a backend for a big data and blockchain environment by Rafael Ríos at...
Big Data Spain
 
AI: The next frontier by Amparo Alonso at Big Data Spain 2017
Big Data Spain
 
Disaster Recovery for Big Data by Carlos Izquierdo at Big Data Spain 2017
Big Data Spain
 
Presentation: Boost Hadoop and Spark with in-memory technologies by Akmal Cha...
Big Data Spain
 
Data science for lazy people, Automated Machine Learning by Diego Hueltes at ...
Big Data Spain
 
Training Deep Learning Models on Multiple GPUs in the Cloud by Enrique Otero ...
Big Data Spain
 
Unbalanced data: Same algorithms different techniques by Eric Martín at Big D...
Big Data Spain
 
State of the art time-series analysis with deep learning by Javier Ordóñez at...
Big Data Spain
 
Trading at market speed with the latest Kafka features by Iñigo González at B...
Big Data Spain
 
Unified Stream Processing at Scale with Apache Samza by Jake Maes at Big Data...
Big Data Spain
 
The Analytic Platform behind IBM’s Watson Data Platform by Luciano Resende a...
Big Data Spain
 
Artificial Intelligence and Data-centric businesses by Óscar Méndez at Big Da...
Big Data Spain
 
Why big data didn’t end causal inference by Totte Harinen at Big Data Spain 2017
Big Data Spain
 
Meme Index. Analyzing fads and sensations on the Internet by Miguel Romero at...
Big Data Spain
 
Vehicle Big Data that Drives Smart City Advancement by Mike Branch at Big Dat...
Big Data Spain
 
End of the Myth: Ultra-Scalable Transactional Management by Ricardo Jiménez-P...
Big Data Spain
 
Attacking Machine Learning used in AntiVirus with Reinforcement by Rubén Mart...
Big Data Spain
 
More people, less banking: Blockchain by Salvador Casquero at Big Data Spain ...
Big Data Spain
 
Make the elephant fly, once again by Sourygna Luangsay at Big Data Spain 2017
Big Data Spain
 

Recently uploaded (20)

PPT
Module 1.ppt Iot fundamentals and Architecture
nanditha7766
 
PPTX
Tartificialntelligence_presentation.pptx
ry7r52mzb4
 
PDF
WOOl fibre morphology and structure.pdf for textiles
Rajendrakumar868651
 
PPTX
Final SEM Unit 1 for mit wpu at pune .pptx
anishtilekar08
 
PDF
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
KodekX
 
PDF
Enhancing emotion recognition model for a student engagement use case through...
IAESIJAI
 
PDF
Hindi spoken digit analysis for native and non-native speakers
IAESIJAI
 
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
IAESIJAI
 
PDF
Hybrid horned lizard optimization algorithm-aquila optimizer for DC motor
IAESIJAI
 
PDF
Assigned Numbers - 2025 - Bluetooth® Document
Bloombase
 
PPTX
observCloud-Native Containerability and monitoring.pptx
anupsingh76937
 
PDF
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
rameswartudu05
 
PDF
Zenith AI: Advanced Artificial Intelligence
Biz Preneurs
 
PDF
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
PDCA Consulting
 
PDF
Microsoft Solutions Partner Drive Digital Transformation with D365.pdf
Microsoft Dynamics
 
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
MatthewLewis227954
 
DOCX
search engine optimization ppt fir known well about this
StandardCodeLearning
 
PDF
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
IAESIJAI
 
PDF
August Patch Tuesday
Ivanti
 
PPTX
Chapter 5: Probability Theory and Statistics
RandyFin
 
Module 1.ppt Iot fundamentals and Architecture
nanditha7766
 
Tartificialntelligence_presentation.pptx
ry7r52mzb4
 
WOOl fibre morphology and structure.pdf for textiles
Rajendrakumar868651
 
Final SEM Unit 1 for mit wpu at pune .pptx
anishtilekar08
 
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
KodekX
 
Enhancing emotion recognition model for a student engagement use case through...
IAESIJAI
 
Hindi spoken digit analysis for native and non-native speakers
IAESIJAI
 
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
IAESIJAI
 
Hybrid horned lizard optimization algorithm-aquila optimizer for DC motor
IAESIJAI
 
Assigned Numbers - 2025 - Bluetooth® Document
Bloombase
 
observCloud-Native Containerability and monitoring.pptx
anupsingh76937
 
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
rameswartudu05
 
Zenith AI: Advanced Artificial Intelligence
Biz Preneurs
 
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
PDCA Consulting
 
Microsoft Solutions Partner Drive Digital Transformation with D365.pdf
Microsoft Dynamics
 
Group 1 Presentation -Planning and Decision Making .pptx
MatthewLewis227954
 
search engine optimization ppt fir known well about this
StandardCodeLearning
 
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
IAESIJAI
 
August Patch Tuesday
Ivanti
 
Chapter 5: Probability Theory and Statistics
RandyFin
 

Data Science in 2016: Moving up by Paco Nathan at Big Data Spain 2015

  • 2. Data Science in 2016: Moving Up 2015-10-15 • Madrid • http://bigdataspain.org/ Paco Nathan, @pacoid
 O’Reilly Media
  • 3. • general patterns • trends and analysis: the discipline, the jobs • some good examples: moving up into use cases • glimpses ahead: an emerging content • a proposed theme Data Science 2016: Moving Up
  • 5. Design Patterns Methodology for cloud-computing architecture
 (2008-06-29) http://ceteri.blogspot.com/2008/06/methodology-for- cloud-computing.html
  • 9. Design Patterns: Issues some cloud • integration could be better • that implies sharing markets • VCs in SiliconValley dislike that • customers need integration
  • 15. Design Patterns: Where? some cloud • that playing field becomes overly crowded, soon… • what happens at that point?
  • 16. • so much emphasis on plumbing: `data engineering` • not enough on domain expertise, which trumps all Much activity in Big Data seems awkwardly focused at the bottom of the tech stack: infrastructure, not domain However, that may be changing… Design Patterns: Opinion
  • 18. Interesting Trends There are many possible trends to discuss, but let’s 
 concentrate on four of these going into 2016: • leveraging multicore and large memory spaces • generalized libraries for frequently repeated work • workflows blend the best of people and computing • framework for a big leap ahead, not just incremental
  • 19. Original definitions for what became relational databases had less to do with dedicated SQL products, more similarity with something like 
 Spark SQL Interesting Trend #1: Contemporary Hardware A relational model of data 
 for large shared data banks
 Edgar Codd
 Communications of the ACM (1970)
 dl.acm.org/citation.cfm?id=362685
  • 20. Python Java/Scala RSQL … DataFrame Logical Plan LLVMJVM GPU NVRAM Unified API, One Engine, Automatically Optimized Tungsten backend language frontend … from Databricks Interesting Trend #1: Contemporary Hardware
  • 21. Deep Dive into ProjectTungsten: 
 Bringing Spark Closer to Bare Metal
 Josh Rosen
 spark-summit.org/2015/events/deep-dive-into-project- tungsten-bringing-spark-closer-to-bare-metal/ Set Footer from Insert Dropdown Menu Physical Execution: CPU Efficient Data Structures Keep data closure to CPU cache Interesting Trend #1: Contemporary Hardware from Databricks
  • 22. Interesting Trend #2: Generalized Libraries Tensors are a good way to handle time-series 
 geo-spatially distributed linked data with lots 
 of N-dimensional attributes In other words, nearly a general case for handling much of the data that we’re likely to encounter That’s better than attempting to shoehorn data into matrix representation, then writing lots of custom code to support it
  • 23. Tensor factorization may be problematic, but probabilistic solutions seem to provide relatively general case solutions: TheTensor Renaissance in Data Science
 Anima Anandkumar @UC Irvine
 radar.oreilly.com/2015/05/the-tensor- renaissance-in-data-science.html Spacey RandomWalks and 
 Higher Order Markov Chains
 David Gleich @Purdue
 slideshare.net/dgleich/spacey-random- walks-and-higher-order-markov-chains Interesting Trend #2: Generalized Libraries
  • 24. Interesting Trend #3: Leveraging Workflows evaluationoptimizationrepresentationcirca 2010 ETL into cluster/cloud data data visualize, reporting Data Prep Features Learners, Parameters Unsupervised Learning Explore train set test set models Evaluate Optimize Scoring production data use cases data pipelines actionable results decisions, feedback bar developers foo algorithms APIs, algorithms, developer-centric template thinking – 
 these only go so far; the overall context is a workflow…
  • 25. evaluationoptimizationrepresentationcirca 2010 ETL into cluster/cloud data data visualize, reporting Data Prep Features Learners, Parameters Unsupervised Learning Explore train set test set models Evaluate Optimize Scoring production data use cases data pipelines actionable results decisions, feedback bar developers foo algorithms look beyond an API, beyond a code repo … think of people and machines working together Interesting Trend #3: Leveraging Workflows APIs, algorithms, developer-centric template thinking – these only
  • 26. Chris Ré, @Stanford
 https://www.macfound.org/fellows/943/ Drugs, DNA, and Dinosaurs: Building High Quality Knowledge Bases with DeepDive
 Strata CA (2015) TheThorn in the Side of Big Data: too few artists
 Strata CA (2014) Interesting Trend #4: A Leap Ahead
  • 27. Chris Ré https://www.macfound.org/fellows/943/ Drugs, DNA, and Dinosaurs: Building High Quality Knowledge Bases with DeepDive Strata CA (2015) TheThorn in the Side of Big Data: too few artists Strata CA (2014) Interesting Trend #4: A Leap Ahead cognitive computing “flywheel”: probabilistic reasoning about complex data and predictions together
  • 28. Chris Ré https://www.macfound.org/fellows/943/ Drugs, DNA, and Dinosaurs: Building High Quality Knowledge Bases with DeepDive Strata CA (2015) TheThorn in the Side of Big Data: too few artists Strata CA (2014) Interesting Trend #4: A Leap Ahead
  • 30. William Cleveland 
 “Data Science: an Action Plan for Expanding 
 the Technical Areas of the Field of Statistics,” 
 International Statistical Review (2001), 69, 21-26 http://www.stat.purdue.edu/~wsc/papers/ datascience.pdf Leo Breiman
 “Statistical modeling: the two cultures”, 
 Statistical Science (2001), 16:199-231 http://projecteuclid.org/euclid.ss/1009213726 …also good to mention John Tukey Data Scientists: Primary Sources
  • 31. Data Scientists: Five Years of Strata Conference
  • 32. One 2015 report (RJMetrics) tallied a minimum of 
 11,400 data scientists worldwide by scraping LinkedIn So many suddenly, really? Perhaps that’s doubtful… Comparing surveys: O’Reilly Media conducts salary surveys 
 for data scientists, along with exploring about the tools used 2013 – tools, trends, not all data is “Big”, coding scripts! 2014 – correlation of tools and skills, rapid evolution 2015 – divide blurring between open source and proprietary Data Scientists: Everywhere, all the time?
  • 36. Enlitic http://www.enlitic.com/ deep learning to assist doctors treating cancer Moving Up: Medicine
  • 37. Moving Up: Medicine “Whatever the models might discover or predict, Howard isn’t suggesting they’ll do away with a doctor’s judgment. Rather, artificially intelligent computers could provide strong, unbiased second opinions, or perhaps lead a doctor down 
 a path of investigation she other wouldn’t have considered.” With Enlitic, a veteran data scientist plans 
 to fight disease using deep learning
 GigaOM (2014-08-22)
 https://gigaom.com/2014/08/22/with-enlitic-a-veteran- data-scientist-plans-to-fight-disease-using-deep-learning/
  • 38. Moving Up: Political Platform http://www.predikon.ch/en/voting-patterns/residents
  • 39. Moving Up: Political Platform Mining Democracy
 Matthias Grossglauser @EPFL
 ICT Labs (2015)
 http://ictlabs-summer-school.sics.se/ slides/mining%20democracy.pdf What if a political candidate could cluster political positions in a multi-dimensional data space, to optimize for being recommended to voters? http://www.predikon.ch/en/voting-patterns/residents
  • 40. Moving Up: Government Ethics TheWhite House has a plan to help society through data analysis
 Fortune (2018-09-30)
 http://fortune.com/2015/09/30/dj-patil-white-house-data/
  • 41. Moving Up: Government Ethics TheWhite House has a plan to help society through data analysis
 Fortune (2018-09-30)
 http://fortune.com/2015/09/30/dj-patil-white-house-data/ “Opening up government data about child labor to concerned data scientists; recruiting folks to help analyze data about suicide prevention, social injustice and incarceration; a call for mandatory and `intrinsic` ethics instruction in every course teaching students data science; and an effort to help the transgender community create its own census of sorts, so that members and society can get a better grasp on the issues that matter to the group.”
  • 42. Moving Up: Neuroscience Analytics +Visualization for Neuroscience: Spark,Thunder, Lightning Jeremy Freeman
 2015-01-29 youtu.be/cBQm4LhHn9g?t=28m55s
  • 43. For excellent examples of Science and Data together see CodeNeuro, particularly for 
 use of Jupyter notebooks + Apache Spark Moving Up: Neuroscience
  • 46. Massive Open Online Courses – 
 seven year trend, beginning with: Connectivism and Connective Knowledge
 George Siemens, Stephen Downes
 University of PEI (2008)
 http://cck11.mooc.ca/ Learning: What About MOOCs? Adios EdTech. Hola something else
 George Siemens (2015-09-09)
 http://www.elearnspace.org/blog/2015/09/09/ adios-ed-tech-hola-something-else/
  • 47. Online education: MOOCs taken by educated few
 Ezekiel Emanuel, Nature 503, 342 (2013-11-21) • 80% students already have an advanced degree • 80% come from the richest 6% of the population Michael Shanks @Stanford: “retrenchment around traditional disciplines will make disparities even more pronounced” An Early Report Card on Massive Open Online Courses
 Geoffrey Fowler, WSJ (2013-10-08) Amherst, Duke, etc., have rejected edX Learning: What About MOOCs?
  • 48. Online education: MOOCs taken by educated few Ezekiel Emanuel • 80% students already have an advanced degree • 80% come from the richest 6% of the population Michael Shanks disciplines will make disparities even more pronounced” An Early Report Card on Massive Open Online Courses Geoffrey Fowler Amhers Learning: What About MOOCs? So then, what else works better?
  • 49. How to Flip a Class 
 CTL @UT/Austin
 http://ctl.utexas.edu/teaching/flipping-a-class/how 1. identify where the flipped classroom model makes 
 the most sense for your course 2. spend class time engaging students in application activities with feedback 3. clarify connections between inside and outside 
 of class learning 4. adapt your materials for students to acquire course content in preparation of class 5. extend learning beyond class through individual 
 and collaborative practice Learning: Inverted Classroom
  • 50. Scalable Learning
 David Black-Schaffer @Uppsala
 Sverker Janson @KTH SICS https://www.scalable-learning.com/ • active learning: Flipped Classroom and Just-in-timeTeaching • exams built directly into specific diagrams within videos • metrics for where in video+code that students get stuck • instructor can customize subsequent classroom discussions 
 (active teaching phase) based on stuck/unstuck metrics Learning: Inverted Classroom
  • 51. Learning programming at scale Philip Guo 
 O’Reilly Radar (2015-08-13) http://radar.oreilly.com/2015/08/learning- programming-at-scale.html • PythonTutor • Codechella Tutors could keep an eye on around 
 50 learners during a 30-minute session, 
 start 12 chat conversations, and 
 concurrently help 3 learners at once Learning: Collaborative Learning
  • 52. Data-driven Education and the Quantified Student Lorena Barba @GWU PyData Seattle (2015) https://youtu.be/2YIZ2SY9mW4 • keynote talk: abstract, slides • homepage • Open edX Universities Symposium, DC 2015-11-11 Learning: If you study just one link from this talk…
  • 53. If by some bizarre chance you haven’t used 
 it already, go to https://jupyter.org/ • 50+ different language kernels • new funding 2015-07 • UC Berkeley, Cal Poly • nbgrader autograder by Jess Hamrick • jupyterhub multi-user server • curating a list of examples • repeatable science! see also:
 Teaching with Jupyter Notebooks
 http://tinyurl.com/scipy2015-education Learning: Jupyter Project
  • 54. Embracing Jupyter Notebooks at O'Reilly
 Andrew Odewahn
 O’Reilly Media (2015-05-07) https://beta.oreilly.com/ideas/jupyter-at-oreilly O’Reilly Media is using our Atlas platform 
 to make Jupyter Notebooks a first class authoring environment for our publishing program Jupyter, Thebe, Atlas, Docker, etc. Learning: O’Reilly Media
  • 57. Is it possible to measure “distance” between 
 a learner and a subject community? From Amateurs to Connoisseurs:
 Modeling the Evolution of User 
 Expertise through Online Reviews
 Julian McAuley, Jure Leskovec
 http://i.stanford.edu/~julian/pdfs/www13.pdf Learning: Machine Learning about People Learning
  • 58. Learning,Assessment,Team Building, Diversity – these can be accomplished together, in situ Collective Intelligence in Human Groups
 Anita Williams Woolley @CMU
 https://youtu.be/Bz1dDiW2mvM • balance of participation (no one dominates) • 2+ women engaging within the group • group size < 9 • diversity of formal backgrounds Learning: Machine Learning about People Learning
  • 60. Data Science teams apply machine learning (automation) to help arrive at key insights, to learn what is important 
 in data sets – finding the proverbial needle in the haystack Cognitive Computing exhibits people + automation 
 as a process, in a learning context That’s also a basic tenet of workflows in general: 
 people + automation And a key aspect of the emerging gig economy too… People + Automation
  • 61. People + Automation: Gig Economy
  • 62. People + Automation: Gig Economy http://orchestra.unlimitedlabs.com/ “Workflows with humans and machines”
  • 63. People + Automation: Gig Economy Workers in aWorld of Continuous Partial Employment Tim O’Reilly Medium (2015-08-31)
 https://medium.com/the-wtf-economy/workers-in-a- world-of-continuous-partial-employment-4d7b53f18f96 http://conferences.oreilly.com/next-economy
  • 64. Learning is key. Effective use of Data Science in these new economic conditions requires people + automation, learning together – albeit in different ways. Plus, there’s an excellent framework for that: Autopoiesis and Cognition
 Humberto Maturana, FranciscoVarela
 Springer (1973) https://books.google.es/books?id=nVmcN9Ja68kC People + Automation
  • 65. I’d like to leave this as a theme for you to consider about 
 Data Science 2016, Moving Up into use cases… We see an intersection of key points in both the emerging Cognitive Computing context and the Gig Economy in general: systems of people + automation, learning together It posits an interesting duality for use to leverage With that I wish you a great conference here at Big Data Spain! People + Automation
  • 67. contact: Just Enough Math O’Reilly (2014) justenoughmath.com
 preview: youtu.be/TQ58cWgdCpA monthly newsletter for updates, 
 events, conf summaries, etc.: liber118.com/pxn/ Intro to Apache Spark
 O’Reilly (2015)
 shop.oreilly.com/product/ 0636920036807.do