Management Information

Systems

Big Data and IoT

Dr. Md. Rakibul Hoque

University of Dhaka
A Minute on the Internet in 2019
and 2020
 Big Data

Name Symbol Value

Huge volumes of data which is in, Kilobyte kB 103
-> Terabytes(1024 Gigabytes) Megabyte MB 106
-> Petabytes(1024 Terabytes) Gigabyte GB 109
-> Exabytes(1024 Petabytes) Terabyte TB 1012
Petabyte PB 1015
-> Zettabytes(1024 Exabytes)
Exabyte EB 1018
-> Yottabytes(1024 Zettabytes) Zettabyte ZB 1021
-> Brontobytes(1024 yottabytes) Yottabyte YB 1024
-> Gegobyte (1024 Brontobytes) Brontobyte* BB 1027
Gegobyte* GeB 1030

The Data Size Is Getting Bigger and Bigger

 Big Data

 About 2.5 quintillion bytes of data are generated

every day and almost 90% of the world’s data was
generated in the last few years.
 Data is growing faster than ever before and
about 1.7 megabytes of new information will be
created every second for every human being on the
planet.
 463 exabytes of data will be generated each day by
humans as of 2025.
 95 million photos and videos are shared every day
on Instagram.
 Big Data
 Facebook users generating 90 pieces of contents (notes,
photos, link, stories, posts), while 600 million active
users of social platform spent over 9.3 billion hours a
month on the site.
 1 Million likes per minute
 Every day, 306.4 billion emails are sent, and 5 million
Tweets are made.
 Every minute 24 hours of video is uploaded in YouTube.
 We perform 40,000 search queries every second
(on Google alone), which makes it 3.5 searches per day
and 1.2 trillion searches per year.
 Big Data
 A flight generates 240 terabytes of new data every
year. Black Box captures voices of the flight crew,
recordings of microphones and earphones, and the
performance information of the aircraft.
 Walmart handles 1 million customer transaction/hour.
 73 products are ordered via Amazon per second in
the world.
 This volume of data equates to 2-hourlong HD
movies, which one person would need 47 million
years to watch in their entirety.
 Big Data

Big Data is primarily

measured by the volume
of the data.
Big Data also includes
data that is coming in fast
and at huge varieties.
 Big Data

Big Data is a collection of large and complex

data sets which are difficult to process using
common database management tools or
traditional data processing applications.
The US Congress defines big data as “a term
that describes large volumes of high velocity,
complex, and variable data that require
advanced techniques and technologies to
enable the capture, storage, distribution,
management, and analysis of the
 Big Data

Big data is a broad term for data

sets so large or complex that
traditional data processing
applications are inadequate.
Challenges include analysis,
capture, data curation, search,
sharing, storage, transfer,
visualization, information
security and information
privacy.
Big data
 Big data
 Big Data requires a scalable architecture for
efficient storage, manipulation, and analysis.
■ Volume refers to the vast amount of data generated
every second.
■ Velocity refers to the speed at which new data is
generated and the speed at which data moves around.
■ Variety refers to the different types of data we can now
use.
■ Veracity refers to the uncertainty or trustworthiness of the
data.
■ Value refers to our ability turn our data into value.
 Different Types of Big Data
 Structured data refers to data that has a defined length and format
■ Computer- or machine-generated: Machine-generated data generally
refers to data that is created by a machine without human intervention.
■ Human-generated: This is data that humans, in interaction with
computers, supply.
 Semi-structured data refers to data that falls between structured
and unstructured data.
■ Semi-structured data does not necessarily conform to a fixed schema
(that is, structure) but may be self-describing and may have simple
label/value pairs.
 Unstructured data is data that does not follow a specified format
Different Types of Big Data
 Different Forms of Big Data
 Examples of Machine-generated Unstructured Data:
■ Satellite images: includes weather data or the data
that the government captures in its satellite surveillance
imagery.
■ Scientific data: includes seismic imagery, atmospheric
data, and high energy physics.
■ Photographs and video: includes security,
surveillance, and traffic video.
■ Radar or sonar data: includes vehicular,
meteorological, and oceanographic seismic profiles.
 Different Forms of Data

 Examples of Human-generated Unstructured Data:

■ Text internal to your company: includes all the text within
documents, enterprise information, logs and survey results
■ Social media data: includes data from the social media
platforms such as YouTube, Facebook, Twitter, LinkedIn, and
Flickr.
■ Mobile data: includes text messages and location
information.
■ Website content: includes data from any site delivering
unstructured content, like YouTube, Flickr, or Instagram.
 States of data
 There are three basic states of data: data at rest, data in
motion, and data in use.
 Data at rest
• Data at rest is a term that refers to data stored on a device
or backup medium in any form.
• It can be data stored on hard drives, backup tapes, in
offsite cloud backup, or even on mobile devices.
• Data at rest is a term that refers to data stored on a device
or backup medium in any form. It can be data stored on hard
drives, backup tapes, in offsite cloud backup, or even on
mobile devices.
 States of data

Data in motion
• Data in motion is data that is currently traveling across a network or sitting in a
computer’s RAM ready to be read, updated, or processed.
• This data in motion (usually encrypted) includes data moving across a cables
and wireless transmission. It can be emails or files transferred over FTP or SSH.
 Data in use
• Data in use is data that is not just being stored passively on a hard drive or
external storage media. This is data that is being processed by one or more
applications.
• This is data currently in the process of being generated, updated, appended, or
erased.
Stages of Maturity
 Where does the Big Data
come from?

Everywhere! Web logs, RFID, GPS systems,

sensor networks, social networks, Internet-
based text documents, Internet search
indexes, detail call records, astronomy,
atmospheric science, biology, genomics,
nuclear physics, biochemical experiments,
medical records, scientific research, military
surveillance, multimedia archives, …
 Where does the Big Data
come from?
 Stock Exchange Data: The stock exchange data
holds information about the ‘buy’ and ‘sell’ decisions
made on a share of different companies made by the
customers.
 Power Grid Data: The power grid data holds
information consumed by a particular node with
respect to a base station.
 Transport Data: Transport data includes model,
capacity, distance and availability of a vehicle.
 Search Engine Data: Search engines retrieve lots
of data from different databases.
Socially connected world
Creating the Social Enterprise
 Mobile Device
 There are 5.22 Billion people that have a mobile
device in the world. This means that 66.83% of the
world's population has a mobile device.
 The number of smartphone users in the world is
3.5 billion, and this means 44.81% of the world's
population owns a smartphone.
 There are more than 3.5 billion mobile internet
subscribers
 There are 1 million apps available, which have been
downloaded more than 100 billion times.
 192 countries have active 3G mobile network
 Internet of Things
 The Internet of Things (IoT) is a scenario in which
objects, animals or people are provided with unique
identifiers and the ability to transfer data over a
network without requiring human-to-human or
human-to-computer interaction.
 The Internet of things is the network of physical
devices, vehicles, home appliances and other items
embedded with electronics, software, sensors,
actuators, and network connectivity which enables
these objects to connect and exchange
 Internet of Things

 The Internet of Things (IoT), also sometimes

referred to as the Internet of Everything (IoE),
consists of all the web-enabled devices that collect,
send and act on data they acquire from their
surrounding environments using embedded
sensors, processors and communication hardware.
 According to Gartner Inc. (a technology research
and advisory corporation), there are nearly 26
billion devices on the Internet of Things.
Number of Times People Interact
with Connected Devices
Crowdedness
 Crowdsourcing

 Crowdsourcing is the process of obtaining needed

services, ideas, or content by soliciting contributions from
a large group of people, and especially from an online
community, rather than from traditional employees or
suppliers.
 Wikipedia – perhaps the pioneers of crowdsourcing. The
not-for-profit Wikipedia Foundation launched its free, web-
based, multilingual and collaborative encyclopaedia in
2001.  It has over 17m articles written collaboratively by
the community and is the most popular reference site on
the internet.
 Crowdsourcing

 Top brands like Pepsi, Coca-Cola and Oreo are turning to

the crowd. It’s not only the popular (and cheap) thing to do.
It’s good marketing.
 Last year Coke made a big splash when it announced that
it would shift it’s business model to be more open. Since
then the company has been working with customers to
enhance communications and even rely on consumers for
product development. Last year the company asked its 50
million fans on Facebook (at the time) to suggest an
invention, cause or social app that could spread happiness.
 Crowdsourcing

 Starbucks – an ideas forum where customers

are invited to share, vote, discuss and see –
“You know better than anyone else what you
want from Starbucks. So tell us. What’s your
Starbucks Idea? Revolutionary or simple – we
want to hear it. Share your ideas, tell us what
you think of other people’s ideas and join the
discussion. We’re here, and we’re ready to
make ideas happen. Let’s get started.”
Big Brand Crowdsourcing
Campaigns
Types of Crowdsourcing
 Crowdfunding

 Crowdfunding is the practice of funding a

project or venture by raising monetary
contributions from a large number of people,
typically via the internet.
 A collective effort by consumers who network
and pool their money together, usually via
the Internet, in order to invest in and support
efforts initiated by other people or
organizations.
Crowdfunding
Why should we care? It impacts
all the things firms care about
 Did you know?

Big Data Hits Real Life

http://www.nytimes.com/video/business/

100000002206849/big-data-hits-real-life.html
Thank
You