UNIT Two Emerging Technology
UNIT Two Emerging Technology
EMERGING
TECHNOLOGIES
Introduction to Bigdata
Other well documented use cases of the first forms of data
analysis come from the Roman empire.
The ancient Roman military utilized very detailed
statistical analysis to ‘predict’ at which border the chance
of an enemy insurgency would be the most prevalent.
Based on these analyses, they were able to deploy their
armies in the most efficient way possible. It is not a far
stretch to consider these calculations one of the earliest
forms of ‘predictive’ data analysis. And again, these
analysis techniques provided the Roman military with an
advantage over other armies.
The term ‘Big Data’ has been in use since the early 1990s.
Although it is not exactly known who first used the term, most
people credit John R. Mashey (who at the time worked at
Silicon Graphics) for making the term popular.
The last two decades, the volume and speed with which data is
generated has changed beyond measures of human
comprehension.
The total amount of data in the world was 4.4 zettabytes in
2013. That is set to rise steeply to 44 zettabytes by 2020. To put
that in perspective, 44 zettabytes is equivalent to
44 trillion gigabytes.
Even with the most advanced technologies today, it is
impossible to analyze all this data. The need to process these
increasingly larger (and unstructured) data sets is how
traditional data analysis transformed into ‘Big Data’ in the last
decade.
Definition of Big Data
Big data is a large data set that is difficult to process and
analyze with traditional methods.
Most of the time, the term big data means a range
of structured, Unstructured, and Semi-structured data.
This is largely due to the rise of computers, the Internet, and
technology capable of capturing information from the real
and physical world we live in, and converting it to digital
data that can benefit businesses and organizations.
Big Data Analysis
Big data analysis refers to the systematic processing and
analysis of large and complex data sets, known as big data,
to extract valuable insights.
This process allows organizations to leverage the
exponentially growing data generated from diverse sources,
including IoT sensors, social media, financial transactions,
and smart devices, to derive actionable intelligence through
advanced analytic techniques
Examples of data analysis software
Altair One Amazon QuickSight Cognos
Analytics
Alteryx Platform Domo Power BI
Key Principles and Methods
Big data analysis involves several key principles and methods to
uncover insights and patterns within an organization's data. These
methods include:
Descriptive Analytics: This method focuses on summarizing and
describing past data to understand its basic characteristics. It
answers the "what happened" question.
Diagnostic Analytics: This method delves deep into the data to
identify the root patterns and trends observed in descriptive
analytics. It answers the "why it happened" question.
Predictive Analytics: This method uses historical data, statistical
modeling, and machine learning to forecast trends. It answers the
"what will happen" question.
Prescriptive Analytics: This method goes beyond prediction to
provide recommendations for optimizing future actions based on
insights derived from all previous analyses. It answers the "what
to do" question.
Characteristics of Big data
Big data is characterized by the following five dimensions, which highlight
the core challenges and opportunities inherent in big data analytics:
Volume: The sheer volume of data generated today presents a significant
challenge. Big data technologies and cloud-based storage solutions enable
organizations to store and manage these vast data sets cost-effectively.
Velocity: Data is being produced at unprecedented speeds, requiring robust
processing capabilities to capture, process, and deliver accurate analysis in
near real-time.
Variety: Today's data comes in many formats, from structured to
unstructured text, video, and images. Flexible data management systems
are needed to handle and integrate disparate data types for comprehensive
analysis.
Veracity: Data reliability and accuracy are critical. Techniques and tools
for data cleaning, validation, and verification are integral to ensuring the
integrity of big data.
Value: Big data analytics aims to extract actionable insights that offer
tangible value, transforming raw data into strategic assets
Big data sources
There are two types of big data sources: internal and external ones. Data
is internal if a company generates, owns and controls it. External data
is public data or the data generated outside the company;
correspondingly, the company neither owns nor controls it.
E.g
Climate information data collected from IOT based Sensors
Digital Pictures (Pinterest)
Digital Audio (Spotify, Pandora, Apple Music, Amazon Music)
Digital videos (Netflix, HBO Max, Hulu, Disney)
Social Media (Facebook, Instagram, Pinterest, Snapchat, YouTube,
WhatsApp)
Retail Stores and E-Commerce Websites (Amazon, Target, Walmart,
Costco, Etsy, Wayfair)
Financial transaction records (Invoices, E-receipts)
Cell phone GPS (Global Positioning System) signals data
Categories of source of Big Data
1. Easy Access
You may simply get the necessary information right away,
in real time, from wherever you are.
All you need is an internet connection and a smart device.
2. Quick operation
You can finish many tasks very quickly because of the
inflow of data.
3. Monitoring Data
Keeping track of product expiration dates also increases
your safety.
4.Cost Saving
It helps people save money and energy.
Limitations of IOT
1. Dependency on Technology
The internet connection is the key requirement for IoT.
So, it is useless if the Internet is absent.
2. Security
A lot of information is available on the Internet as it
connects to all household appliances, industrial
equipment, and public sector services.
Thus, hackers can attack this data to get private
information and the results would be terrible.
3. Inter Compatibility
Many times, equipment from different manufacturers
connects.
The solution to this drawback is for the manufacturers to
create a shared standard. But there is a chance that the
technical issues could still exist.
How Does IOT Work?
I. Smart Agriculture
II. Smart Home
III. Smart Vehicles
IV. Smart Healthcare
V. Smart Cities
VI. Maintenance management
VII. Smart outlets
Smart Agriculture:- This can be done by first collecting data
for a farm such as soil quality, sunlight levels, seed type, and
rainfall density from various sources like farm sensors,
satellites, local weather stations from various sources like
farm sensors, satellites, local weather stations, etc.
Smart Home:- connecting all the home applications like
lighting, air conditioners, locks, thermostat, etc.
Smart Vehicles:- Smart vehicles or self-driving cars are Iot
applications as they can be called are pretty dependent on IoT.
These cars have a lot of features that are integrated with
each other and need to communicate such as the sensors that
handle navigation, various antennas, controls for speeding or
slowing down, etc.
Tesla Motors’ cars use the latest advancements in Artificial
Intelligence and the Internet of Things.
Smart Healthcare:- the Healthcare Industry where doctors can
monitor patients remotely through a web of interconnected devices.
One of the most common uses of IoT applications in healthcare is
using robots. These include surgical robots that can help doctors in
performing surgeries more efficiently with higher precision and
control.
There are also disinfectant robots that can clean surfaces quickly
and thoroughly using high-intensity ultraviolet light.
Smart Cities:-Smart City-Traffic Management, Waste management,
and Water Distribution.
Supply chain:- Real-time goods tracking and getting inventory
information.
Connect Health:-Patient care, calorie expenditure, heart rate
pattern, temperature, activity levels.
Connected cars:-Automobile companies can automatically
perform billing, insurance, parking.
Maintenance management
One of the areas where the application of IoT technology is most
extensive is precisely maintenance management. Through the
combination of sensors and software specialized in CMMS/
EAM maintenance management
The software in charge of processing and arranging
the data collected by the sensors are designed to
specifically address the maintenance management
needs of physical assets, their application is almost
unlimited.
The real-time monitoring of physical assets allows
determining when a measurement is out of range and
it is necessary to perform condition-based
maintenance (CBM), or even applying Artificial
Intelligence (AI) algorithms such as Machine
Learning or Deep Learning to predict the failure
before it happens.
Smart outlets
Turning a device on/off remotely, tracking the
energy levels of a device, etc. Generally, IoT
affects many areas of day-to-day life and many
social and technical issues can be solved by
using the applications of IoT.