KUMPULAN 31

IoT BASED OBJECT COUNTING AND COLOUR DETECTION

Norafiqah Nazirah binti Jailani, Noor Farhana binti Md Husin, Nor Farisha Diana
binti Rosli,
Muhammad Shukri bin Ahmad

Centre of Diploma Studies (CeDS),

Department of Electrical Engineering,
Universiti Tun Hussein Onn Malaysia, Campus Pagoh, Pagoh-Muar,
84600 Johor, Malaysia.

1.0 INTRODUCTION

The Industry 4.0 knows as fourth industrial evolution is an integrated system

that combines robotic control, big data analysis and automation tools. It helps
collecting data from machines or devices and further integrate it with the
digital services. To achieve aim of Industry 4.0, it requires qualified personnel
in the future and thus need to be nurtured starting from school to make
student interested in STEM. This project is one of the methods to attract
passion and participation of student in developing the 4.0 technology industry.
With this project, student will get some knowledge and they can image to
make something new based on the system and some component in this
project.

2.0 BACKGROUND STUDY

In recent years, knowledge in technology is the most important things to

learn, especially for children and teenagers who will face Industrial Revolution
4.0. According to the previous Higher Education Minister Datuk Seri Idris
Jusoh, universities must be prepared to adapt and change their curriculum to
be able fill in the job. Ways to prepared to this revolution, a lot of innovation
related to the industry must be exposed to the student. This also related to
national mission on five-year strategic plan for science, technology,
engineering and math education, STEM.

Student in school nowadays are still less exposed to Industry 4.0 does not
clearly related it the subject taken by the student. This problem can cause
lack of students in the field of engineering. They also cannot visualize the
concept of what they a supposed to learn based on their subject and this
leads them to stop learning about the interesting application around them.

Page | 1
 Technology on their hand but does not adequately explored.

This project is to expose student towards Industrial Revolution 4.0 in

concept of automation by creating learning kit from 3D printing and the type
of sensor device detector. This is because based on national mission on five-
year strategic plan STEM, production of learning kit will be developed more
meaningful and inspiring through things like project-based learning, robotics
clubs, and gaming workshops and anything that pushes students to identify
and solve problems using knowledge from various disciplines.

3.0 LITERATURE REVIEW

STEM education has been economically and politically gathering support in

the last decade in the United States [1] and has been utilized to promote
students' engagement in STEM fields [2]. There is an increased emphasis on
the importance of creativity and abstract reasoning in STEM education [3]. In
this sector, this project is one of the learning tools in exposing students to the
beauty of electrical engineering technology such as Arduino tools, 3D printing,
software programming, and so forth. Innovative STEM instructional practices
such as project-based learning (PBL) have increased content knowledge,
interest in STEM fields, and 21st century skill levels. In PBL classrooms,
students were more responsible for their own learning as teachers served as
facilitators of that learning

This project is based on Internet of Things (IoT). Internet of Things is a

system of interrelated computing devices, mechanical and digital machines,
object, animal or people that are provided with unique identifiers (UIDs) and
ability to transfer data over a network without requiring human-to-human or
human-to-computer interaction. There are 4 fundamental components of IoT
system which is sensor/device, connectivity, data processing and user
interface. Data from the device will save at the cloud server using wireless
communication and will transfer to user interface like a mobile phone.

In every project it requires a lot of devices and component. In each project,

comparisons of each component are important to choose the devices. In IoT
device, NodeMCU is an easy to complete Arduino project exists or any
development board that has an input output pin available. It is build based on
the mature ESP8266 technology to take advantage of the abundant
resources. Others device of IoT is ESP8266 Wi-fi module is a low-cost Wi-fi
microchip with full Internet Protocol Suits stack and microcontroller capability
but the programming of the ESP8266 is more complicated than NodeMCU.

For microcontroller, Arduino MEGA and Arduino UNO are based on

ATmega1280 datasheet. The Arduino MEGA it is had 54 digital input output
pin, 16 analog inputs and URTs. The Mega is compatible with most shields
designed. For Arduino UNO, it has 20 digital input output pin and 6 analog
input pins. The UNO has an extensive support community, which makes it is

Page | 2
 very easy way to get start working with embedded electronics.

In displaying data, the suitable devices are OLED (organic light-emitting

diode) I2C Display. OLED display based on SSD1306 OLED driver IC. OLED is
emissive electroluminescent layer is a film of organic compound that emits
light in response to an electric current. Other display device is Liquid Crystal
Display (LCD). It is a flat panel display or other electronically modulated
optical devices that use the light modulating properties of liquids crystal.

The Colour sensor is a complete colour detector. It consists of a TAOS

TCS3200 RGB sensor chip and has 4 white LEDs. It can detect and measure a
nearly limitless range of visible colours to a certain degree. Next sensor is
Infrared sensor ( IR sensor). It is an electronic sensor that measures infrared
light radiating from object in its field of view. They are most often use in PIR-
based motion detectors. The indicator is use RGB colour Module. It is an
additive colour model in which red, green and blue light are addend together
in various ways to reproduce a broad array of colour. The purpose is for the
sensing, representation and display of image in electronic system.

4.0 METHODOLOGY

In this project, we decide to use Arduino MEGA 2560 as our microcontroller,

NodeMCU for IoT devices, Arduino Serial I2C LCD 1602 Liquid Crystal Display
Module to display counter on our hardware, Infrared (IR) sensor to detect
the movement of the object and colour sensor to detect colour of the load
and Blynk app to display in IoT system.

Figure 1 : Block diagram of this project

Infrared sensor is used to detect the movement of the object and IR Led
will be on. In the same time, colour sensor will detect the colour of the load
and RGB Led will be light up depends the colour of the object. Colour sensor
only detect three colour which is red, green and blue. Every detection of the
infrared sensor and colour sensor will be sort and count the object
depending on colour detection. IoT is implemented by using NodeMCU to
collect the data and display on the smartphone. NodeMCU collect data and
send it to the local server. Local server the upload the data to the Blynk and
display it by using virtual connection.
Page | 3
 Figure 2 : Flowchart of system in this project

Blynk app is the Platform for IOS and android to control microcontroller over
the internet. It allows to create interface by using various widgets. To set up
for server, use Blynk cloud for easily handle thousands of devices and be
launched on microcontroller. Set up Blynk Libraries to enable communicates
with server and process all the incoming and outcoming commands.
Connection between Arduino MEGA, NodeMCU and others
component.
Reset
Sensor
System
NodeMCU

Reset OLED I2C

Display and
Indicator Arduino
MEGA

Infrared
OLED I2C Colour Sensor Sensor
Display

Page | 4
 Table 1 : Programming and explanation of
the coding
No Programming Explanation
.
#include <SoftwareSerial.h>
SoftwareSerial
At NodeMCU, attach library
softSerial(D9,D10);
softwareserial and declare
void setup() {
1. RX=D9 and TX=D10. softSerial
softSerial.begin(9600); }
sent to Arduino a character ‘H’
void loop(){
and start proceed the task.
softSerial.print('H');
Delay(1000); }
#include <SoftwareSerial.h>
SoftwareSerial softSerial(10,11);
At Arduino MEGA, attach
(softSerial.begin(9600);
softwareSerial library and
Void loop()
2. declare RX=10 and TX=11.
{char InChar;
softSerial receive character ‘H’
InChar = softSerial.read();
and start proceed the task.
Serial.println(InChar);
if(InChar == 'H')}
#define BLYNK_PRINT Serial
#include <ESP8266WiFi.h>
#include Including library for Blynk and
<BlynkSimpleEsp8266.h> Wi-fi connections. Enter token
3. char auth[] = fot auth and Wi-fi ssid and
"eec4aaf106134e43bfbc66aee9 password for Blynk to access
86xxxx"; Wi-fi.
char ssid[] = "Wi-fi name";
char pass[] = "password Wi-fi";

Declared for LCD in Blynk with

4. WidgetLCD lcd(V1);
mention the pin virtual for it.

int irObstaclePin = D10; Declaring the pin for IR sensor

5.
int Obstacle = HIGH; and first condition on IR sensor.

#include <SPI.h>
#include <Wire.h> Library for declaration the I2C
6.
#include <Adafruit_GFX.h> display based on SSD1306.
#include <Adafruit_SSD1306.h>

#define SCREEN_WIDTH 128

#define SCREEN_HEIGHT 32 Delaclaretion for sizing the
7. #define OLED_RESET 4 screen and the reset for I2C
Adafruit_SSD1306 LCD.
display(OLED_RESET);

Page | 5
5.0 RESULT & DISCUSSION

In this chapter, it is explained about the results that have been obtained
through some testing in this project.

Table 2 : Result
Colour
Movement Counter to Display in Blynk
Detectio
detection counting (IoT)
n
Number of R
RED (R)
detection
GREEN Number of G
Obstacle
(G) detection
Number of B
BLUE (B)
detection
No
- -
Obstacle

From Table 2, there had two conditions that movement detected obstacle or
no obstacle. When movement detected by IR sensor data achieved neither
obstacle nor no obstacle. After movement detected, colour sensor active for
colour detected. There only three colours detected which is red, green and
blue. Data of colour sensor received will continue to counter to counting
system for kept data for display at Blynk LCD Widget. If movement detected
no obstacles, automatically on-activated follow by all device also non-
activated. In both conditions, display on Blynk LCD Widget always display the
same as obstacle condition, no data being transfer or received.

Table 3 : Comparison of devices

Light Night vision Light vision ( 51-
intensity (0.01-50 lx) 100000 lx)
Speed
detection of 85% 60%
Table
colour sensor
3 is
Speed
detection of 100% 100%
IR sensor
Surrounding
Not effected Not effected
temperature
Stability of
transmit data
Stable Stable
when load is
thickness
Shinning of
Very accurate Accurate
load
explained about testing device using light vision and dark vision. In this test,
Page | 6
 the devices that used is IR sensor and colour sensor. From that table, it shows
in night vision is more affection that light vision. This is because on the night
vision, there is no disturbed of light. From both tables, it can interact student
to more interest and get more idea to create another application with this
device.

6.0 CONCLUSION

Based on the results obtained, this can help in the learning process in the
student to understand the subject STEM very well. This project can provide
additional support for interest in their education. With the results of this
project, the objective is achieved as a kit learning project can give an impact
in attracting students to understand the learning process more efficiently.

Hopefully, this project can be improved with a more concise concept in

improving learning skills. It can also be expanded towards a more successful
future.

7.0 APPENDICES

[1]M. K. Daugherty, "The Prospect of an' A' in STEM Education", Journal of

STEM Education: Innovations and Research, vol. 14, no. 2, pp. 10-15, 2013.

[2]M. Honey, G. Pearson, H. Schweingruber, STEM integration in K-12

education: Status prospects and an agenda for research., Washington, D.
C.:National Academies Press, 2014.

[3]M. H. Land, "Full STEAM ahead: the benefits of integrating the arts into
STEM", Procedia Computer Science, vol. 20, pp. 547-552, 2013

Page | 7
2