IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308
DATA MIGRATION SYSTEM IN HETEROGENEOUS DATABASE
Shashikant Patel1, Sagar Wakchaure2, Mahendra Pingale3, Saba Siraj4
1, 2, 3, 4
IOK-COE, Pune University, India
Abstract
With information becoming an increasingly valuable corporate asset, today's IT organizations need the right tools to store, manage,
and move that information in the most reliable and cost efficient manner. As part of an Information Lifecycle Management (ILM) best-
practices strategy, organizations require innovative solutions for migrating data between storage systems, especially in heterogeneous
environments.
To support this need, we as planed to design a powerful tool that enables affordable, high- performance data migration in a wide
range of storage environments. This project is the unique challenges of data migration in dynamic IT environments and the key
business advantages that we have designed to provide over traditional tools used for migration.
Keywords: - Data Migration, Database, Design.
---------------------------------------------------------------------***---------------------------------------------------------------------
1. INTRODUCTION 3. SYSTEM ARCHITECTURE
There are data migrated in the old system manually. The cost
and error ratio of these approach are relatively high.
Typically, these data are those necessary for the new system
while the old systems cannot provide.
A "Database Migrator" is usually developed for individuals
and organizations to save time for converting to a new
database if a database already exists. Instead of creating all the
tables etc. of the already existing database, one can simply use
the software to convert it into new database, if required. It can
also be used by organizations that deal with complex data
import, export and migration issues. After all, importing,
exporting or migrating data between different sources is very
complicated and time consuming especially if these data
sources store data in different formats.
Fig 1: System Architecture
2. LITERATURE REVIEW
Issues concerning the transference of data from existing Step 1 - The user is provided with the login facility. The user
databases to other applications are discussed. The process of will first enter its username and password which are encrypted
transferring data is called data migration, and it is divided into in our coding. The user’s entered information is validated.
two processes extracting data from existing systems in the
form of an extracted file, and loading data from the extracted Step 2 - The user is then asked to select the source database
file into the new application. The new application usually which is to be migrated. The source database consists of
requires data in different formats, and so transformation of Access, SQL Server and Oracle. After selecting the source
data is generally needed. Moreover, the new application database the user has to fill the details of the selected source
frequently requires data from more than one source database database to create the connection.
system, so integration of data is necessary in the migration
process. Step 3 - After the connection is tested the user is asked to
select the destination database to which the migration will take
place. After selecting the destination database the user has to
fill the details of the selected destination database to create the
connection.
__________________________________________________________________________________________
Volume: 03 Issue: 02 | Feb-2014, Available @ http://www.ijret.org 305
IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308
Step 4 - The user is asked to select the tables, columns of the 2) The next part deals with migrating Tables applying
table, views which are to be migrated. constraints such as primary key, foreign key, unique key,
index key and check constraints. Migrations of views are also
Step 5 - the user is also provided with the facility to select supported.
either the schema of the table or rows of the table along with 3) We have also provided facility for selecting and deselecting
the constraints which are applied to the tables. the fields of a table or an entire table itself for migration. The
mapping rules have been defined in an MS Access which is
Step 6 - Click start migration button to start the migration. referenced by our migrator tool to map the various data types
After the complete and successful migration of source in the process of migration. After the migration has occurred a
database to destination database it displays the status report of status report will be displayed which will indicate if the table
the complete migration process. schema is migrated, records are inserted, constraints like
primary key, foreign key, unique key, check constraints have
4. OBJECTIVES been migrated successfully or pending or failed.
1) Migration of source databases schema to the destination
7. ADVANTAGES OF PROPOSED SYSTEM
database.
2) Then follows the migration of tables to the destination Security: The application is such that it allows the
database. authorized user.
3) And then it is topped by the actual migration of data from Time efficient: Migrating every record manually
source to destination database. would take quite a lot of time but using a migration
4) To prompt the user to select the source database and tool would take the application few seconds to
destination database. Connections for source and destination migrate from the specified source to the specified
are tested. destination.
5) Tree view structure is designed to enable the user to select Flexible: The inherent nature of this application is
and deselect tables, views for migration from source structure flexible. The initial concept of data migration that we
to the target structure. have implemented on typical case of Access to Sql
6) This form will display a summary of all the selected items. can be further extended to any source database and to
User is allowed to select constraints to be applied such as any destination database.
primary key, foreign key and unique key. Interactive: The highly interactive nature of this
application ensures that minimum special training is
5. METHODOLOGY required to handle it.
In this approach, following factors that affect the Component
Selection Efforts have been proposed. 8. FUTURE WORK
Portability: This factor is defined as the ability of a Scheduling :
component to be transferred from on environment to another One can migrate the data at any time. If you want to
with little modifications, if required. migrate the data at 5 o’clock then you can set the time.
Functionality: Functionality of a component depends upon Migration can be done in small area network :
the number of functions and their properties in these functions. One can migrate the data in LAN or Wi-Fi.
Security: The primary goals of software security are the
preservation of the confidentiality, integrity, and availability
9. CONCLUSIONS
of the information assets and resources that the software
creates, stores, processes, or transmit, including the executing We know that various organizations use different type of
programs themselves databases to store their user’s information. If we want to use
the existing databases of such organizations then we have to
6. SCOPE convert the database in the format which is compactable to our
application. This database migration is achieved by database
The purpose of the project keeps the scope of project limited migration tool. A Database Migration Suite is usually
to following categories. developed for individuals and organizations to save time for
They are: converting to a new database if a database already exists. The
1) The initial part deals with conventional migration keeping purpose of our project is to migrate data from an existing
in mind i.e. we strictly adhere to the definition that the source database to another database. Our migrator tool provides
of data to be migrated is a database and the destination is also source databases as MS Access, destination databases as SQL
a database .While doing so the only part that undergoes any Server and Oracle. We also have implemented migration from
visible change is the structure of the source and destination SQL Server to Oracle and vice versa.
database while all the data, attributes, table name etc remains
unaffected..
__________________________________________________________________________________________
Volume: 03 Issue: 02 | Feb-2014, Available @ http://www.ijret.org 306
IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308
REFERENCES
[1]. Lixian Xing, Yanhong Li, "Design and application of data
migration system in heterogeneous database" in 2010
International Forum on Information Technology and
applications.
[2]. "DATA MIGRATION BEST PRACTICES" App Global
Services January 2006.
[3]. Microsoft CRM Data Migration Framework White Paper
by Parul Manek, Program Manager Published: April 2003.
[4]. Jaiwei Han, Michelinne Kamber, "Data Mining: Concepts
and Techniques."
[5]. Manjunath T.N, Ravindra S Hegadi, Ravikumar G K."A
Survey on Multimedia Data Mining and Its Relevance Today"
IJCSNS Vol. 10 No. 11-Nov 2010, pp. 165-170.
[6]. Manjunath T.N, Ravindra S Hegadi, Ravikumar G K.
"Analysis of Data Quality Aspects in at warehouse Systems",
(IJCSIT)-Jan-2011.
[7]. DATA Quality in health Care Data warehouse
Environments Robert L. Leitheiser, University of Wisconsin
Whitepaper.
[8]. Potts, William J. E., (1997), Data Mining Using SAS
Enterprise Miner Software. Cary, North Carolina: SAS
Institute.
__________________________________________________________________________________________
Volume: 03 Issue: 02 | Feb-2014, Available @ http://www.ijret.org 307
