DATA MIGRATION PROJECT – ON PREM TO AZURE
CLOUD
Architecture Diagram
Steps Involved -
1. MySQL On-Premises Data
2. Azure Data Factory Creation
3. Azure SQL Database Creation
4. Creating Linked Services
5. Creation of Pipeline
6. Run the Pipeline
7. End-to-End Testing
Creation of Azure Data Factory:
Step1: Create Data factories in red colour box
Step 2: Create Data factories in red colour box
Step 3: Fill the form accordingly and click on next
Step 4: Check the Configure Git Later box and click next
Step 5: Keep the options as-is and click next
Step 6: Keep the options as-is and click next
Step 7: Keep the options as-is and click next
Step 8: Now validation completed and click on create
Step 9: Now Deployment in-progress
Step 10: Now deployment completed and click on Go to resource.
Step 11: Now you’ll be see this and click on Launch studio.
Step 12: Now you’ll be able see the UI of ADF.
Creation of Azure SQL Database:
Step 1: Click on SQL Databases
Step 2: Click on Create SQL database
Step 3: Fill the form accordingly and Click on Create New server
Step 4: Fill the form and click ok
Step 5: Fill the remaining portion of step 2 and click next
Step 6: Select Public-end point and select Yes and then click on next
Step 7: Keep this page as-is and click on next.
Step 8: Keep this page as-is and click on next.
Step 9: Keep this page as-is and click on review+create.
Step 10: Now click on create
Step 11: Deployment is in progress
Step 12: Deployment succeeded and click on Go to resource
Step 13: Now you are able to view SQL Database UI and click on Query editor
Step 14: Now enter your credentials and click on OK
Step 15: Now you are able to view SQL Database Editor.
Now we can start the process of implementing the process of
migration
Step 1: Click on pencil icon
Step 2: After clicking Pencil Icon Now you click on Pipelines and click on New pipeline
Step 3: Click on dropdown of Move and Transform then drag the Copy data into canvas
Step 4: Now click on Source followed by New
Step 5: After clicking on new it’ll show like this now click on Database
Step 6: Scroll down and choose MySQL and click continue
Step 7: Keep a proper name and click on drop down and create new linked service
Step 8: Now you’ll be see this screen, click on Connect via integration runtime dropdown
and click new
Step 9: Select Sel-Hosted integration runtime setup and click continue
Step 10: Put proper name and click on Create
Step 11: Now Click on download and install integration runtime software
Step 12: After clicking on it now you will see this screen and click on download.
Step 13: Select proper version and click on download
Step 14: Software download is in progress
Step 15: Download completed
Step 16: Now install the software by clicking next
Step 17: Select check box and click next
Step 18: Again, click next
Step 19: Now click on Install
Step 20: Now installation is in progress
Step 21: Now installation completed and click on Finish
Step 22: After clicking finish then it will open like this.
Step 23: Now navigate to ADF tab and copy the code
Step 24: Paste that key in the box and click on register
Step 25: Now click on Finish
Step 26: After clicking on Finish then click Launch Configuration manager
Step 27: Now navigate to ADF tab and click close
Step 28: Now select selfhosted integration run time.
Step 29: After filling the form Click on test connection
Step 30: Once test connection successful click on Create
Step 31: select any one of table and click ok
Step 32: Now click on Preview Data to view the sample data
Step 33: Now you will be able to view the sample data
Step 34: Now close the sample data and click on sink followed by click on New
Step 35: Now select Azure SQL Database and click on Continue
Step 36: Give proper name and Click on Dropdown of linked service and select new.
Step 37: Fill the form and click on Test Connection
Step 38: Test Connection successful and now click on Create
Step 39: Give proper table name and Click Ok
Step 40: Select Auto Create Table the click on Publish all
Step 41: After clicking on Publish now click on Publish
Step 42: Published successfully
Step 43: Add trigger-> Trigger now
Step 44: Click on ok
Step 45: Pipeline running and click on View pipeline to view the status
Step 46: Pipeline run succeeded
Step 47: Now navigate to Azure SQL Database editor tab. You’ll be able to view the table
which was in on-prem moved to Cloud.
Step 48: Now click on table … and select Top 1000 rows
Step 49: Now you’ll be able to view the data in table
