Internet of things the salesforce lego machine cloud
Download as PPTX, PDF3 likes1,405 views
This document discusses building a "Machine Cloud" using the Salesforce platform to control Lego Mindstorms EV3 robots. It describes the requirements for connecting devices to Salesforce APIs, including the ability to connect to WiFi and parse XML/JSON. It demonstrates pairing an EV3 robot in Salesforce by generating an OAuth token, and controlling robots through custom objects and the Streaming API. Code examples are provided for moving robots and listening for commands. Further developing the Machine Cloud API and supporting other devices is suggested.
Internet of things the salesforce lego machine cloud
- 1. Internet of Things - The Salesforce Lego Machine Cloud Andrew Fawcett FinancialForce.com, CTO @andyinthecloud
- 3. About FinancialForce.com âą San Francisco Headquarters âą Harrogate, UK âą Granada, Spain âą Toronto, Canada âą Manchester, US âą Opening Sydney, AUS in Sept, 2014 âą 350+ Employees âą 400+ by 12/31/2014 âą Customers in 31 countries âą 80% Y-o-Y revenue growth âą Advent commitment of $50 million
- 4. Session Resources âą Follow the Session in the Dreamforce App, I will share this slide deck and other related links on the Feed âą Be social and feel free to ask follow up questions! ï
- 5. Introduction âą What are the device requirements? âą How intelligent does the device need to be? âą What is a Machine Cloud? âą Building a Machine Cloud with Salesforce1 Platform âą Demos âą How to make your own Machine Cloud with with Lego Mindstorms EV3
- 6. What does a Device need to call the Salesforce APIâs? âą Ability to connect to a local internet gateway â e.g. phone or other computer connected to Internet âą Ability to connect direct to Internet â SSL support ideally, though non-SSL end points proxies can be used âą Ability to parse XML or JSON â String manipulation or ideally JSON or XML parsers âą Ability to consume Java libraries â Ideally Salesforce Web Service Connector Basic Capabilities, limited RAM/CPU Advanced Capabilities e.g. running OSâs
- 7. What does a Device need to call the Salesforce APIâs? âą Common runtime language â Such as Java! âą Oracle port to ARMv5 process running on Lego Mindstorms EV3 âą Community Java runtime known as Lejos for Lego Mindstorms NXT
- 8. How intelligent should the device be? âą Processing power and storage can vary â Depends on sensor input and output demands â Cloud based logic can be used via HTTPS communications â HTTPS communications âą Streaming communications vs Polling âą Ability to connect locally to the device is useful â Lego Mindstorms EV3 runs a Lego variation of Linux â Can TELNET to it and execute Unix commands â Java Remote Debug is also possible
- 9. LEGO Mindstorms EV3 Programmable Brick Feature Spec Display Monochrome LCD 178 x 128 pixels Operating System Linux based Main Processor 300 MH Texas Instruments Sitara AM11808 (ARM9 core) Main Memory 64 MB RAM, 16 MB Flash USB Host Port Yes WiFi Yes via USB Dongle Bluetooth Yes
- 10. What is a Machine Cloud? âą A single place for machines to communicate and share information âą Machines can communicate to us and other machines across the world âą Can be used to store data âą Can perform calculations on behalf of devices, with access to more information, also easier maintenance and updates to software
- 11. Introducing a Machine Cloud built with Salesforce1 Platform Salesforce1 Mobile Custom Objects REST and Streaming APIâs Connected Applications
- 12. Controlling Machines through Custom Objects #clicksnotcode
- 13. Controlling Machines through Custom Objects #clicksnotcode
- 14. Demo : Pairing Pairing Mindstorm EV3 Robots to our Machine Cloud and sending commands
- 15. Ok so what just happened under the hood? Salesforce Streaming and REST APIEV3 #1 ev3force.jar Heroku Connected App EV3 Pairing REST API EV3 #2 ev3force.jar Custom Objects Commands Commands Pairing Pairing
- 16. You want to go further under the hood? Salesforce Streaming and REST API Heroku Connected App EV3 Pairing REST API EV3 2. Get Pin 3. Wait for PIN Entry and receive oAuth Token 4. User Enters PIN, oAuth Token is passed /ev3force.properties 5. EV3 stores oAuth Token ev3force.jar Custom Objects 1. oAuth Token stored? First time ev3force.jar runs Each time ev3force.jar runs 6. Read Robot Details 7. Start Listening 8. Create Command records
- 17. Demo: Controlling a Lego Robot Moving a Robot around
- 18. Demo: Programming a Robot Pre-creating Command records and sending a Run Program command
- 19. How is it implemented?
- 20. Code: Pairing // Http commons with pairing service HttpClient httpClient = new HttpClient(); httpClient.setConnectTimeout(20 * 1000); // Connection timeout httpClient.setTimeout(120 * 1000); // Read timeout httpClient.start(); // Get a pin number ContentExchange getPin = new ContentExchange(); getPin.setMethod("GET"); getPin.setURL("https://ev3forcepairing.herokuapp.com/service/pin"); httpClient.send(getPin); getPin.waitForDone(); Map<String, Object> parsed = (Map<String, Object>) JSON.parse(getPin.getResponseContent()); // Display pin number to enter into Salesforce LCD.clear(); LCD.drawString("Pin " + parsed.get("pin"), 0, 3);
- 21. Code: Pairing // Wait for oAuth token for the given pin number while(true) { getPin = new ContentExchange(); getPin.setMethod("GET"); getPin.setURL("https://ev3forcepairing.herokuapp.com/service/pin?pin=" + pin); httpClient.send(getPin); getPin.waitForDone(); parsed = (Map<String, Object>) JSON.parse(getPin.getResponseContent()); oAuthToken = (String) parsed.get("oAuthToken"); robotId = (String) parsed.get("robotId"); serverUrl = (String) parsed.get(âserverUrl"); if(oAuthToken!=null) break; LCD.drawString("Waiting " + waitCount++, 0, 4); Delay.msDelay(1000); }
- 22. Code: Pairing <td><b>Pin:</b></td> <td> <form action="/default/pinset.jsp"> <input name="pin"/> <input type="submit" value="Pair"/> <input name=ârefreshToken" type="hidden" value="${canvasRequest.client.refreshToken}"/> <input name="recordId" type="hidden" value="${canvasRequest.context.environmentContext.record.Id}"/> </form> </td> <body> <% String pin = request.getParameter("pin"); String refreshToken = request.getParameter(ârefreshToken"); String robotId = request.getParameter("recordId"); PairingResource.setConnection(pin, refreshToken, robotId); %> Now check your EV3! </body>
- 23. Code: Listening for Commands via Streaming API // Subscribe to the 'commands' topic to listen for new Command__c records client.getChannel("/topic/commands").subscribe(new ClientSessionChannel.MessageListener() { public void onMessage(ClientSessionChannel channel, Message message) { HashMap<String, Object> data = (HashMap<String, Object>) JSON.parse(message.toString()); HashMap<String, Object> record = (HashMap<String, Object>) data.get("data"); HashMap<String, Object> sobject = (HashMap<String, Object>) record.get("sobject"); String commandName = (String) sobject.get("Name"); String command = (String) sobject.get("Command__c"); String commandParameter = (String) sobject.get("CommandParameter__c"); String programToRunId = (String) sobject.get("ProgramToRun__c"); executeCommand( commandName, command, commandParameter, programToRunId, partnerConnection); } });
- 24. Code: Moving the Robot around with Lejos import lejos.hardware.motor.Motor; public static void moveForward(int rotations) { Motor.B.rotate((180 * rotations)*1, true); Motor.C.rotate((180 * rotations)*1, true); while (Motor.B.isMoving() || Motor.C.isMoving()); Motor.B.flt(true); Motor.C.flt(true); } public static void moveBackwards(int rotations) { Motor.B.rotate((180 * rotations)*-1, true); Motor.C.rotate((180 * rotations)*-1, true); while (Motor.B.isMoving() || Motor.C.isMoving()); Motor.B.flt(true); Motor.C.flt(true); }
- 25. Building your Lego Robot âą What do I need? â Edimax EW-7811UN 150Mbps Wireless Nano USB Adapter â Micro SD Card (SDHC Only), 1GB, no greater than 32GB â Lego Mindstorms EV3 Set, Gripper Robot!
- 26. Creating your own Lego Robot Machine Cloud! âą Installation in Salesforce â Install the Machine Cloud managed package (see Readme) âą https://github.com/afawcett/legoev3-machinecloud âą Installation on Lego Mindstorms EV3 1. Install Lejos on your SDCard and install in the EV3 âą http://sourceforge.net/p/lejos/wiki/Home/ 2. Use the Lejos menu on the EV3 to connect to your Wifi 3. Copy the ev3force.jar to your EV3 Robot (from /dist folder in GitHub Repo) âą Run the /bin/ev3console UI and deploy using the Programs tab
- 27. Creating your own Lego Robot Machine Cloud! âą Connecting your Robots 1. Run the ev3force.jar application on the EV3 2. Note the PIN number shown on the EV3 Robot 3. Login to your Salesforce org and create a Robot record 4. Enter PIN number, wait for the device to connect to Salesforce 5. Send it commands and programs to run!
- 28. Further Ideas⊠⹠Expose the Machine Cloud via Salesforce Communities âą Machine Cloud API? â Perhaps we already have this? âą Using the Salesforce API to insert records to the Command__c object? ï âą Add support for other Devices? â Watches, Phones etc âą Add support for Generic Streaming API events â Events not driven by Database events but by processes
- 29. Session Resources âą Follow the Session in the Dreamforce App, I will share this slide deck and other related links on the Feed âą Be social and feel free to ask follow up questions! ï