Team 2013 Weekly Presentation #2 10/6/2019 - 10/12/2019
Progress ● Submitted Problem Statement on September 30th Beginning research on IoT testing/verification (in general terms) ● ● Meeting with sponsor to answer questions from last week ● Research on specific IoT testing methods
The Problem ● Many IoT devices - need one way to test them ● Focus on HVAC ● System composed of ○ Machine - sensors push data to cloud through a gateway ○ Cloud - stores/analyzes data ○ Interface - usually mobile/web app to monitor data and/or control machine (actuators) ● Our focus: end-to-end communication Carrier Wi-Fi thermostat between gateway and interface
Simple IoT Architecture
Heat Pump Types of HVAC Systems ● Heat Pump Rooftop Unit ● ● Water Source Heat Pump ● Packaged HVAC ● Split System HVAC Ductless System ●
Technologies Used in IoT ● RFID - uses radio frequency NFC - mostly used in mobile devices ● ● Bluetooth - close range wireless comm RFID ● Z-Wave - low power RF tech. Mainly used for home automation (lamp controlling, etc.) Wi-Fi - most common in IoT ● ● 2G/3G/4G/5G ● Others
Goals of IoT Verification/Testing ● Performance - speed of data transfer Scalability/Reliability - how scalable and reliable is the system ● ● Cost/time reduction ● Automation - testing process should do most of the work ● Compatibility - process should apply to many different devices
Types of IoT Testing ● Usability: How useful is the device? Can it provide the necessary data? Compatibility: Many devices, different hardware/software ● ● Reliability and scalability: Simulations to ensure reliability and scalability of device. Can we add more devices to the system? ● Data integrity: Lots of data, needs to be verified Security: Many users accessing lots of data, need authentication (passwords, ● encryption, etc.) ● Performance: Speed of acquiring/transferring data
Gray Box Testing ● Probably used in this project Develop test cases for a system that is only partially understood ● ○ Might know how the systems interact with each other, but not sure how each system works ○ Info, documentation, source code are limited
Challenges to Consider ● Complexity of hardware-network-software mesh Device interaction in real time ● ○ security, backward compatibility, upgrade issues ● Real-time data testing Many different UIs ● ● Network availability/strength/etc
Sponsor Tasks so Far... ● Research and/or develop various IoT testing/verification methods and reference IoT architectures ○ In practice (used by companies) ○ Theoretical (method exists, but no practical application) ○ Created by us ● Focus on gateway-cloud-application interaction Verification goals: Performance analysis and data integrity ● ○ E.g. Changing temperature on app - How long until this change takes effect on the thermostat? How long until this is reflected on app? ○ Need a way to automatically verify data in system ■ To accomplish these, need access to data on both gateway and interface/app ○ Start with simple system (1 app, 1 device), then move to more complex ● Deliverables As defined in Carrier project statement ○
Possible Testing Methods/Tools ● Check network latency (e.g. ping command in cmd) Wireshark ● ○ Free and open-source software for analyzing packets sent over the internet (data integrity and transfer speeds) ● Build small IoT systems and run simulations (IoTIFY) IoTIFY process
Example of IoT Testing Architecture ● In this system the main testing features were ○ Interoperability ○ Conformance ○ Semantics Validation
What to Do Next... ● Figure out: Technologies that Carrier uses for IoT ○ ○ How these systems interact with each other What tools can be used ○ ● Ask for a model ● Find out which verification goals we should focus on Define a reference IoT architecture (focus on HVAC) ● ● Get answers to questions in problem statement
References 1. https://www.guru99.com/iot-testing-challenges-tools.html 2. https://www.softwaretestinghelp.com/internet-of-things-iot-testing/ 3. https://www.buildings.com/news/industry-news/articleid/21020/title/drive-hvac- efficiency-with-internet-of-things-functionality 4. https://www.propmodo.com/how-iot-is-taking-over-the-hvac-industry/ 5. http://twentyonecelsius.com.au/blog/everything-you-need-to-know-about-hvac- systems/ 6. https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=8281514
Recommend
More recommend
