Testing Connected Devices Flashcards
What expectations do users have for their mobile devices?
Users have expectations that their mobile applications and IoT devices will “just work”.
What type of device is considered capable of joining IoT?
Any device capable of supporting an internet enabled component
What issue is occurring as the tech industry leaps forward?
Backward compatibility is receiving less emphasis, but more is needed; users do not want to be forced to upgrade to take advantage of new applications and features.
How can testers provide good device test coverage when a high volume of devices currently exists?
They can select a representative sample set
What tools can be used to test for multiple devices? List and define.
- Simulators: provide a standard response to various inputs and “simulate” the interaction with a real device
- Emulators: these go one step further than simulators and “emulate” the responses of the hardware device as well as the software
What is one of the most difficult aspects of connected device testing? Why?
Defining users’ expectations; user group may be large and expectations vary dramatically, even with targeted users
What are six characteristics of note for connected devices?
- Usability
- Performance
- Security
- Interoperability
- Accuracy
- Reliability
In terms of characteristics of connected devices, describe usability.
Users expect software to be attractive, inviting, easy to use, easy to understand, and enjoyable
In terms of characteristics of connected devices, describe performance. What is an important variable to consider?
The criteria for performance tends to be loosely defined, often identified when a product does not meet expectations.
Important variable to consider is lack of connectivity; a product cannot control the quality of the connection, but it can control the response when the connection is poor.
In terms of characteristics of connected devices, describe security.
Connected devices have unique security risks, such as public Wi-Fi hotspots and devices becoming lost or stolen.
In terms of characteristics of connected devices, what does interoperability include? What does this result in, and what determines a device’s interoperability?
Generally includes:
- the portability of an application to different devices
- the ability of an application to interoperate with other software
- the compatibility of the software across different browsers and OS’s
Results in a nearly infinite number of combinations. The architecture of the product determines its interoperability capabilities.
In terms of characteristics of connected devices, describe accuracy. How is accuracy ensured?
Targets the ability of the software to provide accurate results for a given set of inputs. Accuracy is ensured by testing in safety-critical environments.
In terms of characteristics of connected devices, specifically test environments, describe reliability. How is reliability tested into an application?
Testing environments must be representative and stable and requires time since reliability tests determine the mean time between failure (MTBF).
Reliability cannot be tested into an application—it must be built in.
Reliability assurance is a ____________ activity, not a ___________ activity.
Development;testing
What is lightweight testing?
Involves a whole team approach that helps everyone review and understand requirements from the beginning and to revisit and validate fulfillment requirements throughout development
