AWS Device Farm | Testing Your App Flashcards
Can I use the device camera?
Testing Your App
AWS Device Farm | Mobile Services
Yes, you can use the device cameras, both front- and rear-facing. Due to the way the devices are mounted, images and videos may look dark and blurry.
I don’t have any automated test scripts yet. What do the built-in tests do?
Testing Your App
AWS Device Farm | Mobile Services
The built-in compatibility test suite allows you to install, uninstall, launch, and run Fuzz on the app.
What does Fuzz do?
Testing Your App
AWS Device Farm | Mobile Services
Fuzz will perform fuzz testing on your UI immediately after launch. It streams random user input (touches, swipes, keyboard input) in a rapid fashion to your app. You can configure the number of events, the delay between events, and the seed used to randomize events. Using the same seed across test runs will result in the same sequence of events.
I test using an automation framework. Which frameworks do you support?
Testing Your App
AWS Device Farm | Mobile Services
For testing iOS, Android, and FireOS apps, we currently support Appium Java JUnit, Appium Java TestNG, Appium Python, Calabash, Instrumentation (Including JUnit, Espresso, Robotium, and any instrumentation-based tests), UI Automation, UI Automator, and XCTest (Including XCUI and KIF). For more information and updated list, visit our documentation.
Which test frameworks do you support for web applications?
Testing Your App
AWS Device Farm | Mobile Services
You can run tests written in Appium Java JUnit, Appium Java TestNG, or Appium Python.
Can you add support for a modified framework or one I designed myself?
Testing Your App
AWS Device Farm | Mobile Services
We’re always evaluating frameworks to support. Please contact us.
How does AWS Device Farm decide when to take a screenshot during a test?
Testing Your App
AWS Device Farm | Mobile Services
If you use one of the supported automation frameworks, you are in full control and can decide when to take screenshots. Those screenshots are included in your reports automatically.
Android: Is Google Play Services available on your devices? Which version is installed?
Testing Your App
AWS Device Farm | Mobile Services
Yes, Google Play Services is installed on devices that support it. The services are updated as new versions become available.
Android: Is there a default Google account on the devices?
Testing Your App
AWS Device Farm | Mobile Services
No, devices do not have an active Google account.
Does AWS Device Farm support record and playback automation or do I have to write my scripts?
Testing Your App
AWS Device Farm | Mobile Services
AWS Device Farm supports frameworks like Espresso and Robotium that have record and playback scripting tools.
iOS: Do I need to add your UDIDs to my provisioning profile?
Testing Your App
AWS Device Farm | Mobile Services
No, AWS Device Farm will automatically replace a provisioning profile and resign your app so it can be deployed on our devices.
iOS: My app does not contain debug symbols. Can I supply a dSYM file to AWS Device Farm?
Testing Your App
AWS Device Farm | Mobile Services
No, but you can download the logs and symbolicate the stack traces locally.
Android: My app is obfuscated. Can I still test my app on AWS Device Farm?
Testing Your App
AWS Device Farm | Mobile Services
Yes, if you use ProGuard. If you use DexGuard with anti-piracy measures, we are unable to re-sign the app and run tests against it.
My app serves ads. Will they be displayed on your devices? Will my ad provider flag this as abuse and ban my account?
Testing Your App
AWS Device Farm | Mobile Services
Although devices have access to the Internet, we make no guarantee that ads will be displayed. We recommend that you remove ads from the builds tested on AWS Device Farm.
Can I access the machine hosting the device or access its shell as part of my tests? Can I reach the Internet from it?
Testing Your App
AWS Device Farm | Mobile Services
Yes. If you’re using a client-server framework like Calabash, Appium, or UI Automation, you can access the Internet and execute limited shell commands from the host.
I’d like to supply media or other data for my app to consume. How do I do that?
Testing Your App
AWS Device Farm | Mobile Services
You can provide a .zip archive up to 4 GB in size. On Android, it will be extracted to the root of external memory; on iOS, to your app’s sandbox. For Android expansion files (OBB), we will automatically place the file into the location appropriate to the OS version. For more information, see the Developer Guide.
My app requires dependencies to test all functionality. Can I install other apps?
Testing Your App
AWS Device Farm | Mobile Services
Yes, you can select multiple apps and the order in which to install them. These dependent apps will be installed before your tests begin.
Can I test upgrade flows for my app? How do I install an old version of my app?
Testing Your App
AWS Device Farm | Mobile Services
Yes, in order to test your upgrade flow, you can upload and install an old version of your app before the new version is installed and tested.
My app makes use of location services. Can I specify the physical location of the device?
Testing Your App
AWS Device Farm | Mobile Services
Yes, you can supply latitude and longitude coordinates that will be used to override a device’s GPS.
Can I run localization tests? How do I change the language of the device?
Testing Your App
AWS Device Farm | Mobile Services
Yes, you can provide a locale (for example, “en_US”) to override the default locale setting on a device.
How long does it take before my test starts?
Testing Your App
AWS Device Farm | Mobile Services
Tests are immediately queued for execution and usually start within minutes. If one or more devices are not available, test execution for those devices will remain queued until they become available. Testing on the other devices in your test run will continue.
What is the maximum test time allowed?
Testing Your App
AWS Device Farm | Mobile Services
The maximum time allowed is 60 minutes. If you need a longer timeout, please contact us.
