AWS Device Farm | Testing Your App

Question 1

Can I use the device camera?

Testing Your App

AWS Device Farm | Mobile Services

Answer 1

Yes, you can use the device cameras, both front- and rear-facing. Due to the way the devices are mounted, images and videos may look dark and blurry.

Question 2

I don’t have any automated test scripts yet. What do the built-in tests do?

Testing Your App

AWS Device Farm | Mobile Services

Answer 2

The built-in compatibility test suite allows you to install, uninstall, launch, and run Fuzz on the app.

Question 3

What does Fuzz do?

Testing Your App

AWS Device Farm | Mobile Services

Answer 3

Fuzz will perform fuzz testing on your UI immediately after launch. It streams random user input (touches, swipes, keyboard input) in a rapid fashion to your app. You can configure the number of events, the delay between events, and the seed used to randomize events. Using the same seed across test runs will result in the same sequence of events.

Question 4

I test using an automation framework. Which frameworks do you support?

Testing Your App

AWS Device Farm | Mobile Services

Answer 4

For testing iOS, Android, and FireOS apps, we currently support Appium Java JUnit, Appium Java TestNG, Appium Python, Calabash, Instrumentation (Including JUnit, Espresso, Robotium, and any instrumentation-based tests), UI Automation, UI Automator, and XCTest (Including XCUI and KIF). For more information and updated list, visit our documentation.

Question 5

Which test frameworks do you support for web applications?

Testing Your App

AWS Device Farm | Mobile Services

Answer 5

You can run tests written in Appium Java JUnit, Appium Java TestNG, or Appium Python.

Question 6

Can you add support for a modified framework or one I designed myself?

Testing Your App

AWS Device Farm | Mobile Services

Answer 6

We’re always evaluating frameworks to support. Please contact us.

Question 7

How does AWS Device Farm decide when to take a screenshot during a test?

Testing Your App

AWS Device Farm | Mobile Services

Answer 7

If you use one of the supported automation frameworks, you are in full control and can decide when to take screenshots. Those screenshots are included in your reports automatically.

Question 8

Android: Is Google Play Services available on your devices? Which version is installed?

Testing Your App

AWS Device Farm | Mobile Services

Answer 8

Yes, Google Play Services is installed on devices that support it. The services are updated as new versions become available.

Question 9

Android: Is there a default Google account on the devices?

Testing Your App

AWS Device Farm | Mobile Services

Answer 9

No, devices do not have an active Google account.

Question 10

Does AWS Device Farm support record and playback automation or do I have to write my scripts?

Testing Your App

AWS Device Farm | Mobile Services

Answer 10

AWS Device Farm supports frameworks like Espresso and Robotium that have record and playback scripting tools.

Question 11

iOS: Do I need to add your UDIDs to my provisioning profile?

Testing Your App

AWS Device Farm | Mobile Services

Answer 11

No, AWS Device Farm will automatically replace a provisioning profile and resign your app so it can be deployed on our devices.

Question 12

iOS: My app does not contain debug symbols. Can I supply a dSYM file to AWS Device Farm?

Testing Your App

AWS Device Farm | Mobile Services

Answer 12

No, but you can download the logs and symbolicate the stack traces locally.

Question 13

Android: My app is obfuscated. Can I still test my app on AWS Device Farm?

Testing Your App

AWS Device Farm | Mobile Services

Answer 13

Yes, if you use ProGuard. If you use DexGuard with anti-piracy measures, we are unable to re-sign the app and run tests against it.

Question 14

My app serves ads. Will they be displayed on your devices? Will my ad provider flag this as abuse and ban my account?

Testing Your App

AWS Device Farm | Mobile Services

Answer 14

Although devices have access to the Internet, we make no guarantee that ads will be displayed. We recommend that you remove ads from the builds tested on AWS Device Farm.

Question 15

Can I access the machine hosting the device or access its shell as part of my tests? Can I reach the Internet from it?

Testing Your App

AWS Device Farm | Mobile Services

Answer 15

Yes. If you’re using a client-server framework like Calabash, Appium, or UI Automation, you can access the Internet and execute limited shell commands from the host.

Question 16

I’d like to supply media or other data for my app to consume. How do I do that?

Testing Your App

AWS Device Farm | Mobile Services

Answer 16

You can provide a .zip archive up to 4 GB in size. On Android, it will be extracted to the root of external memory; on iOS, to your app’s sandbox. For Android expansion files (OBB), we will automatically place the file into the location appropriate to the OS version. For more information, see the Developer Guide.

Question 17

My app requires dependencies to test all functionality. Can I install other apps?

Testing Your App

AWS Device Farm | Mobile Services

Answer 17

Yes, you can select multiple apps and the order in which to install them. These dependent apps will be installed before your tests begin.

Question 18

Can I test upgrade flows for my app? How do I install an old version of my app?

Testing Your App

AWS Device Farm | Mobile Services

Answer 18

Yes, in order to test your upgrade flow, you can upload and install an old version of your app before the new version is installed and tested.

Question 19

My app makes use of location services. Can I specify the physical location of the device?

Testing Your App

AWS Device Farm | Mobile Services

Answer 19

Yes, you can supply latitude and longitude coordinates that will be used to override a device’s GPS.

Question 20

Can I run localization tests? How do I change the language of the device?

Testing Your App

AWS Device Farm | Mobile Services

Answer 20

Yes, you can provide a locale (for example, “en_US”) to override the default locale setting on a device.

Question 21

How long does it take before my test starts?

Testing Your App

AWS Device Farm | Mobile Services

Answer 21

Tests are immediately queued for execution and usually start within minutes. If one or more devices are not available, test execution for those devices will remain queued until they become available. Testing on the other devices in your test run will continue.

Question 22

What is the maximum test time allowed?

Testing Your App

AWS Device Farm | Mobile Services

Answer 22

The maximum time allowed is 60 minutes. If you need a longer timeout, please contact us.