Software Engineering Week 15-16

Question 1

it is not a single process or tool, it’s a collection of tool and process working together to automate the manual process.

This uses various libraries, test
data and various reusable modules to automate the manual process to save the time of the tester. It is a set of rules which is used for creating and designing test cases.

Answer 1

Automation testing framework

Question 2

This term refers to lowering of human involvement in various processes and doing the same process automatically with less human involvement.

It is the process of automating repetitive processes of users to make the work efficient which saves a lot of time.

Answer 2

Automation

Question 3

This not only offers the benefit of reusing the code which saves a lot of time but it also help others to write the code in a standard format. Hence, this framework handles
all the issues which occur while running the test.

It is also useful when users want to repeat the same process using test scripts whenever it is required to test on multiple browsers at the same time.

Answer 3

Test Automation Framework

Question 4

This framework is based on the concept of record and playback mode that is always achieved in a linear manner.

This framework mostly used for testing on the
small applications in which step are written in a sequential order.

Answer 4

Linear Scripting Framework

Question 5

This break down test cases into small modules.

There, the modules are independently tested first and then the application is tested as a whole which makes each test independent.

Answer 5

Modular Testing Framework

Question 6

In this testing framework, a separate file in a tabular format is used to store both the input and expected output results.

A driver script where all test cases are called can execute all the test cases with multiple sets of data. This driver script contains navigation that spreads through the program which covers both reading of data files and logging of test status information.

Answer 6

Data Driven Testing Framework

Question 7

This framework separates script logic from test data, then stores the data externally. After that, it stores the keywords in a different location.

Since user can use the same keyword across different test scripts which re-uses the code.

Answer 7

Keyword Driven Testing Framework

Question 8

This framework improves the weaknesses of different test frameworks. It is a combination of many types of end-to-end testing approaches which uses the advantages of other frameworks.

Answer 8

Hybrid Testing Framework

Question 9

This is an approach in which test cases are developed to specify and validate what will the code do. It starts with designing part and develop test cases for small functionalities for your application, which instructs developers to write code if previous script fails.

Answer 9

Test Driven Development Framework (TDD)

Question 10

This has been derived from the TDD approach and in this method tests are more focused and are based on the system behaviour. Testers can create test
cases in simple English language which helps even the non-technical people to easily analyse and understand the tests.

Answer 10

Behaviour Driven Development Framework (BDD)

Question 11

Test framework helps in making the best use of resources, it does this by making
the process easier with use of different resources according to organisational needs.

Answer 11

Optimisation of Resources

Question 12

Test automation frameworks increase the volume of testing by perform test on
many devices as it’s not possible to perform manual testing on all devices.

Answer 12

Increased Volume of Testing

Question 13

Test automation frameworks enable simultaneous testing on different types of devices.

When test scripts are automated, than testers can perform the script on other devices at the same time.

Answer 13

Simultaneous Testing

Question 14

Performing different test cases manually can be very time consuming so
instead of it we can run all the test cases from our script in very less time.

Answer 14

Enhanced Speed and Reliability

Question 15

An automation script minimises the time taken to prepare and run tests. With
increased efficiency and speed, we can gain more output in less time.

Answer 15

More Output in Less Time

Question 16

Test automation framework helps in fixing bugs at an early stage which don’t
need much manpower to carry which saves time and expenses of the organisation.

Answer 16

Fixing Bugs at an Early Stage

Question 17

With a test automation framework, you don’t need to see all test cases, you can run the test cases and come back later and view the result. User doesn’t need to be present at execution time physically.

Answer 17

Remote Testing

Question 18

You can use your automation script in any of your other application or website
which has same functionality which increase the code re-usability.

Answer 18

Reusable Automation Code

Question 19

QA automation assumes using tools to automatically review, assess, and validate a software product against the set
requirements for code quality, functionality (business logic), and user experience.

Answer 19

Building Automation Frameworks

Question 20

This testing allows you to improve software testing speed without compromising its quality. A
purpose-built automated testing framework can help you test all the nooks and crannies of your product and ensure
end-to-end tests coverage for different usage scenarios.

Answer 20

Automated software testing

Question 21

This framework is a collection of rules, tools, and processes your organization uses to perform
comprehensive QA at different stages of your software development lifecycle.

Answer 21

Test automation framework

Question 22

Quality assurance is a multi-faceted activity. You can probe newly built software from different angles to ensure it works like it was meant to and has no critical bugs or vulnerabilities.

Answer 22

How to Build a Test Automation Framework Step-by-Step

1. Determine The Optimal Test Automation Framework Architecture

Question 23

Design a Reference Test Automation Framework

Conceptually, all QA automation frameworks have four layers:

Answer 23

Test generation

Test definition

Test execution

Test adaptation

Question 24

The test generation layer sets the baseline for subsequent QA automation. Your goal here is to formalize your main
test types, design manual tests, and set up test data capture and generation to support the selected QA scenarios.

Answer 24

Test Generation Layer

Question 25

Components (and supporting tools) of Test Generation Layer are used to:

Answer 25

Edit and navigate test suite structures Align test cases to test objectives (or SUT requirements) Document the test design

Question 26

At this stage, you need to analyze the available test data and match it to the planned test cases. Then begin designing test scripts for the approved use cases. The components (and supporting tools) of this layer are used to: Partition (constrain), parameterize, or instantiate test data Document the test data, test cases, and/or test procedures

Answer 26

Test Definition Layer

Question 27

With all the prep work done, you are ready to move to actual QA work. This part of a test framework includes all the tools you need to run, log, and report on automated test case execution.

Answer 27

Test Execution Layer

Question 28

A robust test execution layer provides the following capabilities:

Answer 28

Auto-set up and tear down of the SUT for test execution (i.e. set of test cases including test data) Rapid configuration and parameterization of the test setup Interpretation of both test data and test cases and subsequent transformation of them into executable scripts SUT response validation (i.e. comparison of expected and actual results) for reporting Precise control and proper timing for automated test execution

Question 29

As mentioned earlier, a testing automation framework is a combination of processes and tools. The previous section described the process layout. Now let’s focus on the QA automation tools.

Answer 29

Decide on Your Test Automation Tech Stack

Question 30

community-developed and supported software you can use without any license purchases. There are no constraints for customization.

Answer 30

Open-source

Question 31

licensed software, offering access to a rich set of native functionality out of the box.

Answer 31

Proprietary tools

Question 32

any combination of the above two options within your AQA framework.

Answer 32

Custom solutions

Question 33

When deciding on your QA automation stack, you should always take into account:

Answer 33

Programming languages (most QA tools are language-specific) Operating systems (your testers are using) Platform support (web, mobile, tablet, etc) Some of the automated testing tools we recommend at Edvantis are:

Question 34

cross-browser web testing framework

Answer 34

Selenium WebDriver

Question 35

end-to-end JavaScript testing framework

Answer 35

Cypress

Question 36

open-source desktop automation testing framework

Answer 36

WinAppDriver

Question 37

After you’ve selected your test framework, you need to decide on the implementation approach. To better illustrate different paths to implementation, we’ll use Selenium.

Answer 37

Decide on Your Path to Implementation

Question 38

Similar to other QA automation tools, Selenium supports several test design patterns:

Answer 38

Wrapper methods: In software engineering, a wrapper is a method of encapsulation. Essentially, you create a custom variant of executing a certain function because the original one doesn’t meet all your requirements (e.g. it is too complex to execute or doesn’t perform all aspects of testing you need). Then add this wrapper into your framework. Abstraction methods: Abstraction is a technique software engineers use to hide unnecessary details from the users. In test frameworks, abstracting certain functionalities promotes better code structure and maintainability. Page Object method: This is the most commonly used method for organizing test cases. Here you denote each web page of an app as a class file — such that contains only all corresponding web page elements. Then perform tests on these elements. Doing so reduces code duplication and improves test maintenance.

Question 39

Automated testing is heavily-reliant on data. The more data you have — the better outcomes you’ll gain. However, when you are doing QA at the pre-production stages, you may be lacking meaningful first-hand data to cover all testing scenarios. Therefore, consider extra test data generations strategies such as: Synthetic data from automated data generation tools Mass copy of data from production to testing environment Mass copy of test data from legacy systems Manual test data creation

Answer 39

Develop Test Data

Question 40

In software engineering, a wrapper is a method of encapsulation. Essentially, you create a custom variant of executing a certain function because the original one doesn’t meet all your requirements (e.g. it is too complex to execute or doesn’t perform all aspects of testing you need). Then add this wrapper into your framework.

Answer 40

Wrapper methods

Question 41

is a technique software engineers use to hide unnecessary details from the users. In test frameworks, abstracting certain functionalities promotes better code structure and maintainability.

Answer 41

Abstraction methods

Question 42

This is the most commonly used method for organizing test cases. Here you denote each web page of an app as a class file — such that contains only all corresponding web page elements. Then perform tests on these elements. Doing so reduces code duplication and improves test maintenance.

Answer 42

Page Object method

Question 43

enables meaningful and effective implementation of CI/CD. Automation Testing is at the core of any CI/CD pipeline.

Answer 43

Automation Role of Automation on CI/CD

Question 44

whole concept of CI/CD revolves around:

Answer 44

build fast, test fast, fail fast.

Question 45

Test automation offers the following advantages:

Answer 45

-Reduces manual efforts when the same test must be run repetitively. This frees up more time to perform rigorous manual tests. -Gives immediate feedback. -Tests can be more accurate and cover more test cases. -Helps generate and compare multiple test results, ensuring product consistency. -Becomes an integral part of the CI/CD pipeline, abiding with its principle of build fast, fail fast.

Question 46

Many teams follow the Test Driven Development (TDD) approach. Unit tests are written by the developers and run as a part of the build phase.

Answer 46

Unit Tests

Question 47

After every commit is built and deployed onto the development environment, these tests are run to check if the newly added module/changes work well together. Some organizations have a dedicated environment to run integration tests.

Answer 47

Integration Tests

Question 48

Regression tests are run once nightly to ensure that the newly added changes do not impact the existing code. This helps make sure the day’s work is all good and gives feedback if any changes are necessary.

Answer 48

Regression Tests

Question 49

Before releasing the code to the production environment, a set of tests are run to evaluate the responsiveness and stability of the system. These tests are run on the UAT/Pre-Production environment after the code is deployed at the end of the sprint.

Answer 49

Performance and Load Tests