You are currently designing the TAA of a TAS. You have been asked to adopt an approach for
automatically generating and executing test cases from a model that defines the SUT. The SUT is a state-
based and event-driven that is described by a finite-state machine and exposes its functionality via an API.
The behavior of the SUT depends on hardware and communication links that can be unreliable.
Which of the following aspects is MOST important when designing the TAA in this scenario?
A. Looking for tools that allows direct denoting of exceptions and actions depending on the SUT events.
B. Adopting a test definition strategy based on classification tree coverage for the test definition layer.
C. Looking for tools that allow performing setup and teardown of the test suites and the SUT.
D. Adopting a test definition strategy based on use case/exception case coverage for the definition layer.
Which of the following statements BEST describe aspects of the SUT to consider when designing a TAA?
A. All the interaction between SUT and TAS should be logged with the highest level of detail
B. All the internal test interfaces of the SUT should be removed prior to the product release
C. All the interface of the SUT affected by the tests should be controllable by the TAA
D. All the external test interfaces of the SUT should be removed prior to the product release
Consider a TAS that is going to be deployed for the first time. The TAS requires share resources and run it its own test environment. The infrastructure for the TAS has been created along with maintenance procedures. It is very unlikely the TAS will be required to work in other target Environments. There is a high-risk that when the TAS is deployed in its own test environment, a number of existing application will no longer work because of conflicts with the existing shared resources. Which of the following activities would you expect to be MOST effective at mitigating the risk associated with the first deployment of the TAS?
A. Testing the TAS for application compatibility issues in the target environment
B. Testing the TAS for its ability to be implemented in other target test environments.
C. Testing the TAS for regressions due to optimization that fix non-functional issues.
D. Testing the TAS for ITS ability to run a shared test environment
Consider the following example of TAS metrics.
Time to execute automated tests
Speed and efficiency of TAS components
Which of the following statements is TRUE?
A. A and B are both internal TAS metrics
B. A is an internal TAS metric and B is an external TAS metric
C. A and b are both external TAS metric
D. A is and external TAS metric and b is an internal TAS metric
Consider a TAS associated to dynamically changing software frequent releases. Your goal is to determine
the amount of effort required to maintain the automated tests of the regression test suite for each new
release of the SUT.
What is the MOST important metric to collect to achieve your goal?
A. The code coverage achieved with the automated tests, for each new release of the SUT
B. The number of automated tests which fail because of a single software defect, for each new release of the SUT
C. The time it takes to execute all the automated tests, for each new release of the SUT.
D. The number of automated tests requiring maintenance, for each new release of the SUT.
Which of the following attributes should NOT be included in a test execution report associated with a suite of automated tests?
A. Summary of the test execution results
B. System/Application under test and its version
C. Defect clusters identified during test execution
D. Environment in which the tests have been executed
Which of the following statement about the implementation of automated regression testing is FALSE?
A. When automating regression tests, the structure of automated tests must always be the same as the corresponding manual tests
B. When automating regression tests, the corresponding manual tests should have already been executed to verify they operate correctly
C. When automating regression tests, the initialization steps set the test preconditions should be automated wherever possible
D. When automating regression tests, consideration should be given to how much time would be saved by automation
A defect in a SUT has been resolved and validated by an automated defect re-test in the current release of the software. This retest has now been added to the automated regression test suite. Which statement BEST describes a reason why this defect could re-occur in future releases?
A. Automated defect confirmation testing is not effective at confirming that the resolved defect will continue to work in future releases
B. The configuration management process does not properly control the synchronization between software archives
C. The automated regression test suite is not run consistently for future releases.
D. The automated regression test suite has a narrower scope of functionality
Consider a TAS that exclusively uses the APIs of a SUT. To make this work, significant changes have been required to the SUT by adding a set of dedicated test interfaces to the APIs. All the automated tests will use these test interfaces when interacting with the SUT. Assume that you are currently verifying the correctness of the automated test environment and test tool setup. Which of the following would you expect to be the MOST specific risk associated with this scenario?
A. The connectivity from the TAS to the dedicated test interfaces will not work
B. The process of configuring the TAS will be error-phone due to manual intervention
C. The automated test cases will not contain the expected result
D. False alarms, that are unlikely to occur in the real world, will be observed during testing
Assume that you are the TAE responsible for the correct functioning of a TAS, deployed in a test environment that consists of a few machines running the same version of the operating system. The TAS has been working and stable since its deployment, it has been used to run an automated test suite consisting of many similar automated test. The infrastructure team is planning to update the operating system on these machines by installing a new the service pack for security reasons. Since the vendor of the operating system assurance full backward compatibility, the infrastructure team assurance that there will be no impacts on the functioning of the TAS. What is the BEST approach to confirm the correct functioning of the TAS in this scenario?
A. Verify the behavior of the automated tests by running a small tests, then gradually run the remaining tests to confirm the correct functioning of the whole automated test suite.
B. Make sure that the infrastructure team has completed installing the service pack on the machines where SUT is running, then run the whole automated test suite to verify its behavior
C. Verify the behavior of the whole automated test suite by running all the automated tests
D. Do not run any tests because you can immediately confirm the correct functioning of the automated test suite
