ISTQB CT-AI Exam Dumps (V10.02) – Updated Materials for Your Certified Tester AI Testing (CT-AI) Certification Preparation

1. Which ONE of the following characteristics is the least likely to cause safety related issues for an Al system? SELECT ONE OPTION

2. An e-commerce developer built an application for automatic classification of online products in order to allow customers to select products faster. The goal is to provide more relevant products to the user based on prior purchases.

Which of the following factors is necessary for a supervised machine learning algorithm to be successful?

3. ln the near future, technology will have evolved, and Al will be able to learn multiple tasks by itself without needing to be retrained, allowing it to operate even in new environments. The cognitive abilities of Al are similar to a child of 1-2 years.’

In the above quote, which ONE of the following options is the correct name of this type of Al? SELECT ONE OPTION

4. Which ONE of the following tests is MOST likely to describe a useful test to help detect different kinds of biases in ML pipeline? SELECT ONE OPTION

5. A software component uses machine learning to recognize the digits from a scan of handwritten numbers.

In the scenario above, which type of Machine Learning (ML) is this an example of? SELECT ONE OPTION

6. In a certain coffee producing region of Colombia, there have been some severe weather storms, resulting in massive losses in production. This caused a massive drop in stock price of coffee.

Which ONE of the following types of testing SHOULD be performed for a machine learning model for stock-price prediction to detect influence of such phenomenon as above on price of coffee stock. SELECT ONE OPTION

7. Which ONE of the following options does NOT describe an Al technology related characteristic which differentiates Al test environments from other test environments? SELECT ONE OPTION

8. Which ONE of the following activities is MOST relevant when addressing the scenario where you have more than the required amount of data available for the training? SELECT ONE OPTION

9. Which of the following is a technique used in machine learning?

10. A tourist calls an airline to book a ticket and is connected with an automated system which is able to recognize speech, understand requests related to purchasing a ticket, and provide relevant travel options. When the tourist asks about the expected weather at the destination or potential impacts on operations because of the tight labor market, the only response from the automated system is, "I

don’t understand your question."

This AI system should be categorized as?

11. Which ONE of the following options does NOT describe a challenge for acquiring test data in ML systems? SELECT ONE OPTION

12. You have been developing test automation for an e-commerce system. One of the problems you are seeing is that object recognition in the GUI is having frequent failures. You have determined this is because the developers are changing the identifiers when they make code updates.

How could AI help make the automation more reliable?

13. Which ONE of the following options describes a scenario of A/B testing the LEAST? SELECT ONE OPTION

14. In a conference on artificial intelligence (Al), a speaker made the statement, "The current

implementation of Al using models which do NOT change by themselves is NOT true Al*.

Based on your understanding of Al, is this above statement CORRECT or INCORRECT and why? SELECT ONE OPTION

15. The stakeholders of a machine learning model have confirmed that they understand the objective and purpose of the model, and ensured that the proposed model aligns with their business priorities. They have also selected a framework and a machine learning model that they will be using.

What should be the next step to progress along the machine learning workflow?

16. A local business has a mail pickup/delivery robot for their office. The robot currently uses a track to move between pickup/drop-off locations. When it arrives at a destination, the robot stops to allow a human to remove or deposit mail. The office has decided to upgrade the robot to include AI capabilities that allow the robot to perform its duties without a track, without running into obstacles, and without human intervention. The test team is creating a list of new and previously established test objectives and acceptance criteria to be used in the testing of the robot upgrade.

Which of the following test objectives will test an AI quality characteristic for this system?

17. Written requirements are given in text documents, which ONE of the following options is the BEST way to generate test cases from these requirements? SELECT ONE OPTION

18. A ML engineer is trying to determine the correctness of the new open-source implementation *X", of a supervised regression algorithm implementation. R-Square is one of the functional performance metrics used to determine the quality of the model.

Which ONE of the following would be an APPROPRIATE strategy to achieve this goal? SELECT ONE OPTION

19. Pairwise testing can be used in the context of self-driving cars for controlling an explosion in the number of combinations of parameters.

Which ONE of the following options is LEAST likely to be a reason for this incredible growth of parameters? SELECT ONE OPTION

20. An engine manufacturing facility wants to apply machine learning to detect faulty bolts.

Which of the following would result in bias in the model?

21. Which ONE of the following options represents a technology MOST TYPICALLY used to implement Al? SELECT ONE OPTION

22. Which ONE of the following is the BEST option to optimize the regression test selection and prevent the regression suite from growing large? SELECT ONE OPTION

23. Which ONE of the following approaches to labelling requires the least time and effort? SELECT ONE OPTION

24. Which ONE of the following options describes the LEAST LIKELY usage of Al for detection of GUI changes due to changes in test objects? SELECT ONE OPTION

25. "Splendid Healthcare" has started developing a cancer detection system based on ML. The type of cancer they plan on detecting has 2% prevalence rate in the population of a particular geography. It is required that the model performs well for both normal and cancer patients.

Which ONE of the following combinations requires MAXIMIZATION? SELECT ONE OPTION

26. Before deployment of an AI-based system, a developer is expected to demonstrate in a test environment how decisions are made.

Which of the following characteristics does decision making fall under?

27. “BioSearch” is creating an Al model used for predicting cancer occurrence via examining X-Ray

images. The accuracy of the model in isolation has been found to be good. However, the users of the model started complaining of the poor quality of results, especially inability to detect real cancer cases, when put to practice in the diagnosis lab, leading to stopping of the usage of the model.

A testing expert was called in to find the deficiencies in the test planning which led to the above scenario.

Which ONE of the following options would you expect to MOST likely be the reason to be discovered by the test expert? SELECT ONE OPTION

28. "AllerEgo" is a product that uses sell-learning to predict the behavior of a pilot under combat situation for a variety of terrains and enemy aircraft formations. Post training the model was exposed to the real-world data and the model was found to be behaving poorly. A lot of data quality tests had been performed on the data to bring it into a shape fit for training and testing.

Which ONE of the following options is least likely to describes the possible reason for the fall in the performance, especially when considering the self-learning nature of the Al system? SELECT ONE OPTION

29. Max. Score: 2

Al-enabled medical devices are used nowadays for automating certain parts of the medical diagnostic processes. Since these are life-critical process the relevant authorities are considenng bringing about suitable certifications for these Al enabled medical devices.

This certification may involve several facets of Al testing (I - V).

I. Autonomy

II. Maintainability

III. Safety

IV. Transparency

V. Side Effects

Which ONE of the following options contains the three MOST required aspects to be satisfied for the above scenario of certification of Al enabled medical devices? SELECT ONE OPTION

30. Which ONE of the following hardware is MOST suitable for implementing Al when using ML? SELECT ONE OPTION

31. A system was developed for screening the X-rays of patients for potential malignancy detection (skin cancer). A workflow system has been developed to screen multiple cancers by using several individually trained ML models chained together in the workflow.

Testing the pipeline could involve multiple kind of tests (I - III):

I. Pairwise testing of combinations

II. Testing each individual model for accuracy

III. A/B testing of different sequences of models

Which ONE of the following options contains the kinds of tests that would be MOST APPROPRIATE to include in the strategy for optimal detection? SELECT ONE OPTION

32. Which ONE of the following tests is LEAST likely to be performed during the ML model testing phase? SELECT ONE OPTION

33. Which ONE of the following types of coverage SHOULD be used if test cases need to cause each neuron to achieve both positive and negative activation values? SELECT ONE OPTION

34. Which ONE of the following models BEST describes a way to model defect prediction by looking at the history of bugs in modules by using code quality metrics of modules of historical versions as input? SELECT ONE OPTION

35. Which ONE of the following combinations of Training, Validation, Testing data is used during the process of learning/creating the model? SELECT ONE OPTION

36. Which ONE of the following options is the MOST APPROPRIATE stage of the ML workflow to set model and algorithm hyperparameters? SELECT ONE OPTION

37. Which of the following is THE LEAST appropriate tests to be performed for testing a feature related to autonomy? SELECT ONE OPTION

38. A beer company is trying to understand how much recognition its logo has in the market. It plans to do that by monitoring images on various social media platforms using a pre-trained neural network for logo detection. This particular model has been trained by looking for words, as well as matching colors on social media images. The company logo has a big word across the middle with a bold blue and magenta border.

Which associated risk is most likely to occur when using this pre-trained model?

39. A company producing consumable goods wants to identify groups of people with similar tastes for the purpose of targeting different products for each group. You have to choose and apply an appropriate ML type for this problem.

Which ONE of the following options represents the BEST possible solution for this above-mentioned task? SELECT ONE OPTION

40. Which ONE of the following options is an example that BEST describes a system with Al-based autonomous functions? SELECT ONE OPTION

41. Which of the following is an example of an input change where it would be expected that the AI system should be able to adapt?

42. Upon testing a model used to detect rotten tomatoes, the following data was observed by the test engineer, based on certain number of tomato images.

For this confusion matrix which combinations of values of accuracy, recall, and specificity respectively is CORRECT? SELECT ONE OPTION

43. Which ONE of the following options BEST DESCRIBES clustering? SELECT ONE OPTION

44. Which ONE of the following describes a situation of back-to-back testing the LEAST? SELECT ONE OPTION

45. The activation value output for a neuron in a neural network is obtained by applying computation to the neuron.

Which ONE of the following options BEST describes the inputs used to compute the activation value? SELECT ONE OPTION

46. Data used for an object detection ML system was found to have been labelled incorrectly in many cases.

Which ONE of the following options is most likely the reason for this problem? SELECT ONE OPTION

47. An image classification system is being trained for classifying faces of humans. The distribution of the data is 70% ethnicity A and 30% for ethnicities B, C and D.

Based ONLY on the above information, which of the following options BEST describes the situation of this image classification system? SELECT ONE OPTION

48. Which ONE of the following statements correctly describes the importance of flexibility for Al systems? SELECT ONE OPTION

49. Which ONE of the following statements is a CORRECT adversarial example in the context of machine learning systems that are working on image classifiers. SELECT ONE OPTION

50. Arihant Meditation is a startup using Al to aid people in deeper and better meditation based on analysis of various factors such as time and duration of the meditation, pulse and blood pressure, EEG patters etc. among others. Their model accuracy and other functional performance parameters have not yet reached their desired level.

Which ONE of the following factors is NOT a factor affecting the ML functional performance? SELECT ONE OPTION