Demo - AI for Testers

Abschnittsübersicht

• Abschnitt Welcome! auswählen

  Einklappen Ausklappen

  Welcome!

  Alles einklappen Alles aufklappen

          

  Welcome to the demo for AI for Testers! In this course, you’ll learn practical ways to use AI in your testing work and evaluate the quality and risks of systems that contain AI. Through examples and exercises, you’ll build on your testing skills while strengthening the human judgment that effective testing still requires. My goal was to create a short, practical course for software testers who want to learn how to apply AI in their daily work, without feeling like you're becoming an AI engineer or data scientist. I hope I have met that goal!

  In this demo, you will notice that many of the links are disabled due to the nature of the demo. I have left the topics in place to show the outline of the course. To purchase an enrollment, just visit https://mysoftwaretesting.com/AI-For-Testers_p_150.html

  • Aktivität Announcements auswählen

    

    Announcements Forum
  • Aktivität Course Notes auswählen

    

    Course Notes Datei
  • Aktivität AI Glossary auswählen

    

    AI Glossary Datei
• Abschnitt Module 1 — Understanding What You’re Testing auswählen

  Einklappen Ausklappen

  Module 1 — Understanding What You’re Testing

    

  • Aktivität Slides in PDF auswählen

    

    Slides in PDF Datei
  • Aktivität Lesson 1 - AI Without the Hype (22:09) auswählen

    

    Lesson 1 - AI Without the Hype (22:09) Link/URL
  • Aktivität Exercise auswählen

    Exercise

    In this exercise, we will use Google Gemini to generate some test cases from a short requirement.
    The requirement:
    The system shall be able to calculate postage based on weight:
    Under 1 pound, the postage is $10
    From 1 pound to 4.99 pounds, the postage is $15
    From 5 pounds to 9.99 pounds, the postage is $20
    Over 10 pounds, the postage is $2.95 per pound

    Instructions
    Go to google.com and click on AI Mode.
    Enter the following prompt. (Note the key elements of the prompt)
    Context – I am a tester working on creating test cases to verify a requirement for calculating postage rates.
    Instruction – Create test cases that contain specific conditions and expected results for the following requirement.
    Data – [Insert requirement here]
    Format – The test case must show test conditions and expected results
    Constraints – Limit the number of test cases to the minimal amount needed to verify the requirement.

    Verify the output. Did it match your expectations?

  • Aktivität Exercise Solution (7:17) auswählen

    

    Exercise Solution (7:17) Link/URL
  • Aktivität Lesson 2 - How AI Systems Are Different (6:14) auswählen

    

    Lesson 2 - How AI Systems Are Different (6:14) Link/URL
  • Aktivität Lesson 3 - Where AI Failures Come From (5:16) auswählen

    

    Lesson 3 - Where AI Failures Come From (5:16) Link/URL
  • Aktivität Lesson 4 - Training, Validation, Testing—and Production (18:54) auswählen

    

    Lesson 4 - Training, Validation, Testing—and Production (18:54) Link/URL
  • Aktivität Lesson 5 - The AI System, Not Just the Model (8:43) auswählen

    

    Lesson 5 - The AI System, Not Just the Model (8:43) Link/URL
• Abschnitt Module 2 — Testing AI Systems auswählen

  Einklappen Ausklappen

  Module 2 — Testing AI Systems

          

  • Aktivität Lesson 1 - What Does “Correct” Mean When There Isn't One Right Answer? (12:23) auswählen

    

    Lesson 1 - What Does “Correct” Mean When There Isn't One Right Answer? (12:23) Link/URL
  • Aktivität Lesson 2 - Testing for Accuracy and Hallucination (14:17) auswählen

    

    Lesson 2 - Testing for Accuracy and Hallucination (14:17) Link/URL
  • Aktivität Lesson 3 - Testing Variability and Consistency (13:16) auswählen

    

    Lesson 3 - Testing Variability and Consistency (13:16) Link/URL
  • Aktivität Exercise auswählen

    Exercise

    Prompt: “A store allows returns within 30 days. A customer wants to return an item after 32 days. Should the store accept the return? Explain briefly.”
    Use whichever AI you have access to (Gemini is fine) and submit the same prompt five times and compare the answers.
    Look for:

    Does AI consistently say the return is outside the policy?
    Does it recommend making exceptions?
    Does it invent conditions not stated in the policy?
    Does its reasoning change?

    Key takeaway: Different wording is acceptable. Different interpretations of the same rule may indicate inconsistent behavior.

  • Aktivität Exercise Solution (11:49) auswählen

    

    Exercise Solution (11:49) Link/URL
  • Aktivität Lesson 4 - Testing Variability and Consistency - Part 2 (6:22) auswählen

    

    Lesson 4 - Testing Variability and Consistency - Part 2 (6:22) Link/URL
  • Aktivität Lesson 5 - Bias, Fairness, Safety, and Harm (13:11) auswählen

    

    Lesson 5 - Bias, Fairness, Safety, and Harm (13:11) Link/URL
  • Aktivität Exercise Solution (6:50) auswählen

    

    Exercise Solution (6:50) Link/URL
  • Aktivität Lesson 6 - Testing AI Over Time (36:21) auswählen

    

    Lesson 6 - Testing AI Over Time (36:21) Link/URL
  • Aktivität Exercise auswählen

    Exercise

    Let’s try this prompt with Gemini:
    “A customer purchased this item 32 days ago without a receipt. Based on the following policy, is the customer eligible for a refund?”
    “Most items may be returned within 30 days with a receipt for a full refund to the original payment method.
    Returns without a receipt may receive store credit at the item's current selling price.”

    Run it 5–10 times, then paraphrase the question several ways.

    Record: Decision | Reason given | Grounded? | Consistent? | Acceptable?

  • Aktivität Exercise Solution (8:40) auswählen

    

    Exercise Solution (8:40) Link/URL
• Abschnitt Module 3 — Using AI as a Testing Tool auswählen

  Einklappen Ausklappen

  Module 3 — Using AI as a Testing Tool

        

  • Aktivität Reusable Prompt Library auswählen

    

    Reusable Prompt Library Datei
  • Aktivität Lesson 1 - AI as a Testing Assistant—Not an Oracle (9:54) auswählen

    

    Lesson 1 - AI as a Testing Assistant—Not an Oracle (9:54) Link/URL
  • Aktivität Lesson 2 - Using AI to Generate Test Ideas (13:32) auswählen

    

    Lesson 2 - Using AI to Generate Test Ideas (13:32) Link/URL
  • Aktivität Exercise auswählen

    Exercise

    You have a simple requirement:
    “A user account will be locked after three unsuccessful login attempts.”

    Write down about five test ideas individually, without using AI.
    Then use AI.
    Ask it to identify ambiguities, risks, boundaries, and test ideas.

  • Aktivität Exercise Solution (7:09) auswählen

    

    Exercise Solution (7:09) Link/URL
  • Aktivität Lesson 3 - Using AI to Analyze Requirements (10:00) auswählen

    

    Lesson 3 - Using AI to Analyze Requirements (10:00) Link/URL
  • Aktivität Exercise auswählen

    Exercise

    Consider this requirement: “Users can reset a forgotten password by entering their email address. A reset link will be sent to the user and will expire after 30 minutes.”
    Do you see any problems with this requirement?
    Now, use AI to examine this requirement.

  • Aktivität Exercise Solution (4:36) auswählen

    

    Exercise Solution (4:36) Link/URL
  • Aktivität Lesson 4 - Using AI to Improve Test Assets (16:39) auswählen

    

    Lesson 4 - Using AI to Improve Test Assets (16:39) Link/URL
  • Aktivität Exercise auswählen

    Exercise

    Consider this requirement: Customers may return most items within 30 days of purchase with a receipt for a full refund.
    Consider the associated test case:

    Preconditions: Customer has purchased an item
    Test Data: Item, receipt
    Steps: 1. Log in. 2. Select the item. 3. Choose Return. 4. Complete the return process.
    Expected Result: The return should work correctly.

    Prompt: Critique this requirement and test case. Identify weaknesses, assumptions, missing coverage, and anything that would make the test difficult to execute or evaluate. Do not invent requirements that aren't stated.

  • Aktivität Exercise Solution (13:20) auswählen

    

    Exercise Solution (13:20) Link/URL
  • Aktivität Lesson 5 - Testing AI-Generated Code and Tests (17:23) auswählen

    

    Lesson 5 - Testing AI-Generated Code and Tests (17:23) Link/URL
• Abschnitt Module 4 — Building a Responsible AI Testing Strategy auswählen

  Einklappen Ausklappen

  Module 4 — Building a Responsible AI Testing Strategy

    

  • Aktivität AI Test Evaluation Record auswählen

    

    AI Test Evaluation Record Datei
  • Aktivität Lesson 1 - Risk-Based Testing for AI (13:57) auswählen

    

    Lesson 1 - Risk-Based Testing for AI (13:57) Link/URL
  • Aktivität Exercise auswählen

    Exercise

    Consider 3 AI systems:
    A. AI recommends movies to streaming customers.
    B. AI determines whether insurance claims should be flagged for investigation.
    C. AI assistant helps technicians diagnose problems with industrial equipment.

    Identify the top three failures you would worry about for each.

    Then determine:
    Impact → Likelihood/uncertainty → Exposure → Testing response

  • Aktivität Exercise Solution (4:41) auswählen

    

    Exercise Solution (4:41) Link/URL
  • Aktivität Lesson 2 - Evaluating AI Quality (14:42) auswählen

    

    Lesson 2 - Evaluating AI Quality (14:42) Link/URL
  • Aktivität Lesson 3 - Evaluating AI Quality (16:49) auswählen

    

    Lesson 3 - Evaluating AI Quality (16:49) Link/URL
  • Aktivität Exercise auswählen

    Exercise

    ShopSmart is an online retailer selling clothing, electronics, and household products.
    The company is introducing an AI-powered customer service assistant to reduce the workload of its support staff.
    The assistant will:

    • Answer questions about products, shipping, and returns.
    • Retrieve information from ShopSmart's product catalog and return policies.
    • Look up customer order status after verifying the customer's identity.
    • Recommend products based on customer preferences.
    • Refer customers to a human representative when it cannot resolve an issue.

    The assistant uses a large language model (LLM) and retrieval-augmented generation (RAG) to access company information.

    Important Business Rules

    • Most products can be returned within 30 days.
    • Electronics must be returned within 15 days.
    • The assistant cannot approve exceptions or issue refunds.
    • Customer information must not be disclosed to unauthorized users.
    • The assistant must not invent product specifications or company policies.

    ShopSmart plans to launch the assistant in four weeks.

    Develop a basic AI test strategy for ShopSmart.

    Address these six areas:
    1. Key Risks - Identify the three most important risks associated with the assistant.
    2. Quality Characteristics - Which AI quality characteristics matter most?
    3. Acceptance Criteria - How will you determine whether the assistant performs acceptably?
    4. Test Approach - What types of testing will you perform?
    5. Test Data - What scenarios and data will you need?
    6. Monitoring - What should ShopSmart monitor after deployment?

  • Aktivität Exercise Solution (3:28) auswählen

    

    Exercise Solution (3:28) Link/URL
  • Aktivität Lesson 4 - Governance and Controls Testers Should Understand (11:49) auswählen

    

    Lesson 4 - Governance and Controls Testers Should Understand (11:49) Link/URL
  • Aktivität Lesson 5 - The Tester in an AI World (10:58) auswählen

    

    Lesson 5 - The Tester in an AI World (10:58) Link/URL
  • Aktivität AI Test Strategy Template auswählen

    

    AI Test Strategy Template Datei
• Abschnitt Summary auswählen

  Einklappen Ausklappen

  Summary

      

  • Aktivität Course Evaluation auswählen

    

    Course Evaluation Feedback
  • Aktivität Leave a Review auswählen

    

    Leave a Review Link/URL