Sophia Antipolis, France
Free of charge
Contact us

UCAAT 2026 will take place in ETSI Headquarters in Sophia Antipolis, France, on 14-16 April 2026.

Overview

The annual ETSI User Conference on Advanced Automated Testing (UCAAT) is the most important point in the calendar of ETSI’s Technical Committee Methods for Testing and Specification (TC MTS).

ETSI’s UCAAT conference, now in its 12th year, is dedicated to all aspects of automated testing including model-based testing, cloud testing, mobile testing, test methodologies, test management and standardised test specification by focusing on the practical challenges that are often faced in industry and standardisation.

This conference brings together research and industry from different application domains such as telco, banking, IT services, automotive, robotics, healthcare, defence and software vendors to meet, discuss and share their practical experiences in the field of software testing. UCAAT is aimed specifically at test engineers, test designers, test automation experts, test tool and test service providers, as well as test and quality assurance analysts. More broadly, UCAAT is also of interest to engineers working in software development, automation, and DevOps, as well as project leaders or managers in digital transformation, and academics and researchers in the field of testing.

UCAAT gives attendees a unique opportunity to discover, share, learn, and challenge modern test automation approaches, technologies and strategies for research, industry and standardisation.

UCAAT 2026: Augmenting Test Automation with Machine Logic and Human Insight

As software systems grow in complexity, traditional test automation approaches often fall short in adapting to rapid changes and nuanced behaviours.
This conference explores the synergistic integration of machine logic—encompassing AI-driven automation, predictive analytics, and adaptive algorithms—with the contextual reasoning and strategic thinking unique to human testers.
By combining computational precision with human insight, we aim to redefine the boundaries of test automation, enabling more resilient, efficient, and intelligent testing practices.
Attendees will gain practical perspectives on hybrid frameworks, real-world applications, and emerging trends that bridge the gap between automation and human judgment. 

The event is of particular interest for:

  • Test engineers, designers or test automation experts
  • Engineers working in test specification, automation, DevOps and RPA
  • Software developers or architects
  • Project leaders or managers in digital transformation
  • Test tool or service providers
  • Test and quality assurance analysts
  • Academics and researchers in testing

 Programme Committee

Rémi Caudwell, Sogeti, France - PC Chair

Daniel Ardelean, Nokia, Romania
Julien Binard, France Travail, France
Sergio Borghese, Kalliope S.r.l., Italy
Alexis Despeyroux, Testing Solutions and Services, France
Pablo Garcia, Sharpness AB, Sweden
Florence Guerlais, Air France KLM, France
Marija Jankovic, CERTH, Greece
Martti Käärik, Elvior, Estonia
Raymond Knopp, Eurecom, France
Anne Kramer, Smartesting, France
Philip Makedonski, University of Göttingen, Germany
Barış Sarıalioğlu, TesterYou, Turkey
Stephan Schulz, Giesecke + Devrient, Germany
Naum Spaseski, ETSI, France
Szilard Szell, Eficode Oy, Finland
Jan Tretmans, TNO, The Netherlands
Dirk Tepelmann, Gematik
Sofia Tsekeridou, Netcompany SEE & EUI, Greece
Andreas Ulrich, Siemens, Germany
Boris Wrubel, Software Test, Austria

 

Subscribe to the ETSI Events mailing list and/or the UCAAT Mailing list to get the latest news about this event! 

  • Tuesday 14 April a.m.: Pre-Conference Tutorials and Workshops
  •  
     

     08:30 - 9.00  Registration & welcome coffee

    09:00 - 12:30 TUTORIALS & WORKSHOPS

    9:00 - 10:30 PARALLEL SESSION 1

    Tutorial 1 (part 1): Workshop model-based testing cyber physical systems
    Machiel Van der Bijl, Axini and Jan Tretmans, TNO

    Tutorial 2: May the automation be with you
    Julien Binard and Sébastien Lamblin, France Travail

    10:30-11:00  Coffee break

    11:00 - 12:30 PARALLEL SESSION 2

    Tutorial 1 (part 2): Workshop model-based testing cyber physical systems
    Machiel Van der Bijl, Axini and Jan Tretmans, TNO

    Tutorial 3: Workshop plug & test: Mobile test automation with android
    Boris Wrubel and Christian Musilek, Software Test

    Tutorial 4: Testing in Rust: From zero to hero
    Maria Shalnova-Weinzierl, Carl Zeiss Digital Innovation GmbH

    12:30-14:00  Lunch

  • Tuesday 14 April p.m.: Conference day 1
  •  
     

    CONFERENCE DAY 1

    14:00 - 14:30  CONFERENCE OPENING

    14:30 - 16:00  SESSION 1 - Generative AI & LLMs for test creation
    Session Chair: Boris Wrubel, Software Test, Austria, Member of the Programme Committee

    This session focuses specifically on the application of Large Language Models (LLMs) and Generative AI to create, verify, and assist in writing test cases and assertions.

    • 14:30 - 15:00  LESS guidance: Using LLMs for requirement formalisation and automated test case generation
      Abhishek Shrestha, Holger Schlingloff, Jürgen Großmann - Fraunhofer FOKUS
    • 15:00 - 15:30  Domesticate a developer’s targeted IA to produce better automated tests!
      Woody Grochulski, Valerie Perez Guillot - Air France
    • 15:30 - 16:00  ViTO - The Visual Test Oracle for GenAI-based assertions
      Rahul Singh, Blue Yonder

    16:00 - 16:30  Coffee Break

    16:30 - 17:30  SESSION 2 - Validating AI agents and autonomous systems
    Session Chair: Martti Käärik, Elvior, Estonia, Member of the Programme Committee

    These presentations address the complex challenge of testing the AI itself, specifically focusing on Autonomous Agents, probabilistic decisions, and Digital Twins.

    • 16:30 - 17:00  Automated testing of AI agents
      Thomas Fehlmann, Eberhard Kranich - Euro Project Office AG
    • 17:00 - 17:30  Operationalising probabilistic decisions: Digital twins for validating AI
      Marius Corici, Hauke Buhr, Manar Zaboub, Fraunhofer FOKUS
    • 17:30 - 18:00  When AI joins the test team: Experiences from selenium-based automation
      Boris Wrubel 
  • Wednesday 15 April: Conference Day 2
  •  
     

    CONFERENCE DAY 2

    8:00 - 9:00 Registration and welcome coffee

    09:00 - 10:00  KEYNOTE SPEECH - Describing and measuring AI quality: the new frontier
    Sebastian Hallensleben, Resaro

    10:00 - 10:30  PRESENTATION OF POSTERS & EXHIBITORS
    Session Chair: Rémi Caudwell, Sogeti, France, Programme Committee Chair

    10:30 - 11:00  Coffee break

    11:00 - 12:30  SESSION 3 - Testing IoT, embedded systems & robotics
    Session Chair: Julien Binard, France Travail, France, Member of the Programme Committee

    A hardware-centric session dedicated to the unique challenges of testing physical devices, firmware, and compliance in the IoT and robotics space

    • 11:00 - 11:30  Warehouse automation & testing robots: An experience report
      Mesut Durukal, Indeed
    • 11:30 - 12:00  CertifIoT: Automating IoT regulation compliance on the smart home gateway
      Anna Maria Mandalari, Fabio Palmese, Hamed Haddadi - Mulini SRL
    • 12:00 - 12:30  Detecting memory access violations in firmware fuzzing
      Ramon Barakat, Karsten Isakovic - Fraunhofer FOKUS


    12:30 - 14:00  Lunch

    14:00 - 15:30  SESSION 4 - Advances in Model-Based Testing (MBT)
    Session Chair: Stephan Schulz, Giesecke + Devrient, Germany, Member of the Programme Committee

    This session groups presentations that explicitly utilize Model-Based Testing (MBT) methodologies to solve problems in regulated, medical, and security domains.

    • 14:00 - 14:30  From data model to test evidence: Human‑in‑the‑loop automatic test synthesis for GxP‑grade systems
      Hans Christiaan de Raad, OpenNovations
    • 14:30 - 15:00  Model based testing of the Bilihome medical device, an experience report
      Machiel Van der Bijl, Ronald Van Doorn - Axini
    • 15:00 - 15:30  Fuzzing + model-based testing = state-based fuzzing 
      Jan Tretmans, Stefan van den Berg, Lars van Arragon - TNO & Radboud University

    15:30 - 16:00  Coffee break

    16:00 - 17:30  SESSION 5 - AI-enhanced test automation frameworks
    Session Chair: Sergio Borghese, Kalliope S.r.l., Italy, Member of the Programme Committee

    This session focuses on the practical evolution of standard automation; using AI to improve existing frameworks (like Selenium/Playwright) via auto-healing and frugal strategies.

    • 16:00 - 16:30  KOGNY: An AI based toolkit for predictive maintenance
      Yacine Rebahi, Ramon Barakat - Fraunhofer FOKUS
    • 16:30 - 17:00  Frugal vibe testing
      Yann Helleboid, Orange
    • 17:00 - 17:30  Reinvent your automated tests with AI-powered self-healing
      Antoine Bouchet, Steven Pescheteau - Qanary


    18:30 - 22:00  SOCIAL EVENT
    Hotel Mercure, Sophia Antipolis

  • Thursday 16 April: Conference Day 3
  •  
     

    CONFERENCE DAY 3

    8:30 - 9:00 Registration and welcome coffee

    09:00 - 10:00  KEYNOTE SPEECH - When green pipelines lie about quality
    Maria-Olga Raimondo, Onelity

    10:00 - 12:30  SESSION 6 - Strategic QA: Process, people, and human-AI collaboration
    Session Chair: Marija Jankovic, CERTH, Greece, Member of the Programme Committee

    This session explores the human and managerial side of QA: team dynamics, BDD processes, and the "human-in-the-loop" necessity in AI adoption.

    • 10:00 - 10:30  Human-in-the-loop hyperautomation: An AI-augmented modular framework for unified test domains and common reporting
      Varvana Menta, Rafael Tatse - Netcompany

    10:30 - 11:00  Coffee break

    • 11:00 - 11:30  Unseen battles: The odyssey of a test automation engineer in an ageing team
      Jozsef Panczel, SAP AG
    • 11:30 - 12:00  Stellar specifications: Elevating test reliability and reporting quality for astronomy software
      Ahmed Mubbashir Khan, ESO
    • 12:00 - 12:30  Beyond the hype: Practical lessons from integrating ML-driven test intelligence with human expertise
      Tanvi Mittal, US Bancorp


    12:30 - 14:00  Lunch

    14:00 - 15:30  SESSION 7 - Standardisation and industrial applications
    Session Chair: Jan Tretmans, TNO, The Netherlands, Member of the Programme Committee

    This session covers testing in highly standardized environments (Telecoms, ETSI standards) and specific industrial applications (Predictive Maintenance).

    • 14:00 - 14:30  Better acceptance through interactive and AI-enabled standards
      Jens Grabowski, Philip Makedonski - University of Goettingen
    • 14:30 - 15:00  Testing the conformance of mobile devices implemented based on the 3GPP standards
      Olivier Genoud, ETSI

    15:00 - 15:30  Best paper award & conference closing

logo agilitest

Agilitest is a comprehensive test automation platform designed for large-scale, enterprise and mission-critical systems. It enables teams to automate functional, end-to-end and regression tests across web, desktop, SAP, APIs and complex business applications, without requiring advanced programming skills. Agilitest generates test scripts in ATS - ActionTestScript, an open-source execution language that allows tests to be replayed without any Agilitest licence. This open format ensures long-term sustainability, portability and vendor independence of test assets. The platform focuses on robustness, maintainability and industrialisation of test assets, making it particularly suitable for long-term projects and regulated environments. ATS scripts can be easily inspected, modified or generated by AI systems, enabling advanced automation, test optimisation and AI-assisted test creation. At UCAAT, Agilitest will showcase its approach to resilient test automation, test governance and AI-assisted test optimisation.

logo all4testAll4Test is a company specialized in software testing, software quality, and AI and test automation. We support organizations in improving their QA practices through expert services, training programs, and innovative solutions. All4Test is also the organizer of the Soirée du Test Logiciel, a major event for the QA community in France.

logo brightestAt Brightest, we empower software testers to excel in a rapidly evolving digital landscape. As a global certification body, we offer industry-leading certifications, that validate your expertise in critical areas such as test automation, AI, Agile, Accessibility, and much more. We proudly offer a wide range of certification exams in multiple languages, including: ISTQB, TMMI, IFPUG, iSAQB, and United Certifications in topics such as Selenium with Java or Python, User Experience, Agile, Artificial Intelligence, Cloud, Data & Analytics, DevOps, Performance Testing, and Testing Fundamentals for Software Engineers. Whether you're looking to advance your career or enhance your skills in test automation, we have the right certification for you! 

qanary full logo UCAATQanary is the next-generation, no-code test automation platform designed to bridge the gap between business intent and technical reliability. Our solution centers on two high-impact pillars: a smart user-journey recorder and AI-driven self-healing. With our intuitive recorder, anyone can create robust, cross-browser functional tests in under two minutes by simply navigating their application—no coding required. To solve the industry's biggest pain point, our AI "Self-Healing" technology automatically detects U broken tests in real-time, reducing maintenance overhead by up to 90%. Qanary ensures that your automation stays resilient, even as your product evolves rapidly.

logo tricentisTricentis is one of the global leaders in enterprise continuous testing. Tricentis’ AI-based continuous testing product portfolio offers a fundamentally new way of performing software testing—an approach that is fully automated, completely codeless, and intelligently driven by AI. It addresses both agile development and complex enterprise applications, enabling organizations to accelerate their digital transformation by significantly increasing software release speed, reducing costs, and improving software quality. Widely credited with reinventing software testing for DevOps, the cloud, and enterprise applications, Tricentis has been recognized as a leader by all major industry analysts, including Forrester, Gartner, and IDC. Tricentis has more than 2,500 customers, including some of the world’s largest brands such as McKesson, Accenture, Nationwide Insurance, Allianz, Telstra, Dolby, and Vodafone.

logo upskill4itUpSkill4IT is a training organization dedicated to enhancing skills in software testing, software quality, AI and automation. Our expert-led, hands-on training programs help IT teams master modern testing tools and methodologies. As a partner of the Soirée du Test Logiciel, UpSkill4IT actively contributes to the professional development of the QA community.

XQUALXQual offers a complete ALM (Application Lifecycle Management) solution to manage the traceability of releases, requirements, tests (manual or automated), and defects. It accelerates testing campaigns, improves collaboration between teams, and facilitates audits and management through clear metrics. Compatible with more than 100 automation frameworks, XQual integrates AI features (scoring, test generation) as well as connectors (JIRA, GitLab, etc.). It is available in the cloud or on-premise for sovereign use, with simple pricing and no hidden costs. 


The Stellar Forge: Automating astronomical scale  CI-CD via Jenkins
Presented by: Ahmed Mubbashir Khan, ESO

The VLT Data Flow System, critical for ESO operations and operational for over 20 years, relies on dozens of interacting tools and ‘nebulae of code’, for multiple telescopes, dozens of instruments and hundred of heterogeneous components overtime engineers have used different systems for building and packing software slowly things started converging, Jenkins came into the picture and forge started.
This is an experience report on how we are using Jenkins to build, test (execution), publish and deploy (part of the system) from Heterogeneous build systems to Jenkinsfile and Jenkins Shared Libraries, from copying artifacts to deploying to production on demand transforming our fragmented meteoroid stream into a synchronous satellite constellation.
This Automation and optimization of build, test (execution) and related activities in continuous integration, delivery, and deployment workflows have greatly improved our performance in such activities.
And we are still evolving, creating a new spiral arm of automation within our galactic system, constantly refining its structure and velocity.

Leveling up your test automation and yourself
Presented by: Martin Gijsen, Consultant

Do you ever see test automation as a whole presented as a structured and coherent field of expertise? Few practitioners do, and this results in several challenges for them:
- It is hard to ensure they learn about all areas of the field,
- It is easy to overlook areas in their TA strategy,
- It is even harder to advance to an advisory / consulting level of expertise.
The usual focus on tools and techniques is at least in part to blame: The technical side receives so much attention that there is little left for giving automation high business value (known as ‘building the thing right’ versus ‘building the right thing’ for production code).
Having a better overview helps!
In the first few minutes, the audience will collect many test automation topics. It will then see how they come together in a meaningful, structured overview that is known by the acronym PuPPET: Product, Understanding, People, Processes, Execution, and Techniques. It will then also see clearly explained its application for:
- Learning (and teaching) the craft,
- Seeing where AI is (and will be) changing our work and what will remain,
- Creating and updating a test automation strategy,
- Planning your career (for anyone from juniors to consultants),
- General communication, between testers and also with other automation stakeholders.
This touches the CfP topics: AI, the value of TA, and a context-driven generic approach instead of ‘best practices’.

Pipeline test automation for AI/ML in MedTech
Presented by: Nikita Gavrish, Congenica

Test automation ML tools in MedTech. Case study about implementing test design and test automation for ML algorithms doing pattern recognition for cancer and rare diseases using FASTQ medical data.

AI-enabled test specification with TDL
Presented by: Martti Käärik, Elvior - Philip Makedonski, Göttingen University - Charalampos Tsotakis, ITI

Creating tests for standardised technologies is a demanding task. In addition to understanding the target technology, its domain, and related standards, knowledge in testing technologies, processes, and organisation-specific rules and conventions are also required. Reports from early attempts in AI-enabled test generation from standards directly suggested that intermediate representations are required.
ETSI’s Test Description Language (TDL) aims to provide a standardised notation for the entire test specification process, from test objectives, through test purposes and test descriptions, to executable tests, which often relies on disparate and incompatible notations. As such, it can serve as an intermediate notation at all stages in an AI-enabled test generation process, blending human and AI-generated input. We will explore how AI-enabled tools can assist in applying TDL, especially for users, as the language has become more sophisticated and keeps evolving.

From data model to test evidence: Human-in-the-loop model-driven test generation for GxP-grade systems
Presented by Hans Christian de Raad, OpenNovations

This poster presents a model-centric approach to automated testing for high-integrity systems in which the information model, business rules, workflow states, authorization policies, and human-defined invariants drive the generation of both application artifacts and multi-layer test evidence. Rather than treating testing as a separate activity added after implementation, the approach generates persistence-layer objects, REST API behavior, UI components, and systematic good, fuzzy, and false test families as part of the same controlled change process.
GxP-grade environments provide the stress case for this work, but the underlying pattern is broader: any domain facing sustained change pressure together with strong demands for traceability, security, data integrity, and controlled release can benefit. The poster shows how this model-driven test generation approach, with clear MBT relevance, supports cross-layer verification of workflows, permissions, integrity rules, and rejection behavior while keeping release judgment under human control.
It also highlights how machine logic already contributes through rule-based test derivation, structured boundary exploration, CI/CD execution, and evidence-by-construction, with AI positioned as a future augmentation for anomaly triage and boundary-case suggestion. Workflow diagrams and technology-stack references connect the architecture to practical tooling across PHP, Python, PostgreSQL, and browser-based testing.

ETSI is at the forefront of Methods for Testing & Specification standardisation efforts, our initiatives include:

ETSI TC MTS

  • Develop methodologies for standardised test specifications, including formal definition languages
  • Specify the required testing environment, covering operational and procedural aspects
  • Provide methodologies for test execution and results analysis
  • Evaluate methods and techniques for advanced and/or formal specification of standards, with respect to efficiency, quality, and testability
  • Collaborate across ETSI and with external Standards Development Organisations (SDOs) to ensure consistency, interoperability, and global impact

ETSI TC MTS WG AI (AI Testing)

TC MTS WG AI, focuses on standardisation methodologies that support trustworthy, testable, and auditable AI systems across the full lifecycle. The group develops frameworks for testing, documentation, certification, and conformity assessment, while also exploring how AI itself can automate and enhance testing and auditing activities. More information.

Call to Action!

ETSI TC MTS / WG AI has recently started a project to further develop the Technical Report TR 104 119. One objective of the project is to validate the documentation approach by creating documentation for some selected Use Cases of High-Risk AI systems and GPAI models. Interested parties are invited to submit their responses via this questionnaire.
Developers, providers and deployers are invited to provide their use cases along with corresponding requirements and, in return, receive EU AI Act–compliant documentation. More information.

Not yet a member of ETSI? Ready to take it a step further?

Joining ETSI means co-creating the standards of tomorrow, benefiting from an active international network, and increasing your impact by actively shaping the future of quantum cryptography and technology. Let’s talk!
Visit our Membership Page or visit our stand during the event.

UCAAT is an established series of annual events. Previous editions of the UCAAT have focused on different aspects of test automation following emerging trends through the years. Information about previous editions of the UCAAT, including the programmes and presentation slides, are available from the archived websites linked below. Browse through the archives and discover past experiences shared at UCAAT!

Event venue

ETSI Headquarters
650 Route des Lucioles
06921 Sophia Antipolis
FRANCE

Tel: +33 4 92 94 42 00

Travel & Accomodation

Details of how to get to ETSI, local transport and hotels

Any Questions? Contact us