---
title: "Evaluate an AI Pilot | Transformery"
url: https://transformery.ch/blog/evaluate-an-ai-pilot
description: "Review an AI pilot against the work it was meant to improve. Use this template to compare time, quality and rework before deciding what to do next."
lang: en
---

Skip to main content

Back to Insights (https://transformery.ch/blog)

Transformation in practice

AI Adoption

# How to evaluate an AI pilot and decide what to do next

Transformery · 16 November 20263 min read

The demo drafts a reply in seconds. In customer service, someone checks every sentence, looks up exceptions and corrects the greeting. Whether the AI pilot helps depends on the whole request. How much work does it take to get from a new request to an approved reply? Do customers still receive a reliable answer?

Before deciding whether to expand, compare the same workflow with and without AI. Include time spent reviewing and correcting the output. Agree on quality requirements and make the decision with the people who are responsible for the work.

## Examine a complete workflow

Consider an illustrative example from a Swiss business. The service team wants to spend less time writing replies to common requests. The pilot covers a small set of standard cases. Staff review each draft and approve it before sending anything.

Compare requests of a similar level of difficulty. Record which cases belong in the comparison and how you handle missing information or exceptions. Use data approved for the test. If you use examples drawn from daily work, include typical exceptions on purpose. They help you see where the workflow reaches its limits.

## Bring three observations to the review

- **Time across the workflow.** How long do people spend on the request, including looking up information, entering it, checking the output and correcting it? If response time matters, record the waiting time as well.
- **Quality of the reply.** Use the same criteria to review the replies. Are the details correct, the next steps clear and the promised deadlines ones the team can actually offer? Record mistakes caught before sending and errors that make a reply unsuitable for approval.
- **Work for the team.** Who deals with poor drafts? What happens when a request falls outside the agreed scope? Ask staff when they would choose to use the workflow and why.

Before the test, agree on what improvement would matter and which errors would rule out further use. A handful of cases can show you what to investigate next. A wider rollout needs enough comparable observations and a way to handle exceptions in everyday work.

## Continue, adjust or end the pilot

**Continue.** The team sees a benefit across comparable workflows, the replies meet the agreed quality requirements and someone can take responsibility for running it. Name the next bounded use and the date you will review it.

**Adjust.** The benefit is limited to certain requests. Narrow the scope or change one specific step. Then check how the change affects effort and quality.

**End.** Review time absorbs the savings, a critical error remains possible or the conditions for running the workflow are missing. Record what you learned and how the team will handle the requests from here.

## A template for recording the decision

> We compared [workflow and cases]. The time and work including review were [observation]. For quality, we observed [findings and exceptions]. We will [continue, adjust or end] because [reason]. [Person or role] will take the next step by [date]. We will review the decision using [evidence].

A useful pilot ends with a decision the team can explain. People should be able to say which requests the workflow applies to and who they can turn to when they have a problem.

Read the case study on AI in insurance workflows: https://transformery.ch/case-studies/ai-insurance-workflows

If you are planning a first pilot: Transformery's AI consulting and adoption support (https://transformery.ch/services/ai-transformation).

## Structured data

```json
[
  {
    "@context": "https://schema.org",
    "@type": "Organization",
    "@id": "https://transformery.ch/#organization",
    "name": "Transformery",
    "legalName": "Transformery GmbH",
    "url": "https://transformery.ch/",
    "logo": "https://transformery.ch/og-image.jpg",
    "description": "We help organisations transform, leaders evolve, and individuals grow — across technology, skills and culture. With a strong focus on AI adoption.",
    "telephone": "+41 79 754 55 90",
    "email": "info@transformery.ch",
    "address": {
      "@type": "PostalAddress",
      "streetAddress": "Werftestrasse 2",
      "addressLocality": "Luzern",
      "postalCode": "6005",
      "addressRegion": "LU",
      "addressCountry": "CH"
    },
    "geo": {
      "@type": "GeoCoordinates",
      "latitude": 47.0470386,
      "longitude": 8.3142826
    },
    "areaServed": [
      {
        "@type": "Country",
        "name": "CH"
      },
      {
        "@type": "Country",
        "name": "DE"
      },
      {
        "@type": "Country",
        "name": "AT"
      }
    ],
    "sameAs": [
      "https://www.linkedin.com/company/transformery",
      "https://www.youtube.com/@transformery_ch",
      "https://search.ch/tel/luzern/werftestrasse-2/transformery-gmbh"
    ],
    "contactPoint": {
      "@type": "ContactPoint",
      "contactType": "customer service",
      "email": "info@transformery.ch",
      "telephone": "+41 79 754 55 90",
      "availableLanguage": [
        "English",
        "German"
      ]
    }
  },
  {
    "@context": "https://schema.org",
    "@type": "ProfessionalService",
    "@id": "https://transformery.ch/#service",
    "name": "Transformery",
    "url": "https://transformery.ch/",
    "image": "https://transformery.ch/og-image.jpg",
    "parentOrganization": {
      "@id": "https://transformery.ch/#organization"
    },
    "description": "Transformation consultancy in Lucerne, Switzerland: culture transformation, leadership development, AI adoption and B2B sales transformation.",
    "priceRange": "$$$",
    "telephone": "+41 79 754 55 90",
    "email": "info@transformery.ch",
    "address": {
      "@type": "PostalAddress",
      "streetAddress": "Werftestrasse 2",
      "addressLocality": "Luzern",
      "postalCode": "6005",
      "addressRegion": "LU",
      "addressCountry": "CH"
    },
    "geo": {
      "@type": "GeoCoordinates",
      "latitude": 47.0470386,
      "longitude": 8.3142826
    },
    "areaServed": [
      {
        "@type": "Country",
        "name": "CH"
      },
      {
        "@type": "Country",
        "name": "DE"
      },
      {
        "@type": "Country",
        "name": "AT"
      }
    ],
    "knowsLanguage": [
      "de-CH",
      "en"
    ],
    "hasOfferCatalog": {
      "@type": "OfferCatalog",
      "name": "Transformation Services",
      "itemListElement": [
        {
          "@type": "Offer",
          "itemOffered": {
            "@type": "Service",
            "name": "Culture Transformation",
            "url": "https://transformery.ch/services/culture-transformation"
          }
        },
        {
          "@type": "Offer",
          "itemOffered": {
            "@type": "Service",
            "name": "Leadership Transformation",
            "url": "https://transformery.ch/services/leadership-transformation"
          }
        },
        {
          "@type": "Offer",
          "itemOffered": {
            "@type": "Service",
            "name": "AI Transformation",
            "url": "https://transformery.ch/services/ai-transformation"
          }
        },
        {
          "@type": "Offer",
          "itemOffered": {
            "@type": "Service",
            "name": "Sales Transformation",
            "url": "https://transformery.ch/services/sales-transformation"
          }
        }
      ]
    }
  },
  {
    "@context": "https://schema.org",
    "@type": "Person",
    "@id": "https://transformery.ch/team/daniel-marti#person",
    "name": "Daniel Marti",
    "givenName": "Daniel",
    "familyName": "Marti",
    "image": {
      "@type": "ImageObject",
      "url": "https://transformery.ch/team/daniel-marti.jpg",
      "width": 400,
      "height": 400,
      "caption": "Daniel Marti - Founder of Transformery"
    },
    "jobTitle": "Founder & Managing Director",
    "description": "Daniel Marti is the founder of Transformery, a transformation and change management expert with 15+ years experience helping organizations navigate complex transformations, AI adoption, and leadership alignment.",
    "url": "https://transformery.ch/team/daniel-marti",
    "email": "daniel.marti@transformery.ch",
    "telephone": "+41 79 754 55 90",
    "sameAs": [
      "https://www.linkedin.com/in/daniel-roger-marti/"
    ],
    "worksFor": {
      "@type": "Organization",
      "name": "Transformery",
      "@id": "https://transformery.ch/#organization"
    },
    "knowsAbout": [
      "Change Management",
      "Transformation Communication",
      "Leadership Alignment",
      "AI Adoption"
    ],
    "knowsLanguage": [
      "German",
      "English"
    ],
    "address": {
      "@type": "PostalAddress",
      "addressLocality": "Luzern",
      "addressCountry": "CH"
    }
  },
  {
    "@context": "https://schema.org",
    "@type": "Person",
    "@id": "https://transformery.ch/team/christoph-lang#person",
    "name": "Christoph Lang",
    "givenName": "Christoph",
    "familyName": "Lang",
    "image": {
      "@type": "ImageObject",
      "url": "https://transformery.ch/team/christoph-lang.jpg",
      "width": 400,
      "height": 400,
      "caption": "Christoph Lang - Culture and Innovation Expert at Transformery"
    },
    "jobTitle": "Culture and Innovation Expert",
    "description": "Christoph Lang is a transformation and leadership expert at Transformery, specializing in innovation management, customer experience, and mediation.",
    "url": "https://transformery.ch/team/christoph-lang",
    "email": "christoph.lang@transformery.ch",
    "sameAs": [
      "https://www.linkedin.com/in/christoph-lang-nottwil/"
    ],
    "worksFor": {
      "@type": "Organization",
      "name": "Transformery",
      "@id": "https://transformery.ch/#organization"
    },
    "knowsAbout": [
      "Innovation Management",
      "Customer Experience",
      "Mediation",
      "Business Development"
    ],
    "knowsLanguage": [
      "German",
      "English"
    ],
    "address": {
      "@type": "PostalAddress",
      "addressLocality": "Luzern",
      "addressCountry": "CH"
    }
  },
  {
    "@context": "https://schema.org",
    "@type": "LocalBusiness",
    "@id": "https://transformery.ch/#localbusiness",
    "name": "Transformery",
    "legalName": "Transformery GmbH",
    "alternateName": "Transformery",
    "url": "https://transformery.ch/",
    "image": [
      "https://transformery.ch/og-image.jpg",
      "https://transformery.ch/transformery-logo.png"
    ],
    "logo": "https://transformery.ch/og-image.jpg",
    "description": "We help organisations transform, leaders evolve, and individuals grow — across technology, skills and culture. With a strong focus on AI adoption.",
    "priceRange": "$$$$",
    "currenciesAccepted": "CHF, EUR",
    "paymentAccepted": "Invoice, Bank Transfer",
    "address": {
      "@type": "PostalAddress",
      "streetAddress": "Werftestrasse 2",
      "addressLocality": "Luzern",
      "postalCode": "6005",
      "addressRegion": "LU",
      "addressCountry": "CH"
    },
    "geo": {
      "@type": "GeoCoordinates",
      "latitude": 47.0470386,
      "longitude": 8.3142826
    },
    "hasMap": "https://www.google.com/maps/place/Transformery/@47.0470422,8.3117077,667m/data=!3m2!1e3!4b1!4m6!3m5!1s0x478ffb8e845f8fa3:0x888902ea2e884ce1!8m2!3d47.0470386!4d8.3142826!16s%2Fg%2F11hdf8s47z",
    "sameAs": [
      "https://www.linkedin.com/company/transformery",
      "https://www.youtube.com/@transformery_ch",
      "https://search.ch/tel/luzern/werftestrasse-2/transformery-gmbh"
    ],
    "areaServed": [
      {
        "@type": "Country",
        "name": "Switzerland"
      },
      {
        "@type": "Country",
        "name": "Germany"
      },
      {
        "@type": "Country",
        "name": "Austria"
      }
    ],
    "openingHoursSpecification": {
      "@type": "OpeningHoursSpecification",
      "dayOfWeek": [
        "Monday",
        "Tuesday",
        "Wednesday",
        "Thursday",
        "Friday"
      ],
      "opens": "08:00",
      "closes": "18:00"
    },
    "hasOfferCatalog": {
      "@type": "OfferCatalog",
      "name": "Transformation Services",
      "itemListElement": [
        {
          "@type": "Offer",
          "itemOffered": {
            "@type": "Service",
            "name": "Culture Transformation",
            "url": "https://transformery.ch/services/culture-transformation",
            "description": "Align strategy, leadership behaviour and routines so culture drives execution—not resistance."
          }
        },
        {
          "@type": "Offer",
          "itemOffered": {
            "@type": "Service",
            "name": "Leadership Transformation",
            "url": "https://transformery.ch/services/leadership-transformation",
            "description": "Build leaders who create clarity, trust and accountability—and translate strategy into daily execution."
          }
        },
        {
          "@type": "Offer",
          "itemOffered": {
            "@type": "Service",
            "name": "AI Transformation",
            "url": "https://transformery.ch/services/ai-transformation",
            "description": "Make AI transformation real: adoption, workflows, capability building and measurable impact."
          }
        },
        {
          "@type": "Offer",
          "itemOffered": {
            "@type": "Service",
            "name": "Sales Transformation",
            "url": "https://transformery.ch/services/sales-transformation",
            "description": "Build a modern sales engine—from visibility to loyalty. Trust, process, enablement, tooling and customer care."
          }
        }
      ]
    },
    "serviceType": [
      "Culture Transformation",
      "Leadership Development",
      "AI Transformation",
      "Sales Transformation",
      "Change Management"
    ],
    "knowsLanguage": [
      "English",
      "German"
    ],
    "email": "info@transformery.ch",
    "telephone": "+41 79 754 55 90",
    "foundingDate": "2019"
  },
  {
    "@context": "https://schema.org",
    "@type": "ProfessionalService",
    "@id": "https://transformery.ch/#professionalservice",
    "name": "Transformery",
    "url": "https://transformery.ch/",
    "image": "https://transformery.ch/og-image.jpg",
    "description": "We help organisations transform, leaders evolve, and individuals grow — across technology, skills and culture. With a strong focus on AI adoption.",
    "priceRange": "$$$$",
    "address": {
      "@type": "PostalAddress",
      "streetAddress": "Werftestrasse 2",
      "addressLocality": "Luzern",
      "postalCode": "6005",
      "addressCountry": "CH"
    },
    "areaServed": [
      "Switzerland",
      "Germany",
      "Austria"
    ],
    "serviceType": [
      "Culture Transformation",
      "Leadership Development",
      "AI Transformation",
      "Sales Transformation",
      "Change Management"
    ],
    "knowsLanguage": [
      "English",
      "German"
    ],
    "email": "info@transformery.ch",
    "telephone": "+41 79 754 55 90"
  },
  {
    "@context": "https://schema.org",
    "@graph": [
      {
        "@type": "SiteNavigationElement",
        "name": "Team",
        "url": "https://transformery.ch/team"
      },
      {
        "@type": "SiteNavigationElement",
        "name": "Culture Transformation",
        "url": "https://transformery.ch/services/culture-transformation"
      },
      {
        "@type": "SiteNavigationElement",
        "name": "Leadership Transformation",
        "url": "https://transformery.ch/services/leadership-transformation"
      },
      {
        "@type": "SiteNavigationElement",
        "name": "AI Transformation",
        "url": "https://transformery.ch/services/ai-transformation"
      },
      {
        "@type": "SiteNavigationElement",
        "name": "Sales Transformation",
        "url": "https://transformery.ch/services/sales-transformation"
      },
      {
        "@type": "SiteNavigationElement",
        "name": "Insights",
        "url": "https://transformery.ch/blog"
      }
    ]
  },
  {
    "@context": "https://schema.org",
    "@type": "WebSite",
    "@id": "https://transformery.ch/#website",
    "name": "Transformery",
    "alternateName": "Transformery.ch",
    "url": "https://transformery.ch/",
    "description": "People and Business Transformation",
    "publisher": {
      "@type": "Organization",
      "@id": "https://transformery.ch/#organization"
    },
    "inLanguage": "en",
    "potentialAction": {
      "@type": "SearchAction",
      "target": {
        "@type": "EntryPoint",
        "urlTemplate": "https://transformery.ch/blog?q={search_term_string}"
      },
      "query-input": "required name=search_term_string"
    }
  },
  {
    "@context": "https://schema.org",
    "@type": "WebPage",
    "@id": "https://transformery.ch/blog/evaluate-an-ai-pilot#webpage",
    "url": "https://transformery.ch/blog/evaluate-an-ai-pilot",
    "name": "Evaluate an AI Pilot | Transformery",
    "description": "Review an AI pilot against the work it was meant to improve. Use this template to compare time, quality and rework before deciding what to do next.",
    "inLanguage": "en",
    "isPartOf": {
      "@id": "https://transformery.ch/#website"
    },
    "about": {
      "@id": "https://transformery.ch/#organization"
    },
    "primaryImageOfPage": {
      "@type": "ImageObject",
      "url": "https://transformery.ch/images/blog/transformations-fail.jpg"
    },
    "datePublished": "2026-11-16",
    "dateModified": "2026-11-16"
  },
  {
    "@context": "https://schema.org",
    "@type": "Article",
    "@id": "https://transformery.ch/blog/evaluate-an-ai-pilot#article",
    "headline": "Evaluate an AI Pilot",
    "description": "Review an AI pilot against the work it was meant to improve. Use this template to compare time, quality and rework before deciding what to do next.",
    "image": {
      "@type": "ImageObject",
      "url": "https://transformery.ch/images/blog/transformations-fail.jpg",
      "width": 1200,
      "height": 630
    },
    "url": "https://transformery.ch/blog/evaluate-an-ai-pilot",
    "datePublished": "2026-11-16",
    "dateModified": "2026-11-16",
    "author": {
      "@type": "Organization",
      "name": "Transformery",
      "@id": "https://transformery.ch/#organization",
      "url": "https://transformery.ch"
    },
    "publisher": {
      "@type": "Organization",
      "name": "Transformery GmbH",
      "@id": "https://transformery.ch/#organization",
      "url": "https://transformery.ch",
      "logo": {
        "@type": "ImageObject",
        "url": "https://transformery.ch/og-image.jpg",
        "width": 1200,
        "height": 630
      }
    },
    "mainEntityOfPage": {
      "@type": "WebPage",
      "@id": "https://transformery.ch/blog/evaluate-an-ai-pilot"
    },
    "articleSection": "AI Adoption",
    "keywords": "transformation, change management, practice",
    "inLanguage": "en",
    "wordCount": 550,
    "timeRequired": "PT3M",
    "speakable": {
      "@type": "SpeakableSpecification",
      "cssSelector": [
        "h1",
        "h2",
        "article p:first-of-type"
      ]
    },
    "copyrightHolder": {
      "@type": "Organization",
      "@id": "https://transformery.ch/#organization"
    },
    "copyrightYear": 2026,
    "isPartOf": {
      "@type": "CreativeWorkSeries",
      "name": "Transformation in practice",
      "url": "https://transformery.ch/blog"
    }
  },
  {
    "@context": "https://schema.org",
    "@type": "BreadcrumbList",
    "itemListElement": [
      {
        "@type": "ListItem",
        "position": 1,
        "name": "Home",
        "item": "https://transformery.ch"
      },
      {
        "@type": "ListItem",
        "position": 2,
        "name": "Insights",
        "item": "https://transformery.ch/blog"
      },
      {
        "@type": "ListItem",
        "position": 3,
        "name": "evaluate-an-ai-pilot"
      }
    ]
  }
]
```