Skip to content
XICBOT

Settings

Deutsch
Counted, not estimated

Conversation Analytics: understand what your visitors ask

The evaluation reads your own rows and nothing else: conversations, messages, replies, tool calls, outcomes and visitor ratings.

In plain language

The analysis counts what happens in your chats. It only reads your own data. It shows topics, open questions and gaps in knowledge. It also shows where chats break off or are handed over to a person. Every number is counted, not guessed. If the basis is missing, the card shows the reason instead of a zero.

Request a free initial consultation View pricing

  • Answers with a source reference
  • Loads only after your consent
  • No minimum term, cancellable monthly

Out of them come metric cards, a daily series, topics, unanswered questions, knowledge gaps, drop-offs and prompts. Every figure in there is counted, none estimated — and where the basis is missing, the card shows the reason instead of a zero.

42 of 48
answers carrying a source reference
XICBOT, own measurement series of 11 September 2026
1.3 s
to the first character of the answer, median
XICBOT, own measurement series of 11 September 2026
8 of 8
questions without a basis declined instead of guessed
XICBOT, own measurement series of 11 September 2026
2,670
sections from 70 documents in our own knowledge base
XICBOT, count in our own database
A question the assistant has no answer for yet, Example conversation, reconstructed
  1. Visitor:Do you deliver to Austria as well?

  2. Assistant:There is nothing on that in the stored sources. I do not guess — I would rather say so.

    • Knowledge gap written · type: refusal · event raised
  3. Visitor:And how do I find out, then?

  4. Assistant:I am handing over to a person, along with the conversation so far, so that you need not write anything twice.

    • The gap row carries no copy of your question; it is looked up through the message. Once the message is deleted, the list no longer shows a question.

Ask it yourself, Assistant of this website

Automated assistant

Enter sends, Shift and Enter starts a new line.

The assistant only loads after your consent. Privacy

What the evaluation counts, and from what

The evaluation queries no outside party. It computes over your own rows and delivers the metric cards in a single request. Besides its value, every card states whether a measurement happened and, in case of doubt, the reason; share cards carry numerator and denominator so that it stays visible what a share rests on. Where nothing could be measured, that reason is shown — not a zero that looks like a result.

Seven, thirty or ninety days can be chosen. Without a setting, thirty days and Europe/Berlin apply. The time zone comes from the reader's browser; an unknown zone is an error, not a silent substitution. The window works with local day boundaries, and the current day is included.

  • Topics of the period

    Topics are formed from the most recent visitor questions inside the window. Identical wordings count with their frequency but enter the comparison only once. A topic carries at most three lead terms, in the spelling that was actually typed. Alongside it stand the conversations concerned, the suggestions offered and taken, and the share of handovers.

    • The similarity of two questions is computed on our own server, without any outside service and without a model call
    • The method knows no word meaning, only agreement in word forms, word pairs and character sequences
    • Two versions of the same question with no shared word parts therefore stay separate topics
    • Questions without distinguishing features, a bare thank-you for instance, are counted but form no topic
    • Every topic carries the figure of the preceding window of equal length and a direction
  • Knowledge gaps

    A gap is a row of its own, written the moment a finished answer ends without a single source reference. It carries one of two types: refusal by the model, or answer without a reference. In our own measurement series, 42 of 48 answers carried a source reference — the rest would each have produced a row here and show where the knowledge base needs to catch up.

    • A gap is only written from twelve characters of question text on, and only where knowledge is stored at all
    • The question text is not copied into the row; it is looked up through the message
    • Once the message is deleted, the list no longer shows a question
    • Every new gap additionally raises an event that your team can pick up
    knowledge base
  • Unanswered questions

    Next to the gaps stands the visitor message immediately before an evasive answer, truncated to three hundred characters. Like concerns are grouped into bundles in chronological order rather than in the best conceivable division: whoever came first determines the bundle.

    • Bundling uses the same similarity as the topics, with the same limit
    • The most recent questions of the window are evaluated up to a fixed ceiling, so that one request stays predictable
    • The topic list ends at fifteen entries, the other lists at fifty
  • Outcomes and drop-offs

    What the conversation produced is counted: enquiries, appointments, carts, plus the tool calls, separated into executed, declined and failed. A drop-off, by contrast, is not written but derived: an open conversation, not handed over, with at least one visitor message, silent for thirty minutes and without an enquiry, appointment or cart.

    • Beside the drop-off stands the position: the sequence number of the last message in the conversation
    • The distribution computes over all cases in the window; the list shows only the most recent ones
    • The last half hour is not yet countable, because the silence has to exceed the limit first
    • Outcomes are counted, not valued: no revenue figure, no attribution of an amount
  • Handovers and frustration

    The assistant detects frustration deliberately without a language model, through a point system: the call for a human weighs heaviest, joined by angry words, sensitive topics, the same question for the third time, writing in capitals, piled-up exclamation marks and two fruitless answers in a row. From the configured threshold on, a handover happens — exactly once per conversation.

    • The threshold sits with each assistant version and can be set tighter or wider
    • The notice to your team only goes out once the handover is recorded in the database
    • The evaluation shows the handover rate per topic, not only as a single total
  • Language and window class

    The distribution knows exactly two features: the language of the conversation and the window class — phone, tablet, desktop or wide. The class comes from the loader script; where it is missing it stays empty and the conversation is listed separately as unspecified, instead of moving into a guessed bucket.

    • Nothing is read from the browser identifier, because there is no way to verify what it claims
    • What a visitor clicks on your site is not measured, and no path across your pages is tracked
    • Inside the chat window, only what the visitor triggers counts, the rating of an answer for instance
    • The visitor's address exists only as a salted fingerprint per tenant, and the evaluation does not read it
  • References, coverage, retrieval quality

    An answer counts as referenced when its source field is filled. The coverage sits in the answer row and was measured at answering time against the knowledge as it then stood: the share of meaning-bearing question terms in the best match — the very figure that decides whether the assistant would rather not answer. Retrieval quality comes from the most recent test-set run inside the window.

    • Without stored test rows there is no run, and the card names exactly that reason
    • The rank counts the position of the first passage from the expected document
    • Retrieval quality belongs to the tenant: a filter on a single assistant does not apply there
    • A falling value may come from harder test questions having been added — that is no regression in the stored knowledge
    • Answer times are given as median and as an upper percentile, not as an average
  • Prompts instead of thresholds

    Alongside the figures come prompts: ten kinds, each with the cases counted and the place where the change is made. A prompt arises from a case that occurred, not from a threshold and not from an industry value — a benchmark nobody measured would be invented. A kind without a case does not appear at all, and the response states the total number of kinds, so that an empty list stays distinguishable from a failure.

    • Recognised gaps turn into additions in the knowledge base
    • Recurring concerns turn into new actions for the assistant
    • Follow-up questions at the same point turn into clearer sections on your website

A figure only becomes something once someone reads it and acts. If questions about order status pile up, a status lookup through a connected inventory system in the support assistant suggests itself, with a connection in the Custom package; if a question about shipping costs sits just before many drop-offs, the answer belongs in the shop assistant before anyone has to ask it in the chat. We implement such changes with you and measure again afterwards, in the same window.

42 of 48

answers carrying a source reference

questions whose answer is in the knowledge base; six carried no source reference

The figures the operation can be measured against

  • Usage and answer quality are kept apart, so volume and quality do not blur into one.

  • Self-resolved, handed to a person and no answer together describe a period.

  • A figure without a basis reads as not measured, never as zero.

Demo account with sample data, German interface
Analytics: a seven-, thirty- or ninety-day window, followed by the usage and answer-quality groups with figures such as self-resolved, handed to a person, answers with a citation and no answer.

How the evaluation becomes an improvement

Between a conversation held and a better answer lie five steps, and none of them is magic. The assistant records as it answers, the evaluation computes over what was recorded, people read it, changes are made to knowledge, actions and pages — and afterwards the same figure stands there again for comparison.

  1. Record

    While answering, the assistant records what it did itself: which sources it used, how well your knowledge covered the question, which tool it called and what came of it. These fields are already part of the answer row. The evaluation later reads exactly that and recomputes nothing that was not measured at the time.

  2. Compute

    One request returns the metric cards for the chosen window, separated by tenant and with local day boundaries. Every card states whether a measurement happened; where the basis is missing, the reason stands where a figure would otherwise be. Share cards carry numerator and denominator.

  3. Refresh

    The view fetches the figures again on its own and marks a state as stale as soon as it is noticeably older than the cycle. Behind it sits a short cache, so that a screen left open all day does not keep the database busy. This is not a real-time picture: up to a minute passes between an event in the chat and it being shown.

  4. Read

    Alongside the cards stand topics, knowledge gaps, unanswered questions, drop-offs and prompts. Every prompt names the cases it arose from and the place where a change would take effect. Sorting follows the number of cases, not an impact nobody has measured.

  5. Improve

    Then something is changed: a missing answer added to the knowledge base, a new action enabled, a follow-up question phrased differently, a section on your website made clearer. Afterwards the same card appears again in the next window — together with the value of the preceding window of equal length, so the direction stays readable.

The order is not decorative: whatever was not recorded while answering cannot be reconstructed afterwards. A card without a basis therefore shows the reason and not a zero — a zero would be a statement about something that was never measured.

What the analytics does not do belongs in the description too: it does not say why someone bought or broke off, and it proves no effect of your change. It shows the cases, the value of the preceding period of equal length and the point at which a change can take hold. What of that is chance it does not separate out — the decision stays with you.

When patience runs out before anyone asks for a person, Example conversation, reconstructed
  1. Visitor:That is the third time I have asked this!!!

  2. Assistant:You are right, I am getting nowhere here. I am bringing someone from the team in.

    • Points: same question for the third time · piled-up exclamation marks · two answers without result · threshold reached · handover
  3. Visitor:Do I have to write all of it again now?

  4. Assistant:No, the conversation so far goes along. The handover happens exactly once, so no fresh notice is raised with every further sentence.

    • This is detected without a language model, through counted features. Later this conversation appears in the handover rate and under the topic the question was bundled into.

The weekly report on Monday morning

Anyone who does not look at the evaluation every day has it delivered once a week. The report is the same computation over a fixed window, translated into sentences — and each of those sentences hangs on a figure from the report, not on a phrasing that always fits.

  1. Queue

    On Monday morning at 06:41 the scheduler places one job per tenant into the queue. The time deliberately sits off the hour so that the dispatch does not coincide with every other task on the hour.

  2. Checking Whether a Report Comes About

    Before the calculation, the run checks three conditions: the account has an owner with a confirmed address, the report has not been unsubscribed, and the tenant is active. If one of them is missing, no report comes about. An email to an unconfirmed address is not sent, and unsubscribed stays unsubscribed — even when a lot happened during the week.

  3. Compute

    The background service picks the job up and computes the window of the past seven days in Europe/Berlin. What results are twelve labelled cards — the same figures that also appear in the customer area.

  4. Phrase

    The cards turn into sentences, and every sentence carries its figure with it. The sentence about the citation share, for instance, only appears when it is below half — otherwise it is not a hint but filler.

  5. Marking What Was Not Measured

    In the table each card carries either its figure or the reason it is missing, in plain words exactly where the value would otherwise stand. Shares are given as percentages, the response time in seconds. A card without a basis gets no zero: the zero would be a measurement and thus a statement about something nobody collected. If there was not a single conversation during the week, exactly one sentence says so.

  6. Deliver

    The report goes to the account owner and only to a confirmed address. Unsubscribing deliberately sits outside the login: anyone who no longer wants the report need not sign in first.

If the report fails to arrive, that is a finding and not a coincidence: either the job never left the queue or the address is not confirmed. Both can be checked, instead of blaming the delivery.

What the evaluation cannot do

An evaluation is only worth something once it is also clear what it does not say. This one counts your own rows and nothing else. Anything beyond that would be guesswork — and a guessed figure does more damage in a decision than a missing one.

  • There is no alerting: the evaluation does not call you, it is read or delivered as a weekly report
  • Output comes as a data record for further processing; there is no spreadsheet or PDF export
  • An integration key hands out exactly these figures and no conversation content
  • No amount is attributed to a conversation: the outcome is counted, not its value
  • No comparison with other businesses, because an industry value nobody measured would be invented
  • The last half hour is incomplete, because derived figures only become countable once their limit has passed

Setup once, operation monthly

The evaluation is tied to the package: it is included from Pro on. Without the entitlement, the interface answers with a block instead of empty cards — a zero would not be distinguishable from "not included". An integration key hands out exactly these figures, no conversation content.

Conversation analytics in the Pro package

from 149 € per month net

Minimum term: none, cancellable monthly

  • Evaluation in the customer area that refreshes itself, plus a weekly report on Monday
  • Topics, knowledge gaps, unanswered questions, drop-offs, outcomes and handovers
  • Concrete recommendations that we implement with you
  • Evaluated separately per tenant, visitor addresses only as a salted fingerprint

All prices net, plus VAT Source: XICBOT price list, as of 11 September 2026

Conversation analytics is part of the Pro package: one-time setup from 2,900 € net, operation from 149 € per month net with hosting in Germany, care and updates, including shop connection with Shopware Community Edition, product cards and cart in the chat. Before any setup we check what would be countable at your end today: without conversations held, every card stays empty, and a test assistant on your website produces the first rows for it. Ongoing services are booked individually and can be cancelled monthly; there is no minimum term.

What you can do with the insights

An evaluation is only worth as much as the steps that follow from it. That is why we translate every insight into a concrete action on the assistant, shop or website, keeping an eye on what makes the biggest difference. The following list shows typical measures that can be derived directly from the conversations and that we implement together with you, before we measure the impact again. Often the measures concern the wording in the lead assistant, because a badly phrased follow-up question shows up there at the drop-off position: the sequence number of the last message says which question the conversation ended on.

  • Add missing answers to the knowledge base so frequent questions are answered directly and from your own content
  • Enable new actions, such as a status lookup through a connected inventory system (Custom package) or taking appointment requests, when a topic keeps coming up in the chat
  • Surface product cards where visitors specifically ask about certain products or variants in the conversation
  • Defuse drop-off points in the purchase process, for example with a clear hint about shipping cost or delivery time
  • Sharpen website content when visitors keep searching for the same information in the chat instead of finding it
  • Take seriously the wording people ask in: the evaluation shows it as it was typed, not in your own language
  • Adapt the assistant's greeting and suggestions per page to the most frequent concerns of the respective visitors

What Your Chats Reveal About Your Business

In the initial call we show which evaluations an assistant delivers — from frequent questions and knowledge gaps to the topics that come up just before a decision.

See the evaluations See all functions

Typical insights and what follows from them

How does conversation analytics help in everyday practice? The following journeys are anonymized and illustrative, but show typical patterns from our project experience. They connect the reading of conversations with the concrete actions that follow. One example of measurable impact: around 70 percent (Baymard Institute) of online carts are abandoned, and the evaluation makes visible at which point in the conversation this happens, for instance at the shipping cost or an open question about delivery time.

Today

  • Support: The same questions keep reaching the team by phone and email
  • Online shop: Unclear which products are discussed and where purchases break off
  • Website: Visitors could not find important information on the website
  • Appointments: Unclear why proposed appointments often go unconfirmed in the conversation
  • After a Change: Whether the addition achieved anything remains a matter of feeling

With the assistant

  • Support: A topic of order status with many handovers, knowledge base extended and a status lookup through the connected inventory system (Custom package) enabled as an action — more conversations without a handover in the next window
  • Online shop: A topic of shipping costs just before many drop-offs, a shipping note and a product card added to the shop assistant — fewer silent drop-offs at the same point in the next window
  • Website: Knowledge gaps of the same kind in a row, the missing content added on the page and in the knowledge base — no new gap on that topic in the next window
  • Appointments: Many proposals without confirmation at the same point in the conversation, the preceding question reworded and the times stated in full in the proposal — in the next window more confirmed appointments stand beside the proposals
  • After a Change: The same card in the next window, beside it the value of the preceding period of equal length — what can be read is the direction, not the cause; what chance contributed the analytics does not separate out

Evaluation without glass-box visitorsWhat gets evaluated are your own rows: conversations, messages, tool calls, outcomes. No visitor profile arises from that — the address exists only as a salted fingerprint per tenant, truncated to its leading part for IPv6, and the evaluation does not read it. Who processes the data and what the processing agreement says belongs on the privacy and hosting page.

Without and with conversation analytics

Without an evaluation much stays guesswork: you sense which questions are frequent and puzzle over why conversations end. The difference is less the amount of figures than where they come from — on the left what people remember, on the right what was counted, with anything unmeasured marked as such.

Without evaluation

  • Which questions come up most often?: gut feeling and single impressions
  • Where does the assistant lack answers?: rarely noticed in time
  • Which products are of interest?: only later in the sales figures
  • Where do conversations end?: unclear and hard to grasp
  • What do we improve first?: a guess without priority

With XICBOT conversation analytics

  • Which questions come up most often?: topics from the wordings, with a comparison period
  • Where does the assistant lack answers?: a gap as its own row, with its type
  • Which products are of interest?: readable from the lead terms of the topics
  • Where do conversations end?: drop-off derived, with the position in the flow
  • What do we improve first?: prompts ordered by the number of cases that occurred

Both columns remain columns: a figure decides nothing by itself. It merely shortens the way from a hunch to a question that can be answered — and states how certain it is.

Analytics that grows with your business

Your business does not stand still, and neither should your assistant. New products, seasonal promotions, changed opening hours or an additional language change what visitors ask. Conversation analytics keeps pace: it shows when a new topic emerges, whether an action is well received and where new questions arise after a change. A change becomes visible through the comparison with the preceding window of equal length: a topic that did not exist before carries no previous figure, and that is exactly what is stated next to it. The insights flow back into the knowledge base, actions and website — whether the support assistant or the shop assistant hits the mark better afterwards is decided by the next measurement, not by the intention.

How chat transcripts turn into concrete improvements is described in conversation analytics: evaluating and optimising chats. Which metrics work for a business case is shown in what an AI assistant costs and returns. How those insights turn into concrete test cases for the next iteration is described in acceptance and test cases before go-live.

Frequently asked questions about conversation analytics

The most frequent questions about the evaluation turn on two things: what exactly is counted, and who gets to see it. Both are answered briefly here.

What exactly does conversation analytics evaluate?

The analytics view delivers 32 metric cards in one response, plus a daily series, topics, unanswered questions, knowledge gaps, blocked cases, drop-off points, recommendations and a version comparison. Things are counted, not estimated: a card without a basis in data carries the note not measured together with a reason instead of a 0, and every share shows its numerator and denominator beside it. Recorded are, among others, conversations, messages, self-resolved cases, handovers, answers with a citation, enquiries, appointments, carts and drop-offs. The distribution knows two attributes, language and window class — no browser identification is read for it. A revenue figure or an attribution to a purchase is deliberately absent. More under conversation analytics.

The assistant does not answer a question. Why?

In most cases the source is missing, not the capability. An answer is built from the sections that were found: at most five search hits plus your text blocks go to the model, numbered, and sourced answers name the excerpts they rely on. If the assistant finds nothing suitable, it usually says that nothing on this is held in the knowledge base. That refusal, like an answer without a used excerpt, is recorded as a gap; from the Pro package you will find it again in conversation analytics among the detected gaps. The route is therefore clear: read the gap, put the content into the knowledge base, re-read the source.

Do I see individual conversations or only numbers?

Both, but kept apart. Analytics shows condensed metrics and topics so you can recognise patterns without profiling individual visitors; it evaluates your own conversations only and knows neither an industry benchmark nor revenue attribution. You can look at individual conversations — masked by default: email address, phone, IBAN and postal address appear as readable placeholders, and the response itself states that it is masked. The plain text is seen only by someone who holds the role for it, states a reason and accepts the log line. Masking protects the display, not the storage: the history remains stored in full.

How does the analysis help me sell more?

It shows which products are asked about in the chat and where conversations break off. Topics are formed from the most recent 5000 visitor questions in the selected period, and the list ends at 15 entries. A drop-off is derived rather than guessed: an open conversation, at least one visitor message, silent for thirty minutes, not handed over and without an enquiry, appointment or cart. On top of that come recommendations in ten kinds, each with counted cases and the area in which you make the change. What the evaluation does not do: it calculates no revenue value and attributes no amount. How the shop assistant carries out the resulting actions is described on its page.

Which package includes conversation analytics?

Conversation analytics belongs to the Pro package: one-off setup from 2,900 € net, operation from 149 € per month net, including shop connection, product cards and the cart in the chat. The analytics endpoints sit behind that plan boundary, not behind an extra line item. Inside you see metric cards, daily curves, topics, unanswered questions, knowledge gaps, abandonment points and a comparison of two versions of your assistant, across periods of 7, 30 and 90 days. Every figure is counted, not estimated: where the basis is missing, the field says unmeasured together with a reason, and not a zero. All services can be cancelled monthly, there is no minimum term. Overview under pricing.

How often do I get evaluations and who implements improvements?

The evaluation refreshes itself every 60 seconds and marks a reading as stale from 90 seconds on; the figures behind it sit in the cache for up to 60 seconds. On top of that comes a weekly report compiled early on Monday over the preceding seven days, in the Europe/Berlin zone, with twelve labelled cards ranging from conversations through self-resolved cases to the drop-off share. A card without a basis carries its reason in plain words instead of a zero, so that a failed measurement does not look like a result. The resulting improvements to assistant, knowledge base and actions we implement together with you and then measure the effect.

Is the evaluation compliant with data protection?

Yes. Conversation analytics works with aggregated metrics and topics instead of personal profiles. The analysis runs on our servers in Germany, governed by a data processing agreement with clear deletion periods; the answers in the chat itself are generated by a specialised model provider, also outside the EU on the basis of standard contractual clauses. Your conversation data belongs to you and is neither sold nor passed on to third parties. Technically, analytics reads no browser identifier and stores no visitor address, only language and viewport class; the similarity of two topics is computed in PHP on our own server, without an external service and without a model call. Every figure is counted: where the basis is missing, the field says unmeasured together with a reason instead of a zero. Details under privacy and hosting.

If a question stays open, it is usually a good one: send it to us and we will say whether the evaluation can answer it — and if not, why not.

Free and without obligation

Understand what your visitors really ask

We go through the figures with you, card by card: what each one counts, where the number comes from and what it expressly does not say. Afterwards you know which of them decides something in your business and which merely looks good. Request a consultation

Request conversation analytics

Tell us what your assistant deals with and what you would like to read off the conversations. We go through the evaluation on a real screen and say which card would stay empty with your data for now. You can reach us by phone at +49 5123 9579000.

Enquiry in three steps

  1. 1. Topic
  2. 2. Your case
  3. 3. Contact

What is this about?

One click is enough, everything else is optional.

Tell us briefly about your case

Everything in this step is optional. It helps us reply with something concrete straight away instead of asking back.

Enquiries per month, roughly (optional)
When should it start? (optional)
How can we reach you?

Name and email address are enough. We reply personally.

We use your details to handle your enquiry. More on this in the privacy policy.