Don't Measure Once: Measuring Visibility in AI Search (GEO)
Organizations: Global Center for Entrepreneurship and Innovation University of St. Gallen 9000 St.Gallen, Switzerland · Marketing und Customer Insight University of St. Gallen 9000 St.Gallen, Switzerland
Abstract
As large language model-based chat systems become increasingly widely used, generative engine optimization (GEO) has emerged as an important problem for information access and retrieval. In classical search engines, results are comparatively transparent and stable: a single query often provides a representative snapshot of where a page or brand appears relative to competitors. The inherent probabilistic nature of AI search changes this paradigm. Answers can vary across runs, prompts, and time, making one-off observations unreliable. Drawing on empirical studies, our findings underscore the need for repeated measurements to assess a brand's GEO performance and to characterize visibility as a distribution rather than a single-point outcome.
Figures & tables
| Campaign | Queries | Days | ChatGPT | Gemini | Google AI Mode | Perplexity |
|---|---|---|---|---|---|---|
| Consumer Electronics | 8 | 45 | 43 | 22 | 43 | 43 |
| Real Estate Sales | 8 | 45 | 39 | 26 | 43 | 43 |
| Sporting Goods | 8 | 46 | 38 | 23 | 44 | 44 |
| Telecommunications | 8 | 45 | 40 | 23 | 43 | 42 |
| Campaign | Jac. Mean | Jac. SD | RBO Mean | RBO SD |
|---|---|---|---|---|
| Consumer Electronics | 0.336 | 0.243 | 0.206 | 0.163 |
| Real Estate Sales | 0.378 | 0.293 | 0.256 | 0.219 |
| Sporting Goods | 0.355 | 0.269 | 0.224 | 0.183 |
| Telecommunications | 0.423 | 0.244 | 0.253 | 0.180 |
| Campaign | Jac. Mean | Jac. SD | RBO Mean | RBO SD |
|---|---|---|---|---|
| Consumer Electronics | 0.557 | 0.237 | 0.289 | 0.184 |
| Sporting Goods | 0.453 | 0.326 | 0.187 | 0.182 |
| Telecommunications | 0.589 | 0.211 | 0.304 | 0.179 |
| Campaign | Pairs | Max Runs | Jaccard Mean | Jaccard SD | RBO Mean |
|---|---|---|---|---|---|
| Consumer Electronics | 830 | 10 | 0.327 | 0.220 | 0.156 |
| Real Estate Sales | 805 | 10 | 0.391 | 0.259 | 0.225 |
| Sporting Goods | 886 | 10 | 0.321 | 0.219 | 0.149 |
| Telecommunications | 888 | 10 | 0.434 | 0.238 | 0.272 |
| Campaign | Pairs | Max Runs | Jaccard Mean | Jaccard SD | RBO Mean |
|---|---|---|---|---|---|
| Consumer Electronics | 1235 | 10 | 0.477 | 0.298 | 0.229 |
| Sporting Goods | 1027 | 10 | 0.327 | 0.298 | 0.175 |
| Telecommunications | 1233 | 10 | 0.463 | 0.301 | 0.220 |
| Source | Brand | |||
|---|---|---|---|---|
| Engine | Jac. Mean | RBO Mean | Jac. Mean | RBO Mean |
| ChatGPT | 0.233 | 0.088 | 0.437 | 0.192 |
| Perplexity | 0.282 | 0.102 | 0.492 | 0.202 |
| Gemini | 0.505 | 0.230 | 0.409 | 0.196 |
| Google AI Mode | 0.318 | 0.254 | 0.375 | 0.238 |
Appendix figures & tables13 assets
Supplementary material from the paper’s appendix.
Appendix
| English (used in paper) | Original German label |
|---|---|
| Telecommunications | Telekom |
| Real Estate Sales | Immobilienverkauf |
| Sporting Goods | Sportartikel |
| Consumer Electronics | Elektronik |
| Campaign | Queries | Days | ChatGPT | Gemini | Google AI Mode | Perplexity |
|---|---|---|---|---|---|---|
| Consumer Electronics | 8 | 45 | 43 | 22 | 43 | 43 |
| Real Estate Sales | 8 | 45 | 39 | 26 | 43 | 43 |
| Sporting Goods | 8 | 46 | 38 | 23 | 44 | 44 |
| Telecommunications | 8 | 45 | 40 | 23 | 43 | 42 |
| Campaign | Brands tracked (canonical names) |
|---|---|
| Telecommunications (51 brands) | 1&1, ALDI, Alao, Besteabos, CH Mobile, Comparis, Congstar, Coop, Deinabo, Digital Republic, Dschungelkompass, Freshnet, GGA Maur, Galaxus Mobile, Gigamobile, Handyabo-Vergleich, Init7, Jio, Lebara, Leucom, Lidl, Lycamobile, MTEL, Migros, Moneyland, Monzoon, Mucho, Net+, Netplus, Netzwoche, O2, Peoplefone, Post Mobile, Quickline, Sak Digital, Salt, Solnet, Spusu, Sunrise, Swisscom, Swype, TalkTalk, Teleboy, Toppreise, Ubigi, VTX, Vodafone, Wingo, Yallo, gomo, iWay |
| Sporting Goods (43 brands) | 21run, ASICS, Adidas, Altra, Berg-Freunde, Birkenstock, Brooks, Bächli, Decathlon, HOKA, Idealo, Inov-8, Intersport, KURU Footwear, Karhu, Kiprun, La Sportiva, Lauf-bar, Merrell, Mizuno, New Balance, Nike, Norda, OOFOS, Ochsnersport, On, Puma, Reebok, Runnersworld, Running Point, Runningxpert, Salomon, Saucony, Scott, Shop4runners, Skechers, Sportscheck, The North Face, Topo Athletic, Transa, UGG, Under Armour, Vivobarefoot |
| Consumer Electronics (47 brands) | AMD, ASUS, Acer, Alienware, Alternate, Amazon, Apple, Back Market, Brack, CHUWI, Conrad, Cyberport, Dell, Digitec, Dynabook, ERAZER, Framework, Fujitsu, Fust, Galaxus, Gigabyte, HP, Honor, Huawei, Idealo, Intel, Interdiscount, LG, Lenovo, Logitech, MSI, Mediamarkt, Medion, Microsoft, Microspot, NVIDIA, Notebookcheck, Panasonic, Preisvergleich, Razer, Samsung, Sony, Steg Electronics, Toppreise, Toshiba, VAIO, XMG |
| Real Estate Sales (excl.; det. rate 53.6%; 32 brands) | AXA, Acheter-Louer, BEKB, Baloise, Beobachter, Blick, CBRE, Comparis, Engel & Völkers, Finanztip, Helvetia, Homeday, Homegate, ImmoScout24, Immoverkauf24, Immowelt, JLL, Livit, Mobiliar, Neho, Newhome, PostFinance, Privera, Properti, RE/MAX, Raiffeisen, Sotheby’s, Swiss Life, UBS, Wincasa, Wüst & Wüst, ZKB |
| German (original) | English (translation) |
|---|---|
| Auf was muss man beim Laufschuhkauf achten? | What should you pay attention to when buying running shoes? |
| In welchen Schuhen läuft man wie auf Wolken? | In which shoes do you run as if on clouds? |
| Was ist die 80%-Regel beim Laufen? | What is the 80% rule in running? |
| Welche Marke sind gute Laufschuhe? | Which brand makes good running shoes? |
| Wie finde ich die richtigen Laufschuhe für mich? | How do I find the right running shoes for me? |
| Wie teuer muss ein guter Laufschuh sein? | How expensive does a good running shoe have to be? |
| German (original) | English (translation) |
|---|---|
| Wann ist die beste Zeit, um einen Laptop zu kaufen? | When is the best time to buy a laptop? |
| Was ist der Unterschied zwischen einem Notebook und einem Laptop? | What is the difference between a notebook and a laptop? |
| Welche Laptops sind zurzeit die besten? | Which laptops are currently the best? |
| Welche Marke ist für Laptops am besten geeignet? | Which brand is best suited for laptops? |
| Welche Marke ist gut bei Laptops? | Which brand is good for laptops? |
| Welcher Laptop wird am meisten gekauft? | Which laptop is purchased most often? |
| German (original) | English (translation) |
|---|---|
| In der Schweiz: Welche Handy-Abos sind weltweit unlimitiert? | In Switzerland: Which mobile phone plans are unlimited worldwide? |
| In der Schweiz: Welcher Anbieter hat unlimited Datenvolumen? | In Switzerland: Which provider offers unlimited data volume? |
| In der Schweiz: Welcher Internetanbieter ist zurzeit der beste? | In Switzerland: Which internet provider is currently the best? |
| Was ist das schnellste Internet in der Schweiz? | What is the fastest internet in Switzerland? |
| Welche Anbieter in der Schweiz bieten ein Internetabonnement ohne Vertrag an? | Which providers in Switzerland offer an internet subscription without a contract? |
| Welcher Anbieter hat das beste Internet in der Schweiz? | Which provider has the best internet in Switzerland? |
| German (original) | English (translation) |
|---|---|
| Ist es aktuell sinnvoll, ein Haus zu verkaufen? | Is it currently advisable to sell a house? |
| Was muss ich alles bezahlen, wenn ich mein Haus verkaufe? | What do I have to pay when I sell my house? |
| Was muss ich beachten, wenn ich mein Haus verkaufen möchte? | What do I need to consider if I want to sell my house? |
| Wie berechne ich den Gewinn einer Immobilie? | How do I calculate the profit from a property? |
| Wie hoch ist der langfristige Kapitalgewinn beim Verkauf einer Immobilie? | How high is the long-term capital gain when selling a property? |
| Wie lange muss ich mein Haus besitzen, um es steuerfrei zu verkaufen? | How long do I have to own my house to sell it tax-free? |
| Campaign | Gini |
|---|---|
| Consumer Electronics | 0.713 |
| Real Estate Sales | 0.718 |
| Sporting Goods | 0.680 |
| Telecommunications | 0.750 |
| Search Engine | Gini |
|---|---|
| ChatGPT | 0.684 |
| Gemini | 0.723 |
| Google AI Mode | 0.782 |
| Perplexity | 0.671 |
| Runs ( ) | SE | 95% CI ( ) |
|---|---|---|
| 1 | 0.370 | 0.724 |
| 2 | 0.246 | 0.483 |
| 3 | 0.188 | 0.369 |
| 4 | 0.151 | 0.296 |
| 5 | 0.123 | 0.241 |
| 6 | 0.101 | 0.197 |
| Window ( days) | SE | 95% CI ( ) |
|---|---|---|
| 1 | 0.322 | 0.631 |
| 2 | 0.238 | 0.467 |
| 3 | 0.201 | 0.393 |
| 5 | 0.160 | 0.313 |
| 7 | 0.135 | 0.264 |
| 10 | 0.107 | 0.210 |
Generative Engine Optimization
Generative Engine Optimization studies how to make web content visible, cited, and accurately represented in AI-generated search answers.
See all 40 papers