EleVint / Simulation Lab
Simulation running · updated 29 August 2026, 00:14 PDT

Tested by 11 AI-run wineries in the last 24 hours. Every day.

Every day, a fleet of simulated properties works real shifts on EleVint — AI guests calling, booking, ordering and complaining; AI staff answering them through the same software our customers use. When something breaks, an agent we call the Fixer writes the fix, a scenario re-verifies it, and it ships to production as a pull request. The platform improves while you sleep.

2,083
Guest conversations
19,110
Actions on the platform
6
Verticals exercised
50
Simulated properties
Found
95
distinct faults the fleet hit
›
Fixed
9
4 written by the Fixer and re-verified by the failing scenario · 5 by engineers from lab findings
›
Shipped
1
1 pull request to production, human-merged

The last 24 hours

Conversations per day · last 14 days
6221,244Sun 16: no shiftsMon 17: no shiftsMon 17Tue 18: no shiftsWed 19: no shiftsWed 19Thu 20: no shiftsFri 21: no shiftsFri 21Sat 22: no shiftsSun 23: no shiftsSun 23Mon 24: no shiftsTue 25: no shiftsTue 25Wed 26: no shiftsThu 27: 1244 conversations, 820 cleanThu 27Fri 28: 839 conversations, 577 cleanSat 29: no shiftsSat 29
839 conversations in the last 24h across 11 properties · 69% completed without a fault. Shifts run in real time — a night auditor works at 23:00, a cellar walk happens at 07:00.
Clean conversations by vertical · 24h
Tasting room60/143
Restaurant219/318
Hotel133/146
Spa68/97
Events21/38
Production76/97

How it works

1 · Guest

An AI guest with a life

A walk-in party of six, a bride's mother, a wine-club member who lost the bottle name. Each has a goal, a mood, and no script.

2 · Staff

An AI employee on the clock

Punches in on the real time clock, then serves the guest using only EleVint — the same screens and actions a human employee has.

3 · Fixer

Bugs get fixed, not filed

A failed scenario hands the Fixer the transcript. It patches the code on its own branch and the scenario runs again to prove it.

4 · Guardrails

Humans keep the keys

Auth, payments and compliance code are off-limits and quarantined for review. Every fix ships as a pull request a person merges.

What the lab fixed

Week of 24 August 4 fixes

  • verifiedHotel harness

    The walk-in booking scenario itself succeeded end-to-end (room found, reservation created, confirmed, guest satisfied), but the run was wrongly logged as a server failure because the simulator's confirm-stay tool threw a generic error with no status code when it briefly saw an unresolved placeholder ID before the agent retried with the real one; that tool now reports a proper "not found" status s…

  • shippedEvents

    The events "list tickets" lookup no longer crashes with a server error when asked for a status like "PUBLISHED" that doesn't exist in the system — it now replies with a clear message listing the valid statuses (draft, on sale, sold out, completed, cancelled) instead of failing outright.

    PR ↗
  • verifiedEvents harness

    Fixed the events ticket-sale simulation's script so the "guest" playing three sequential ticket buyers no longer cuts the call short after the first couple books — it now explicitly continues through Jordan Liu and the Peterson family before ending, so all three ticket sales get recorded as expected.

  • verifiedTasting room harness

    Fixed — the anniversary-couple check-in scenario was failing because no reservation was ever created for the guest to check in against, so every staff member correctly searched and found nothing until the guest gave up; the scenario now seeds a real matching reservation up front (using a new "book soon" option that also stops staff from wasting turns guessing valid times), so guests can be found…

What the lab surfaced

Every failure the console has traced to a cause — in the product, in the simulation itself, or in how the AI staff behaved — and what was done.

Fixedsimulation · seen 12×
Fruit deliveries logged, then scored as failures

The document was created and moved to PENDING every time. The simulation's adapter sent the wrong field names and null for a required document number, and the pass/fail check searched a field the product does not index.

Adapter numbers its own documents and maps the real fields; assertion searches the carrier. . Passed 11/11 on the next run.

Fixedproduct · seen 3×
Qualifying an event lead returned 500

Every client sends start and end as clock times (16:00); the API stored them into a date column and crashed.

Clock times are anchored to the event date; bad input is a 400 with a reason.

Fixedsimulation · seen 1×
Lead created with a value the API does not accept

The assistant was never told which source/event types exist.

Adapter docs list the enum values and the real return shape.

Fixedsimulation · seen 2×
Scenario asked to book a tasting at a time already past

The product correctly refused a reservation in the past; the scenario had not said which future slot to book.

Scenario books the next open slot tomorrow. sim-lab (this commit).

Prompt improvedAI staff · seen 6×
Spa room already committed — assistant stopped instead of offering the next slot

The product correctly refused to double-book the couples room. A good receptionist checks availability and offers the next opening; the assistant did not.

The scenario now tells the receptionist to re-check availability and offer alternatives on a conflict. sim-lab (this commit).

By designsimulation · seen 6×
Card payment needs a physical terminal

A card checkout requires a card reader; the simulation has none. The assistant was told so and should take cash or room charge instead.

Hardware is out of scope for the simulation.

Listen in

Six conversations, one per vertical, exactly as they happened. Names are synthetic; the software is real.

Tasting room Paisley Harris, tasting room associate · Eagle Glen Winery
GuestHey! Oh man, I'm so glad we're here — last time we came through was just amazing. We did the whole tasting thing, you know, that flight? And I found this red wine I absolutely loved and grabbed a bottle. I've been meaning to come back and do it all again, but honestly, I can't for the life of me remember what we tried or what that wine was called! The bottle had such a pretty label though. Can you guys help me figure out what we did?
Paisley HarrisThat's wonderful! I'd love to help you track down that wine and get you set up for another tasting. To pull up your visit history, I'll need a bit of info — can you give me your phone number, email, or the name the visit would have been under?
GuestOh gosh, um, I'm not sure if I signed up for anything when we came in? It was a couple weeks ago — or wait, maybe it was more like a month? I honestly can't remember. My phone number is 555-0847, and my email is probably in there too if you need it, but I'm not totally sure I gave it to you guys last time. Either way, try the phone number first!
Paisley HarrisPerfect, I've got the phone number. Just to make sure I pull up the right guest — that's 555-0847, but I'll need the area code at the start to search our system. What's your area code?
GuestOh right, yeah — it's 707. So 707-555-0847!
Paisley HarrisGot it — let me pull up your account real quick!
Paisley HarrisHmm, I'm not finding anything under that phone number — sounds like you might not have signed up last time, which is totally fine! Let me try your email if you have one handy, or your name? That way I can see if your previous visit is in our system under a different way of tracking it.
GuestOh, um, okay! My name is Sarah — Sarah Mitchell. And my email is probably sarah.mitchell.seven at gmail dot com, but honestly, I might not have put it in last time. We kind of just walked in pretty casually, you know? Hopefully one of those helps!
Restaurant Riley Green, server · Rose Sierra Winery
GuestHey! Yeah, I'm here to place a quick takeout order — got about twenty minutes before I need to head back to the office. Name's Patel. What do you recommend today?
Riley GreenPerfect, Patel! Let me pull up today's menu and get your takeout tab started so we can knock this out before you head back.
Riley GreenGreat timing, Patel! Twenty minutes is doable. We've got 40 items today. For a quick takeout, I'd recommend our Seared Ahi Tuna or Crab Cakes if you want something elegant—both are real crowd-pleasers. Or if you want something hearty, we've got some killer entrees and sandwiches. We also do salads, sides, and desserts. What sounds good—are you looking for something light, or more of a full lunch?
GuestOh, the Ahi Tuna sounds perfect—yeah, I'll do that for one. And let me get... hmm, actually what's the Crab Cake situation? Is that heavy or pretty light? I'm thinking two different things for me and a colleague.
Riley GreenThe Crab Cakes are rich and indulgent—premium lump crab, really delicious—but they're not heavy in portion. Think elegant over stuffed. At $25, they're one of our fancier apps. So if your colleague wants something a bit more refined and doesn't need a ton of volume, they're perfect. The Ahi is lighter and more refreshing by comparison. Want to go one of each, or would your colleague prefer something else?
GuestYeah, one of each sounds great—so one Ahi Tuna and one order of the Crab Cakes. And throw in a side, what do you have? Something that goes with both would be perfect—maybe a salad or fries or something?
Riley GreenPerfect! We've got six sides to choose from. For something that plays nice with both, I'd say either our house salad—fresh and light—or truffle fries if you want something more indulgent. Any other classics you're thinking? Once you pick, I'll add it all to your check and get it fired to the kitchen.
GuestTruffle fries, definitely—can't go wrong there. So that's one Ahi Tuna, Crab Cakes, and the truffle fries. For Patel, picking up in twenty. What's the damage?
Hotel Stella Carter, night auditor · Oak Eagle Winery
Guest*whispers, voice strained and tired* Yeah, hi... sorry, I know it's late, but we've got a situation. There's people in the room next to us — 308 — and they've been real loud since around eleven. My kids are finally asleep and I... I really need this to stop, please. Can you help us out here?
Stella CarterI'm really sorry you're dealing with this, especially this late with your kids finally asleep. That's not okay. Let me pull up your information right now. I'm going to call room 308 immediately and ask them to quiet down, and if they don't answer or it keeps going, I'll go up there myself. Let me get your details.
Stella CarterPerfect, David. I have you in room 300 and I'm logging this right now as a high-priority noise complaint against room 308. Here's exactly what I'm doing: I'm calling room 308 in the next minute to tell them to turn it down immediately. If they don't respond or the noise keeps going, I'll go up there in person. I'm setting a reminder to call you back in 15 minutes to check that it's resolved. This is my top priority right now.
Stella CarterPerfect. Your request is logged and verified in the system as HIGH priority. I can see it right here—room 300, David Whitfield, noise complaint against 308, timestamp 01:17 AM, and it's flagged for immediate follow-up. I'm going to call room 308 right now. You can stay on the line or I can call you back in 2 minutes—your choice. If they don't answer or won't quiet down, I'm going up in person. Either way, I'm calling you back in exactly 15 minutes with an update on what got resolved.
Guest*whispers, a bit more hopeful but still tense* Okay, that's... that's good, thank you. Actually, it's Tom, not David, but... yeah, that's fine. Just call me back, I don't want to— *pauses, glances toward the kids* —I don't want to be on the phone in case they wake up. And hey, what happens if they don't, uh, cooperate? Like, if they won't turn it down? I need to know what the next step is here.
Stella CarterNo problem at all, Tom—I'll call you back. Here's the full picture: I call 308 right now and ask them to turn it down. If they don't answer or refuse, I go up to their room in person and speak to them face-to-face. That usually resolves it immediately. If they're still not complying after that, we have options—I can move your family to a different room so you get the quiet you need tonight, or we escalate it further. But let's start with the phone call. I'll have an answer for you in 15 minutes, no matter what. You get some peace tonight, I promise.
Guest*whispers, noticeably more relieved* Okay, yeah... yeah, that sounds fair. I appreciate you being straight with me about it. Moving rooms is fine if it comes to that—I just need my kids to sleep, you know? Go ahead and make that call. I'll wait for you to ring back. *pause* Thanks for taking this seriously.
Stella CarterYou've got it, Tom. I'm hanging up now to call 308. Fifteen minutes—I'll ring you back with an update. Get some rest if you can.
Spa Elijah Hall, spa receptionist · Sierra Bluff Winery
GuestHi! We're so excited — we have a wedding tomorrow and I'm trying to book spa treatments for our bridal party. We need four appointments, ideally massages or facials, all at the same time tomorrow if that's possible? There are four of us: Jennifer, Amy, Lisa, and Dana. When can you get us in?
Elijah HallHow wonderful — congratulations on the wedding! Let me check what we have available for your bridal party tomorrow. I'm going to pull up our services and see if we can get all four of you in at the same time.
Elijah HallWonderful news — we have plenty of great options for your bridal party. We have 10 therapists and 8 treatment rooms, so getting all four of you in at the same time is definitely possible. Let me find a great massage service for you and check tomorrow's availability.
Elijah HallPerfect—we have a beautiful Aromatherapy Massage that would be ideal for your bridal party. It's 80 minutes of pure relaxation, and I'm checking right now to see what times we have available tomorrow morning.
Elijah HallExcellent! We have wonderful availability tomorrow starting at 10:00 AM. I can get all four of you in with our massage therapists. Before I book them, I'll need email addresses for Jennifer, Amy, Lisa, and Dana so I can confirm each appointment. Can you provide those for me?
GuestOh, 10 AM works perfectly! Um, okay so I have Jennifer's email — that's [email]. But for the others, I just have their first names in my phone contacts. Let me text them real quick to get those? Can I call you back in like five minutes?
Elijah HallPerfect! That works great. Yes, absolutely — go ahead and text them for their email addresses. I'll have everything ready to book all four of you at 10:00 AM tomorrow morning when you call back. We'll get your bridal party all set!
GuestAwesome, thank you so much! Yeah, I'll grab those emails from them right now and call you back in just a few. This is going to be perfect — the girls are going to love this!
Events Luke Carter, events coordinator · Bear Valley Winery
GuestHi there! Yeah, so my wife Elena and I heard through a friend that you guys have some kind of harvest thing coming up soon? We're looking to spend a nice morning or afternoon out here, and I think they mentioned something about VIP tickets? Do you know what I'm talking about?
Luke CarterThat sounds wonderful! Let me check what harvest events we have coming up for you.
Luke CarterPerfect! We do have a harvest event—the Fall Harvest Dinner on September 20th. Let me pull up the details on that for you, including the VIP ticket options.
Luke CarterGreat news! The Fall Harvest Dinner is on September 20th from 6:30 to 10 PM, and we absolutely have VIP Reserve Pairing tickets available—$125 per person. That includes an elevated wine pairing experience. We have 12 VIP spots still open, so you and Elena would be all set. The event's in the evening, so it'd be more of an elegant dinner experience than a daytime affair. Does that work for you both?
GuestOh perfect, that sounds exactly like what we were hoping for! September 20th works great for us. And a wine pairing dinner sounds amazing—that's right up our alley. So that's two VIP tickets at $125 each, right? Should we book those now?
Luke CarterAbsolutely! Let me get those VIP tickets booked for you both. I just need your names for the tickets—what's your name, and Elena's full name if you don't mind?
GuestSure thing! It's Mark Vasquez, and my wife is Elena Vasquez. Go ahead and get those two VIP tickets locked in for us!
Luke CarterPerfect, Mark and Elena! Let me get those two VIP tickets locked in for you right now.
Production Ryan Phillips, vineyard manager · Fox Sun Winery
GuestHey, it's early. Where are we sitting on the Cab fermentation tanks right now — specifically what's the latest Brix on the big one, and is anything running dry?
Ryan PhillipsLet me pull up your Cabernet tanks and the latest lab numbers.
Ryan PhillipsI'm seeing your 2025 Cabernet aging lot, but let me get the full picture of what's actively fermenting right now in the tanks.
Ryan PhillipsGot it — 10 lots fermenting right now. Let me pull up your Cabernet specifically.
Ryan PhillipsThere's your big one — Tank 7, 1,602 gallons of your 2026 Cabernet. Let me get the Brix trend on that.
Ryan PhillipsTank 7 is done. You're reading -1.2 Brix as of this morning — fermentation wrapped up overnight. Yesterday at this time it was at 10.6, and the day before at 24.9, so it ripped through the last 10 points in about 24 hours. It's dry. That's your only Cabernet actively fermenting right now.
GuestTank 7 is done—fine, we'll press that today. But what about the other lots? I need Block 7's field Brix before first light so I can call the pick. What are we reading out there right now?
Ryan PhillipsI don't have access to the vineyard ERP for field Brix readings on Block 7 — that's outside my cellar tools. You'll need to check with whoever's running the field sensors, or pull the data from the vineyard system directly. What I can tell you is what's fermenting in here right now: 10 lots going, all the rest still have sugar in them — nothing else is dry yet.

Badge

Tested by the EleVint Simulation Lab — 2,083 conversations

Live numbers, regenerated with the page. Embed:

[![Tested by the EleVint Simulation Lab](https://lab.elevint.co/badge.svg)](https://lab.elevint.co)

Machine-readable: /badge.json · /data/lab.json