I Sent Grok Bot to Buy My Gluten-Free Beer

15 min read

I literally have a couple of minutes just to talk you through what I've done over the last couple of days, or just today actually, to be honest, because it is pretty cool. I've written a couple of tweets about it, but I just thought I'd walk you through it.

My chief of staff and the home bot

This is my chief of staff, and I've just kind of set up a home bot who's in charge of all the stuff around the house. The simple things, like the kids are going to school in September, the school calendar stuff. All these things that are in my head that I'm going to forget and that I keep adding to calendars, but they're just tedious to keep control of.

And then this is the thing I have to buy for the school to bring on the first day. The bot is basically updating the meeting and sending the list to the home bot. So the meeting that I have with the school is on the calendar. I've got to label the bag with the name, not the brand as written. That's one child's list. If both twins are going to be 3 years of age, then we need two bags. Okay, let's keep track of it.

I said, can you create me a nice way of viewing this? And I thought this is quite cool, because that was just built in a second. These are the things that I need to buy. I need to ensure that I have this before we go into the school. I said, can you save the school details, because I'm going to maybe need to call them and I don't have their phone number. It's on that piece of paper. So they've done that.

Two jumbo rolls, bought from my phone

Then I was like, this is a cool thing. Let's test out if we can purchase this right now. This is all from mobile.

I said, can you add two of the jumbo rolls to my Amazon cart? I obviously spelled it wrong. You'll notice that I spell quite badly. And then it translated into English: jumbo paper towels, rolls. And it just found two jumbo rolls in the Amazon cart. Prime, tomorrow, to the house.

I haven't bought them, and I was like, I'm just going to go buy them. And it's going to ask me to log in and make me do all this kind of stuff and it's not going to work. I just went: go buy them. And then it just went, buying the two rolls now, I'll stop if I need to confirm payment. I was like, sure, it's going to need to confirm payment. And then it was like: bought.

Two jumbo rolls arriving tomorrow. Gift card, I've covered it, so nothing extra on the card. Order number blah blah blah. And I was like, oh my god, is this for real? So I checked my emails, and it was actually in my email. It actually did work. I didn't log in or nothing. So I'm guessing the login that I did yesterday has persisted, and I'm still logged in, so it's able to do stuff.

And then I was like, did you mark off that school list of our things to buy? So it did. And there's my beautiful little mini app, I guess you could say, with this marked off. So now I can easily just see this checklist and keep asking it to check things off as I purchase what I need to purchase.

What else can I do?

So I was like, cool, and then I was like, what else can I do? Can I check Twitter for cool uses that people are doing with bots? And it came back with all these cool things, which I thought was really cool. And then, look at this: people are also citing your travel agent and YouTube pipeline as an example, you're already ahead of most of the fleet posts. I love that.

One of the things I set up was the news patrol one. I said, that sounds pretty useful, go ahead and do it. So it's now watching for news on Playwright, Cursor, MCP and model launches. Connecting to the X connector would make it much tighter. I had problems on mobile connecting, so I couldn't get it to work.

I ran out of gluten-free beer

I was literally then going down to my fridge to get a gluten-free beer. And I was like, oh my god, this is the last gluten-free beer. I have no gluten-free beer left. So I was like, what if I could just ask the chief of staff to go buy some?

So I was like: I just ran out of gluten-free beer, should we do an Alcampo shop? That's where I normally buy it online. And order some, or is there a better place with more selection? And it says, I'll check Alcampo for gluten-free beer near you and whether Mercadona, Carrefour or a speciality shop has a better range. I'm like, amazing.

And then, going back into the other one: make sure to include new ideas or suggestions on bot use cases, maybe that needs its own bot. And it's like, got it, I'll fold bot news and use case ideas into the watch. And I'm still on the gluten-free beer. So I'm able to totally just throw my ideas in there, mix up conversations. And that's something that is really cool, because sometimes I say things like this to my husband and he's like, there's too much things going on, you can't do them all. This bot is listening to everything I say in different orders and is able to put it all together. It's cool.

And then this is really cool. Alcampo is the right shop, your hyper already has the widest gluten-free beer shelf. Estrella Galicia six pack on offer, plus the others. I've never seen that one. That's cool.

And then this was actually just a multiple choice, and I just kind of typed it in because I wasn't sure what I was doing. So I was like, let's do an Alcampo delivery. I changed my mind halfway through. I was like, oh, let's just do it. So it went and put the delivery together with a mix of gluten-free beers, which I thought was quite nice, with the ones that were on offer. Instead of me. I'm so indecisive, I'm like, I don't know which ones, just do it for me. This is amazing. I like this. So now the mix is two Estrella Galicia six packs, the offer, plus amber cans. Fantastic. I'll send the cart and the first delivery slot before anything is paid.

Opening the bot's computer

What I noticed when I'm on mobile is sometimes things don't work. I was looking at it and it was going a bit slow, so I opened up the bot's computer. How you open up the bot's computer is you click the computer icon in the bot UI, and then you can see what is going on.

So when I clicked on what's going on, there was this weird tab of an AI car something. Just totally weird. I was like, I don't know where that came from. So I was like, close the tab on AI agents for cars and then go back to the Alcampo tab. Some agent, I don't know what went on there, but that was weird. So I closed that tab and went back to Alcampo.

The two items in the cart so far is about 23 euro, and it's going to finish the beer mix and send the slot before it's paid.

The login button that would not click

Now I had problems on mobile trying to actually click on the login button. This did not work for me on mobile. The login screen, it's really hard on mobile to go take over the computer and find the right thing. It could have been me just copying the password over and the password was wrong, I don't know. Definitely just set up a 1Password MCP in there or something to make it much easier. But that was my experience.

So I basically went, are you logged in? And it told me, look, don't give me credentials, which is nice. So the cart is sitting there.

I open the computer, and what I typed in earlier on mobile is here on desktop. And that's cool that it's persisted across. So maybe this password is wrong. I want to try something here on desktop that would not work on mobile: what if I could copy my password over from 1Password? Let me find the password over here in my 1Password app, because sometimes if I paste that in, look at that. So from desktop I can copy and paste, but from mobile I could not. Something to think about.

Now this is not allowing me to click here. So I've typed my password in and my email is correct, and this is not working. So there's something happening here. So what I can do is say: I have added the password, can you click connect, and let's see if the bot can do it, because I can't do it and this is leaving me stuck. That's my problem here when it comes to shopping. Some sites are working perfect and some sites are not, and it's normally to do with the form filling.

It says, I'll click connect on the form you filled. Don't send the password in chat. I like the way it reminds people to not do that, because that's cool.

Oh my god, did you see it? It just clicked it. Did it work? That's the thing. No, it's back here. So something is going on. That's unfortunate. It's clicking and it's getting an about:blank. So there's something going on with that particular site.

Let's teach it a task, let's see if this works. But then something here is blocking it. I think there's some popup here. This is not working for whatever reason, so I can't teach it. But normally what you can do here is you can teach the bot something. And look at this, it's watching the demo now and it's going to turn it into a skill once it's got the steps. That's the really cool thing. So if that actually worked and it was able to log in, that's going to create a skill and it's going to know that it's to click that button. But for some reason something is not running in there.

I wonder, I'm going to be something stupid here. If I could inspect and figure out what is going on here with this button. Why is this not clickable? It's disabled. If I could just make it clickable, even just for here. Don't tell me this is going to work. Okay. So that's kind of funky though, isn't it?

We have improved our security, so I've got to reset my password. That's very interesting. And this is a question I have for the actual team: should we be saving our passwords in here, into this browser? I'm doing a no for now.

The morning podcast

While I was doing that and waiting for that to happen, I tweaked this morning podcast, because I wanted to show you what it's like. I basically just said, a morning podcast of the things I want to know about. So it creates an MP3 using an Irish English voice, and speak fast, and send the message. And this runs on weekdays at 8:00 a.m.

And I ran just a test run here, because this is really cool. I don't know if you're going to hear this:

Sunday night, so this is a look at Monday through Wednesday. Calendar is empty tomorrow.

I could literally just listen to that, download it. So every morning I'm going to get this and I'm going to know what's on my calendar, what emails I have that are important and stuff. This is fantastic. And I can tweak this as well, this is editable. So I can add in anything I want. I could delete it, activate it, unactivate it. This is fantastic.

Beer, finally

Let's go back in here and let's see if I can actually now log in and buy some beer, because I think that would be pretty cool. And then I could finish my Sunday night with a fridge full of beer on Monday morning to be delivered.

All right, let's connect and let's see. Again, I'm not going to save, but somebody tell me, should I be saving? Would that make life better? And there we are, I'm actually logged in now. So I'm going to close that, because I don't want to do any of the work here.

I'm going to ask it: tell me what time slots are available for tomorrow delivery. Don't purchase anything just yet, because I want to add some more stuff to the cart. That would be great, thanks. See, I'm nice, I say polite things.

So it's going to check Monday delivery. This was always a pain point for me when checking this. And it's going to leave the cart alone.

An hour of my life back

This would be cool, because I don't want to run a delivery just yet. I want to keep adding to it for a couple of hours, maybe days. And this is amazing, because I was literally 3 days without dishwasher salt. I kept going, I need to buy dishwasher salt, I need to go to the supermarket, I need to go to the supermarket. I've literally got twin toddlers. Sometimes going to the supermarket is just an ordeal in itself. So getting those things done is hard, and having your shopping delivered is just amazing.

But sometimes I just don't have the time to sit in front of the computer for an hour. It takes me an hour just to fill the shopping cart with the stuff I need, go through it, go to the app and stuff. It's so slow. If I could do this and save like an hour, I could just have my shopping done. I could do smaller shops more frequently rather than just one big massive shop of, I've run out of everything in the world.

The other routines

Another routine I've got is a news patrol every hour on weekdays. It's going to tell me the news of things on Twitter and things I'm missing out on AI. Keep me up with the AI stuff.

My ZurichJS schedule. This is the next conference I'm speaking at. I don't know if I need this, I kind of don't think I need this, but sometimes at a conference they change your speaking schedule. They should tell you, but it has happened that it's changed. And this is just going to check against that website and make sure nothing has changed against my calendar and the actual website. Again, that's going to use tokens and credits, so maybe I don't use that. So I can decide should I want that or not.

And the actionable ping is just my chief of staff checking the emails and checking the Google calendar and all stuff like that.

It's a bit slow right now. Now it's saying chief of staff is working, but sometimes you're kind of going, is something going on, is something not going on? And you get to a stage where you're like, I don't know what's happening. And sometimes I just ask it, everything okay? I speak to the bot a lot.

So this is my chief of staff, it's pinned up here. You can pin it by just unpin and pin up here. You can also duplicate it if you wanted two chief of staffs for whatever reason. And the chief of staff manages all these, so I very rarely actually need to go in here. When I go into my home bot, for example, you can see I did not speak to my home bot. My home bot is the one that does the shopping, the home kind of stuff, and it just talks back to the chief of staff. So I'm not monitoring much. The travel bot went ahead and looked for flights for Switzerland because it didn't find it in the calendar, and then I said to the chief of staff, no, I've already got flights, check my calendar. And it went and checked the calendar.

So, did I get the beer?

This video is getting much longer than I expected, but it looks like I'm going to get beer, guys. There's time slots there that are available for the delivery with the prices. From 5:00 it is much cheaper to get the shopping delivered, so I should probably choose that time slot. And normally that gives me until about 12:00 in the day.

I have to take over to be quicker. I can go in here and let's see if I can just click the time slot and see what happens. But again, that's not what I should be doing. I should be just getting the bot to do it.

So now I've got that reserved correctly. I think I've got till 3:00 to keep purchasing stuff. So I don't want to actually purchase more, I'm going to just keep adding to the cart. Make sure you keep that tab open, or easily be able to get back to that spot whenever I ask you to purchase more stuff for Alcampo.

There we go, people. That's me. I need to go to bed. See you later.