Winter Vacation Part I: Costa Rica

We’ve been on vacation the last nine days. Two days longer than we had intended, and we still have two more days to go. We’ve been caught up in one of the worst airline travel debacles in recent memory, as a winter cold spell wrecked havoc across most of the north and northeastern United States.

We left on the nineteenth to fly to Costa Rica. We had a layover in Houston then got on our flight to Costa Rica’s capital, San Jose. We were surprised to find ourselves in what I can only describe as the most luxurious flight experience I’ve ever had: first class seating that was spacious and reclined into a bed. It was fantastic. We had TV screens and got served a hot meal. I’ve never had anything like it, it was wonderful.

I had already booked a shuttle to take us from the SJO airport to the Fiesta Resort in Puntarenas, which was about an hour and half drive. I was dumbstruck by the beauty of the mountains, which we saw off in the distance as we wound our way down the highway.

One thing that struck me was the anti-landslide measures that had been put in place. High cliffs bounded the road, and miles of the cliffs were covered either by chain-link fences which were bolted into the granite. In other places, concrete had been sprayed on the cliffs, with small pipes drilled into the wall to let water escape. There were drainage ditches dug into some of them as well, pulling water down gentle slopes, instead of over the sheer drops. It was fascinating.

Our resort was nice, but not the best. We’d budgeted for a more modest stay instead of something like a Sandals or Beaches resort. Most of the guests were Costa Rican, one of the managers told me only a few guests were from out of the country. I ran into a handful of Americans over the week, and a European couple.

We had a beach-front view, we could spy across the bay to Tortuga island, but the actual beach itself was meh. The sand was black, and driftwood washed up everywhere. Younger enjoyed it but we wound up spending most of our time at the pool.

We took an excursion the second day, our only one of the trip. It was an all day trip to the Poas volcano. We had a 90-minute drive where we stopped at a coffee field, where we had a few cups and bought some trinkets. After refreshing ourselves it was on to the volcano.

Costa Rica has microclimates, little islands of weather that change as you climb the mountains. Poas was very cold, rainy and cloudy that day. The 300-meter walk to the overlook was miserable. We were very underdressed for the weather. I basically had to drag Elder, who was practically crying because of the cold and wetness. It was a bust, we couldn’t even see the caldera through the clouds. So we packed it up quickly and head out to the last stop on our day trip, to the waterfall gardens of La Paz.

This was much more fun, the park had a butterfly garden, which the kids really enjoyed, as well as a hummingbird garden. We stopped for lunch, which included a buffet. It was here that we lost our guide, Guillermo. He was a very nice gentleman, in his seventies. We had taken a table on the opposite side of the cafeteria from him, and when we finished eating he was no where to be found. I sent a message to the travel company via Whatsapp while we went for a walk on the nature trail.

The trail was a hike through the woods, following a river. It was beautiful. The path was marked off with stone slabs up and down the wandering hills. It was amazing really. By the time we got out I had gotten a call from the travel manager, he said Guillermo was out looking for us, and we managed to catch up with him a few minutes later. He was distraught about losing us, but I told him it was alright.

We explored the rest of the park, which included large cats, a replica of a traditional cabin, and a snake exhibit. Guillermo showed us the pit viper, the most poisonous snake in Latin America, and told us his brother had been killed by one. Then we went on to the actual waterfalls.

This was my favorite part of the park. Steel steps had been driven into the cliffs, offering observation posts at several points along several deep waterfalls along the river. It was gorgeous. We climbed down to the river bank and then back up and down as we followed the drops along the falls. After a short break back at the gift shop, we made our way back to the van and resumed our long ride back, which was almost three hours.

We didn’t go on any more excursions the whole trip, instead just lounging around the resort. I felt like the resort’s excursions were probably overpriced, but I didn’t have it in me to deal with the firm that waited right outside the resort on the beach. I really wanted to check out the adventure park down in Monteverde, but wasn’t sure that Younger would have been able to do the fun stuff that I wanted to do.

Food at the resort was not that great, with a few exceptions. There was a cafeteria that served various fare, every meal had rice and beans, plantains, a white cheese that resembled mozzarella, and tortillas. There were several stations that had chefs preparing various foods like omelets for breakfast, or fish and chicken dishes. It was traditional Costa Rican fare, but it seemed pretty bland for the most part. The girls didn’t eat much of it, despite wanting to eat there every day. There was a nice selection of desserts and sugary cereals that they liked, of course.

There were several other places to get food there, including a couple of grill stations where one could get hamburgers, pizza, or chorizo, and a two additional sit down restaurants with a la carte menus. As ‘exclusive’ level guests we were able to eat breakfast and lunch here without reservations, but we needed to reserve seats for dinner. This is where I preferred to eat. My best meal was when they transformed the fancier restaurant to a steak house, and I had a wonderful plate that included a trio of meats, including a bacon-wrapped chicken breast, and a pork chop and beef tenderloin.

Of course the alcohol was included. There was a swim up bar in the exclusive pool near our room, serving the local brewed lager, as well as a number of mixed drinks. You could get beer anywhere, and I probably woke up every morning with a hangover, except the day after we went on our trip.

At night there were tons of entertainment options. The entertainment started with a movie — League of Superpets was on the two nights that we saw — followed by an act for the kids to bring them up on stage and interact. After that was a dance and comedy show, with a troupe of four or five couples dancing to Disney songs or whatever, interspersed with a clown slash jesters that juggled and joked and did unicycles and other physical humor. Everything was in Spanish, of course, save for the emcee who repeated everything in Spanish and English — he was a Canadian expat who had lived in CR for twenty five years.

I felt bad about not making any attempt to learn Spanish before our trip. I started doing Duolingo one or two days into the trip, and after a few days was able to make simple requests en Espanol. It wasn’t quite enough though. Despite everything I’d heard about ‘everyone’ in CR speaking English, it wasn’t quite the case. Many of the guides and staff were able to talk to us, but most of the random staff that I talked to didn’t know any. I was able to bridge the gap by using the translate app on my iPhone, it actually worked pretty well despite the app’s clunkiness.

The weather was great the entire trip. There was one or two days where it got so hot around that we had to hide out in our room for a siesta, but we wound up spending mornings and evenings out in the pool.

Missus and I didn’t really spend too much alone time together. We put the girls in the resort’s kids’ club a few times, but they didn’t really enjoy it so we only left them there a few hours. In hindsight, we should have just left the girls in the room by themselves to sneak off and eat.

In all we spent seven days at the resort, which in hindsight, again, was a bit too much. Four days would have been ideal, and we could have spent a couple of days wandering around the country, adventuring. Maybe next year.

We enjoyed a bit of schadenfreude while we were enjoying the tropical weather. A massive cold front had swept through the US, bringing temperatures at home down into the teens. Two days before Christmas the temperature at the house didn’t get above twenty degrees. Our hubris, however, was about hit us upon our return to the United States.

Morning update

I’m behind this morning because I was cleaning the kitchen. I went to the climbing gym last night with someone I met there who lives nearby. He almost got in a wreck on the way home, merging onto the freeway, but never mind that. I got home at 9:30 and stayed up too late. Anyways. Shoulder’s felt great this morning after I stretched the sleep out of them. Ready to rock.

Something popped up for the DAO last night, so I need to provide some updata — that’s updated data — hehe. I’m being silly today because I got into an argument with Missus as soon as I woke up this morning. Gas gauge was on the car and it’s my fault. Anyways.

I’ve got so many ideas of things to do with GPT.

The Discord bot is coming along, but the prompt engineering and training is going a little slower than I wanted. I had an idea this morning, that I should just go ahead and build a demo of this right now.

… ok, back, I literally got sucked into a rabbit hole about text embeddings for semantic search. Stuff is mindblowing.

Sentience

Well, I’ve made some real progress over the past couple days. JARVIS is operational. Buggy, but operational. I’ve had the Discord bot working, and was able to get it to query GPT and Replicate APIs, but yesterday I gave it a memory.

It works by loading the chat history of a named channel into a buffer. The buffer has a max size, and each message in the history gets added to the buffer, which is a FIFO queue of a Message objects, which have authors and message content. Each time a message is added it checks the queue, and if the number of words in the queue plus the new message exceeds the max, it drops.

So when the bot load, it ingests the message history in the channel. Then when a new message comes along, it gets added to the buffer. That’s the setup. After a new message is added to the queue, I check it to see if it mention the bot. If yes, it sends the entire queue, which I call a context buffer, along to GPT, along with any additional prompts that I desire for prepends or appends.

Early testing yesterday was very promising. Its quirky and weird, but we were really happy with the output. It was very fun.

I also did my first fine tuning experiment. I had a Word doc with some content, a technical paper if you will. I broke the document up by newlines, then added them line by line to a JSONL document with blank prompts. I followed the OpenAI instructions and had the job queued in less than an hour. The queue itself took very long so I forgot about it until late in the evening.

It worked. The immediate problem I had though was that I forgot my stop signals, so the model doesn’t know when to shut up. (That’s a good analogy for my own motormouth, I’m sure.) So I’ll need to retrain it today.

As a proof of concept though, I am extremely pleased. I had been fretting over whether fine-tuning a model was this simple, and it appears that it is. Generating quality content and curating the results is the hard part.

JARVIS is going to be fairly complex system, with multiple models and context systems; hooks into various modality systems (txt2txt, txt2img, speech2txt, &c…). Things are going to get really crazy very fast. Feedback loops are going to be very important here, but this is where the recursive functions are going to get really crazy.

https://www.youtube.com/watch?v=Vo7qA7IbQDI

Early Christmas

We’re going out of town for Christmas, going on our first trip to Costa Rica. It’s a make up trip for the company Hawaii trip, which we missed due to COVID. So we head out next Monday morning at 4AM to hop on a flight, and will spend nine days in Puntenares. We’re staying at an all inclusive through Christmas and returning the day after.

We had originally decided not to put up a Christmas tree since we’d be gone, but Younger was really adamant about setting it up. So I pulled our fake tree out of the closet and stood it up downstairs Friday night and let the kids go to town on it.

Missus came up with the great idea of having an early Christmas, and I thought it was fantastic idea. The presents — an electric scooter for Elder and a drum set for Younger — arrived on Saturday and I had them both setup waiting for the girls when they came downstairs Sunday morning. Missus took care of the stockings.

It was a fun morning, I figured the girls would want to stay home and play, but they went to church instead, so I had my Sunday fun-day with my brother over video games. The girls got back and of course I had to play referee with the scooter, making sure Younger got her chance after her sister rode. I also hooked up the drum kit to my laptop so that the girls could do Melodics. They’ll get there, eventually. I had fun with it as well.

I had also been talking about an ‘adventure’ with the girls on Saturday, but we postponed it because the kids were having so much fun playing outside. But Elder asked me about it after lunch and we decided to go for it. I wanted to bring the kids on a longer (3mi) hike to see how they did. I didn’t want to get stuck with them out on an excursion in CR if they weren’t up to it, so I needed a baseline. We went to a popular foot trail across town, which circumnavigated a pond or creek near the river. It was full of elevation changes and I knew it would challenge the girls more than flat land.

So we went. I had my backpack with water and some snacks, and I took the kids — and by that I mean my girls and the neighbors two eldest — who had their own backpacks full of enough fruit to last a week. Or so I thought.

The first half mile was OK, I guess, the kids gave me a bit of trouble with the bags they were carrying. By the second mile they were marching through the woods, singing Christmas carols as they marched through the woods. It was the cutest thing I’d ever seen. They’d also been singing along with the holiday music that I had put on the radio. Sometimes it’s good to be a dad.

We made it out of the woods to a small park near a bridge. At the end of the bridge stand these large lion statues, so we took a break to take some pictures, then we headed out on the final leg of our journey. The trail split, one going back into the woods, meandering up and down the hills around the lake. The other was a paved path and took a straight shot back to the parking lot where we arrived. We took the short path.

This is where things started to go wrong. The girls were obviously tuckered out at this point. I held their hands and walked slowly with them. Younger had been holding her bladder pretty much the whole trip by now. She had told me that she didn’t need to go several times before we entered the woods, then told me she had to go after we were a half mile down the trail. I stopped to use a Porto-potty, but the girls were too fearful of using them.

As we came up within sight of the parking lot, the girls got in a fight. Younger ran down a hill and somehow got hit by her friend, then she retaliated. She was very sensitive, and tried to go off by herself to regulate, but I wasn’t about to have her running off. In hindsight, this is where I should have corrected, as Younger just got worse and worse from there.

I tried to distract the kids with a small playground that was just off the parking lot, but bathroom needs soon took over and the kids made a beeline for the toilets. I packed them up and we headed to Dairy Queen for their reward.

We went inside DQ, I let the kids order a chili or hot dog and a mini-Blizzard. While I was trying to finagle myself into a free Blizzard the kids were arguing over seating. The three girls, Younger on the end, were crammed into one side of the booth leaving S., the only boy, on the other side. I told Younger to move over but she said she’d rather sit outside. Fine, I said.

After a minute outside, she started screaming. I lost it. She said the other kids were teasing her through the window. It escalated from there. She was too sensitive and everything I told her just made her more and more furious. It doesn’t matter if the other kids are teasing you, I said, you don’t get to act like that. She tried to plant herself on the ground right in the main walkway. Thankfully no one was at the restaurant.

I picked her up and plopped her in the seat, against her wishes. I brought the food out and warned her that if she didn’t eat now, and tried to start eating after everyone else had finished that she was going to have to wait till we got home. She said nothing, knees pulled to her chest. Just a scowl.

And then, when it was time to go, what did she do? Told me she was hungry. By that time I had manhandled her into the car, and I was livid. How dare you, I told her. I had gone out of my way to make the day special: arranging things with Santa to have Christmas early, and I had taken her and her friends out for a hike and literally bought her ice cream. How dare she?! She tried to tell me to leave her alone, and I was so mad the only thing I could do was berate her. I think I called her spoiled and might have cussed, I’m pretty sure. But I told her the other kids were getting in the car and she better not say another word or she was dead meat. I think I had already grounded her at this point.

I’ll not mention the car ride back. It was pretty uncomfortable for all of us. I apologized for losing my temper and being an asshole. It was not my best moment. So we got home, Younger ran in to go to her room, and I unpacked the car.

It was not the best day ever.

There’s probably a lot here I could psychoanalyze about my childhood. There was a lot of yelling. When I was younger, my parents left me with a friend of the family, someone’s mom, for babysitting after school. It was not great. The woman, who I’d describe as morbidly obese, lived in the small house with her sister, who was blind. All I remember from those days is sitting in the living room watching game shows, and the occasional arguments, which would devolve into yelling and screaming. I obviously wasn’t comfortable in that house, but I’m not sure I ever mentioned anything to my parents. I must have been nine, maybe?

Of course the dads did a lot of yelling and hitting back then. Me and my brother, our cousins, would all get whipped when we misbehaved. Sometimes it was a wooden spoon, or a belt, or when we were real bad, we were threatened with breaking a switch off a tree. Don’t get a dry one that’s gonna break, or you’ll have to get another one. Needless to say, that was a threat that carried weight. I remember also one time we were so bad on a road trip that my dad pulled over, made us get out, pull our pants down and put our hands on the bumper of the car. Then he gave us a bare-assed spanking right on the side of the highway were everyone could see. I remember stories about this even more than I remember the event itself.

So not to end this post on a horrible down note, but this is the discipline that my parents taught me. Of course hitting your kids is wrong, and yelling at them is much better, but I’ve never acquired the soft skills that good daycare workers have. Missus picked up some skills during her career, so she’s able to subtly misdirect the kids’ attention better than I can. I’m more like Judge Dredd when it comes to conflict resolution.

SFPD

I totally went Science Fair Project Dad on one of Elder’s projects. You know about SFPD, he’s the one that gets way to involved with their kid’s projects and winds up doing most of it for them. So you see these really polished, professional looking things that it’s obvious the kids didn’t do on their own. So I have done.

The assignment was to ‘create an instrument from common household items. Demonstrate amplitude and pitch by playing a rhythm or melody on the instrument.’ So what did we do? We asked GPT for examples of course! We asked the AI for ten possible projects, then asked for clarification on a few of them before settling on one. We decided to make a popsicle stick piano.

We may have gone a bit overboard.

The local hardware store didn’t have the sticks, so we made a trip out to Michael’s. While there, we found a nice plank of pine about a foot in diameter that we could use for the base. We’d attach the popsicle sticks to a 12x1x0.25 piece, and screw that to the mount.

The first thing we did was stained the wood. Yes, I had an old can in the garage that I pulled out and we stained the base, the mounting block and all the popsicle sticks, which I literally just dipped in the paint can. Unfortunately the can was old and most of the pigment was settled in the bottom of the can, so the stain job came out really uneven and messy. I figured it was fine, since this was a 5th grade project after all.

Yesterday we went back to the hardware store to get the screws we needed, then started putting everything together. The plan was to put screws on either side of each key stick, which would allow us to tune each key. I did most of the marking here, drawing with a level and ruler, marking off where each of the two screws would go for the eight keys. After I got the first few done I handed the drill off to Elder so she could do a couple.

In all, it didn’t come out too bad. It’s got no resonance, so it’s not loud at all. A couple of the mounting screws are off, so the keys don’t make proper contact, losing tone and sound. But enough of them work to do a basic three of four note melody. And it does work as a drum in some respect.

Elder had to write a report for this project, which she did on her own despite my egging her on to use chatGPT. She actually told me that she needed to do the work herself, bless her heart. I wanted her to write the essay then fold it into GPT to see what it could do. I’ll teach her it’s a collaborative tool. It still requires effort to use, it’s just a huge lever for the eventual output.

Anyways, my musical brain couldn’t help turning her presentation into a rap. I’m such a ham, that’s the kind of stuff I used to do in school. I remarked to Elder that one year for English class I wrote an entire song for a creative writing assignment and played it before the class. I really wish I could remember more; the memory is weak. So while I was meditating this morning, my brain kept churning out versus, which I related to Elder this morning:

Well my name’s Elder and I’m here to say
I got a portable piano that I’m here to play
You wanna build your own, here’s what you do
Get a few pieces of wood and a bunch of screws
You can make the note low by making it long
Short keys high notes can you follow along
I can play the beat quiet I can play the beat loud
I can play the beat all day to rock the crowd
I El and I’m done and that’s all I say
but I think this report deserves an A

Now Elder doesn’t have the same fearlessness that I did at her age, I had already played the lead in the school musical by her age, but she won’t even try out for the lead. She hasn’t learned how to deal with that stage fright and comes up with other reasons to convince her not to try.

But I performed this rap, or a variation of it, for her this morning and she seemed somewhat open to the idea. There was a little fear there, but I assured her that it would go over well and she had nothing to worry about. She wasn’t able to memorize what I came up with in the 10 minutes we had before we had to shuffle out the door, but I think she got the gist of it.

I can’t wait to hear what she comes up with.

Idea man

I’m getting the day off on the right start. I woke at five when Younger finally kicked Missus out of the bed. I laid awake for the next hour, dreaming of things to build with GPT.

Someone mentioned on Twitter that AGI is bring about the renaissance of the idea man. That’s me.

Yesterday was a bit rough as chatGPT was overloaded yesterday. I was trying to do some SQL work and every time I threw my queries into the prompt box I kept getting errors. Then later, after I put the kids to bed, it was fast and snappy. I guess a lot of people are relying on it for work. Even this morning it’s still throwing errors and long delays. I can only see how dependent people are going to become on AGI. It will be come an integral part of people’s toolkit, and not having it will be like losing your phone or internet.

I talked to my cousin J yesterday. I haven’t talked to anyone back home in quite a while, maybe a year, but my brother reminded me that it was her birthday. So I called and caught up and chatted with her for about 45 minutes. Everything is everything; the main concern was about our 87-year old grandmother. She’s not as mobile as she used to be and repeats herself all the time. Her two older sisters have dementia, and that’s a big concern. J said grandma is in ‘pain all the time’ and I responded that I’m only 43 and I’m in pain all the time. Not much, but it’s always something. I can only imagine how it gets when I’m twice that age.

If meditation has taught me anything it’s that pain is always with us. Whether it’s bodily pain, emotional discomfort or whatever, the mind is like a spotlight that can focus in on these discomforts as needed. Even sitting, in itself, causes discomfort, and part of the practice of meditation is to focus on that pain, make it an object of attention while keeping the body still. We’re already dealing with the pain, it’s the fear of the pain in the future that makes us fidget and fuss.

I’ve got work to do this morning. I’m not sure how much crazy stuff I’ll get done to day if GPT is offline. I got some tasks to wrap up from yesterday and plenty of work to prepare for the rest of the day. Hopefully I can get that knocked out and spend the day working on the bot. I’d like to get it working with Stable Diffusion, so that it can generate images when mentioned. I think I might be able to pull that off this week if I have time, then set up some sort of context overlay so that people can chat with it.

I’ve got ideas.

Hooky

A coworker passed on this interview with OpenAI CEO Sam Altman. I’d never paid the guy too much time but I’m paying attention now. There were a couple of standout points that he made, and I’m adjusting my mental models accordingly. Heavy stuff.

Elder is staying home today. She wanted to play hooky — and I’m inclined to let her. She had her choral performance last night — I missed it because Younger wanted to go and they only gave each kid two tickets. She then proceeded to act up during the performance, forcing Missus to leave early. Not pleased.

So I told Elder she could stay home as long as she did her school work: today’s; her homework for the week, which she’s behind on and is due on Friday; and a special project that is due on Friday also. I told her I was going to set her a pomodromo timer and she was going to work off of that for an hour and we’d see how things work. She’s out doing her gym class, and out running and riding her bike around.

I’m fine with her staying home from school. As long as she’s motivated to work, I’m fine with it. I offered her the opportunity to pull out in third grade, during COVID, so that she could do GalileoXP, but she — and her mother — wanted her to go. So back she went. But maybe today is a look at what it might look like for her to homeschool.

I wrote the following message to Younger’s elementary school principal:

I was the one hollering at you about GPT this morning and wanted to follow-up with you on it. To show you what it does, I prompted it to generate the following text for you:

I wanted to bring to your attention a new technology that is going to greatly impact education in the next few years – GPT-3. GPT-3 is a conversational AI model that has the ability to understand and respond to human language with unprecedented accuracy.

This technology has the potential to revolutionize how we approach learning and collaboration in the classroom. Through its ability to generate text based on prompts, students can use GPT-3 to help them write essays and research papers, leading to a deeper understanding of the material.

However, we must also be aware of the potential for students to use GPT-3 to cheat on assignments. We will need to put in place measures to detect and prevent this type of behavior.

Overall, I believe GPT-3 has the potential to greatly enhance the educational experience for both elementary and collegiate students. I would be happy to discuss this further with you and how we can integrate this technology into our curriculum.

Best regards,
[Your Name]


You can access the chatGPT page here: https://chat.openai.com/chat. I encourage you to talk to it and ask it questions: things your teachers and students might ask, and see how it responds. It is very good at ‘imagining’ or role-playing, so you might tell it that you are a middle-school principal dealing with whatever various issues, and see what it comes up with. The language model is somewhat inconsistent with certain subjects, but it’s very good overall.

chatGPT just released last week and it’s ease of use tells me that it’s going to be everywhere soon. I’m already incorporating it into my professional workflows, it’s very good at generating copy or condensing and editing. And for variations, it’s amazing.

Just don’t trust it’s answers. There’s a lot of inconsistencies. That said, I expect these models to continue to continuously improve. The next version of GPT, GPT-4 is expected in the coming months.

Take care, I’d be more than happy to speak more on this if you like.


Consumed

I am shook. All I can think about is GPT.

Yesterday was a mess. Woke up sick and sleep deprived, but I had sprint meetings. I did my best to lead but by two I was a brain-muddled mess. I think we got some work done, though.

Elder has a choral performance tonight, she’s excited. Of course she doesn’t own a white blouse per the requirements, so there was a bit of bustle this morning.

I got sleep last night, and feel mostly myself today. I meditated, but all I did was think about how I’m going to continue my prompt engineering. I’m thinking I’ll start with some axioms and then start talking to GPT about what I want to do. Provide it with a base layer that will serve for it’s training data.

One thing some people are getting hung up on with GPT is that it has a tendency to make shit up, like adding a pineapple to the statue of David’s description or something. I don’t know if it’s an intentional watermark or something in one of the settings, but this is somewhat beyond the point. It’s great at generating endless possibilities; it’s a content generator, and idea machine.

There’s enough there to give one direction toward the next step, or at least a starting point. It’s like a dopamine hit for me, a never-ending font of newness and possibility. It never ends.

My wife jokes that every six months I have a new hobby that I really get into really obsessively: climbing, sim racing, piano, flight sims, the like. This is something completely different. This tech is important and world changing.

I do keep oscillating somewhat, between the the grandiosity of it and the futility. I’ve been a bit hyperbolic, after recognizing some of the flaws in the system I realize I may have to walk some things back. But I don’t care. I’m building.

And I’ve got the best assistant in the world. We’ve all got it. It’s incredible. Building a context system and middleware system for GPT-controlled game engine… that’s what I’m talking about.

Prompter

I’ve been somewhat manic the last few days, having finally gotten a real chance to play with GPT through the wonderful chatGPT. It is AMAZING. I’ve been playing with it rabidly, exploring what it can do and how it can be leveraged as a personal digital assistant. The model knows a lot — it was trained off of wikipedia and other various library models, so it can talk about anything. And its really good at making things up. Here an example:

I’ve been working with Diffusion Models the past couple weeks and they’re fun, but I’ve been meaning to take a closer look at GPT-3 to see what it can do. chatGPT makes it super easy. And the results are amazing.

I’ve already managed to hook GPT-3 up to a Discord bot and have been doing some experiments with prompt overlays — where the my base prompt is injected on top of the user request. I’m using it as a bit of game master for a role playing game. I actually used chatGPT to help me code and troubleshoot the system. I’ve got a lot of work to do on it but it’s very, very interesting.

Getting my story straight

I have a doctors appointment tomorrow, and he’s the only one who can hold me accountable for my drinking, so I’ve been good this week. No alcohol this week. I’ll likely keep it up until our trip to Costa Rica, which as been on my mind also.

I slept better last night, some trouble, but my body is adjusting to the earlier bedtime. Seasonal affective disorder and all that, probably. Order vitamin D. Pronounced not with a long I sound as in “eye” but a short one that rhymes with “fit”. Vit-amen, the way Mo says it.

Mo asked me how I was doing, like Mitch did. I’m fine, none of this is affecting me at all. I’m just putting my head down and doing what I can while everyone else does what they need to do. Tight resources, DIY spirit. Make do. Good enough to move on: GETMO is my motto.

I talked to Todd yesterday. Like me, he has addictive personality. We have destructive history, since we were teens. He gave up drinking but got hooked on the crypto casino. Chasing shitcoin mints on Ethereum, trying to beat the bots. Problem is he’s not disciplined, I told him, you don’t go in with a plan and you don’t know when to get out. So your emotions get in the way and you stay in to long and miss your chance.

Quit chasing the dragon, I told him. Find a project that you believe in and contribute. You don’t have to learn coding, there’s all kinds of PR/HR type of stuff that one can do to contribute. Better yet, bring crypto into the real world. He’s worked in it, knows things that people don’t. I tried to distinguish his greed from the actual promise of bitcoin. You can’t just opt out of the future of the financial system, I said. Gave an example of what Strike is doing with BTC payments, do something like that. Just like selling in-home water filters, bitcoin ATMs.

Todd didn’t ask how I was doing. Knew I’d tell him anyways. It was my call; he texted me asking about Kraken layoffs. FTX didn’t get me, saw the .com contagion and got everything I could off the .us site while I could. Lost a bit because of ACH transfer clearing. Should have known they were tight when they went from 10 to 15 day clearing. Figured it was because of fraud.

I lost most of my money in April, or should have anyways. If Perp hadn’t gotten hacked I would have been liquidated. Pretty much got lucky on that one, else I would have gone down with my fervid belief that sub 20K was unlikely. Silly me. So I got the fuck out of everything and to my hardwallets. I may be a bit fuzzy on the timing, but I think I may have seen Voyager go down — only some ADA and LINK, not much — and got my funds out of BlockFi ASAP.

But things are good. I’m fit and healthy, I got no money problems — yet. I told Todd I don’t care what else is going on, all I care is that one breath follows another. Everything else is fine with me. Sure, I fight with people and get upset about things, and my body will eventually fall apart, but right now is all I got to deal with, and right now is just perfect.