19 KiB
| title | date | tags | vod | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| robocadey: Shitposting as a Service | 2022-04-30 |
|
|
What is art? Art is when you challenge the assumptions that people make about a medium and use that conflict to help them change what they think about that medium. Let's take "Comedian" by Maurizio Cattelan for example:
By my arbitrary definition above, this is art. This takes assumptions that you have about paintings (you know, that they use paint on the canvas) and discards them. This lets you change what you think art is. Art is not about the medium or the things in it. Art is the expression of these things in new and exiting ways.
Originally I was going to use some Banksky art here, but for understandable reasons it's quite difficult to get images of Banksky art.
One of my favorite kinds of art is the "uncanny valley" of realism. Let's take Death Stranding as an example of this. Death Stranding is a video game that was released in 2019 for the PlayStation 4 and is one of my favorite games of all time. The game has a very hyper-realistic art style that is firmly in the centre of the uncanny valley:
This game mixes very realistic scenery with a story about dead bodies turning into antimatter and you being a UPS delivery person that saves America. This is art to me. This transformed what a video game could be, even if the entire game boils down to Kojima themed fetch quests. Oh and trying not to die even though you can't die but when you die it's really bad.
I want to create this kind of art, and I think I have found a good medium to do this with. I write a lot on this little independent site called Twitter. This is one of the main things that I write on, and through the process of the last 8 years or so, I've written a shockingly large amound of things. I post a lot of weird things there as well as a lot of boring/normal things.
However a lot of my posts boil down to creating a "stream of consciousness", or using it as a way to help deal with intrusive thoughts. There's a certain art to this, as it is a candid exchange between the author and the reader. The reader doesn't get all the context (heck, I doubt that I have all the context lol), but from there they get to put the pieces together.
So, when thinking about trying to get into the uncanny valley with this kind of art medium, my mind goes back to the old days on IRC channels. Many IRC channels run bots to help them run the channel or purely for amusement. One of my favorite kinds of bots is a Markov chain bot. These kinds of bots learn patterns in text and then try to repeat them at random. With enough training data, it can be fairly convincing at first glance. However, you need a lot of training data to get there. More training data than I have ever tweeted.
This ends up creating a situation where the markov bot is right in the uncanny valley of realism. At first glance it is something that isn't not plausibly human. It looks like a bot, but it also looks like a human, but it also looks like a bot. It appears to be in the middle. I like this from an artistic standpoint because this challenges your assumptions that bots need to be obviously bots and humans need to be obviously human.
In the past I have ran a service I call cadeybot. It took all of my Discord
messages, fed them into a Markov chain, and then attempted to create new
messages as a result. This worked pretty well, but we ran into an issue where it
would basically regurgitate its training data. So when people thought it was
being novel about roasting people, someone would search the chat and find out
that I said those exact words 2 years ago.
This isn't really exciting from an artistic point of view. You could get the same result from randomly replying with old chat messages without any additional data in the mix.
I haven't run cadeybot in some time because of this. It gets really boring
really fast.
However, I was looking at some DALL-E generated images and then inspiration struck:
What if I fed all those tweets into GPT-2?
So I did that. I made @robocadey@botsin.space as a fediverse bot that generates new content based on everything I've ever tweeted.
Data
The first step of this is getting all of my tweet data out of Twitter. This was a lot easier than I thought. All I had to do was submit a GDPR data request, wait a few days for the cloud to think and then I got a 3 gigabyte zip file full of everything I've ever tweeted. Cool!
Looking through the dump, I found a 45 megabyte file called tweets.js. This
looked like it could be important! So I grabbed it and looked at the first few
lines:
$ head tweet.js
window.YTD.tweet.part0 = [
{
"tweet" : {
"retweeted" : false,
"source" : "<a href=\"http://www.bitlbee.org/\" rel=\"nofollow\">BitlBee</a>",
"entities" : {
"hashtags" : [ ],
"symbols" : [ ],
"user_mentions" : [
{
So it looks like most of this is really just a giant block of data that's
stuffed into JavaScript so that the embedded HTML can show off everything you've
ever tweeted. Neat, but I only need the tweet contents. We can strip off the
preamble with sed, and then grab the first entry out of tweets.js with a
command like this:
$ cat tweet.js | sed 's/window.YTD.tweet.part0 = //' | jq .[0]
{
"tweet": {
"retweeted": false,
"source": "<a href=\"http://www.bitlbee.org/\" rel=\"nofollow\">BitlBee</a>",
"entities": {
"hashtags": [],
"symbols": [],
"user_mentions": [
{
"name": "@Lyude@queer.party🌹",
"screen_name": "_Lyude",
"indices": [
"0",
"7"
],
"id_str": "1568160860",
"id": "1568160860"
}
],
"urls": []
},
"display_text_range": [
"0",
"83"
],
"favorite_count": "0",
"in_reply_to_status_id_str": "481634023295709185",
"id_str": "481634194729488386",
"in_reply_to_user_id": "1568160860",
"truncated": false,
"retweet_count": "0",
"id": "481634194729488386",
"in_reply_to_status_id": "481634023295709185",
"created_at": "Wed Jun 25 03:05:15 +0000 2014",
"favorited": false,
"full_text": "@_Lyude but how many licks does it take to get to the centre of a tootsie roll pop?",
"lang": "en",
"in_reply_to_screen_name": "_Lyude",
"in_reply_to_user_id_str": "1568160860"
}
}
It looks like most of what I want is in .tweet.full_text, so let's make a
giant text file with everything in it:
sed 's/window.YTD.tweet.part0 = //' < tweets.js \
| jq '.[] | [ select(.tweet.retweeted == false) ] | .[].tweet.full_text' \
| sed -r 's/\s*\.?@[A-Za-z0-9_]+\s*//g' \
| grep -v 'RT:' \
| jq --slurp . \
| jq -r .[] \
| sed -e 's!http[s]\?://\S*!!g' \
| sed '/^$/d' \
> tweets.txt
This does a few things:
- Removes that twitter preamble so jq is happy
- Removes all at-mentions from the training data (so the bot doesn't go on a mentioning massacre)
- Removes the "retweet" prefixed tweets from the dataset
- Removes all urls
- Removes all blank lines
This should hopefully cut out all the irrelevant extra crap and let the machine learning focus on my text, which is what I actually care about.
Getting It Up
As a prototype, I fed this all into Markov chains. This is boring, but I was able to graft together a few projects to get that prototype up quickly. After some testing, I ended up with things like this:
This was probably the best thing to come out of the Markov chain testing phase, the rest of it was regurgitating old tweets.
While I was doing this, I got GPT-2 training thanks to this iPython notebook. I uploaded my 1.5 megabyte tweets.txt file and let the big pile of linear algebra mix around for a bit.
Once it was done, I got a one gigabyte tarball that I extracted into a new
folder imaginatively named gpt2. Now I had the model, all I needed to do was
run it. So I wrote some Python:
#!/usr/bin/env python3
import gpt_2_simple as gpt2
import json
import os
import socket
import sys
from datetime import datetime
sockpath = "/xe/gpt2/checkpoint/server.sock"
sess = gpt2.start_tf_sess()
gpt2.load_gpt2(sess, run_name='run1')
if os.path.exists(sockpath):
os.remove(sockpath)
sock = socket.socket(socket.AF_UNIX)
sock.bind(sockpath)
print("Listening on", sockpath)
sock.listen(1)
while True:
connection, client_address = sock.accept()
try:
print("generating shitpost")
result = gpt2.generate(sess,
length=512,
temperature=0.8,
nsamples=1,
batch_size=1,
return_as_list=True,
top_p=0.9,
)[0].split("\n")[1:][:-1]
print("shitpost generated")
connection.send(json.dumps(result).encode())
finally:
connection.close()
server.close()
os.remove("/xe/gpt2/checkpoint/server.sock")
And I used a Dockerfile to set up its environment:
FROM python:3
RUN pip3 install gpt-2-simple
WORKDIR /xe/gpt2
COPY . .
CMD python3 main.py
Then I bind-mounted the premade model into the container and asked it to think up something for me. I got back a list of replies and then I knew it was good to go:
[
"oh dear. I don't know if you're the best mannered technologist you've come to expect from such a unique perspective. On the technical side of things, you're a world-class advocate for open source who recently lost an argument over the state of the open source world to bitter enemies like Python.",
"I also like your approach to DNS! One step at a time. More info here: ",
"tl;dr: it's a bunch of random IP addresses and the outcome is a JSON file that you fill out in as you go.",
"datasoftware.reddit.com/r/programmingcirclejerk-memes",
"datasoftware.reddit.com/r/programmingcirclejerk-memes",
"datasoftware.reddit.com/r/programmingcirclejerk-memes",
"datasoftware.reddit.com/r/programmingcirclejerk-memes",
"Oh dear, can we third-person?",
"A group of us is a CVE-1918 impact statement",
"Is that breaking news?",
"Lol datasom shitposting omg ",
"I'm gonna be on the list for #Giving is easy, don't look so far ahead ",
"Oh dear. Welcome to ThePandora: ",
"I use a lot of shift lol",
"I thought you were an orca",
"Foone, my old computer crashed. What happened to your hard drive? ",
"Yeah I know some of those things should be automated, but this is about experimentation and experimentation is what makes me happy",
"Am I? ",
"Experiment is my favorite part of the article",
"Yes I can, scroll past the how to read words videos",
"I was able to see into space but I cannot seen into your eyes",
"This is with a virtual keyboard/MAC address field",
"Yes but with the keymap \"~M\"",
"Yes this is a structural change, I am trying to tease things out a bit. I am trying to make it slightly different sounding with the key mapping. I am trying to make it different sounding sounding.",
"The main thing I am trying to do is make it easy to type backwards. This is going to take experimentation. I am trying to make it slightly different sounding.",
"Is this vehicle of mercy?",
"God i forgot "
]
However, this involved using Docker. Docker is decent, but if I have the ability
not to, I don't want to use Docker. A friend of mine named ckie saw that I was
using Docker for this and decided to package the gpt_2_simple library into
nixpkgs. They also made it easy
for me to pull it into robocadey's environment and then I ripped out Docker,
never to return.
Now the bot could fly. Here was the first thing it posted after it got online with GPT-2 in a proper way:
I can't make this up.
Art Gallery
Here are some of my favorite posts it's made. Most of them could pass off as my tweets.
Some of them get somber and are unintentionally a reflection on the state of the world we find ourselves in.
Others are silly.
I say things like this:
and it fires back with:
This is art. It looks like a robot pretending to be a human and just barely passing at it. This helps you transform your expectations about what human and bot tweets really are.
If you want to influence robocadey into giving you an artistic experience,
mention it on the fediverse by adding @robocadey@botsin.space to your posts.
It will think a bit and then reply with a brand new post for you.
Setting It Up
You probably don't want to do this, but if you're convinced you do then here's some things that may help you.
- Use the systemd units in
/runof github:Xe/x. - Put your model into a squashfs volume that you mount to the
/var/lib/private/xeserv.robocadey-gpt2/checkpointfolder. - Don't expect any warranty, reliability promises or assistance setting this up. I made this for myself, not for others. Its source code is made available to make the code part of that art, but the code is not the art that it makes.
Good luck.
I guess what I think about art is that it's not just the medium. It's not just the expression. It's the combination of it all. The expression, the medium, the circumstances, all of that leads into what art really is. I could say that art is the intangible expressions, emotions, and whatever that you experience when looking at things; but that sounds really really pretentious, so let's just say that art doesn't exist. Well it does, but only in the mind of the viewer.
There's not some objective scale that can say that something is or is not an art. Art is imagined and we are conditioned to believe that things are or are not art based on our upbringing.
I feel that as a shitposter my goal is to challenge people's "objective sense"
of what "can" and "can't" be art by sitting right in the middle of the two and
laughing. Projects like robocadey are how I make art. It's like what 200 lines
of code at most. You could probably recreate most of it based on the contents of
this post alone. I wonder if part of the art here comes from the fact that most
of this is so iterative yet so novel. Through the iteration process I end up
creating novelty.
You could also say that art is the antidote to the kind of suffering that comes
from the fundamental dissatisfactions that people have with everyday life. By
that defintion, I think that robocadey counts as art.
Either way, it's fun to do these things. I hope that this art can help inspire you to think differently about the world. Even though it's through a chatbot that says things like this:
What is this if not art?