AI for storytelling, games, explainability, safety, ethics. Professor
@GeorgiaTech
. Associate Director
@MLatGT
. Time travel expert. Geek. Dad. he/him
This is a huge scandal!
TL;DR University System of Georgia privatized some of its dorms. Those companies are now using their contracts to force universities to fill dorms to near-capacity to protect their profits
Erm no. I read the article. The graphic designer did a lot of iterations on the prompt, cherry picked an image, and then used a feature allowing portions of the image to be re-generated.
AI hype itself is harmful. Now we have lawyers who believe in the omnipotence of ChatGPT and using it to craft legal briefs. As bad as it is for the lawyer who gets in trouble, it also means the client is going to suffer some ramifications too.
1st day of online class for my 1st grader.
Teacher read a story online about a character named Echo the Owl. It kept triggering peoples’ Amazon Echos.
One of the Echos asked if anyone wanted to buy a bible.
Working on a walkthrough of transformer code with side-by-side comparison to the computation graph. Felt the default image everyone uses is hard to interpret. Also, I like to show the matrices in my computation graphs. § refers to sections in a colab notebook (coming soon)
PhD students in my group asking if it is okay to take some vacation time…
My response: Oh god yes! Get out of here. Go. Rest. Don’t ask, just tell me you are are peacing out for a bit. Thumbs up. Good for you.
At today’s White House meeting on AI:
- OpenAI
- people who left OpenAI because it wasn’t focused enough on existential risk
- people who bought the exclusive rights to everything OpenAI makes
- Google
In about 3 weeks universities will be in session again. Many universities (like my own) want to pretend that things will be back to normal. The buildings and classrooms and quads will all be there and look the same. The routines of commuting to classes will be the same… 1/7
This is happening in Arizona, Georgia, Kentucky, New Hampshire, and other places.
There's a renewed assault on the right to vote, using lies of voter fraud to restrict voter access.
We must defeat these attacks on our democracy.
My paper on “Weird A.I. Yankovic: Generating Parody Lyrics" was accepted to the NeurIPS workshop on Machine Learning for Creativity & Design
arxiv:
code: (launch colab executable from there)
So cool. One of the most famous AI research labs in the world contacted some of the members of my lab about some work they did then wrote a paper on a related topic without citing my team.
Magic: The Gathering is Turing Complete.
So is Microsoft Excel.
That implies there exists a polynomial-time procedure that will transform any spreadsheet into a deck of Magic: The Gathering cards.
Good night.
Reason to reject: "The method seems too simple”
Yet we achieved results substantially greater than baseline.
Once again, we are victim of the AI community’s bias toward complicated solutions even when simple solutions exist. William of Occam would be disappointed
Today’s realities:
1. Non-neural net code written more than 5 years ago works just fine
2. Neural net code written a year ago on TensorFlow doesn’t work anymore
My online NLP course is kicking off Monday morning 😱
All lectures written and recorded from scratch. All new programming assignments written from scratch. It's taken me a year.
Maybe just to get out ahead of things.
My team put a LLM inside a Deep Q-learning agent in 2019
Started playing with A*-like planning with LLMs last year
Finished with day 1 of Intro to AI class with 300 students. I asked everyone to wear a mask. And they did! Near 100%.
Damned proud of my Yellow Jackets today.
*opinion* Altman would rather talk about regulation of sci-fi scenarios and not about the real world consequences of how AI can be used right now to do harm. Things like protection from discrimination, fairness, privacy, ability to receive remedy... 1/3
For your weekend reading...
"A Very Gentle Introduction to Large Language Models without the Hype"
Written for a non-technical audience who want to know how ChatGPT and similar things work.
With lots of metaphors (that don't involve brains)
Hi everybody. I started putting together a
@PyTorch
primer on Google Colab for my AI class. It’s a work in progress, but feel free to check it out. It assumes basic understanding of neural nets (and of course python coding)
I’m going to make a new website for my lab. How hard could that be? I’ll use Jekyll.
To get Jekyll I need to update Ruby. To update Ruby I need to update homebrew. Homebrew update fails.
Dear
@GeorgiaTech
President
@CabreraAngel
, I would like to openly invite you, the
@BORUSG
and Gov Kemp to attend my class two weeks from now.
I will make sure you get prime seats, right in the middle of the 350 students of uncertain vaccination status and possibly not masking
Cool,
@Meta
wants to have a short call about whether I want to apply for a general engineering position. They say my experience seems very relevant to what they’re hiring for. If I’m lucky I might even work on some applied ML products, but I don’t want to get my hopes up.
Dear Reviewer
#2
: we are sorry we did not compare our systems against another system that came out after we submitted our paper. Our time machine was on the fritz the weekend before the paper was due.
GPT-2 (2019) vs. GPT-4 (2024)
look how beautifully original gpt-2 is! it's like comparing gpt's poetic child drawings vs. corporate emails from middle age.
Why aren’t there more Country songs about neural nets? They are all about taking in loss, embracing that loss, making the loss flow through you until you become better
Not too long ago I wrote a blog post laying out an argument for why the reasoning capabilities of LLMs will be limited.
Today I learned a startup professing to improve LLM reasoning received a $1B valuation.
There is a strong incentive to not look to closely at the science.
We’ve known for a while that real neurons in the brain are more powerful than artificial neurons in nural nets. It takes a 2-layer ANN to compute XOR, which can apparently be done with a single real neuron
Brains are amazing. Our lab demonstrates that single human layer 2/3 neurons can compute the XOR operation. Never seen before in any neuron in any other species. Out now in
@sciencemagazine
. Congrats Albert, Tim
@mattlark
@YiotaPoirazi
& CO
Folks! I am finally not too embarrassed to re-release EasyGen, a visual programming language for text data pipelines for neural nets.
Colab:
Github:
Here’s a program to scrape the web for generating Star Trek/romance book titles.
Summarizing my conversation today with my doctor:
Me: I’m teaching in-person
Dr: Are students vaccinated?
Me: Can’t mandate it
Dr: 😱
Dr: Wearing masks?
Me: Can’t require it
Dr: 😱
Dr: Can you ask them to wear a mask or leave?
Me: Not allowed
Dr: 😱
Dr: Well can YOU wear a mask?
Purportedly leaked internal Google document
"We Have No Moat, And Neither Does OpenAI"
Whether this is a real document or not, I believe the larger message that Google and OpenAI are running on borrowed time is legit. I've been saying as much.
Neural language models like GPT-2 are getting really good at generating text.
What's missing? The ability to control the generation with an end-goal.
But now you can!
Accepted to
#IJCAI2019
: Controllable Neural Story Plot Generation via Reward Shaping
aaaaanyway, if one wishes to read one of the transcripts with LaMDA by the now-terminated Google employee, here it is:
Personally, I don't see anything other than the Eliza Effect
Hypothetical question. Some people have access to GPT-3 and others do not. What happens when we start seeing papers in which GPT-3 is used by non-OpenAI researchers to achieve SOTA results?
Here’s the real problem, tho: is OpenAI picking research winners and losers?
I should write a book. Something like: “AGI: Artificial Greed, Incorporated: How a Few Half-Baked Algorithms Wrapped in Glitzy Interfaces will Make the Rich Richer and the Poor Poorer"
1st day of in-person class Monday morning. Incredibly stressed. Class of 300 with no vax or mask mandate indoors on campus. Just don’t know what I will see when I walk into class. I don’t if I won’t lose my shit if I see unmasked students. Never taught in a mask before.
.
@GeorgiaTech
HR just approved my request for medical accommodation. I won’t have to teach an in-person class this Fall.
1. HR should not be the one deciding what is and is not safe for me. THIS MAKES ME SO MAD 😠
2. Will continue fighting for those who cannot get a waiver.
Not only is a single neuron cell equivalent to a multilayer ANN, but in some cells a single dendrite of a single cell is equivalent to a multilayer ANN capable of computing the XOR function
If a novel was good, would you care if it was created by
#AI
?—The first computer-generated screenplays are promised within five years. Fiction can’t be far behind | by
@richardlea
@guardian
Been saying this for a while but if you want to solve self-driving cars, work with municipalities to build smart cities. Separate autonomous vehicles from humans with infrastructure like dedicated lanes. But then you will discover that it’s just easier to build mass-transport
Muahahahah. I’ve now written an R script that converts bibtex to json and a python script that converts json to yaml and jekyll script that converts yaml to html. I’ve lost my mind.
Dear reporters,
If someone says AI is going to kill us all… don’t ask what we are going to do about it… ask why they think that, what is their evidence or reasoning
Proposal: t-SNE visualizations should be called a t-SNEeezes. You sneeze out high dimensional data and then you inspect the mess that hits a 2D surface