Melanie Mitchell Profile Banner
Melanie Mitchell Profile
Melanie Mitchell

@MelMitchell1

44,027
Followers
657
Following
386
Media
5,975
Statuses

Professor, Santa Fe Institute. More thoughts at .

Santa Fe, NM
Joined September 2011
Don't wanna be here? Send us removal request.
@MelMitchell1
Melanie Mitchell
2 years
Captcha
Tweet media one
64
574
4K
@MelMitchell1
Melanie Mitchell
1 year
@ChrisMurphyCT Senator, I'm an AI researcher. Your description of ChatGPT is dangerously misinformed. Every sentence is incorrect. I hope you will learn more about how this system actually works, how it was trained, and what it's limitations are.
33
154
3K
@MelMitchell1
Melanie Mitchell
3 years
New paper by me: "Why AI is Harder Than We Think". Feedback is welcome!
Tweet media one
88
480
2K
@MelMitchell1
Melanie Mitchell
1 year
I didn't sign "the letter". Current AI poses lots of risks, but describing these systems as "ever more powerful digital minds" that no one can control is likely to make the problem even worse. What's needed: more transparency and better public discourse.
57
327
2K
@MelMitchell1
Melanie Mitchell
5 months
Current chatbots can pass the Turing Test, right? A lot of people have claimed this, but Cameron Jones ( @camrobjones ) and Benjamin Bergen of UCSD actually tested the claim! (Spoiler: The answer is "no, they don't pass.")
80
472
2K
@MelMitchell1
Melanie Mitchell
3 years
Important progress in psychology and AI.
Tweet media one
Tweet media two
21
242
2K
@MelMitchell1
Melanie Mitchell
2 months
@bestofdyingtwit I hope Satya responds with a poop emoji
10
12
2K
@MelMitchell1
Melanie Mitchell
2 years
Very impressive---indeed, awe-inspiring---AI demos this last week, e.g., from OpenAI (image generation) and Google (text generation). These demos seem to convince many people that current AI is getting closer and closer to human-level intelligence. 🧵 (1/8)
32
334
1K
@MelMitchell1
Melanie Mitchell
1 year
Rather than asking AI researchers how soon machines will become "smarter than people", perhaps we should be asking cognitive scientists, who actually know something about human intelligence?
120
227
1K
@MelMitchell1
Melanie Mitchell
1 year
How does modern AI work, what is its history, and how does it compare with human intelligence? My book gives an in-depth, accessible guide for lay people & experts alike. Coming in 2023: new chapters on transformers, generative AI, and AI "alignment".
41
188
1K
@MelMitchell1
Melanie Mitchell
15 days
Wrenching news: Dan Dennett has died. He's been a great friend and incredible inspiration for me throughout my career. I will miss him enormously.
41
201
1K
@MelMitchell1
Melanie Mitchell
2 months
Cf. Geoffrey Hinton, 2016: "“People should stop training radiologists now. It’s just completely obvious that within five years deep learning is going to do better than radiologists."
@Carnage4Life
Dare Obasanjo🐀
2 months
Jensen Huang, CEO of Nvidia, argues that we should stop saying kids should learn to code. He argues the rise of AI means we can replace programming languages with human language prompts thus enabling everyone to be a programmer. AI will kill coding.
1K
5K
21K
61
164
1K
@MelMitchell1
Melanie Mitchell
4 years
So cute. But wouldn't the opposite be more useful -- that is, to teach neural networks about how *babies* learn? 🙂
@hardmaru
hardmaru
4 years
I just ordered this book for my kids.
Tweet media one
128
2K
10K
17
125
1K
@MelMitchell1
Melanie Mitchell
1 year
Wow, Twitter is blocking likes, RTs, and replies to this tweet. WTF @elonmusk ??
Tweet media one
26
102
977
@MelMitchell1
Melanie Mitchell
1 year
Very interesting and provocative article (not sure I agree with conclusions, but they are worth considering seriously).
46
196
961
@MelMitchell1
Melanie Mitchell
8 months
Many have said this, but needs to be repeated: AI surpassing humans on a benchmark is not the same (at all!) as AI surpassing humans on a general ability. E.g., just because a benchmark has "language understanding" in its name doesn't mean it tests general lang. understanding.
@mustafasuleyman
Mustafa Suleyman
8 months
incredible AI progress in one eye-full. this is what exponential looks like. speech, image, reading, language understanding, grade school math, codegen - all nearing or exceeded human performance
Tweet media one
62
264
1K
47
207
849
@MelMitchell1
Melanie Mitchell
2 years
Interesting take by @AlisonGopnik : Large language models are "cultural technologies" -- they are not themselves intelligent agents, but, like Wikipedia and libraries, they are technologies that allow humans to access the intelligence of other humans.
16
142
754
@MelMitchell1
Melanie Mitchell
4 years
Personal news: I'm excited to announce that, starting in February, I will be in residence at the Santa Fe Institute for one year, as the inaugural Davis Professor of Complexity. I'm thrilled for this opportunity to work more closely with all the brilliant people at @sfiscience .
Tweet media one
33
43
738
@MelMitchell1
Melanie Mitchell
1 year
In LLMs, the need for "prompt engineering" is a sign of *lack* of robust language understanding. It will be interesting to see if scaling LLMs alone will reduce the need for prompt engineering.
61
98
713
@MelMitchell1
Melanie Mitchell
1 year
This headline. 🙄
@60Minutes
60 Minutes
1 year
One AI program spoke in a foreign language it was never trained to know. This mysterious behavior, called emergent properties, has been happening – where AI unexpectedly teaches itself a new skill.
434
743
2K
51
59
694
@MelMitchell1
Melanie Mitchell
2 years
Amidst all the recent Twitter talk on the role of symbols vs. deep learning in AI, I came across a very interesting article by Allen Newell, published in 1982, entitled "Intellectual Issues in the History of Artificial Intelligence". 🧵 (1/9)
11
166
636
@MelMitchell1
Melanie Mitchell
5 years
My son is home from college for a visit, and look what I discovered him reading😂:
Tweet media one
38
13
629
@MelMitchell1
Melanie Mitchell
2 years
This is such a perfect metaphor for AI. (From )
Tweet media one
16
133
611
@MelMitchell1
Melanie Mitchell
4 years
New: My adventures using GPT-3 to make Copycat analogies. I did some systematic experiments with no cherry picking. I hope you enjoy this! "Can GPT-3 Make Analogies?"
24
148
596
@MelMitchell1
Melanie Mitchell
5 years
Bound galleys of my new book arrived today! It will be published in October.
Tweet media one
23
69
597
@MelMitchell1
Melanie Mitchell
1 year
One more point about the Yoshua Bengio blog post. He says: "Biological evolution has given rise to gradually more intelligent beings on Earth, simply because smarter entities tend to survive and reproduce more." This is just empirically false. Or am I missing something?
Tweet media one
131
47
594
@MelMitchell1
Melanie Mitchell
4 months
A book on Amazon, published in 2023, with the same title as my 2019 book. The "sample" on Amazon reads like a ChatGPT summary of my book (with some small post-editing). Is this legal? Same author has published 2 dozen other books on Amazon in 2023 alone. 😠😡
Tweet media one
103
146
570
@MelMitchell1
Melanie Mitchell
1 year
I'm reading Yoshua Bengio's new blog post, "How Rogue AIs may Arise". Mostly it's the same arguments as in earlier writings by Bostrom, Russell, etc. Lots to say about all this but there's one issue I want to point out. 🧵 (1/8)
22
111
555
@MelMitchell1
Melanie Mitchell
1 year
There is so much wrong in this tweet. Our political leaders need better AI literacy.
@ChrisMurphyCT
Chris Murphy 🟧
1 year
ChatGPT taught itself to do advanced chemistry. It wasn't built into the model. Nobody programmed it to learn complicated chemistry. It decided to teach itself, then made its knowledge available to anyone who asked. Something is coming. We aren't ready.
1K
1K
9K
27
60
557
@MelMitchell1
Melanie Mitchell
5 years
Guy at next table in coffee shop: "What are you working on so intensely, Miss?" Me: Writing a book." Him: "What's it about?" Me: "Artificial intelligence." Him: "Did you know that two AIs at Facebook invented their own language that humans couldn't understand?" Me: uh....
27
49
545
@MelMitchell1
Melanie Mitchell
2 years
Me talking to CNN about (non) sentient AI 🤖
@questCNN
Quest Means Business
2 years
"Philosophers for centuries have pointed out that each of us, while individually aware of our own consciousness, has no proof that other people even are conscious." Santa Fe Institute Professor @MelMitchell1 talks a Google engineer's claim that an AI system has become sentient.
12
51
155
36
122
542
@MelMitchell1
Melanie Mitchell
1 year
In a dialogue in Gödel, Escher, Bach (1979), the Crab describes "a new...very flexible kind of computer": "they are called 'smart-stupids', since they are so flexible, and have the potential to be either smart or stupid, depending on how skillfully they are instructed." (1/2)
@MelMitchell1
Melanie Mitchell
1 year
'It is at once both smarter and dumber than any person you've ever met' Describes most big AI successes!
7
24
165
11
91
526
@MelMitchell1
Melanie Mitchell
1 year
This discourse gets dumber and dumber. Soon all news will be journalists asking LLMs what they think about stories by other journalists. Journalists: please stop anthropomorphizing these systems!
33
94
523
@MelMitchell1
Melanie Mitchell
6 months
Our leaders are using the best and most rigorous science about AI to create regulations, right?
Tweet media one
27
67
523
@MelMitchell1
Melanie Mitchell
4 years
I'm honored and thrilled to receive this award from @necsi . The award is named for the brilliant polymath Herbert Simon, whose 1969 book "The Sciences of the Artificial" has been so influential to all of us in complex systems science. I'm looking forward to ICCS 2020!
@necsi
NECSI
4 years
We are pleased to announce that the Herbert A. Simon Award will be presented to Melanie Mitchell for her prolific contributions to complex systems science and artificial intelligence. She will receive the Award at ICCS 2020:
1
23
106
51
48
523
@MelMitchell1
Melanie Mitchell
1 year
Feeling like my job as a scientist is still secure.
Tweet media one
24
40
495
@MelMitchell1
Melanie Mitchell
3 years
Tired: Word embeddings Wired: Bird embeddings
Tweet media one
7
55
483
@MelMitchell1
Melanie Mitchell
3 years
The paperback edition of my latest book is now out in the US and UK! This book is meant to be an accessible, entertaining, and even-handed account of modern AI, how it works, and how far it has to go to capture the complexity of human intelligence.
25
83
470
@MelMitchell1
Melanie Mitchell
4 months
On the topic of AI training on copyrighted data, many people have echoed the argument made by Andrew Ng below. But it would be interesting to think about what copyright law would be like if humans had the ability to memorize entire books and recite them when prompted to do so.
Tweet media one
88
55
479
@MelMitchell1
Melanie Mitchell
3 years
"Herbert Simon said we should call it 'complex information processing.' What would the world be like if it was called that instead?"
28
77
470
@MelMitchell1
Melanie Mitchell
3 years
overfull hbox, badness 10000
Tweet media one
6
39
475
@MelMitchell1
Melanie Mitchell
1 year
OMG is ChatGPT doing paid product placement?
Tweet media one
27
59
465
@MelMitchell1
Melanie Mitchell
2 years
Until then, I will admire the impressive products of machine learning and big data, but will not mistake them for progress toward general intelligence. (8/8)
14
36
449
@MelMitchell1
Melanie Mitchell
2 years
Sticking my neck out here, but..... I don't understand why people think machines could possibly learn common sense from language alone.
@GaryMarcus
Gary Marcus
2 years
Still more trouble in GPT-3 paradise: the "impressive zero-shot performance of large language models is mostly due to existence of dataset bias in ... benchmarks." – @xiang_lorraine et al, new Arxiv: "A Systematic Investigation of Commonsense Understanding [in LLMS]"
6
26
132
27
49
448
@MelMitchell1
Melanie Mitchell
1 year
My take on the recent GPT 3.5 "theory of mind" paper. It's consistent w/ earlier results, e.g., from @Maxwell_Nye et al., that LLMs can keep track of variables & attributes in simple stories (). Calling this "theory of mind" is vast overinterpretation.
@KevinAFischer
Kevin Fischer — soul/acc
1 year
This paper is not receiving enough attention: GPT 3.5 displays emergent theory of mind
Tweet media one
107
619
4K
27
78
449
@MelMitchell1
Melanie Mitchell
2 years
Tweeps: an AI / philosophy question: Several people (e.g., Searle, Penrose) have argued that machine intelligence is not just hard but impossible *in principle*. Has anyone made an (interesting) argument for that position more recently (e.g., in last 5 years)?
112
68
438
@MelMitchell1
Melanie Mitchell
5 years
Prediction: Quantum computing practitioners will come to regret using the term "quantum supremacy" because the term is an easily misunderstood hype magnet, similar to the hype magnetism of the term "artificial intelligence".
13
93
423
@MelMitchell1
Melanie Mitchell
4 years
RIP Lord Robert May. His work on the logistic map was hugely influential to me in learning about complex systems.
Tweet media one
3
102
425
@MelMitchell1
Melanie Mitchell
5 months
Forget Q*, this is Cute*
@_vztu
Zhengzhong Tu
5 months
Reinforcement learning explained
157
2K
13K
10
69
417
@MelMitchell1
Melanie Mitchell
5 years
Thread: I'm thrilled to announce that my new book is finally launched! Click below for a description, table of contents, reviews, ordering information etc. /1
26
111
415
@MelMitchell1
Melanie Mitchell
1 year
One of my new years resolutions is to blog (from time to time) about interesting work in AI. I'm trying out Substack for this. My first post is a perspective on recent paper by Webb et al., "Emergent Analogical Reasoning in Large Language Models".
12
61
412
@MelMitchell1
Melanie Mitchell
1 year
Yeah, the Senate hearings on AI regulation are going great. (from )
Tweet media one
30
92
408
@MelMitchell1
Melanie Mitchell
1 year
Brilliant essay by my colleague, David Krakauer, on the question "Does GPT-4 Really Understand What We're Saying?"
24
112
410
@MelMitchell1
Melanie Mitchell
7 months
If the phrase "godfather of AI" were to be mysteriously eradicated from the English language, I wouldn't miss it.
22
23
397
@MelMitchell1
Melanie Mitchell
6 years
"Can you prove it was raining that day?" "Yes, I have a photo." Amazing (and scary) work:
Tweet media one
6
208
392
@MelMitchell1
Melanie Mitchell
2 years
But it's worth remembering the Bongard problems, created by a Russian computer scientist in the 1960s as a challenge to AI. These problems require a rich and general understanding of basic concepts such as "same" vs. "different". (2/8)
Tweet media one
11
52
388
@MelMitchell1
Melanie Mitchell
3 years
AI experts, what do you propose that we do about insane statements like this from US defense officials? (From the @washingtonpost 's article about autonomous "AI" weapons. )
Tweet media one
48
90
379
@MelMitchell1
Melanie Mitchell
3 years
Question for AI researchers: What would you say are the most important advances towards more *general* AI that have happened over the last five years? That is, general as opposed to narrow AI. (I'm writing a review of this.) 1/3
66
71
374
@MelMitchell1
Melanie Mitchell
15 days
Tweet media one
2
86
365
@MelMitchell1
Melanie Mitchell
1 year
These numbers are B.S. These figures came from: They asked over 4,000 people who happened to publish at two 2021 AI conferences, & only 17% (~700) people responded. This doesn't represent 50% of AI researchers! & hardly from an unbiased sample.
@Laurie_Garrett
Laurie Garrett
1 year
OK, check this out. It gave me goosebumps and will like ruin tonight's sleep.
Tweet media one
59
67
272
34
71
362
@MelMitchell1
Melanie Mitchell
3 months
Then and now. ¯\_(ツ)_/¯
Tweet media one
11
40
362
@MelMitchell1
Melanie Mitchell
11 months
"AI Apocalypse Scorecard". See what your favorite AI researchers say about purported "existential threats" of AI:
25
101
358
@MelMitchell1
Melanie Mitchell
6 months
"Pretraining data for LLMs is already basically all of human knowledge". Interesting claim, but what about all the knowledge that isn't written down anywhere?
@boazbaraktcs
Boaz Barak
6 months
Folks might be a bit too manic-depressive about LLMs with any advance meaning that robot apocalypse is around the corner, and any obstacle means that we've hit the wall. Concretely, pretraining data for LLMs is already basically all of human knowledge, so not being to…
31
15
170
34
38
350
@MelMitchell1
Melanie Mitchell
2 years
" it seems probable that most of the grand underlying principles have been firmly established and that further advances are to be sought chiefly in the rigorous application of these principles to all the phenomena which come under our notice." -- Albert Michelson, 1894 on physics
@NandoDF
Nando de Freitas 🏳️‍🌈
2 years
Someone’s opinion article. My opinion: It’s all about scale now! The Game is Over! It’s about making these models bigger, safer, compute efficient, faster at sampling, smarter memory, more modalities, INNOVATIVE DATA, on/offline, … 1/N
104
222
869
19
52
348
@MelMitchell1
Melanie Mitchell
4 years
The state of "smart reply" on my phone. Sentiment analysis for the win!
Tweet media one
9
55
334
@MelMitchell1
Melanie Mitchell
6 months
If you're in Santa Fe, come to my free public lecture, "The Future of AI" on Wednesday (11/15) at 7:30pm MST at the Lensic Theater! If you're not in Santa Fe, watch the livestream on SFI's YouTube Channel. All info is here:
8
79
335
@MelMitchell1
Melanie Mitchell
4 years
Indeed, computer science has a culture of hardcore all-nighter paper writing (not to mention 24-hour hackathons) that definitely hurts all people who are parents, and especially women. I think the CS focus on conference rather than journal publications is part of the problem.
@NandoDF
Nando de Freitas 🏳️‍🌈
4 years
There’s also the insidious biases, which are the hardest to surmount, eg Professors who foster a culture of killing oneself on paper deadlines, to the point of not sleeping the night before. This favoured single males. I’m guilty of this and I apologise to all my students. 7/
5
14
204
11
55
329
@MelMitchell1
Melanie Mitchell
7 months
Huge thanks to the @CompSysSoc for this honor!
@sfiscience
Santa Fe Institute
7 months
🏆 SFI Professor @MelMitchell1 receives the 2023 Senior Scientific Award from the @CompSysSoc for her outstanding contributions to #AI , #ComplexityScience , and education.
Tweet media one
7
19
158
32
28
333
@MelMitchell1
Melanie Mitchell
3 years
New paper testing whether "natural language understanding" benchmarks actually test language understanding. Answer: No.
@anh_ng8
Anh (Totti) Nguyen
3 years
Do SotA natural language understanding models care about word order? Nope 🙃, 75% to 90% of the time, for BERT-based models, on many GLUE tasks (where they outperformed humans). "marijuana cause cancer" == "cancer cause marijuana" Ouch... 1/4
Tweet media one
19
138
647
13
75
323
@MelMitchell1
Melanie Mitchell
4 years
If you're quarantined or otherwise stuck at home, and yearning to learn some complexity science, check out @sfiscience 's for some excellent tutorials and full-length courses!
1
90
317
@MelMitchell1
Melanie Mitchell
1 year
New postdoc job in AI / CogSci available at the Santa Fe Institute. Are you a grad student or postdoc interested in working with me on AI systems for abstraction and analogy? See for more info. Apply by June 9. Pls RT! (View from our campus)
Tweet media one
7
182
311
@MelMitchell1
Melanie Mitchell
11 months
Agreed! The message from Altman at al. seems to be "AI is so dangerous, powerful, and mysterious that only people at the top AI companies know enough to regulate it." Regulatory capture is the point.
@Jake_Browning00
Browning.jake00
11 months
I don't think anyone should report on the 22-word letter from Altman et al. on regulating AI to prevent existential risk without mentioning it comes just after OpenAI threatened to leave the EU rather than be regulated.
15
65
193
14
85
311
@MelMitchell1
Melanie Mitchell
10 months
Wow, this public statement by three of the authors of the recent MIT paper on GPT-4 is....quite something.
@NeilDeshmukh
Neil Deshmukh
10 months
MIT professors (Armando Solar-Lezama, Tonio Buonassisi @toniobuonassisi , and Yoon Kim ) have released a public statement regarding the paper, and asked us to share:
4
49
259
16
35
304
@MelMitchell1
Melanie Mitchell
2 years
A striking (if rare) statement of modesty from the brilliant E. O. Wilson: "Knowing where my capabilities lay, I chose the second of the two routes to success in science: breakthroughs for the extremely bright, syntheses for the driven." RIP to a giant of science.
2
44
299
@MelMitchell1
Melanie Mitchell
4 months
Reading the fantastic biography of von Neumann by @Ananyo , I learned the useful German phrase "Froschmäusekrieg", literally "a war of frogs and mice", meaning "a bitter but unimportant altercation". Useful term for many of today's academic battles!
11
36
306
@MelMitchell1
Melanie Mitchell
6 months
Conclusion: "Our results support the hypothesis that GPT-4, perhaps the most capable “general” LLM currenly available, is still not able to robustly form abstractions and reason about basic core-concepts in contexts not previously seen in its training data." (8/9)
2
76
303
@MelMitchell1
Melanie Mitchell
2 months
Excellent discussion by @tom_siegfried of LLM "understanding" and our recent paper on evaluating analogical reasoning with counterfactual tasks:
6
91
304
@MelMitchell1
Melanie Mitchell
9 months
Article in Nature today on the question of how to assess AI systems, including some recent work by myself and my collaborators!
4
101
304
@MelMitchell1
Melanie Mitchell
7 months
Who else is countering the LLM "AGI" narrative? Google product manager for Bard! (From by @daveyalba ) 👀 ⬇️
Tweet media one
26
46
300
@MelMitchell1
Melanie Mitchell
2 years
Such a strange article. It's been known for *forever* that humans are predisposed to anthropomorphize even with only the shallowest of signals (cf. ELIZA). Google engineers are human too, and not immune.
This story (by @nitashatiku ) is really sad, and I think an important window into the risks of designing systems to seem like humans, which are exacerbated by #AIhype :
43
203
817
11
58
296
@MelMitchell1
Melanie Mitchell
1 year
@Abebab Horse's mouth:
Tweet media one
1
50
287
@MelMitchell1
Melanie Mitchell
2 months
Searching for "As an AI language model" also yields some choice results
Tweet media one
Tweet media two
@NMoiroux
Nicolas Moiroux @[email protected]
2 months
@RetractionWatch Want to see more, try this search on Google scholar: "certainly, here is" -chatgpt -llm
9
121
1K
5
50
296
@MelMitchell1
Melanie Mitchell
1 year
Recently I hosted a fantastic workshop at the Santa Fe Institute, entitled "AI and the Barrier of Meaning 2". Description below. (1/4)
Tweet media one
5
68
291
@MelMitchell1
Melanie Mitchell
1 year
Mastodon tip: I used to automatically go through the list of people I follow on Twitter & find the handles of those who are on Mastodon. It created a CSV file that I was able to upload to Mastodon so I could automatically follow those people. Very easy!
7
62
288
@MelMitchell1
Melanie Mitchell
4 years
Love this example of "unintended cue learning" from
Tweet media one
10
82
284