My new course, Generative AI for Everyone, is now available!
Learn how Generative AI works, how to use it in professional or personal settings, and how it will affect jobs, businesses and society. This course is accessible to everyone, and assumes no prior coding or AI…
1/ Thrilled to announce: Our new course ChatGPT Prompt Engineering for Developers, created together with
@OpenAI
, is available now for free! Access it here:
The suspension of the H1B visa program is bad for the US, bad for innovation, and will shatter dreams and disrupt lives. As a former H1B visa holder, my heart goes out to all the families affected.
More companies should tell employees it's fine if your kids show up on Zoom when you're working from home. This isn't a sign of someone being unprofessional. This is a sign that you're a human being.
Stephen Hawking once said, "I'm not afraid of death, but I'm in no hurry to die. I have so much I want to do first." RIP Professor Hawking, and may we all strive to live as fully as he did.
1/The call for a 6 month moratorium on making AI progress beyond GPT-4 is a terrible idea.
I'm seeing many new applications in education, healthcare, food, ... that'll help many people. Improving GPT-4 will help. Lets balance the huge value AI is creating vs. realistic risks.
I just told my daughter that if we can have a woman VP in the White House, then she, too can do anything. Since she's 2 years old, she responded that she would like some chocolate.
@geoffreyhinton
I'd like to respectfully point out that the logic in this argument is based on a flawed model for how scientists think. Scientists don't just take a weighted average of others' opinions to form their own.
A good scientist takes as input lots of data, including others' opinions,…
I’m glad DeepNude is dead. As a person and as a father, I thought this was one of the most disgusting applications of AI. To the AI Community: You have superpowers, and what you build matters. Please use your powers on worthy projects that move the world forward.
1/Large language models like Galactica and ChatGPT can spout nonsense in a confident, authoritative tone. This overconfidence - which reflects the data they’re trained on - makes them more likely to mislead.
Thank you to the entire OpenAI team, including esp
@sama
@gdb
@miramurati
, for your incredible contributions to AI. It is tragic that the foolish decisions of a few people are hurting everyone. We love and are rooting for every one of you.❤️
Coursera had started with my machine learning class. I’m delighted to announce that I’ll soon be teaching a new Machine Learning Specialization, created by
@StanfordOnline
&
@DeepLearningAI_
. Please help me spread the word! You can sign up here:
The new Machine Learning Specialization by
@DeepLearningAI_
&
@StanfordOnline
is now available on
@Coursera
!
You’ll learn the fundamentals of ML & gain practical experience with Python. Please help me spread the word, and encourage others to take ML!
AI+ethics is important, but has been partly hijacked by the AGI (artificial general intelligence) hype. Let's cut out the AGI nonsense and spend more time on the urgent problems: Job loss/stagnant wages, undermining democracy, discrimination/bias, wealth inequality.
I think AI agentic workflows will drive massive AI progress this year — perhaps even more than the next generation of foundation models. This is an important trend, and I urge everyone who works in AI to pay attention to it.
Today, we mostly use LLMs in zero-shot mode, prompting…
I just tested positive for Covid.
I am very grateful to the people that’ve worked on vaccines worldwide. My symptoms are comparable to a mild flu, but if I hadn’t had a vaccine & booster, I’m sure it would have been much worse. Thank you! ❤️
Saying bye to my daughter Nova before I head to London for a few days.
I have an irrational worry that by the time I get home on Thursday she'll be all grown up and have forgotten who I am. That's not how it works, right?
When I think about what we can do to build a brighter future for our children, the most important thing is to create a foundation for education. Because education is knowledge. And knowledge is human progress.
When I think of existential risks to large parts of humanity:
* The next pandemic
* Climate change→massive depopulation
* Another asteroid
AI will be a key part of our solution. So if you want humanity to survive & thrive the next 1000 years, lets make AI go faster, not slower.
Deep Learning is getting really good on Big Data/millions of images. But Small Data is important too. Am seeing many exciting applications at Landing AI where you can get good results w/100 images. Hope more researchers work on Small Data--ML needs more innovations there.
@geoffreyhinton
I didn't say it is a conspiracy.
But I think overhyped fears about AI leading to human extinction are causing real harm:
- I'm seeing young students discouraged from entering AI because they don't want to contribute to human extinction.
- Hype about harm is also being used to…
With the fall of Afghanistan's government, women's rights took a big step backward today. This is a sobering reminder that the rise of human rights isn't inevitable, and we have to keep pushing to bolster them.
I'm grateful for Dr. Fauci's tireless work to disseminate good science about the pandemic.
When we see a scientist unfairly attacked, we need to speak up. It is by doing so that we defend not just the scientist, but also the scientific process.
#IStandWithFauci
I'm happy to be on the Time AI 100 list of influential people in AI, and thrilled that 8 others from my Stanford group or other teams I led are also named!
Congratulations to my former advisees and team members:
- Sam Altman
@sama
(as undergrad, interned with me on RL…
AI For Everyone is now available on
@Coursera
! This course will help non-engineers and engineers work together to leverage AI capabilities and build an AI strategy. If you want your company to embrace AI, this is the course to get your CEO to take!
The LVM (large vision model) revolution is coming a little after the LLM (large language model) one, and will transform how we process images. But there’s an important difference between LVMs and LLMs:
- Internet text is similar enough to proprietary text documents that an LLM…
Happy New Year! If you're still working on your 2019 resolutions, don't only plan what you want to do, but also plan what you want to learn. This may be the best investment you can make in your future. I regularly set learning goals for myself, and hope you will too!
It's not right for PhD programs to be accessible only to rich families. The current US proposal to tax tuition forgiveness is a huge step in that direction and will discourage many from pursuing graduate studies.
My greatest fear for the future of AI is if overhyped risks (such as human extinction) lets tech lobbyists get enacted stifling regulations that suppress open-source and crush innovation.
Read more in our Halloween special issue of the Batch:
Happy International Programmers' Day! This is celebrated on the 256th day of the year, which is today. ❤️ all of you writing or learning to write software for other people to use!
I’m teaching a new course: Generative AI for Everyone, which is coming soon!
Learn how Generative AI works, how to use it in professional or personal settings, and how it will affect jobs, businesses and society. This course is accessible to everyone, and assumes no prior coding…
Computer Scientist Alan Turing will appear on UK currency. This is wonderful! Perhaps this acknowledgement of his accomplishments will encourage more people to enter CS and AI?
I'd like to have a real conversation about whether AI is a risk for human extinction. Honestly, I don't get how AI poses this risk.
What are your thoughts? And, who do you think has a thoughtful perspective on how AI poses this risk that I should talk to?
After reading the
@nytimes
lawsuit against
@OpenAI
and
@Microsoft
, I find my sympathies more with OpenAI and Microsoft than with the NYT.
The suit:
(1) Claims, among other things, that OpenAI and Microsoft used millions of copyrighted NYT articles to train their models
(2)…
To all my Google friends: I know this week has been tough with a lot of criticism about Gemini's gaffes.
Just wanted to say I love all of you and am rooting for you. I know everyone means well, and am grateful for your work & eager to see where you next take this amazing tech!
Had an insightful conversation with
@geoffreyhinton
about AI and catastrophic risks. Two thoughts we want to share:
(i) It's important that AI scientists reach consensus on risks-similar to climate scientists, who have rough consensus on climate change-to shape good policy.…
New
@ICEgov
policy regarding F-1 visa international students is horrible & will hurt the US, students, and universities. Pushes universities to offer in-person classes even if unsafe or no pedagogical benefit, or students to leave US amidst pandemic and risk inability to return.
I'm relieved at the election outcome and grateful to so many that made it possible. Thank you to every election worker helping run a fair process. To the media that defended the truth. And to each of you that voted or spoke up for participating in this wonderful democracy. 🇺🇸
Happy 75th Independence Day to all my friends in India! 🇮🇳Democracy is a powerful tool for improving people's lives. It is wonderful to see the many people in India and worldwide continuing to fight for this ideal.
If you're starting a reading group on Large Language Models (LLMs), what is one research paper you will want added to the reading list?
Researchers: Feel free to recommend your own paper too!
No we're not, Mr. President. Living in California, I will keep working to benefit all Americans and all people everywhere. I hope everyone in the Federal Government will do so too.
Laws to ensure AI applications are safe, fair, and transparent are needed. But the White House's use of the Defense Production Act—typically reserved for war or national emergencies—distorts AI through the lens of security, for example with phrases like "companies developing any…
In AI, the ratio of attention on hypothetical, future, forms of harm to actual, current, realized forms of harm seems out of whack.
Many of the hypothetical forms of harm, like AI "taking over", are based on highly questionable hypotheses about what technology that does not…
Announcing AI For Everyone, the newest
@deeplearningai_
course! Whether you're a CEO, product manager, marketer, recruiter, designer, or financier, this non-technical course will help you understand how to apply AI in your company, and navigate AI's rise.
Would love your feedback on this: AI Systems = Code (model/algorithm) + Data. Most academic benchmarks/competitions hold the Data fixed, and let teams work on the Code. Thinking of organizing something where we hold the Code fixed, and ask teams to work on the Data. (1/2)
Announcing the AI Fund! We have raised $175 million, and will start multiple new businesses that use AI to improve human life. We also hope to help many of you enter AI, and do the important work of building an AI-powered society.
One of the (many) reasons AI research is progressing faster than ever is that there're now more people doing AI research than at any other point in history.
This is a wonderful trend, and lets keep welcoming more people into AI!
1/The rise of Software Engineering required inventing processes like version control, code review, agile, to help teams work effectively. The rise of AI & Machine Learning Engineering is now requiring new processes, like how we split train/dev/test, model zoos, etc.
I'm deeply disappointed at White House policies that separate children from parents. No one wants illegal immigration, but cruelty to children is unethical and we cannot justify it as "deterrence." I am a proud immigrant, and have faith in the US to be better than this.
We need a Goldilocks Rule for AI:
- Too optimistic: Deep learning gives us a clear path to AGI!
- Too pessimistic: DL has limitations, thus here's the AI winter!
- Just right: DL can’t do everything, but will improve countless lives & create massive economic growth.
New course with
@huggingface
! Building Generative AI Applications with Gradio, taught by Apolinário Passos
@apolinariosteps
, shows you how to quickly create demos of your machine learning applications to test and iterate/share with others. Check it out!
We just released "Large Language Models with Semantic Search”, built with
@cohere
, and taught by
@JayAlammar
and
@SerranoAcademy
. Search is a key part of many applications. Say, you need to retrieve documents or products in response to a user query; how can LLMs help? You’ll…
Get a free draft copy of my book on how to structure Machine Learning projects: I’d started this before but got distracted building Deep Learning Specialization; I’m now rebooting this. Sign up to get free chapters as they’re released!
@imrahulmaddy
Thanks! When I first became a professor at Stanford, I decided that rather worrying about how to make myself successful, I would instead focus on trying to make others successful. This turned out to be a great decision, and to this day this is still how I approach work!
About time! Geoff Hinton,
@ylecun
and Yoshua Bengio were just selected for the ACM Turing Award for their Neural Network work going all the way back to the 1980s. Congrats to all three! This is a great step for all of AI!
Hello India! Thank you
@nasscom
for having me. I'm excited to see the momentum AI has here. From individuals to companies to the government, all the elements are present for rapid growth!
New short course on sophisticated RAG (Retrieval Augmented Generation) techniques is out! Taught by
@jerryjliu0
and
@datta_cs
of
@llama_index
and
@truera_ai
, this teaches advanced techniques that help your LLM generate good answers.
Topics include:
- Sentence-window retrieval,…
New course! Generative AI with Large Language Models, created with
@AWS
and hosted on
@coursera
. This course goes deep into the technical foundations of LLMs and how to use them. You can sign up here:
You’ll work through the full life-cycle of a…
Right now economists are debating whether 2019 will see a recession. Short-term is hard to predict, but I predict that in the next 5 years, AI adoption across multiple industries--especially outside the software industry--will drive massive global GDP growth.
Last week, I described four design patterns for AI agentic workflows that I believe will drive significant progress this year: Reflection, Tool use, Planning and Multi-agent collaboration. Instead of having an LLM generate its final output directly, an agentic workflow prompts…
Just updated the Deep Learning Specialization with the latest advances. This 2021 release goes up to Transformer Networks, and Prog Exercises are now in TF2. If you’re wondering whether to learn DL, this is a good time to jump in! Learn here:
RIP to my friend, colleague, and AI visionary Nils Nilsson. Your work on the A* algorithm has improved countless lives (this is how we find the shortest path from A to B). I will always remember your work, but even more importantly your kindness.
New short course on Fine-tuning LLMs! Many developers are moving beyond only prompting, to also fine-tuning LLMs - that is, taking a pre-trained model and training it further on your own data, which can deliver superior results inexpensively. In this course,
@realSharonZhou
, CEO…
A little known part of the origin story of LLMs: A lot of early Natural Language Processing research was funded by US intelligence agencies that had an interest in machine translation (and also speech recognition). This funding helped develop benchmarks, grow communities and…
The new UN Climate report shows our planet is nearing crisis. While individuals tweaking their carbon footprint is a good step, we now need more than that. The best hope for our planet is electing decisive global leaders who will make the right choices. Please vote.
While I may be the first woman in this office, I will not be the last—because every little girl watching tonight sees that this is a country of possibilities.
Announcing 's newest specialization, TensorFlow: From Basics to Mastery! In partnership with
@TensorFlow
team. To be great at implementing AI, you need to know how to best use ML frameworks like TF.
@deeplearningai_
Take Course 1:
Great chatting with
@lexfridman
. We talked about everything from the early mistakes I made building MOOCs to the challenges of deploying AI systems. Stay tuned for the podcast episode!
This is a great website, and documents via news clippings the alarm over many beneficial innovations, such as electricity, bicycles, elevators, radio, etc:
After the current wave of alarm over AI human extinction dies down, I wonder if statements about…