AI21 Labs Profile Banner
AI21 Labs Profile
AI21 Labs

@AI21Labs

6,225
Followers
90
Following
62
Media
259
Statuses

AI21 Labs builds Foundation Models and AI Systems for the enterprise that accelerate the use of GenAI in production. 🥂Meet Jamba

Joined August 2019
Don't wanna be here? Send us removal request.
Pinned Tweet
@AI21Labs
AI21 Labs
1 month
Introducing Jamba, our groundbreaking SSM-Transformer open model! As the first production-grade model based on Mamba architecture, Jamba achieves an unprecedented 3X throughput and fits 140K context on a single GPU. 🥂Meet Jamba 🔨Build on @huggingface
Tweet media one
37
258
1K
@AI21Labs
AI21 Labs
3 years
Today we’re launching AI21 Studio, a platform where you can instantly access our state-of-the-art language models to build your own applications - including a 178B parameters model, Jurassic-1 Jumbo. We can’t wait to see what you create!
18
83
290
@AI21Labs
AI21 Labs
1 month
📄Jamba whitepaper is out! The whitepaper details our in-depth ablations on this novel hybrid SSM-Transformer architecture, and how we chose to interleave Mamba, Transformer and MoE. Here are some highlights from the paper 👇1/6
Tweet media one
3
62
257
@AI21Labs
AI21 Labs
7 days
We just released Jamba-Instruct! Built from our groundbreaking SSM-Transformer Jamba architecture, Jamba-Instruct brings the same technological innovation to the enterprise via an aligned model. With leading quality benchmarks, a 256K context window, and the most competitive…
Tweet media one
11
57
276
@AI21Labs
AI21 Labs
1 year
Exciting news! 📣 We've launched Jurassic-2 and our task-specific APIs! Both are major game-changers, with Jurassic-2's new and improved capabilities, and our APIs' plug-and-play reading & writing functions that outperform competitors. Read more:
Tweet media one
3
11
53
@AI21Labs
AI21 Labs
6 months
Our Series C round has not only met but exceeded expectations - with an extension of $53.5 million, bringing the total amount of this round to $208 million! 📈 Special thanks to our latest investors @intelcapital and @ComcastVentures for joining us on this exciting journey.
Tweet media one
2
7
50
@AI21Labs
AI21 Labs
1 year
We’re excited to share our latest innovation with the world and have it launch today on @ProductHunt ! Introducing our latest gaming experiment, “Human or Not?” - the first ever Social Turing Game. 👾
8
12
45
@AI21Labs
AI21 Labs
2 years
AI21 Labs has raised $64 million in series B funding, bringing our valuation to $664 million! Thanks to Ahren Innovation Capital for leading the round, we look forward to growing our incredible #AI21Team and investing more in R&D. Read more here:
3
4
42
@AI21Labs
AI21 Labs
7 months
Our Jurassic foundation models are widely available in @awscloud Bedrock! We are excited to provide more AWS builders and businesses with our reliable, sophisticated and flexible LLMs. Read more here >>
1
8
39
@AI21Labs
AI21 Labs
1 year
We are proud to announce the release of our latest scientific paper about improving grounded text generation and fact attribution - for any off-the-shelf LMs! Read more details about this exciting development and its implications for the future of #AI :
1
12
37
@AI21Labs
AI21 Labs
1 month
Thanks @tri_dao ! We enjoyed the opportunity to extend and build on top of Mamba. The Jamba white paper is coming soon and has some ablations we will share on this subject.
@tri_dao
Tri Dao
1 month
Wow this is a big deal, first large-scale Mamba-based model! Mamba layers brings much longer context and higher inference throughput. Having 4 attention layers seem to be the sweet spot to get the best of Transformer & Mamba architectures.
2
54
496
0
1
33
@AI21Labs
AI21 Labs
2 years
1/n Introducing J1-Grande, the newest member of the Jurassic-1 family. With 17B parameters, Grande offers Jumbo-like quality (10x larger) at an affordable price (⅓ of the cost).
2
11
30
@AI21Labs
AI21 Labs
1 month
Find our new model on @huggingface .
@_philschmid
Philipp Schmid
1 month
Jamba released! @AI21Labs just released the first production-scale Mamba implementation! Jamba is a hybrid SSM-Transformer MoE rivaling open transformer-based LLMs 🚀 TL;DR: 🧠 52B parameters with 12B active during generation 👨‍🏫 16 experts with 2 active in generation 🆕 New…
Tweet media one
5
43
235
0
3
29
@AI21Labs
AI21 Labs
1 year
We are beyond excited to have won Startup of the Year at the #GeektimeAwards ! A huge thank you to our amazing team and to @geektime for this honor and recognition. This is only the beginning for us! 🏆
Tweet media one
1
5
27
@AI21Labs
AI21 Labs
1 month
Building a RAG solution is easy. Building a great one is not. In our guest blog on @streamlit , our team explores the intricacies of how AI21's Contextual Answers Task-Specific Model & our RAG Engine generate context-based answers grounded in your proprietary organizational data.…
0
2
27
@AI21Labs
AI21 Labs
1 month
And 140K context on a single GPU. @ArtificialAnlys We look forward to seeing those benchmarks!
@ArtificialAnlys
Artificial Analysis
1 month
Jamba model launch takeaways - Potentially a new leader for ultra-long prompt use-cases (RAG) ‣ First open-source model of this size to combine MAMBA state-space model architecture, Mixture-Of-Experts (MOE) and the transformer ‣ 256k context window, more than 2X the size of…
Tweet media one
Tweet media two
0
10
39
0
2
25
@AI21Labs
AI21 Labs
1 year
We're thrilled to announce our partnership with Amazon for their latest service, Bedrock. As our Co-CEO, Ori Goshen, stated, "With Jurassic-2 models and Bedrock, developers can maximize the performance of language tasks while optimizing the cost."
Tweet media one
0
5
25
@AI21Labs
AI21 Labs
1 month
This Jamba overview is a great way to quickly understand the novel features Jamba brings to the dev community. Thanks @AiFlux !
@AiFlux
Ai Flux
1 month
0
0
5
1
4
22
@AI21Labs
AI21 Labs
1 year
Honored to be named among the top 3 most promising startups of 2023 by @Calcalist , and proud to be at the forefront of the #GenAI revolution! Thanks to Calcalist for this incredible recognition. Read more about the top 50 startups:
1
2
21
@AI21Labs
AI21 Labs
1 year
Congratulations to our chairman, Prof. @AmnonShashua , on being awarded the Israel Prize for lifetime achievement! 🏆This is a remarkable accomplishment and truly well-deserved. #MachineLearning #IsraelPrize #LifetimeAchievement
Tweet media one
0
0
21
@AI21Labs
AI21 Labs
2 years
What would RBG (probably) say about… anything? Check out our latest AI experiment at and let her judge! #AskRBG
Tweet media one
1
6
20
@AI21Labs
AI21 Labs
10 months
We're excited to introduce Contextual Answers, an API solution where answers are based on organizational knowledge, leaving no room for AI hallucinations. 💭 ➡️
Tweet media one
0
4
18
@AI21Labs
AI21 Labs
2 years
Big thanks to our friends over @GoogleCloud_IL for sending us this sweet surprise after our latest round of funding! Here's to a great partnership and many more celebratory treats to come! 🎂
Tweet media one
Tweet media two
2
0
18
@AI21Labs
AI21 Labs
1 year
Recent evaluations show that our summarize API outperforms OpenAI's models, offering a better user experience and more consistent results. 📈 Learn more about the research and findings 👇
1
3
17
@AI21Labs
AI21 Labs
2 years
We’ve been named one of the top 100 most innovative AI startups of 2022 by @CBinsights ! We are proud that our language models take part in pioneering this momentous period in AI history, and we look forward to shaping the future of NLP as an intelligent thought partner.
Tweet media one
0
4
17
@AI21Labs
AI21 Labs
2 years
1/n Hot off the press – AI21 Studio graduated from Beta!! Seamlessly train your own custom model by the touch of a button using our enhanced user interface.
1
3
16
@AI21Labs
AI21 Labs
11 months
"Humans or Not" has become the largest Turing Test in history, with 1.5 million participants from around the world. 🌎 💡 Uncover the fascinating insights and surprising strategies:
2
2
15
@AI21Labs
AI21 Labs
7 days
(2/4) Jamba-Instruct outperforms or rivals other instruction-tuned competitors across common performance benchmarks.
Tweet media one
1
0
20
@AI21Labs
AI21 Labs
1 year
It was an incredible experience to be a part of the START Global Summit in St. Gallen! Our Co-CEO, @origoshen , had the opportunity to discuss the future of #GenerativeAI and the AI21 labs journey with the brightest minds and leaders in the industry. #START23 #ai #innovation
Tweet media one
Tweet media two
0
0
15
@AI21Labs
AI21 Labs
4 years
Today we announced the launch of our first product @wordtune , an #AI based tool that understands both writing & meaning. Check out our new writing assistant on @googlechrome , and read more on the announcement from @jeremyakahn in @FortuneMagazine :
0
4
14
@AI21Labs
AI21 Labs
5 years
SenseBERT: Pre-training with a novel self-supervised word sense prediction task improves #BERT 's lexical semantics abilities, achieving a state-of-the-art score on the notorious Word-in-Context task. @tpilehvar #SuperGLUE #WordNet #NLProc #deeplearning
0
7
14
@AI21Labs
AI21 Labs
1 year
"Generative anything is the idea that you put in a little and get a lot. It's exciting as it is wondrous" Check out this recent CTech interview with our Co-Founder & Co-CEO, Prof. Yoav Shoham:
0
2
14
@AI21Labs
AI21 Labs
1 year
Interview with our Co-Chief Scientist, @YoavLevine : "When someone creates content, they want to be comfortable to put their name on it. And in certain use cases, the ability to connect the content to sources really facilitates this” via @bdtechtalks
0
6
14
@AI21Labs
AI21 Labs
8 months
Be sure to drop by booth 223 at this year's SaaStr Annual event! Explore the remarkable capabilities of AI21 Studio and discover how you can can easily customize language models to meet your specific needs. #ai21studio #saastr2023 #NLP
Tweet media one
0
3
14
@AI21Labs
AI21 Labs
1 year
Our Co-founder & Co-CEO @origoshen kicking off @awscloud #reInvent2022 with an exciting announcement: you can now deploy our LLM Jurassic-1 on your private SageMaker environment!
Tweet media one
0
1
14
@AI21Labs
AI21 Labs
1 year
Our friends at Verb have launched their AI-enhanced writing apps for authors. It's been a pleasure working with their wonderful team! 🥳
Today, we’re thrilled to launch Verb, an AI-enhanced writing app for fiction writers! ✍️🤖 Verb helps you write, brainstorm, plan, and get feedback on your work. Sign up for free at ! Read on for more on our thinking 👇🧵
6
40
134
0
0
13
@AI21Labs
AI21 Labs
1 year
Our Co-Founder & Co-CEO, @yshoham will participate in @EntreeCap 's panel discussion on #GenerativeAI . You are welcome to join!
Tweet media one
0
1
13
@AI21Labs
AI21 Labs
1 year
Excited to share our latest case study on Verb, a new AI writing tool powered by AI21 Studio! With the use of our custom models, Verb goes beyond mere text generation and becomes a true partner to authors everywhere.
1
4
13
@AI21Labs
AI21 Labs
4 years
We’re excited to share Auxiliary Tuning - a simple and efficient method for reducing training costs by adapting a pre-trained LM to a novel task, e.g. conditional text generation. #NLProc #DeepLearning
0
4
13
@AI21Labs
AI21 Labs
3 years
We're shifting the paradigm of how to scale text-based AI applications affordably & efficiently. Read about our custom models approach and learn how to take your app from prototype to production.
0
4
12
@AI21Labs
AI21 Labs
2 years
Spotted! Our awesome Co-CEO @origoshen on a billboard (!!!) in Tel Aviv. Thanks @Google - we ❤️ you too.
Tweet media one
0
2
12
@AI21Labs
AI21 Labs
2 years
Our very own @GalShachaf will be presenting at #awssummit in Tel Aviv next week to speak about what we're developing here at AI21 Labs and how we use Amazon SageMaker to train large language models. You can register for the summit in this link:
Tweet media one
0
1
11
@AI21Labs
AI21 Labs
2 years
2/n We built a poet and didn’t even know it. We requested a witty poem about the relationship between feline and canine. Here is what the J-1 master sonneteers composed:
Tweet media one
1
0
11
@AI21Labs
AI21 Labs
1 year
Have you heard the news? we're now offering Jurassic-1 Grande on Amazon SageMaker! Check out the blog post and sign up for the preview: #generativeai #aws #largelanguagemodels #nlp #ai
@DanPadnos
Dan Padnos
1 year
Great #reInvent2022 . Really enjoyed co-speaking with @GalOshri and Emily Webber in our session on distributed training and LLMs yesterday. Monday we announced that @AI21Labs Jurassic-1 is now available on @awscloud SageMaker. And today we’re already hearing from eager customers!
Tweet media one
Tweet media two
2
1
13
0
1
10
@AI21Labs
AI21 Labs
1 year
The possibilities of AI in game development are endless. 🎮 Learn how Ubisoft harnessed the power of our AI to revolutionize their game creation process and achieve more in less time: #gamedevelopment #AI #llm
0
0
11
@AI21Labs
AI21 Labs
2 years
Today! Twitter Spaces discussion on best practices for deploying LLMs, led by @percyliang with our very own @Udi73613335 and other industry partners. See you there!
@percyliang
Percy Liang
2 years
Join us tomorrow (Wed) at 12pm PT to discuss the recent statement from @CohereAI @OpenAI @AI21Labs on best practices for deploying LLMs with @aidangomezzz @Miles_Brundage @Udi73613335 . Please reply to this Tweet with questions!
19
42
126
1
2
11
@AI21Labs
AI21 Labs
1 year
Catch our Co-CEO @origoshen in the closing panel at the AWS Startup Showcase on March 9th! They'll be discussing the hottest trend in tech - the future of Generative AI 🔥 Join this virtual event here: #GenerativeAI #TechTrends #LeadershipAdvice
Tweet media one
0
2
11
@AI21Labs
AI21 Labs
7 days
(4/4) With a 256K context window, Jamba-Instruct boasts the largest context window in its size class.
Tweet media one
3
0
16
@AI21Labs
AI21 Labs
2 years
Yoav Shoham ( @yshoham ), our Co-Founder & CEO in an interview with Young Sohn, discussing AI21 Labs – which Young’s Walden Catalyst is an investor in – and its solutions, the history and future of artificial intelligence (AI).
0
2
10
@AI21Labs
AI21 Labs
6 months
Come meet the team at #AWSreinvent in Vegas! 👋 Let's talk #GenAI - schedule a meeting with us:
Tweet media one
0
2
10
@AI21Labs
AI21 Labs
2 years
Our co-founder Yoav Shoham was recently featured on 20 Minute Leaders, a daily talk show that hosts thought leaders from around the world 🌎 Check out the full podcast on Spotify:
0
0
10
@AI21Labs
AI21 Labs
8 months
It's official! Our Jurassic LLMs and Task-Specific models are now available on Google Marketplace. Customers can now easily tap into these resources to build and deploy generative AI-driven applications. 🚀
0
0
9
@AI21Labs
AI21 Labs
3 years
Check out our white paper for a comprehensive technical description and thorough evaluation of our Jurassic-1 (J1) language models:
Tweet media one
0
2
9
@AI21Labs
AI21 Labs
3 years
We used our Jurassic-1 language models to generate rap lyrics about @BarackObama . We're basically the next @Lin_Manuel , right? Discover tons of other ways to use AI21 Studio from the frivolous to the substantial:
1
2
9
@AI21Labs
AI21 Labs
4 years
Happy to share this wine story published on Jancis Robinson, featuring HAIMKE and created by Prof. Yoav Shoham
0
3
8
@AI21Labs
AI21 Labs
7 days
(3/4) Jamba-Instruct results on long-context QA benchmarks, conducted using the same method outlined in section 5.2.2 of our Jamba base model whitepaper.
Tweet media one
3
1
14
@AI21Labs
AI21 Labs
1 month
Jamba was trained to handle contexts of up to 256K. Jamba has excellent performance in the needle-in-a-haystack evaluation, which is especially interesting given its use of only 4 attention layers. It also outperforms Mixtral on most long-context benchmarks. 4/6
Tweet media one
Tweet media two
1
0
8
@AI21Labs
AI21 Labs
2 years
“There are not many places where the general public can go and play with real AI, but now you can.” This Washington Post article explores our most recent AI experiment:
0
1
8
@AI21Labs
AI21 Labs
1 month
We found that scaling Mamba to substantial sizes isn’t trivial and causes unstable training. We had to make some adjustments to the Mamba layers to stabilize them, as can be seen in the graph below (training loss before & after the change) 6/6
Tweet media one
1
1
7
@AI21Labs
AI21 Labs
1 year
Generative AI continues to rapidly develop, creating a new reality. But we're only just beginning and there are few limitations. Read more about it in @Tech12news , recent Op-ed written by our own @DanPadnos (HEB)
0
1
7
@AI21Labs
AI21 Labs
2 years
@GoogleCloud_IL
Google Cloud Israel
2 years
6/ It’s our customers who are the real stars🌟 They take our solutions and create amazing things. We have the privilege to hear from @origoshen @Wordtune by @AI21Labs ,Yaron Inger @Lightricks , and Tzury Bar Yochay @Reblaze about how Google Cloud is helping them innovate faster.
Tweet media one
1
1
7
0
1
7
@AI21Labs
AI21 Labs
3 years
Check out our presentation of “PMI-Masking: Improving LM training by masking correlated spans” at #ICLR2021 ! Oral session: Mon 05/03 2PM EST Poster session: Thu 05/06 12PM EST See our blogpost on PMI-Masking
0
3
7
@AI21Labs
AI21 Labs
4 years
Our own @yshoham will be keynoting at #GMIC on Sep 25.
Tweet media one
1
2
7
@AI21Labs
AI21 Labs
2 years
To be perfectly Queer, EVERY month is #Pride_Month . Enriching Expression is kinda our thing at @Wordtune . So, let’s celebrate #LGBTQ + rights & expression. Flaunt your truth, and celebrate all that is fabulous 🌈👭🌈
Tweet media one
0
0
7
@AI21Labs
AI21 Labs
4 years
AI21 Labs is proud to be a sponsoring partner of @IndexingAI . Check it out! Go @yshoham
@indexingai
AI Index
4 years
One of the most comprehensive studies about AI is now available. #AIIndex2019 tracks and visualizes AI-related information to help ground conversations in data. Read more: @StanfordHAI
Tweet media one
1
27
64
0
1
7
@AI21Labs
AI21 Labs
6 months
Welcome Tom Nides, former US Ambassador to Israel, to AI21's Board of Advisors! We look forward to working together and learning from his unique perspective of the financial market. Glad to have you on board, Tom! 🌟
Tweet media one
0
0
7
@AI21Labs
AI21 Labs
1 month
@_philschmid @Dorialexander We love the quick cycles! Interested to see what people will build with Jamba.
2
0
6
@AI21Labs
AI21 Labs
1 month
Combining Transformer, Mamba & MoE allows flexibility in balancing low memory usage, high throughput, and high quality. Jamba’s KV cache – which becomes a limiting factor when scaling context in pure Transformers – is 8x smaller compared to a pure Transformer. 5/6
Tweet media one
1
0
7
@AI21Labs
AI21 Labs
1 year
Ready to learn from the best? 🎓Join top industry leaders from Google Cloud, and our Co- CEO Prof. Yoav Shoham and developer advocate Yuval Belfer, for a roundtable discussion on generative AI. 🤖 Sign up now to secure your spot:
Tweet media one
1
1
7
@AI21Labs
AI21 Labs
4 years
Check out @yshoham 's keynote speech from #GMIC
0
2
7
@AI21Labs
AI21 Labs
1 year
Curious to learn more about our models? Join our upcoming AMA session this Wednesday, hosted by our NLP experts and Developer Advocates Yotam Shinan and Yuval Belfer. Head over to our Discord, "AMA #1 ," and get ready to ask us your burning questions 🔥
Tweet media one
1
2
6
@AI21Labs
AI21 Labs
1 year
📅Mark your calendars for our second AMA session with our Studio experts, Yuval Belfer and Yotam Shinan! They'll be tackling all your burning questions on Jurassic-2, APIs, NLP, Gen AI, and anything else you throw their way! Join here: #AI21Studio #AMA
Tweet media one
0
1
6
@AI21Labs
AI21 Labs
1 month
We noticed that pure Mamba models struggle to develop in-context learning capabilities. E.g., they performed substantially worse than the pure attention model in 3 common benchmarks while the attention–Mamba exhibits similar results to just Transformers. 3/6
Tweet media one
Tweet media two
1
0
6
@AI21Labs
AI21 Labs
3 years
"Developers will be able to sign up for free to try the service, & can then apply for access to custom models for commercial aims "to use our technology to quickly build any text-based applications they can dream up," says @DanPadnos ." @bryanrwalsh @axios
0
1
6
@AI21Labs
AI21 Labs
1 month
We see that the hybrid Jamba model outperforms both pure attention and pure Mamba models. The ratio of attention-to-Mamba layers of either 1:3 or 1:7 performs comparably, but given that a 1:7 ratio is more compute-efficient, we opt for it in our model. 2/6
Tweet media one
Tweet media two
1
0
6
@AI21Labs
AI21 Labs
5 years
@VeredShwartz @kdnuggets Great post! And good points regarding controllability. @VeredShwartz , have you heard of HAIM? We designed it with controllability in mind. You're welcome to try it at and let us know what you think!
1
0
6
@AI21Labs
AI21 Labs
3 years
We love this Jurassic response. Share all of your fun/ quirky/enlightening Jurassic interactions with us! #chatswithjurassic
@NoamSiegelman
Noam Siegelman
3 years
I saw the new jumbo model by @AI21Labs and wondered whether it will be useful for me as a cognitive scientist working on human language. Because it is so smart I decided to ask it directly - the answer was suprisingly modest 😂
Tweet media one
1
2
21
2
2
6
@AI21Labs
AI21 Labs
2 years
Anddd knows to how to route questions to an external database 🚢🧊
Tweet media one
1
0
5
@AI21Labs
AI21 Labs
1 year
Don't miss the chance to join our own Leeor Moses-Voronov next week for a unique panel discussion on #GenAI , exploring its possibilities and market concerns from different perspectives. Register here to join in-person or virtually:
Tweet media one
0
0
5
@AI21Labs
AI21 Labs
4 years
@jonathanfly we remember you enjoyed #HAIM , our interpolating LM. We just released HAIMKE, a new language model that turns bullet points to a full document - tons of fun! Give it a spin, we're excited to see what you come up with:
1
1
5
@AI21Labs
AI21 Labs
5 months
We’re here in Vegas! ✨ Swing by booth 205 to catch the action—live demos, cool swag, 1:1 sessions, and see how we're shaping the future of LLMs. 🚀
Tweet media one
1
0
5
@AI21Labs
AI21 Labs
11 months
What should you keep in mind when transitioning from demo to production? 🤔 Hear from Yuval Belfer, as he delves into the essential considerations for harnessing the power of #generativeAI . ⬇️
0
0
5