Toby Pohlen Profile Banner
Toby Pohlen Profile
Toby Pohlen

@TobyPhln

26,123
Followers
459
Following
49
Media
267
Statuses

Founding member @xAI . Previously @GoogleDeepMind . @RWTH alumnus.

London, UK
Joined December 2012
Don't wanna be here? Send us removal request.
@TobyPhln
Toby Pohlen
6 months
These are some of the UI features in Grok. First, it allows you to multi-task. You can run several concurrent conversations and switch between them as they progress.
142
367
2K
@TobyPhln
Toby Pohlen
6 months
It's happening
Tweet media one
117
198
2K
@TobyPhln
Toby Pohlen
6 months
You can now submit feedback to help us improve Grok. Feedback can range from a simple "this conversation is good/bad"-rating all the way to an entirely rewritten conversation.
186
189
1K
@TobyPhln
Toby Pohlen
2 months
Do you want to work for @xai in London? Now you can. We're looking for software engineers. Apply if you want to get stuff done, work with smart people, and get grilled in one of my coding interviews. Backend & data: Full-stack:
170
224
1K
@TobyPhln
Toby Pohlen
5 months
June 3rd was my first day at @xai . Here are some of the things I learnt over the past 6 months:
40
107
1K
@TobyPhln
Toby Pohlen
6 months
xAI is a great place to work at. Our culture is engineering-driven and fast-paced with a long-term strategic roadmap to develop safe and strong AI. If you want to learn more, I'm happy to jump on a Google Meet call at short notice. My DMs are open.
87
115
970
@TobyPhln
Toby Pohlen
5 months
We started rolling out Grok to the first batch of users on X.
@elonmusk
Elon Musk
5 months
Grok is rolling out to 𝕏 Premium+ subscribers with the latest app release. Have fun!
5K
4K
37K
241
89
620
@TobyPhln
Toby Pohlen
1 month
We'll release Grok-1.5 in a couple of days and will expand access to more users and more countries.
94
109
913
@TobyPhln
Toby Pohlen
2 months
Grok just got a lot faster. We have many other improvements in the pipeline that will ship soon.
141
101
794
@TobyPhln
Toby Pohlen
5 months
At this rate, people will pay you to use their Mistral 7B APIs by next week.
90
71
515
@TobyPhln
Toby Pohlen
5 months
The pace of innovation and improvement at Tesla is pretty incredible.
@Tesla_Optimus
Tesla Optimus
5 months
There’s a new bot in town 🤖 Check this out (until the very end)!
3K
7K
32K
96
58
429
@TobyPhln
Toby Pohlen
3 months
I'm super excited to work with the great people who are joining @xai today and over the next couple of weeks. Some of the smartest engineers I ever got to interview. PS: We're still hiring
109
70
593
@TobyPhln
Toby Pohlen
2 months
One unpopular opinion I hold is that scripting languages (Python, JS, PHP etc) are great for learning programming but insufficient for learning how computers and operating systems actually work. Becoming proficient in C or C++ can be eye-opening and exciting.
@FFmpeg
FFmpeg
2 months
If we don't keep raising awareness of low-level programming skills, the skillset will disppear forever under a sea of SDKs, binary blobs and proprietary chips. C programming matters, assembly language matters.
157
1K
8K
45
63
588
@TobyPhln
Toby Pohlen
9 months
My second greatest achievement in life.
Tweet media one
@elonmusk
Elon Musk
9 months
Elden Ring is some of the most beautiful art ever created
6K
10K
145K
19
28
540
@TobyPhln
Toby Pohlen
6 months
Grok keeps an ear on the internet's town square in real time.
31
66
492
@TobyPhln
Toby Pohlen
9 months
The work is intense, but I'm feeling really positive about our progress @xai :)
35
40
544
@TobyPhln
Toby Pohlen
5 months
Coincidence? I think not.
91
57
218
@TobyPhln
Toby Pohlen
6 months
What an amazing achievement of innovation, engineering, and execution.
@SpaceX
SpaceX
6 months
Liftoff of Starship!
3K
20K
97K
18
42
388
@TobyPhln
Toby Pohlen
5 months
You can now export your programs from the PromptIDE and run them locally.
94
64
204
@TobyPhln
Toby Pohlen
6 months
And last but not least 😎
15
31
482
@TobyPhln
Toby Pohlen
6 months
PromptIDE highlights: The `user_input()` function asks the user to enter a string. You can use that to write a chatbot in four lines of Python. While executing the prompt, you see the tokenization, sampling probabilities, alternative tokens, and aggregated attention masks.
51
82
441
@TobyPhln
Toby Pohlen
5 months
We may finally be at the point where "super-human performance" actually means "better than most humans" in real-world applications. Can't wait for nearly flawless speech recognition, image understanding, and reasoning/deduction.
91
31
184
@TobyPhln
Toby Pohlen
28 days
Some early results of our first vision model. It'll be integrated into the Grok chat in the medium term. A few other features will ship before that (likely very soon). Props to { @tingchenai , @gabriel_ilharco }.
34
47
424
@TobyPhln
Toby Pohlen
5 months
Long time no see 👀
Tweet media one
113
44
117
@TobyPhln
Toby Pohlen
2 months
In a world where data is the new oil, X is a well.
38
41
341
@TobyPhln
Toby Pohlen
6 months
You can branch conversations to better explore Grok's responses. The response tree (wait until the end of the video) allows you to switch back and forth between the individual branches. There are also /commands to reduce clicking.
13
28
377
@TobyPhln
Toby Pohlen
3 months
I merged my 500th pull request @xai today. You can see the Grok launch night on the graph too.
Tweet media one
63
12
284
@TobyPhln
Toby Pohlen
4 months
If your company is running out of meeting rooms, you don't have too few rooms. You have too many meetings.
126
27
241
@TobyPhln
Toby Pohlen
3 months
Tweet media one
@karpathy
Andrej Karpathy
3 months
My calendar this week
Tweet media one
731
320
12K
35
22
282
@TobyPhln
Toby Pohlen
5 months
Skills, expertise, and work ethics follow a Pareto distribution with α >> 1 meaning that - in a professional context - some people are just exponentially better than others and they are rare. You want to work with and hire people who are exceptional. No compromises.
9
14
354
@TobyPhln
Toby Pohlen
6 months
I'm working on a share feature with conversation preview on X. </test-post>
47
51
320
@TobyPhln
Toby Pohlen
1 month
We're looking for a designer/frontend engineer to join the London team. If you're great at UI design and you can implement your designs in React, please apply so we can pixel-peep together.
57
42
292
@TobyPhln
Toby Pohlen
6 months
API keys can be managed in the PromptIDE, which you have access to if you're part of the early access program.
Tweet media one
56
57
321
@TobyPhln
Toby Pohlen
9 months
@SergiiKirianov Don't forget about the equally important "I need to put down my laptop but don't actually want to close the lid"-pose.
Tweet media one
19
20
331
@TobyPhln
Toby Pohlen
6 months
Final note: There are also some easter eggs 🦧
18
6
312
@TobyPhln
Toby Pohlen
5 months
Companies are groups of people. You cannot talk to a building or a machine. If something is moving slowly, there is a person who can accelerate it. If a policy doesn't make sense, there is someone who can fix it. Want to understand a company? Find out who does what.
2
10
308
@TobyPhln
Toby Pohlen
5 months
Rust >> C++- No snakes in prod.
9
12
300
@TobyPhln
Toby Pohlen
6 months
Yesterday: Cloudflare outage Today: GitHub outage Tomorrow: Launch 💀
18
19
282
@TobyPhln
Toby Pohlen
6 months
You can open all generated code snippets in a VS Code editor.
Tweet media one
4
10
287
@TobyPhln
Toby Pohlen
5 months
You can only move fast if you can iterate quickly. For research, this also means that your infrastructure must support fast iteration. Launching experiments shouldn't take more than 1 minute, not every piece of code needs to be tested & reviewed, compute should be plentiful.
4
15
289
@TobyPhln
Toby Pohlen
5 months
Innovation is paramount and you're never done innovating. It doesn't matter what you or your company achieved yesterday. The value of past rewards is 0. All that matters is how much more you will achieve tomorrow.
4
19
283
@TobyPhln
Toby Pohlen
6 months
You can open Grok's response in a markdown editor, save it and then continue the conversation. This works in tandem with branching and the branch tree I showed above.
5
16
276
@TobyPhln
Toby Pohlen
9 months
Thanks to everyone who applied via our website. I met a lot of people this week and really appreciate how many talented engineers and researchers sent in their CVs 🙏
15
31
115
@TobyPhln
Toby Pohlen
5 months
Metaphorically speaking, progress made by a group of people is described by the vector sum of its members' actions. The best way to make sure a group moves quickly in one direction is to align incentives.
7
12
266
@TobyPhln
Toby Pohlen
6 months
Unlocking my phone after being offline for just 2h.
18
16
229
@TobyPhln
Toby Pohlen
5 months
Time to delivery is critical and it's important to feel a sense of urgency.
4
7
259
@TobyPhln
Toby Pohlen
10 months
I'm working on a new alignment algorithm called Gradient Decent.
27
13
222
@TobyPhln
Toby Pohlen
6 months
I refactored error management in the API. Error messages should be more accurate and less scary now. I also increased the default token limit to 100,000 tks/h. Thanks for beta testing everyone 🫡.
14
18
215
@TobyPhln
Toby Pohlen
8 months
Getting everything ready for the first alpha testers
Tweet media one
41
47
153
@TobyPhln
Toby Pohlen
10 months
Read the source 👀
23
10
180
@TobyPhln
Toby Pohlen
3 months
Dear Spotlight-Search, When I type "bluetooth", I never - ever - want to open the "Bluetooth File Exchange" app. Thank you. Sincerely, Everyone
5
15
89
@TobyPhln
Toby Pohlen
6 months
Grok also got a little redesign to simplify the UI.
Tweet media one
Tweet media two
16
5
167
@TobyPhln
Toby Pohlen
10 months
When interviewing, I usually try to assess a candidate's knowledge ceiling instead of checking if they pass a knowledge floor. On a few occasions, I've met people who are simply so good that I ran out of questions.
15
12
157
@TobyPhln
Toby Pohlen
5 months
@korymath @xai Probably how good open source infrastructure has become over the past 10 years.
3
2
152
@TobyPhln
Toby Pohlen
6 months
The opposite of love isn't hate. It's indifference.
18
12
141
@TobyPhln
Toby Pohlen
10 months
People: "I'm sure your calendar is pretty full" Me: "Indeed"
Tweet media one
30
5
138
@TobyPhln
Toby Pohlen
10 months
Attention isn't all you need.
Tweet media one
18
6
135
@TobyPhln
Toby Pohlen
10 months
@stephenbalaban I did a million iterations of this logo and never saw the lambda until someone pointed it out to me post-launch.
7
1
125
@TobyPhln
Toby Pohlen
6 months
@tapfornerd It's honestly too early to say how we'll scale this in the future. Grok launched just 10 days ago. Right now, our main focus is on making Grok as good as we can. Give us some time :)
10
12
126
@TobyPhln
Toby Pohlen
6 months
@imPenny2x It's very early days for the API. But if you want to play with the model programmatically, you can use our IDE. Here are a few examples to get you started: - Chat: - Concurrency: - Batch process a CSV file:
17
16
116
@TobyPhln
Toby Pohlen
9 months
I find that people who can answer questions in a succinct, precise, and understandable fashion also tend to have strong technical skills.
17
8
86
@TobyPhln
Toby Pohlen
10 months
Finally a reason to buy a WinRAR license.
15
1
82
@TobyPhln
Toby Pohlen
6 months
I switched from CLion to RustRover and the slight difference in text rendering is distracting me 😶
7
5
68
@TobyPhln
Toby Pohlen
6 months
You can upload small files and use them in your prompts via the `read_file()` function from the SDK. The video shows how to run an MMLU evaluation inside the IDE. The model here is our smaller Grok-0.
7
5
62
@TobyPhln
Toby Pohlen
9 months
Strong foundation models relate to domain-specific expert models like CPUs relate to ASICs. One is general and allows its users to choose the application. The other performs well in a narrow domain chosen by the developer.
2
27
43
@TobyPhln
Toby Pohlen
9 months
As an engineer, it's difficult to acknowledge that the best use of my time isn't always doing technical work (coding/data massaging etc.).
11
2
58
@TobyPhln
Toby Pohlen
9 months
"Solve A, then use A to solve B" rarely works as it introduces a discontinuity in the solution space. You risk getting stuck iteratively working towards A and never attending to B. In my experience it's better to tackle B directly in a way that allows taking incremental steps.
15
6
55
@TobyPhln
Toby Pohlen
6 months
@ByeonChansoo Insta reject /s.
2
1
54
@TobyPhln
Toby Pohlen
10 months
Program synthesis via rejection sampling.
10
2
50
@TobyPhln
Toby Pohlen
6 months
If you don't need the token analytics, you can also render the context as markdown.
Tweet media one
4
4
48
@TobyPhln
Toby Pohlen
9 months
The best thing about starting a new company is that all go/ links are up for grabs and guess who's already secured go/employee-of-the-year 😎
5
5
47
@TobyPhln
Toby Pohlen
28 days
@BenjaminDEKR @tingchenai @gabriel_ilharco Haha, yes, we'll have an API. Developers will also get access to the IDE and our current SDK with a small token budget included with X Premium+ while we work on the fully featured API.
3
0
51
@TobyPhln
Toby Pohlen
6 months
The SDK uses Python coroutines. This allows you to implement concurrent contexts.
2
4
47
@TobyPhln
Toby Pohlen
10 months
AI has one aunt, three fathers, three mothers, and seven godfathers. They're all talking about parenting while it hangs out with the rest of us chronically-online folk on Twitter.
1
2
45
@TobyPhln
Toby Pohlen
6 months
@bayeslord @grok The Grok frontend is written in React using NextJS. The PromptIDE is written in Angular. They both share a gRPC API backend written in Rust.
6
5
48
@TobyPhln
Toby Pohlen
9 months
Kubernetes watchdogs should be called k8s k9s.
4
16
46
@TobyPhln
Toby Pohlen
9 months
I'm always happy when I meet others who worked at @RWTH 's Computer Vision group. I learnt a lot during my time there as they allowed me to pursue my own research ideas rather than just acting as an assistant to more senior folk.
4
15
35
@TobyPhln
Toby Pohlen
10 months
Can't wait for Nolan to bring the arXiv cinematic universe to the big screen.
3
6
34
@TobyPhln
Toby Pohlen
9 months
Over the past 10 years we somehow went from developers wanting to write everything from scratch to developers wanting to use SaaS-solutions for everything.
7
3
35
@TobyPhln
Toby Pohlen
6 months
@bostonrob__ The IDE is for researchers, students, and engineers.
1
6
32
@TobyPhln
Toby Pohlen
9 months
Small anecdote: The ResNet paper [1] came out while I wrote my Master's thesis. The results were impressive and the simplicity of the technique allowed everyone to validate its effectiveness within an hour or two of training. I started working on ResNets for semantic segmentation…
@TobyPhln
Toby Pohlen
9 months
@DrJimFan Congratulations to him and MIT indeed. When I focused on computer vision during my Bachelor's and Master's, his modern contributions to the field were as important to me as the early works of @ylecun et al.
0
1
15
6
4
30
@TobyPhln
Toby Pohlen
6 months
@WholeMarsBlog @elonmusk I'll look into it. Can you DM me?
1
0
31
@TobyPhln
Toby Pohlen
10 months
@khushi_ftw Live view of situation on floor 11
Tweet media one
4
4
30
@TobyPhln
Toby Pohlen
6 months
@battleangelviv Let me add a better icon for this use case.
2
1
30
@TobyPhln
Toby Pohlen
10 months
AWS is now a Shovels as a Service (SaaS) business.
1
2
27
@TobyPhln
Toby Pohlen
6 months
@AIRevolutionZon Yes, you can share conversations. Folders are coming soon.
1
0
28
@TobyPhln
Toby Pohlen
2 months
@ggerganov Amazing, well done!
1
0
29
@TobyPhln
Toby Pohlen
10 months
@JoshuaSteinman @elonmusk I hear ya 🎨 [1/2]
2
1
27
@TobyPhln
Toby Pohlen
10 months
Superalignment team coming out of stealth one by one.
4
0
23
@TobyPhln
Toby Pohlen
6 months
@imPenny2x Thanks for the kind words and the useful feedback. Lots of improvements are in the works or have already shipped silently. We'll keep pushing.
3
1
23
@TobyPhln
Toby Pohlen
11 months
You leave every organization twice. Once when you resign and once when your meme channel dies.
1
0
23
@TobyPhln
Toby Pohlen
10 months
Waiting to board a flight to SF. The couple next to me casually talks about street crime and what areas to avoid outright.
3
0
19
@TobyPhln
Toby Pohlen
6 months
@battleangelviv Update will be rolled out tomorrow morning together with some other fixes.
2
0
22
@TobyPhln
Toby Pohlen
10 months
@JoshuaSteinman @elonmusk More seriously [2/2]. I read the discussions last night and wanted to tweet something funny about it but then didn't think anyone would care. The i is slanted to better distinguish the three letters. I also like how it gives the logo a little bit of perspective. Though I'm not…
4
0
22
@TobyPhln
Toby Pohlen
6 months
@ElieMesso A few seconds. But this should get faster in the future. We're working on improving the system along many different axes.
1
0
22