LLM OS / OpenAI / Andrej Karpathy 2023 Nov Week 3 Datumo Newsletter |
|
|
π° Beyond Custom Chatbots to 'LLM OS' |
|
|
'Create a split diagram contrasting two types of computer interfaces.
On the left side, show CLI with a vintage computer screen...'
Image. DALL EΒ·3
Since the unveiling of 'GPTs' at OpenAI's first developer event last week, creating custom chatbots has become a trend. With the Assistant API feature, it's now possible to implement knowledge search without the need for document embedding and search algorithms, and thanks to the increased input token length, very long files can now be uploaded in their entirety.
This newly updated ChatGPT feature can replace many existing services of startups, and currently, in Silicon Valley, there's a meme-like saying, "OpenAI killed my startup." So, what services is OpenAI preparing after creating 'custom chatbots'? Today, let's explore the concept of a Large Language Model as an Operating System, 'LLM OS.'
|
|
|
After CLI and GUI, Comes 'LLM' |
|
|
'The horizontal illustration of a Command Line Interface (CLI) display example is ready, featuring a wide vintage computer monitor with a text-based interface'
Image. DALL EΒ·3
Computer operating systems and interfaces have been evolving steadily over the past decades. Initially, Command-Line Interfaces (CLI) were widely used. Users had to enter precise text commands to use computers, a method that required a high level of technical knowledge. Examples of CLI include DOS, Command Prompt, and the Terminal in Windows and Mac OS. CLI was efficient and powerful but not intuitive, limiting early computer use to experts.
Then came the Graphical User Interface (GUI). GUIs allowed for visual interactions through icons, windows, and menus. With GUIs, anyone could open files and run applications with a mouse click, greatly contributing to the personal computer's distribution and popularization.
Recently, Large Language Models (LLM) are gaining attention as the next generation operating system. An AI-based operating system that understands and generates natural language can autonomously perform tasks based on user questions and commands. This provides a richer and more personalized user experience and can learn users' preferences and styles over time.
|
|
|
Greg Brockman, President of OpenAI, TED Talk. link
Another anticipated effect of the introduction of LLM OS is the blurring of boundaries between operating systems and individual applications. If the operating system, App Store, and apps are all replaced with LLM, various tasks needed for work can be performed without having to run individual programs, much like the current ChatGPT plugin service.
Open AI President Greg Brockman, at the launch of the ChatGPT plugin, said, "I think, shows a new way of thinking about the user interface. Like, we are so used to thinking of, well, we have these apps, we click between them, we copy/paste between them"
and "And by having this unified language interface on top of tools, the AI is able to sort of take away all those details from you. So you don't have to be the one who spells out every single sort of little piece of what's supposed to happen." This hints at the emergence of LLM OS
|
|
|
LLM OS, 'Just Wait a Bit'" |
|
|
Source: Andrej Karpathy. X. link
The release of OpenAI's LLM OS becomes clearer when looking at recent tweets by Andrej Karpathy. Andrej Karpathy is a founding member of OpenAI, who later led the Autopilot AI team at Tesla before returning to OpenAI in February this year.
He has mentioned that he is working on creating something like the artificial intelligence assistant 'Jarvis' from the movies. On the 11th, he tweeted, "LLM OS. Bear with me I'm still cooking," along with a schematic related to it.
|
|
|
*The explanation of this schematic was written with the help of ChatGPT.
- Peripheral devices I/O: Handles video and audio data processing as peripheral device input/output.
- CPU: The Central Processing Unit manages data processing between LLM and other components.
- The CPU role of LLM as mentioned by Karpathy is OpenAI GPT-4 Turbo 256 core (batch size) processor @ 20Hz (tok/s).
- Disk: This stores the file system and embeddings.
- RAM: The term 'context window' could refer to the range of data currently being processed by LLM (128K).
- Browser: Manages data exchange via Ethernet through an internet browser.
- Other LLMs: Could mean communication with other large language models.
|
|
|
It seems OpenAI is not the only company developing LLM OS. LLM OS aligns with the 'super app' concept emphasized by Elon Musk while rebranding Twitter as 'X', and Microsoft has started realizing some features of LLM OS through Copilot. However, for now, OpenAI's new technology, showcasing outstanding models and user-friendly features, is the most anticipated. :)
|
|
|
The Data for Smarter AI
Datumo is an all-in-one data platform for your smarter AI.
|
|
|
Datumo Inc.
π contact@datumo.com
|
|
|
|
|