costa_al
11/16/2023, 7:57 PMNatural Language Computer | Digital Computer
---------------------------------------------------
Base components
--
LLM | CPU
LLMCache | CPUCache
Context | RAM
Prompt | Code block
Inference | Execute code block in CPU
Interrupts
--
Functions | Interrupts
Functions Schema | Interrupt vector table
Storage
--
VectorDB | Disk storage
Data Indexing | File system indexing
RAG | Disk API for Retrieving/Querying
Applications / Services
--
AI Agent | Application / Service
AI Agent State | Application state (e.g. TERM)
Send/Reply methods | Inter-process communication (IPC)
Templates? (early idea) | Executable formats like ELF, PE
Advanced
--
Virtual Context | Swap file / virtual memory (MemGPT)