Minecraft Enthusiast Builds Redstone AI Model, CraftGPT
A Minecraft enthusiast, Sammyuri, has created an innovative project called CraftGPT. This unique language model is built entirely within Minecraft using Redstone components, without relying on command blocks or data packs. CraftGPT is a small model with 5,087,280 parameters, an embedding dimension of 240, and a vocabulary of 1920 tokens. It consists of 6 layers and is trained on the TinyChat dataset. Sammyuri implemented the transformer's logic purely with Redstone wiring, including tokenizers and matrix multipliers. The model was trained externally in Python and hard-coded into the Redstone circuits for inference. Despite using MCHPRS for speed improvements, CraftGPT's response time remains slow, taking about two hours for a simple prompt. It's prone to producing off-topic responses, grammatical errors, or gibberish. The project consists of 439 million blocks, measuring 1,020 x 260 x 1,656 in Minecraft. Sammyuri, known for building a standalone 16-bit CPU and an IRIS Computer capable of running DOOM in Minecraft, has once again pushed the boundaries of in-game computing. CraftGPT, while slow, demonstrates the potential of Redstone engineering in Minecraft for complex tasks.
