Open {hardware} specialist PINE64 has unveiled a brand new gadget aimed toward operating giant language fashions (LLMs) domestically, relatively than counting on cloud suppliers to your generative synthetic intelligence (gen AI) wants: the ALPHA-One.
“[The] ALPHA-One [is] primarily based on [the] StarPro64 single-board pc,” the corporate explains of its creation. “Preinstalled 64G[B] eMMC module incorporates 7b [parameter] DeepSeek/Owen LLM construct in Docker type, [and] will present Meta[‘s] Llama LLM in [the] close to future.”
PINE64 is making ready to launch the ALPHA-One, a generative AI field constructed by placing a StarPro64 (above) right into a passive cooling case (prime). (📷: PINE64)
The machine, dropped at our consideration by Linux Gizmos, is designed to showcase precisely what you are able to do with the StarPro64 — introduced by the corporate together with two different units, the Oz64 and Quartz64-Zero, final yr. Constructed round an ESWIN Computing EIC7700X system-on-chip that includes a neural coprocessor claimed to ship as much as 20 tera-operations per second (TOPS) of compute for machine studying and synthetic intelligence workloads at INT8 precision, PINE64 promised assist for the headline-grabbing DeepSeek giant language mannequin at launch.
The ALPHA-One delivers on that promise: it is a StarPro64 put in in a steel chassis that doubles as a passive heatsink, connecting to the system-on-chip by way of a built-in warmth pipe system. Drawing a claimed sub-30W on the wall, the machine can run the distilled 7b-parameter model of DeepSeek at round 3.5 tokens per second — making it usable for entirely-local operation, when you do not thoughts a bit delay between inputting your immediate and getting your answer-shaped response.
The corporate has confirmed pricing for the gadget at $329.99, a premium over the uncased StarPro64 — but in addition warns that it is bought on buyer-beware phrases with no comeback. “[This has a] No Return and No Refund coverage,” the corporate says, “because of [the fact that the] AI agent is a nascent product and everybody has completely different expectation[s]. This product [is] solely appropriate for [the] early adopter who has curiosity exploring into AI agent, [and is] not appropriate for [the] curious particular person who simply need[s] to purchase, attempt, and return.”
The ALPHA-One is now listed on the PINE64 retailer, however on the time of writing had not but been put up on the market.
