STONETEK G5208 DS Inference Service Platform All-in-One Machine
Inhouse product
【Processor】 2 x AMD EPYC 7K62 (2.6GHz/48C/192M/240W) 【Memory】 16 x 32GB DDR4 RECC 【SSD】 2 x 480GB SATA SSD 【SSD】 1 x 3.84T U.2 SSD 【RAID】 1 x LSI9311-8i 【NIC1】 1 x 25G Ethernet Dual-Port SFP+ 【NIC2】 1 x 10G Ethernet Dual-Port RJ45 【PSU】 4 x 1600W 【GPU】 4 x Geforce RTX4090 24G
Based on the STONETEK SuperSvr G5208 AI Computing Server Platform, this device comes pre-installed with the high-performance software environment of STONETEK AIOS 3.0 DS Edition. It integrates PyTorch deep learning framework, VLLM inference engine and GPUStack inference service platform. It enables real-time monitoring of system resources and model usage, analysis of system load trends, statistics on user consumption and model calls, as well as flexible scheduling of GPU resources.
Related products
