The market for AI servers looks bright
29 March 2023
AI & ML
Seeing a bright future in the development of AI technologies, Microsoft has invested $10 billion into the well-known research laboratory OpenAI, the creators of ChatGPT. On the back of this announcement, Microsoft launched an improved version of its search engine Bing. The new Bing has incorporated a large-scale language model named Prometheus and the technology that underlays ChatGPT. Prometheus is a collaboration between Microsoft and OpenAI.
Not to be left out, Baidu launched ERNIE Bot. Initially operating as a standalone software, ERNIE Bot will be integrated into Baidu’s own search engine at a later time.
Regarding the models and specifications of the computing chips used in these AI projects, ChatGPT has mainly adopted NVIDIA’s A100 and exclusively utilises the cloud-based resources and services of Microsoft Azure. If the demand from ChatGPT and Microsoft’s other applications are combined, then Microsoft’s demand for AI servers is projected to total around 25 000 units for 2023.
Turning to Baidu’s ERNIE Bot, it originally adopted NVIDIA’s A100. However, due to the export control restrictions implemented by the US Commerce Department, ERNIE Bot has now switched to the A800. If the demand from ERNIE Bot and Baidu’s other applications are combined, then Baidu’s demand for AI servers is projected to total around 2000 units for 2023. A survey by TrendForce has revealed that in the market for server GPUs used in AI-related computing, the mainstream products include the H100, A100, and A800 from NVIDIA, and the MI250 and MI250X series from AMD. It should be noted that the A800 is designed specifically for the Chinese market under the context of the latest export restrictions. In terms of the market share for server GPUs, NVIDIA now controls about 80%, whereas AMD controls about 20%.
Focusing just on the specifications of these GPUs, ones that are involved in high-bandwidth computing and thus require high-bandwidth memory (HBM), have attracted even more attention in the market. HBM currently represents about 1,5% of the entire DRAM market. The main suppliers for HBM solutions are Samsung, SK Hynix and Micron. Among them, SK Hynix is expected to become the dominant supplier for HBM3 solutions as it is only one capable of mass producing the HBM3 solution that has been adopted by NVIDIA.
Further reading:
Analogue reservoir AI chip capable of real-time learning
Altron Arrow
AI & ML
TDK Corporation has jointly developed a prototype of a reservoir AI chip using an analogue electronic circuit that mimics the cerebellum with Hokkaido University.
Read more...
Compact edge platform for AI
iCorp Technologies
AI & ML
Built around the Qualcomm QCS6490 octa-core SoC, Quectel’s QuecPi Alpha delivers up to 12 TOPS of on-device AI performance.
Read more...
Axon NPU powers smarter edge
RF Design
AI & ML
The nRF54LM20B from Nordic Semiconductor is an ultra-low-power wireless SoC that combines advanced edge AI capabilities with robust radio connectivity and rich peripheral support.
Read more...
FPGA platform designed for the edge
AI & ML
Sundance Multiprocessor Technology has introduced the SMT135-C, an Efinix Titanium Ti135 evaluation platform designed for edge computing, real-time control, and vision-centric workloads.
Read more...
AI-controlled swarms: Algorithmic warfare
Technews Publishing
AI & ML
The rapid proliferation of Unmanned Aerial Systems (UAS), ranging from hobbyist quadcopters to sophisticated munitions-carrying military drones, has fundamentally altered the security landscape and come to the fore with the current war in the Middle East.
Read more...
Rugged AI PC for industry
Vepac Electronics
AI & ML
Designed to operate where conventional systems fall short, the TB-7145-MVS compact industrial PC supports advanced machine inferencing, real-time data handling, and high-performance graphics workloads without compromise.
Read more...
South Africa’s first operational AI Factory
AI & ML
Altron launches South Africa’s first operational AI Factory delivering enterprise grade AI Infrastructure, platform and services.
Read more...
Industrial Copilot
Siemens South Africa
AI & ML
With Siemens’ vision of Industrial Copilots along the entire value chain, the company wants to unlock this potential to improve human-machine collaboration and accelerate development and innovation cycles.
Read more...
NXP has expanded its MCX A Series
Altron Arrow
AI & ML
NXP has significantly expanded its MCX A Series of Arm Cortex-M33 microcontrollers, doubling the portfolio with six new families aimed at industrial and IoT edge applications.
Read more...
AI-ready embedded SBC
AI & ML
The new Grinn GenioBoard SBC provides a production-ready implementation of a powerful eight-core MediaTek processor, backed by high-speed interfaces, a Linux distro, and CRA-ready security software.
Read more...
printer friendly version