SK Hynix Inc is ramping up its spending on advanced chip packaging, in hopes of capturing more of the burgeoning demand for a crucial component in artificial intelligence (AI) development: high-bandwidth memory (HBM).
The Icheon-based firm is investing more than US$1 billion in South Korea this year to expand and improve the final steps of its chip manufacture, said Lee Kang-wook, a former Samsung Electronics Co engineer who now heads up packaging development at SK Hynix.
Lee specializes in advanced ways of combining and connecting semiconductors, which has grown in importance with the advent of modern AI and its digestion of vast troves of data via parallel processing chains. While SK Hynix has not disclosed its capital expenditure budget for this year, the average analyst estimate puts the figure at 14 trillion won (US$10.5 billion). That suggests advanced packaging, which could take up a 10th of that, is a major priority.
Photo: Bloomberg
“The first 50 years of the semiconductor industry has been about the front-end,” or the design and fabrication of the chips themselves, Lee said in an interview. “But the next 50 years is going to be all about the back-end,” or packaging.
Being first to achieve the next milestone in this race could now catapult companies into industry-leading positions. SK Hynix was chosen by Nvidia Corp to provide the HBM for its standard-setting AI accelerators, pushing the South Korean firm’s value up to 119 trillion won. Its stock gained about 1 percent in Seoul on Thursday, adding to a nearly 120 percent increase since the start of last year. It is now South Korea’s second most valuable company, outperforming Samsung and US rival Micron Technology Inc.
Lee, now 55 years old, helped pioneer a novel method to packaging the third generation of the technology, HBM2E, which was quickly followed by the other two major makers. That innovation was central to SK Hynix winning Nvidia as a customer in late 2019.
HBM is a type of high-performance memory that stacks chips on top of one another and connects them with through-silicon via (TSV) technology for faster and more energy-efficient data processing.
ChatGPT’s release in November 2022 was the moment Lee had been waiting for. By that time, his team had developed a new packaging method called mass reflow-molded underfill (MR-MUF), aided by his contacts in Japan. The process, which involves injecting and then hardening liquid material between layers of silicon, improved heat dissipation and production yields. SK Hynix teamed up with Namics Corp in Japan for the material and a related patent, a person familiar with the matter said.
SK Hynix is pouring the bulk of its new investment into advancing MR-MUF and TSV technologies, Lee said.
Samsung, which has for years been distracted by a succession saga at its very top, is now fighting back. Nvidia last year gave the nod to Samsung’s HBM chips, and the Suwon-based company said on Feb. 26 that it has developed the fifth generation of the technology, HBM3E, with 12 layers of DRAM chips and the industry’s largest capacity of 36 gigabytes.
On the same day, Boise, Idaho-based Micron surprised industry watchers by saying it had begun volume production of 24GB, eight-layer HBM3E, which would be part of Nvidia’s H200 Tensor Core units shipping in the second quarter.
With its big commitment to expanding and enhancing technology at home and a multibillion-dollar advanced packaging facility planned for the US, Lee remains bullish about SK Hynix’s prospects in the face of intensifying competition. He sees the present investment as laying the groundwork to meet more demand to come with future generations of HBM.
COMPETITION: AMD, Intel and Qualcomm are unveiling new laptop and desktop parts in Las Vegas, arguing their technologies provide the best performance for AI workloads Advanced Micro Devices Inc (AMD), the second-biggest maker of computer processors, said its chips are to be used by Dell Technologies Inc for the first time in PCs sold to businesses. The chipmaker unveiled new processors it says would make AMD-based PCs the best at running artificial intelligence (AI) software. Dell has decided to use the chips in some of its computers aimed at business customers, AMD executives said at CES in Las Vegas on Monday. Dell’s embrace of AMD for corporate PCs — it already uses the chipmaker for consumer devices — is another blow for Intel Corp as the company
MediaTek Inc (聯發科) yesterday said it is teaming up with Nvidia Corp to develop a new chip for artificial intelligence (AI) supercomputers that uses architecture licensed from Arm Holdings PLC. The new product is targeting AI researchers, data scientists and students rather than the mass PC market, the company said. The announcement comes as MediaTek makes efforts to add AI capabilities to its Dimensity chips for smartphones and tablets, Genio family for the Internet of Things devices, Pentonic series of smart TVs, Kompanio line of Arm-based Chromebooks, along with the Dimensity auto platform for vehicles. MeidaTek, the world’s largest chip designer for smartphones
TECH PULL: Electronics heavyweights also attracted strong buying ahead of the CES, analysts said. Meanwhile, Asian markets were mixed amid Trump’s incoming presidency Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) shares yesterday closed at a new high in the wake of a rally among tech stocks on Wall Street on Friday, moving the TAIEX sharply higher by more than 600 points. TSMC, the most heavily weighted stock in the TAIEX, rose 4.65 percent to close at a new high of NT$1,125, boosting its market value to NT$29.17 trillion (US$888 billion) and contributing about 400 points to the TAIEX’s rise. The TAIEX ended up 639.41 points, or 2.79 percent, at 23,547.71. Turnover totaled NT$406.478 billion, Taiwan Stock Exchange data showed. The surge in TSMC follows a positive performance
FUTURE TECH: Nvidia CEO Jensen Huang would give the keynote speech at this year’s Consumer Electronics Show, which is also expected to highlight autonomous vehicles Gadgets, robots and vehicles imbued with artificial intelligence (AI) would once again vie for attention at the Consumer Electronics Show (CES) this week, as vendors behind the scenes would seek ways to deal with tariffs threatened by US president-elect Donald Trump. The annual Consumer Electronics Show opens formally in Las Vegas tomorrow, but preceding days are packed with product announcements. AI would be a major theme of the show, along with autonomous vehicles ranging from tractors and boats to lawn mowers and golf club trollies. “Everybody is going to be talking about AI,” Creative Strategies Inc analyst Carolina Milanesi said. “From fridges to ovens