SK Hynix Inc is ramping up its spending on advanced chip packaging, in hopes of capturing more of the burgeoning demand for a crucial component in artificial intelligence (AI) development: high-bandwidth memory (HBM).
The Icheon-based firm is investing more than US$1 billion in South Korea this year to expand and improve the final steps of its chip manufacture, said Lee Kang-wook, a former Samsung Electronics Co engineer who now heads up packaging development at SK Hynix.
Lee specializes in advanced ways of combining and connecting semiconductors, which has grown in importance with the advent of modern AI and its digestion of vast troves of data via parallel processing chains. While SK Hynix has not disclosed its capital expenditure budget for this year, the average analyst estimate puts the figure at 14 trillion won (US$10.5 billion). That suggests advanced packaging, which could take up a 10th of that, is a major priority.
Photo: Bloomberg
“The first 50 years of the semiconductor industry has been about the front-end,” or the design and fabrication of the chips themselves, Lee said in an interview. “But the next 50 years is going to be all about the back-end,” or packaging.
Being first to achieve the next milestone in this race could now catapult companies into industry-leading positions. SK Hynix was chosen by Nvidia Corp to provide the HBM for its standard-setting AI accelerators, pushing the South Korean firm’s value up to 119 trillion won. Its stock gained about 1 percent in Seoul on Thursday, adding to a nearly 120 percent increase since the start of last year. It is now South Korea’s second most valuable company, outperforming Samsung and US rival Micron Technology Inc.
Lee, now 55 years old, helped pioneer a novel method to packaging the third generation of the technology, HBM2E, which was quickly followed by the other two major makers. That innovation was central to SK Hynix winning Nvidia as a customer in late 2019.
HBM is a type of high-performance memory that stacks chips on top of one another and connects them with through-silicon via (TSV) technology for faster and more energy-efficient data processing.
ChatGPT’s release in November 2022 was the moment Lee had been waiting for. By that time, his team had developed a new packaging method called mass reflow-molded underfill (MR-MUF), aided by his contacts in Japan. The process, which involves injecting and then hardening liquid material between layers of silicon, improved heat dissipation and production yields. SK Hynix teamed up with Namics Corp in Japan for the material and a related patent, a person familiar with the matter said.
SK Hynix is pouring the bulk of its new investment into advancing MR-MUF and TSV technologies, Lee said.
Samsung, which has for years been distracted by a succession saga at its very top, is now fighting back. Nvidia last year gave the nod to Samsung’s HBM chips, and the Suwon-based company said on Feb. 26 that it has developed the fifth generation of the technology, HBM3E, with 12 layers of DRAM chips and the industry’s largest capacity of 36 gigabytes.
On the same day, Boise, Idaho-based Micron surprised industry watchers by saying it had begun volume production of 24GB, eight-layer HBM3E, which would be part of Nvidia’s H200 Tensor Core units shipping in the second quarter.
With its big commitment to expanding and enhancing technology at home and a multibillion-dollar advanced packaging facility planned for the US, Lee remains bullish about SK Hynix’s prospects in the face of intensifying competition. He sees the present investment as laying the groundwork to meet more demand to come with future generations of HBM.
SPEED OF LIGHT: US lawmakers urged the commerce department to examine the national security threats from China’s development of silicon photonics technology US President Joe Biden’s administration on Monday said it is finalizing rules that would limit US investments in artificial intelligence (AI) and other technology sectors in China that could threaten US national security. The rules, which were proposed in June by the US Department of the Treasury, were directed by an executive order signed by Biden in August last year covering three key sectors: semiconductors and microelectronics, quantum information technologies and certain AI systems. The rules are to take effect on Jan. 2 next year and would be overseen by the Treasury’s newly created Office of Global Transactions. The Treasury said the “narrow
SPECULATION: The central bank cut the loan-to-value ratio for mortgages on second homes by 10 percent and denied grace periods to prevent a real-estate bubble The central bank’s board members in September agreed to tighten lending terms to induce a soft landing in the housing market, although some raised doubts that they would achieve the intended effect, the meeting’s minutes released yesterday showed. The central bank on Sept. 18 introduced harsher loan restrictions for mortgages across Taiwan in the hope of curbing housing speculation and hoarding that could create a bubble and threaten the financial system’s stability. Toward the aim, it cut the loan-to-value ratio by 10 percent for second and subsequent home mortgages and denied grace periods for first mortgages if applicants already owned other residential
EXPORT CONTROLS: US lawmakers have grown more concerned that the US Department of Commerce might not be aggressively enforcing its chip restrictions The US on Friday said it imposed a US$500,000 penalty on New York-based GlobalFoundries Inc, the world’s third-largest contract chipmaker, for shipping chips without authorization to an affiliate of blacklisted Chinese chipmaker Semiconductor Manufacturing International Corp (SMIC, 中芯). The US Department of Commerce in a statement said GlobalFoundries sent 74 shipments worth US$17.1 million to SJ Semiconductor Corp (盛合晶微半導體), an affiliate of SMIC, without seeking a license. Both SMIC and SJ Semiconductor were added to the department’s trade restriction Entity List in 2020 over SMIC’s alleged ties to the Chinese military-industrial complex. SMIC has denied wrongdoing. Exports to firms on the list
ASE Technology Holding Co (ASE, 日月光投控), the world’s biggest chip assembly and testing manufacturing (ATM) service provider, expects to double its leading-edge advanced technology services revenue next year to more than US$1 billion, benefiting from strong demand for artificial intelligence (AI) chips, a company executive said on Thursday. That would be the second year that ASE has doubled its advanced chip packaging and testing technology revenue, following an estimate of more than US$500 million for this year. ASE is one of the major beneficiaries from the AI boom as Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) is outsourcing production of advanced chip