Full Transcript
Loading transcript…
@HPCpodcast-104: Silicon Photonics, w Keren Bergman (2)
Watch with subtitles, summary & AI chat
Add the free Subkun extension — works directly on YouTube.
- Watch
- Subtitles
- Summary
- Ask AI
This video is for professionals and enthusiasts interested in the future of high-performance computing and AI hardware.
TL;DR
This episode of the ATH HPC podcast features Keren Bergman discussing the advancements in silicon photonics for AI and HPC systems. Key topics include the maturation of the manufacturing ecosystem, the transition of optical interconnects into the data path, and the projected commercial readiness around 2028.
Key Takeaways
- Silicon photonics is maturing, with companies like Nvidia making significant commitments to co-packaged optics for AI and HPC systems.
- The primary advantage of optical interconnects over copper is their ability to transmit vast amounts of data over any distance with significantly lower energy consumption.
- While copper excels at short distances within chips, photonics becomes crucial for chip-to-chip communication within servers and across data centers.
- Cost has historically been the main barrier to widespread adoption of photonics, but the growing manufacturing ecosystem is driving down prices.
- The commercial readiness of optical IO is improving, with 2028 projected as a key year for the first significant deployments of co-packaged photonics.
- The maturation of the manufacturing and packaging ecosystem, supported by real funding and market demand, is critical for silicon photonics to become mainstream.
- Photonics offers superior bandwidth density and lower energy per bit compared to electrical interconnects, making it essential for future high-performance computing.
- The industry is moving towards integrating photonic interfaces directly onto or near chips, enabling faster and more efficient data movement within systems.
In This Video
- 00:00Introduction to HPC Podcast
Welcome to the ATH HPC podcast with hosts Doug Black and Shaheen Khan, discussing supercomputing technologies.
- 01:30Guest: Keren Bergman, Optical IO Expert
Introducing Keren Bergman, an expert in optical IO interconnect technology and co-founder of Escape Photonix.
- 02:51Changes in Optical IO Technology
Discussing advancements in optical IO technology over the past two years, focusing on ecosystem maturation.
- 03:39Photonics in the Data Path
Explaining the concept of bringing photonics into the data path for AI and HPC systems.
- 04:25Co-Packaged Optics vs. Copper
Clarifying that optical IO is for chip-to-chip communication within servers, not within chips.
- 05:10Advantages of Optical Interconnects
Highlighting the low loss and high bandwidth advantages of optical communication over electrical.
- 07:07Commercial Readiness and Cost
Addressing the long-standing question of commercial readiness and the primary barrier of cost.
- 08:51Manufacturing Ecosystem Maturation
The manufacturing ecosystem for photonics is maturing, with major players investing in its future.
- 09:28Projected Deployment Timeline
Estimating 2028 as the year for the first significant deployment of co-packaged photonics in systems.
Questions & Answers
What is silicon photonics and its role in AI and HPC systems?
Silicon photonics is a key technology for photonic interconnects, enabling AI and HPC systems to run faster and cooler by moving data optically within the data path, rather than relying solely on electrical interconnects.
What is co-packaged optics or embedded photonics?
Co-packaged optics, or embedded photonics, involves bringing the photonic interface closer to the chip, allowing data to be transmitted optically over short distances within a server or motherboard.
What are the advantages of optical interconnects over copper for HPC and AI?
Optical interconnects offer significantly lower energy consumption per bit and higher bandwidth density over distance compared to copper, which experiences more loss and requires amplification over longer runs.
When will co-packaged photonics be widely deployed in systems?
While research has been ongoing for decades, widespread commercial deployment of co-packaged photonics in systems is anticipated around 2028, driven by the maturation of the manufacturing ecosystem and significant industry investment.
Why hasn't silicon photonics been fully implemented sooner?
The primary reason for delayed implementation has been cost. While photonics can outperform electrical interconnects, the cost of manufacturing and the ecosystem's development have been significant factors.
What is the main change in silicon photonics over the last two years?
The most significant change has been the maturation of the silicon photonics ecosystem, with major companies making strategic investments and commitments to bring these technologies to the commercial market.
Key Terms
- Silicon Photonics — A technology that uses silicon to create optical components, enabling faster and more efficient data transmission for computing systems.
- Optical IO — Input/Output technology that uses light to transmit data, offering advantages in speed and energy efficiency over traditional electrical methods.
- Co-packaged Optics — A design where optical components are integrated directly onto the same package as the semiconductor chip, reducing distance and improving performance.