Full Transcript
Loading transcript…
74th ECTC 2024 Keynote
Watch with subtitles, summary & AI chat
Add the free Subkun extension — works directly on YouTube.
- Watch
- Subtitles
- Summary
- Ask AI
Engineers, researchers, and industry professionals interested in advanced computing, AI, and the role of photonics in future technology.
TL;DR
The 74th ECTC keynote addresses the exponential growth of AI and its immense energy consumption. Photonics is presented as a crucial technology for scaling AI performance while simultaneously reducing energy usage, particularly in data centers and computing systems.
Key Takeaways
- AI applications are experiencing unprecedented growth, increasing by six orders of magnitude in just six years, with model sizes exceeding 10 trillion parameters.
- The rapid expansion of AI is leading to a significant and unsustainable surge in energy consumption, impacting global power grids and requiring innovative solutions.
- Photonics, particularly silicon photonics, is presented as a crucial technology for enabling continued AI performance scaling while simultaneously addressing and mitigating energy consumption.
- Current electronic interconnects face limitations in bandwidth density and energy efficiency as data distances increase, necessitating alternative solutions for large-scale computing.
- The conference emphasizes packaging as a critical challenge and focus area for integrating advanced photonics solutions into next-generation computing systems.
- The development of photonics aims to flatten or bend the exponential energy consumption curve of AI, preventing it from becoming a prohibitive bottleneck.
- The ECTC conference serves as a vital platform for collaboration, networking, and showcasing cutting-edge technologies in electronic packaging and photonics.
In This Video
- 00:00Welcome to ECTC 2024
Carin Spock welcomes attendees to the 74th ECTC, thanking sponsors, exhibitors, speakers, and attendees.
- 02:57Logistical Information and App Usage
Attendees are reminded to use the ECTC app for the program, updates, networking, and paper scoring.
- 03:36Introducing Keynote Speaker Professor Karen Burkman
Professor Karen Burkman is introduced as the keynote speaker, highlighting her background and affiliations.
- 05:49Photonics for AI Computing Systems
The keynote will discuss silicon photonics for large-scale computing and AI, addressing unprecedented growth.
- 06:06AI Growth and Energy Consumption Challenges
AI applications are growing exponentially, leading to massive model sizes and significant energy consumption concerns.
- 07:24Energy Consumption Scale and Impact
AI's energy use is immense, comparable to cities, impacting power grids and requiring sustainable solutions.
- 09:21Photonics to Enable AI Performance Scaling
Photonics offers a path to scale AI performance while bending the energy consumption curve.
- 10:12Connectivity Solutions and Packaging
Current connectivity solutions and the role of photonics and packaging in these systems are discussed.
Questions & Answers
What is the 74th ECTC conference?
The 74th ECTC is the flagship conference of the IEEE Electronic Packaging Society, bringing together experts to discuss advancements in electronic packaging.
Why is AI growth a concern for computing?
AI applications are growing exponentially, leading to massive model sizes that exceed single compute socket memory and cause tremendous energy consumption.
How does photonics help AI scaling?
Photonics, particularly silicon photonics, is proposed as a mechanism to enable continued performance scaling of AI while also bending the energy consumption curve.
What are the limitations of current electronic interconnects?
Electronic interconnects are effective for very short distances within a chip, but their bandwidth density and energy efficiency drop significantly as distance increases.
What is the role of the ECTC app?
The ECTC app provides the entire program, up-to-date information, a networking platform, and is used for collecting questions for Q&A sessions and paper scoring.
Who is the keynote speaker at 74th ECTC?
The keynote speaker is Professor Karen bman, the Charles Bacheler Professor of Electrical Engineering at Columbia University and director of the Center for Ubiquitous Connectivity (Cubic).
Key Terms
- ECTC — The Electronic Components and Technology Conference, a flagship conference for the IEEE Electronic Packaging Society.
- Silicon Photonics — An emerging field that uses silicon-based materials to create optical devices and circuits for high-speed data transmission.
- AI Computing — Computing systems designed to handle the massive computational demands of artificial intelligence applications, particularly large language models.