11. External GPU Enclosures
Chapter 11 of 20 · 15 min
External GPU (eGPU) enclosures provide upgrade paths for systems without internal GPU capability. This includes laptops, Mini-ITX builds, and compact form factors.
eGPU Architecture
eGPU setups consist of:
- Enclosure with desktop GPU
- Power supply (typically 500-700W built-in)
- Interface (Thunderbolt 3/4 or USB4)
Bandwidth constraints:
| Interface | Bandwidth | eGPU Efficiency |
|---|---|---|
| Thunderbolt 3 | 40 Gbps | 75-85% |
| Thunderbolt 4 | 40 Gbps | 75-85% |
| USB4 | 20-40 Gbps | 60-70% |
Compatible Enclosures
| Enclosure | Max GPU Length | Power | Price |
|---|---|---|---|
| Razer Core X | 12.4" | 500W | $300 |
| Sonnet eGFX Breakaway 550 | 12.3" | 550W | $350 |
| Akitio Node Pro | 11.5" | 600W | $400 |
| ASUS XG Station Pro | 13" | 500W | $250 |
GPU length matters—RTX 4090 at 12.3" fits most enclosures, but longer cards may not.
Real Performance Numbers
Testing Llama 3 8B inference via eGPU:
| Setup | Tokens/sec | Notes |
|---|---|---|
| Internal RTX 3060 | 22 | Baseline |
| eGPU RTX 3060 (TB3) | 19 | 14% slower |
| eGPU RTX 4070 (TB4) | 24 | Acceptable loss |
The bandwidth overhead primarily affects batch processing. Single-query inference shows minimal degradation.
Setup Process
# Linux eGPU setup
sudo apt install nvidia-driver-535
echo 'auto eGPU' | sudo tee /sys/bus/pci/slots/1/power
# Verify GPU detection
nvidia-smi
# Common issue: Hot-plug failures
# Solution: Cold boot with eGPU connected
# 1. Shut down
# 2. Connect eGPU
# 3. Power on enclosure
# 4. Boot system
Failure Modes
- Hot-plug instability: Always connect eGPU before boot
- Thermal throttling: Enclosure fans may be insufficient
- Audio interference: Some enclosures introduce buzzing
- Driver conflicts: Multiple GPUs require careful routing
EXERCISE
Research three eGPU enclosures and compare them across GPU length support, power delivery, and Thunderbolt version. Identify the best option for your current system.