challenge_9946_1781220699800

1. **Parallelism:** GPUs have many cores optimized for parallel matrix operations, so they usually run large neural network inference much faster than CPUs.

2. **Cost/latency profile:** CPUs are often simpler and cheaper for small models or low request volume, while GPUs are more efficient for large models, batching, and high throughput.