They're a market entry point. CUDA became popular not because it was good, but because it was accessible. If you need to spend $10k minimum on hardware just to test the waters of what you're trying to do, that's a lot to think about, and possibly tons of paperwork if it's not your money. But if you can test it on $300 hardware that you probably already own anyway...