Groq is raising up to $650 million from existing investors to fund a new entity called 'Groq 2.0,' which will operate as an AI inference cloud service provider.