Its a good thread, particularly Exuma's comment, but a memento mori from the root node:
My one word "Source?" meant: "You are adding a new episode of fictional info to a discussion about fictional info."
Even in that fictional world the post was wrong. Even if it was right in some allegorical sense, the simplistic allegory adds nothing. "Mixture of experts is like a group of experts where you pick the right expert to ask a question" isn't some hard-won cross-domain self-taught knowledge. It's something a bright 6th grader would pull off.
The self-taught feeling-stuff-out stuff matters when you're making useful connections that get practical results.
When you're just wiring stuff together online, and the wiring together is meaningless, you're doing nothing and taking the consequences of the negative signals
