From the perspective of reading/writing CSVs programmatically, I actually prefer that it's a common character. You'll discover very quickly whether the parser handles escapes correctly. With a more exotic delimiter it might be a long time to discover the problem, and by then it will be harder to fix.

From the perspective of writing CSVs by hand in a text editor, commas suck.