No, you should not major in Computer Science. All I read in your message is a fear of CS, not a passion for it, and if you don't truly want to be a programmer then you should not become one.
If you want to get into game design, you can supposedly do that with ANY degree (http://sloperama.com/advice/designprep.htm
), so why not pursue English or Social Studies if they interest you? Anything you learn, as long as you prove you can finish strong, can be used to benefit you as you work on your game design skills.
And FYI there are tools out there (e.g. GameMaker) for folks who want to dabble in design without learning programming.