I've always loved art, and I want to learn to draw, but is it even possible to go to college for drawing if you have no prior experience?
Yes you can! Usually you do have to make a portfolio, but sometimes you can take a year of "Arts Fundamentals" courses that are like a prep leading into Games and Design industry. It depends on what you want to do.. if you wanna be a TD it's both artistic and technical.. some do more programming, and others do more art. Sometimes the designers design entirely with programs and not any with pencil and paper.. but concept artists almost always draw.. so maybe you should research the industry a bit more before casting an idea aside because you think it doesn't apply or it's invalid. You never know! You might just find a hidden passion!
I've done it and I've worked in games briefly at an internship. Good luck. If you need more info just ask!