Start small. Get a solid turntable. There's forums that can guide you based on budget. It's finding deals in the second hand market, cos there's tons of it. Buying brand new is nice, but it's like buying a new car, you lose a quarter to a third of your cash the moment you hand it over. This is a lesson for me as well, cos every time I get close to an upgrade of sorts I find a rare vinyl I really like or someone is giving a load of stuff away at value. Really what I could do with doing is trimming down the 3-4 thousand vinyls I own and filtering out the parts I find a bit crap. The further you go, the more expensive your taste becomes. I occasionally buy job lots and when I can arrange to get to them vinyl fairs and music car boot sales. As with everything I wish I'd started about ten years earlier when the genuine bargains were about. Twas ever thus.