The items below are what I currently use or have used. You can purchase these items anywhere you wish. Some of my favorite places to buy pilot supplies is online at Sporty's Pilot Shop, Amazon or locally at Pacific Coast Avionics, an airport FBO. The FAA publications are available as a free PDF download. I currently have them downloaded on my iPad and also have a printed version. You do not need every single resource shown. These are just what I personally use on a regular basis as a pilot and flight instructor. Not sure exactly what you need to get started? Feel free to contact me - I'm happy to discuss it with you.
Disclosure: There are some affiliate links below, but these are all products I highly recommend. You won’t find anything on this page that I haven’t personally used.