Yes, cleaning supplies are a must you may want to get a basic kit from someone like Wal-Mart, Bass Pro, Gander Mountain or other large retailer to get started. As time goes by and you read more here you may add additional materials based on your preferences. Be sure the kit you get covers the caliber of your handgun.
Give some consideration to how you intend to secure the firearm when it is not on you. This will obviously be influenced by your situation and risk factors presented by children, visitors, elderly adults, local crime risk, etc.
As for holsters I would recommend using the search function and see what others with similar guns are using. You also may want to just start off with a cheap holster to just sort of get the feeling of carrying. Also, do not forget the importance of a good belt.
Finally, save some money for ammo and range time.