How to dress in business attire - TIPS?

I just got a job... I'm not sure why I'm taking it but it came to me and it might be good. But it's in a business environment. I don't really have the clothes... I used to work in an office and although it was lax I dressed in a nicer business casual. It won't quite cut it for this job.
What should I do? I'm about to go shopping. I don't like "suits" and wearing all one color, it makes me feel weird. I hate the generic looks, women look really bad in the female version of suits and dress suits. I am not against getting blazers though and I do love button up shirts with collars. Sadly I think a sweater with a collared shirt under it is not nice enough (unless I get really good fabric/quality)

Realistic budget

Engagement ring: $100
Wedding ring (female): same ring, same $100
man's ring - also $100
Wedding dress: $300
Bridesmaid dress (each): wore their own black dresses, i spent $40 on shawls
Flower girls dress (each): no children in my wedding
i did spend $100 on matching shirts and ties for the GMs
Venue: free, donated $100 to church
Rentals (Linens, tables, chairs, extras): $80 for FH tux
Music, Ceremony: free musician friend
Music, Reception: brought the computer and ran the playlist- free
Flowers: $50 at costco for rosebuds, all fi