what do you have to do to establish a small business?

I want to start a performing arts studio, but I don't know how you go about establishing a business. Do you file your new company with the city hall or what?