How to get marriage license?

I live in Cleveland, OH and decided to get married with my girlfriend. We went to Cleveland Downtown and got "Domestic Partnership Certificate" which was $55 and valid for 60days. Do we now need to go to our local city hall and set an appointment for a Judge to marry us? If that's the case, after Judge marries us, he then what... signs the Domestic Partnership Certificate and we will be legally married?