That sounds right. The float is either sticking or it is set so that is not closing the inlet completely.
Take the bowl off with the carb upright and hold the floats up while putting liquid (water, gas, beer, whatever) in the fuel line and see if it comes out the inlet. It should start coming out when the floats are about paralllel. If it comes out before the float is lowered that far, that is your problem.