My guess is that your flue pipe is providing too much resistance to air flow. The addition of resistance when you fill up the feed tube tips the balance and the heat riser can't power through it.
Your burn chamber is 35 in^2, heat riser is 36 in^2, and flue pipe is 28.3 in^2. This is about 21% reduction in area going into the flue pipe which may be too high. I don't have enough experience with rmh to know if 35 ft is too long of a flue pipe.
The lack of thermal mass around the flue pipe would also have a strong effect. Without mass, the gases are allowed to cool much more quickly within the flue, which I think is a lack of energy to overcome the friction in the pipe.
The wet clay might be hurting it too, taking energy to evaporate water and lowering the combustion efficiency in the heat riser. But I think the flue is the main issue.
If you need the long duct length, you could try a booster fan at the end of the flue to get air moving. The exhaust should be cooled enough by then to not hurt the fan. This would also make it easier to get started.
http://www.homedepot.com/buy/inductor-8-in-in-line-duct-booster-fan-db208.html
Any pictures?