I experimented with TLUD retorts like this design as I started my biochar production journey and found them temperamental in the same way you did: Inconsistent burning, too much smoke, incomplete charring of the material in the inner drum (or going all the way to ash if I wasn't careful). I shifted my focus to flame cap and haven't really looked back...
...until now, when I was asked by a research supervisor if I could make biochar out of coconut coir chips. It turns out that these will burn readily once they're dry, but they don't achieve a flame, and in a kontiki or trough they smolder and smoke like mad. So I'm making a barrel retort again, only this time things are different.
No TLUD in this design. It's the Black Ripple approach and we discussed it in
this thread a few weeks ago. The primary heat comes from a rocket J-tube and the outer wall of the reactor is insulated to keep in more heat. My hope is that I can run it with a smaller amount of sacrificial wood but get it up to temperature quickly. I have all the parts and if this weekend isn't too wet I hope to put it together and do a trial.