Go for it -- and let us know how it comes out.
I fear that you will be disappointed by how difficult it would be compared to the same building built under the trees and NOT attached. I am sure you will not save any time or money building it as you describe.
