Glue
Your choices for glue are basically A) Cyanoacrylate (Super Glue) or B) Some sort of epoxy.
A) will get you quick dry time, high strength (much higher than the paper it's binding together, anyway,) good low temp performance, and light weight. CA will also work nicely to attach paper to your tube trusses, which will make them quite a bit stronger.
B) will have to be carefully selected from the large array of epoxies out there, will take a while to try, and may require curing at an elevated temperature. The upshot is that there is such a selection out there that you can get basically any performance characteristics you want - high temp, low temp, perfect shear modulus, etc.
The key is to keep the glue as thin as possible, and don't fool yourself about how long that inner piece of the butt joint needs to be - at some point (rule of thumb is about 2x tube radius, one radius inserted into either side) the straws will fail before the joint does, so making that inner piece longer is just going to get you more weight. If 2x radius isn't long enough, put one segment inside the tubes and another outside, that'll balance in-plane torques due to tension and prevent delamination.
Tip: For construction, get yourself a nice ceiling tile and a bunch of large T-pins, print your layout at 100%, put that, covered with plastic wrap on the tile, then use the T-pins to hold pieces in place on top of your print out. That lets you make sure everything fits before gluing, and that it stays put during gluing.