Ditch single-use plastic and switch to a filter bottle.

I picked the Philips GoZero because of its convenient size, the single-handed cap mechanism, and simplistic design. Although, the straw-approach is probably subject to personal preference, it works, and turned out to be pretty useful.

It's easy to clean, replacement filters are reasonably priced, and it's leak-proof—unless you open the cap in a low-pressure environment like an airplane. (Which can be avoided by unscrewing the cap a little to release the pressure.)