Do I have to be connected to the Internet to read my eTextbooks with nookStudy?

No, once you have downloaded the book you can load it anytime - without an Internet connections. For lookups, syncing, and getting new content you will need an Internet connection.