Ethernet connections are almost always faster than Wi-Fi connections, and are usually more stable. You'll need to connect one end of the Ethernet cable to your router, and the other to your computer.

Alexa has some offline limitations but there are still a few things it can handle This article explains what Alexa can (and can't) do without a Wi-Fi internet connection. The short answer is yes.