Not all of them... but "off grid" no longer means living like Ted Kaczynski. The popular understanding has yet to catch up.
You can have artificial lighting all night long (thanks to LEDs and batteries), computers (ideally you want to avoid the DC -> AC -> DC conversion), Internet access (although most satellite systems aren't really optimized for low power yet), running water (solar-powered pumps, cheap large-capacity plastic storage totes), etc.
The items that are still hard to get, because of their inherently energy-intensive nature, are hot water out of the tap on demand, and interior climate control (space heating especially). You need a pretty big solar array and battery system to run even a fairly efficient (AC or heat pump) climate control system. Lots of people get around this by siting their off-grid cabins in places that don't require AC, and making the interior volume small enough to heat with a small biofuel furnace (like a modern, efficient wood stove) that can burn locally-obtained fuel.