A hard disk is a form of RAM, as it is Random Accessed Memory, as is tape. You can access it, I.E. read or write to it. It has nothing to do with stop, start, or anything.
The alternative to RAM is ROM, Read Only Memory, which usually requires a special tool to write to it and has a much shorter lifespan for writes. This is what your Bios is stored in as well as CD-ROM, DVD-ROM. Some may remember DVD-RAM, that allowed to write more than one time to it, which also means a DVD-RW is also RAM (notice the lack of ROM in the name).
All of you would fail the old A+ certification section on ROM vs RAM (not sure about the new one).
As for drives versus memory, we call them different because it's just easier in common language to do so (just as people used to call the computer tower the CPU).
The difference is the volatility, what we consider RAM is volatile, meaning when it loses power, it loses the information. Non-Volatile is an SSD or hard disk, they retain memory in the event of a power loss. Both are still RAM. We use two different sources because non-volatile has always been slower than volatile, however both can and are used for the exact same function, storage/swapping of data. Your own computer uses the hard disk as "ram" when the "ram" is full, Linux calls it a swap file, Microsoft calls it virtual memory, both are the opposite of using your "ram" as a hard disk, which is called a RAM drive.