Backup Windows servers to external hard drive

Dumb question.

Is there such a device that would look like a tape drive to Windows
servers, but instead of removable /tapes/ that go into a vault, they are
removable /hard disks/ that go into a vault?

It sounds like a VTL (virtual tape library), but all the pictures I see of
VTLs are these large things that don't appear to have hard drives that pop
out like a tape cartridge. I'm wondering if there's something where the
hard drives pop out for vault storage. Like an external USB drive only you
don't take it apart to put a different hard drive in.

Wikipedia says:

"While a virtual tape library is very fast, the disk storage within is not
designed to be removable, and does not usually involve physically removable
external disk drives to be used for data archiving in place of tape. Since
the disk storage is always connected to power and data sources and is never
physically electrically isolated, it is vulnerable to potential damage and
corruption due to nearby building or power grid lightning strikes."

and Wikipedia is always right. :)