Yes, you can swim in Fiordland. The waters are quite cold, so it is best to bring a wetsuit and some other safety equipment when you go.