

Depending on what your server is doing, swap use is normal. But if it’s into swap cuz ram is full, you will find it grinds to a halt.
Use free -mh
to see what the memory use is, there is a way to reduce the swapiness if your running a database server and is advised.
That’s how Linux manages it memory, it will use free memory as file cache till it needs it. Then free up memory for process use.
If your only half using the memory for actual services, you may want to reduce it.