$RECYCLE.BIN + System Volume Information

Anyway to hide or get rid of on drive?

Would switching to exFAT over NTFS work ?

The folder are created by Windows. You can safely delete them but they will get created again once you mount the storage in Windows.
Switching to exFAT will not help either.