I have an organised Documents folder, Pictures folder, Videos folder etc synced between my devices with Syncthing. Downloads is just for temporary things I download from the web, but I never delete anything from there, so it just builds up. I keep a backup on an external 2TB SSD