For me what worked is shutting down (Macbook Air 2021 M1) then booting into Safe Mode. After a minute the stuck uploads/downloads cleared out as they normally should.