Mineral dust accumulated on the ocean floor is an important archive for reconstructing past atmospheric circulation changes and climatological conditions in the source areas. Dust emitted from Southern Hemisphere dust sources is widely deposited over the oceans. However, there are few records of dust deposition over the open ocean, and a large need for extended geographical coverage exists. We present a large data set (134 surface sediment samples) of Late Holocene dust deposition from seafloor surface sediments covering the entire South Atlantic Ocean. Polymodal grain-size distributions of the lithogenic fraction indicate that the sediments are composed of multiple sediment components. By using end-member modeling, we attempt to disentangle the dust signal from non-aeolian sediments. Combined with 230Th-normalized lithogenic fluxes, we quantified the specific deposition fluxes for mineral dust, crrent-sorted sediments and ice-rafted debris (IRD). Although the method could not completely separate the different components in every region, it shows that dust deposition off the most prominent dust source for the South Atlantic Ocean—southern South America—amounts up to approximately 0.7 g cm−2 Kyr−1 and decreases downwind. Bottom-current-sorted sediments and IRD are mostly concentrated around the continental margins. The ratio of the coarse to fine dust end members reveals input from north African dust sources to the South Atlantic. The majority of the observations are in good agreement with new model simulations. This extensive and relevant data set of dust grain size and deposition fluxes to the South Atlantic could be used to calibrate and validate further model simulations.