A number of discrepancies have emerged between lattice computations and data-driven dispersive evaluations of the RBC/UKQCD Intermediate-window-hadronic contribution to the muon anomalous magnetic moment. It is therefore interesting to obtain data-driven estimates for the light-quark-connected and strange-plus-disconnected components of this window quantity, allowing for a more detailed comparison between the lattice and data-driven approaches. The aim of this paper is to provide these estimates, extending the analysis to several other window quantities, including two windows designed to focus on the region in which the two-pion contribution is dominant. Clear discrepancies are observed for all light-quark-connected contributions considered, while good agreement with lattice results is found for strange-plus disconnected contributions to the quantities for which corresponding lattice results exist. The largest of these discrepancies is that for the RBC/UKQCD intermediate window, where, as previously reported, our data-driven result, $a_\mu^{W1,{\rm lqc}}=198.9(1.1)\times 10^{-10}$, is in significant tension with the results of 8 different recent lattice determinations. Our strategy is the same as recently employed in obtaining data-driven estimates for the light-quark-connected and strange-plus-disconnected components of the full leading-order hadronic vacuum polarization contribution to the muon anomalous magnetic moment. Updated versions of those earlier results are also presented, for completeness.