Gluon TMDs can be accessed through the analysis of azimuthal asymmetries for heavy quark pair and dijet production in electron-proton collisions, similarly to the way quark TMDs are commonly extracted from semi-inclusive deep-inelastic scattering data. We calculate the upper bounds for these observables, showing in which kinematic regions they are large enough to be measured in future experiments at an Electron-Ion Collider. Moreover, we study their behavior in the small-x region, adopting a McLerran-Venugopalan model for unpolarized and linearly polarized gluon distributions. By comparison with related observables at RHIC and LHC, we expect to gather information on the process dependence of the gluon TMDs and to test our prediction of a sign change of the gluon Sivers function and two other T-odd gluon distributions.