Centaurus A (Cen A), the nearest radio galaxy, was detected as a faint emitter of very high energy (VHE) gamma rays by the H.E.S.S. telescopes in Namibia. The flux derived from the H.E.S.S. data is notably higher than that expected from a single zone synchrotron self-Compton model, which adequately describes the emission from Cen A at lower energies. New observations with H.E.S.S. were performed to clarify the spectral characteristics of the VHE emission from Cen A. I will report on the results of the analysis of the complete H.E.S.S. data set with twice the exposure time of the previously published data set and also the update of the Cen A spectrum obtained with Fermi-LAT at GeV energies. To conclude I will discuss other recent results of, and prospects for, H.E.S.S. observations of the radio galaxies, PKS 0625-35 and Fornax A, respectively.