Next generation photodetectors have to meet several requirements to overcome the current limitations of silicon-based devices. They must be cheap, reliable in fabrication and exhibit low power consumption, for which high speed and low dark currents are essential. Transition metal dichalcogenides (TMDCs) are promising in this regard, especially since the increasing quality of flakes produced via chemical vapor deposition is closing the gap to the excellent properties of mechanically exfoliated ones, allowing reliable and relatively inexpensive production. However, achieving high switching speeds toward Gigahertz photodetection remains challenging, in particular without compromising the responsivity too much. The intrinsic response, i.e., the pure material-based upper limit for photodetection without limitations such as the RC time of the device, has been shown to be in the picosecond regime. In contrast, for the application-relevant extrinsic response time, most reports have revealed response times of milliseconds to microseconds. Some groups report nanosecond response times, and in the combination with highly advanced photonic circuits, even faster combinations are possible. The problem with such sophisticated fabrication techniques remains the scalability. Furthermore, many approaches are based on TMDC heterostructures or combinations of TMDCs with other materials, i.e., hBN, graphene or quantum dots, which in turn complicates fabrication. In this work, we study highly simple TMDC photodetectors, comprising only of exfoliated multilayers or bilayers of pure WSe2 and gold top-contacts. We show that multilayer devices are RC limited and that reducing their photo resistance as well as the device capacitance affords a response time below 2 ns and an electrical bandwidth in excess of 230 MHz, which is unprecedented for pure TMDC photodetectors to our knowledge. The devices are operated at zero bias, leading to a switching energy of only 27 fJ/bit, highlighting the potential of TMDC photodetectors for low-power optical communication. We find response times < 20 ns for bilayers, indicating that the deleterious persistent photocurrent known for MoS2 mono-and bilayers is not an issue for WSe2.