gravity batteries and geothermal are too expensive to be competitive, except in the niches of pumped hydro, district heating, very polar regions, and stranded assets from before pv and wind got so cheap
Incidentally, the only viable gravity batteries known today are pumped hydro reservoirs. On the up side, they only need a hill. On the down side, they need a hill.
(Gravity Vault, BTW, is 100% scam.)
Suspending weights from ocean platforms (e.g. scrapped supertankers), for flat places with deep sea nearby, should be a viable alternative, but it has not been done yet. Deep cave systems are another, either draining water into them or (for those below the water table) pumping air in. There are a lot of deep caves.
Geothermal is also an 'always on' renewable.