Over the counter iron supplements are totally safe to take for the period indicated on them. They contain as much iron as a medium piece of chicken liver.
Most of the over the counter ones I see online are 65 mg iron, which is nearly twice the iron in a whole half kilo of chicken liver.
The medical sites say a safe value is no more than 45 mg per day.
There are also low iron pills (or "gentle iron") that are 28 mg.
So not only are many over the counter pills potentially over the safe levels, but it still doesn't even really answer the question, which is whether the low-dose pills that are under the RDA effective in countering an iron deficiency.
Anyway. I think I'll ask my doctor at a once-every-several-years checkup.
Do you live in America? Supplements tend to be much stronger there. Here in Germany at the local pharmacy you will mostly find in the 10mg-30mg range. I've bought and drank them before to no ill effect, which is why I even started this entire chain.