There are likely several > earth-mass objects in our solar system that are as-yet uncatalogued, and almost certainly many hundreds of dwarf planet-mass objects too. Granted, they are further out, but their influence is almost undetectable even over millions of years. It's pretty unlikely that the presence of an earth-mass black hole for just a few years (since it would likely be moving many times solar escape trajectory) would have much in the way of a measurable impact.