I'd say that instead of attempting to 'level the playing field', every other owner in your league needs to step up.
I've been in a very active league the past few years, and I find it fun to make moves and pick guys up on a hunch. To me, that's one of the essences of fantasy baseball strategy. I wouldn't take that away unless there's serious wrongdoing or collusion between owners.