From what I've heard, admins can't really do anything about repeat offenders / downvote trolls because of something about scanning through databases or something. But then I also saw a post yesterday about how Friendica reveals the usernames of people who upvote and downvote, so it seems like that information is accessible in the API or framework of the Fediverse.