Hey, great, any contribution towards improvements are welcome. There's also some tickets there ... juz sayin' 😜
I would be ideal if the filtering were done as a UI task, though obviously not client side. With the reorganization of the Steem services with Hive and so on, I think it will be offloaded from the basic blockchain operations, which are far too tightly coupled with it's internal node database and the RPC services on that. I think we need to wait for that but there's a chance to contribute directly to that code and perhaps really make what we're talking about here happen. I'd wait for a beta release though before I start poking around so as not to waste my time!
I had the opportunity to put an idea related to the review panel to Ned recently and he believes SMTs will take care of this. After considering it I'm inclined to agree, either that or it's an idea for something else, not Steemit after all.
On the idea itself though, there are many holes and I'm constantly reworking it. The latest best version is the creation of a curators SMT which uses a network of willing reviewers to kind of super charge a post. So instead of changing how Steem fundamentally works, it's an additional layer of reward, avouchment and community building. Speaking of which, it will be interesting to see how communities affect things.
On the AI accepting random losses, you can work around it I think. For example a multiple choice out of 4 with one right answer you have 25% change of randomly selecting the right one. But if you negatively score accounts that get a loss you can reduce the 1/4 takings to almost nothing if they choose uniformly randomly. Of course a human cabal of answers could collude against the system so I'm trying to come up with a way to build a chain of responsibility between reviewers as a way to mitigate this and the bot attack.
I'm coming up with a beta version (or a general system for testing) that might be able to operate in a live simulation mode without SMTs as they're not available yet.
I think your idea sounds promising. But, yeah so much wait-and-see: SMTs Hive.
A reputation based system for reviewers - sort what curie has, but not so monolithic might work.
It's a pity but yes, we must wait and see. The balance there is that any implementation would take at least as long as it will take to see some of these changes, and would perhaps become obsolete or in need of so much update that it'd be better to wait.
However I do think we could prototype some of these ideas before that time, perhaps using a BitShares asset or just a simple DB or on chain version of that by adding comments to a particular post, etc. It wouldn't have real assets but the ideas could be tested.
There's also the SMT test net, though it looks complicated and unfinished.