So I've setup my Sumo Logic free account two days ago and installed their data collector to stream my witness server log file for steemd. Using their logreduce (categorisation of types of events present in the logs) and field extraction rules (extract values from the text logs and make them available in variables that can be used for queries and filters), I've setup a basic dashboard as seen above.
From top to bottom, left to right:
- The number of blocks my witness has signed in the last 24 hours. I might change this to the last 7 days.
- The average number of transactions per hour (counted from the blocks my server receives from other witnesses).
- A graph that shows the top 30 witnesses ordered by number of transactions signed.
- A graph showing the number of transactions in each block received. In the case of the RC issues encountered with HF20, this graph should flatten down.
- A graph showing the number of blocks signed by each witnesses ordered by the number of blocks.
- A list of witnesses who double signed in the last 7 days. Double signing usually happens when two different servers are using the same witness signing key and hence signing the same block both at the same time. This is usually not a good thing. It's empty for now as no one has double signed recently 👍.
- A list of accounts having low Resource Credits and trying to do something on the blockchain
Spammers are being stopped by HF20
Now the little discovery I'm talking about in the title of this post is related to the last panel on my dashboard.
The account that attracted my attention is @ammard, as I was updating my dashboard yesterday, I noticed that his count number was increasing a lot. As you can see in the screenshot below, that user is trying to do something on the blockchain and HF20 is rejecting the action due to low RC. A normal user (human) would have seen that their account is low in RC, or at least would have noticed there is an issue posting or doing things on Steemit and would have stopped but this account kept doing it. So I went and had a look at @ammard profile to see what's going on.
@ammard comments revealed this:
He's been posting heaps of identical comments on the the exact same post which cannot be opened anymore due to receiving over 43K comments: https://steemit.com/animal/@sephiroth206/maziepuppyoxxb3jlm
the replies received by @ammard is also interesting.Looking at @sephiroth206 also revealed that it is also dodgy. A look at
This morning, I noticed a last interesting thing is @ammard history on steemd.com says that he has has -19282.71% RC but he still managed to make some comments 2hrs before. But it seems to have settled now as I've just checked it again and his last activity was 12 hours ago. But to be at -19274.26%, he must be already negative few days ago but he somehow managed to comment spam once in a while. His steemd.com history also shows that there was a huge drop of activity since 7 days ago. That account was spamming a lot before but then suddenly the RC introduced by HF20 prevented it from spamming again.
Related content
- ULOG 104 - Using Sumo Logic to monitor the witness server logs
- Witness Earnings Report - 2018-10-08
- Witness Earnings Report - 2018-10-01
- ULOG 094 - Steem blockchain hardfork 20 week
Summary of some of my other contributions
| Project | Description | Link |
|---|---|---|
| Steemed Phish | Chrome browser extension to make external links more visible and alert you on Phishing/Scamming links | Steemed Phish |
| Dtube Community Support | This project by @evildido allows users to run their own IPFS node and pin videos in order to cache them for longer. Dtube has the tendency of deleting non-popular video after few days only. I helped Dockerizing the project for an easier deployment on almost any platform. I've also contributed by running two nodes, one in Australia and one in Canada to cache #teamaustralia and #teamnz videos. | Dockerizing Dtube Community Support |
| DiscoSteem Bot | This is a Discord/Steem bot project by @planetenamek. When I started Steemulant Bot for the Vietnamese community, I didn't know the existence of DiscoSteem Bot and wanted something written in NodeJS. I've ended up continuing my own project as it contains code and logic for personal use and for the Vietnamese community. But I've decided to share some useful features that can benefit the users of DiscoSteem Bot and will continue to add more functionalities as I go. | Dockerizing DiscoSteem Bot |
| A Dollar A Day | This is a project run by @pennsif and will donate 15 SBD every day to a charity | "A dollar a day" fundraiser - Karaoke Singing: Le chanteur malheureux |
| Team Vietnam | I started a new Vietnamese community on Discord and developed @teamvn, a community bot to help grow the Vietnamese community and help them create higher quality content. | |
| POCKET-JS | This is my Javascript (NodeJS) port of the POCKET confirmer by @biophil. POCKET is an experimental crypto token on top of STEEM. | POCKET-JS Confirmer |
| Skippy Bot | I've written this Discord bot for @teamaustralia, it has three main features: a level bot (like Tatsumaki but with Australian animal images), a chatter bot and a footer banner generator for both @teamaustralia, @teamnz and @steemph | Witness Update 2018-07-30 - Team Australia's Skippy Bot |
Credits
- The image at the top has been generated with the Canva app using my own photo.
I'm always happy to see spammers failing miserably XD Your dashboard looks pretty cool :)
That’s always good indeed. Need to check on them to see if they find any workaround though
Posted using Partiko iOS
So we have some very valid data driven proofs on the effectiveness of RC. Really appreciate setting this up and sharing the findings.
Yep. Looks like RC is doing its job
Posted using Partiko iOS
I used @jehovahwitness as an example of a bad actor with decreased activity since HF20. They're in the SBI flag list, meaning they don't get upvotes from us, but I still see their posting frequency when I do look at the member data and it decreased a lot after HF20.
That helps groups like @steemcleaners do their job better, since they can now spend much less voting power on each abusive account.
Posted using Partiko Android
Yea. The decrease in spam activities has also a good impact on payout to authors. And steemcleaners can use the saved power for other types of abuse
Posted using Partiko iOS
Pretty cool stuff, spotting the spam at a high level. Thanks for sharing.
I’m looking forward to seeing what else the tool will allow me to see in the logs. I’m also planning to feed it with some data from the blockchain itself, but that might blow out the quota of my free tier account lol
Posted using Partiko iOS
Thanks for the update mate.
Chúc mừng @quochuy, bạn đã nhận được một upvote 40%. Tôi là con bot của cộng đồng Việt Nam trên Steemit. Tôi được tạo ra bởi nhân chứng @quochuy và được uỷ quyền, tín nhiệm bởi các thành viên Việt Nam, hôm nay tôi vote cho bài của bạn để ủng hộ bạn. Tôi hi vọng sẽ được thấy nhiều bài viết hay từ bạn.
Chúc bạn vui vẻ, và hẹn gặp lại một ngày gần đây.
Congratulations! Your post has been selected as a daily Steemit truffle! It is listed on rank 25 of all contributions awarded today. You can find the TOP DAILY TRUFFLE PICKS HERE.
I upvoted your contribution because to my mind your post is at least 8 SBD worth and should receive 206 votes. It's now up to the lovely Steemit community to make this come true.
I am
TrufflePig, an Artificial Intelligence Bot that helps minnows and content curators using Machine Learning. If you are curious how I select content, you can find an explanation here!Have a nice day and sincerely yours,
TrufflePigHi, @quochuy!
You just got a 0.51% upvote from SteemPlus!
To get higher upvotes, earn more SteemPlus Points (SPP). On your Steemit wallet, check your SPP balance and click on "How to earn SPP?" to find out all the ways to earn.
If you're not using SteemPlus yet, please check our last posts in here to see the many ways in which SteemPlus can improve your Steem experience on Steemit and Busy.
Hi @quochuy!
Your UA account score is currently 5.689 which ranks you at #446 across all Steem accounts.
Your rank has dropped 2 places in the last three days (old rank 444).Your post was upvoted by @steem-ua, new Steem dApp, using UserAuthority for algorithmic post curation!
In our last Algorithmic Curation Round, consisting of 391 contributions, your post is ranked at #21.
Evaluation of your UA score:
Feel free to join our @steem-ua Discord server