gtg witness log

in #witness-category7 years ago (edited)

Security Update

There was a potential vulnerability in steemd that could lead to a denial of service. Current stable branch (2ee5160) has an appropriate fix. All publicly accessible nodes should be updated.

This bug, however, did not create any risk to the Steem blockchain, accounts, keys, or balances.
Last but not least:

I want to thank you (know who) for reporting and handling it in a professional way.
Good job, as always :-)

Dear witness, please keep your nodes in shape

If you are a witness, it is highly recommended to support the network by running some nodes. Some of us run their services powered by one or many of such nodes, others have complex, distributed infrastructures for their R&D projects, while some are taking their first steps by running their own seed node. In either case, it is crucial to keep them in a good shape.
Security update mentioned above is a good excuse to do some maintenance checks:

  • do you still have enough storage for your block log and shared memory file?
  • isn't your shared memory size too small?
  • is your seed node reachable from outside?
  • is it able to keep up with the head block for most of the time?

Public Steem API endpoint - status and plans

wss://gtg.steem.house:8090

For now, the main purpose of my node is to help various service providers with the transition from WebSockets to JSON RPC 2.0 requests by giving them a bit more time to adapt.
(Honestly, you guys should have done that a while ago.)

If your app is already compatible with json rpc 2.0, please consider using Steemit Inc cluster: https://api.steemit.com or any other API endpoint of your choice.
List of API nodes provided by @jamzed

I’m writing this because I’m currently experiencing increased load on my node, which is caused not only by the high rate of requests from several big service providers that I know but also by a lot of new ones and tons of distributed, short-lived connections from random end-users.

That causes performance issues and 503/504 when upstream steemd(s) are too loaded to respond on time. Make sure that your software can handle such a situation gracefully.

Please be responsible while using public resources: if you expect a significant number of requests, you should consider running your local node, which would also greatly reduce latency, improve performance, and save your time.

(Seriously, when you need to throw 80 million of get_blocks on a public API node in one week, you are doing it wrong. PRO TIP: we don’t even have 20 million blocks yet.)

But fear not. I’m not complaining, I will scale it up. I just need a little time.


- connections coming to my node, real-time scale

Another thing is that it’s not really about the performance of hardware as such, but about certain limitations of the current steemd and the way it handles RPC connections. For now, I’ve just added the second server running steemd to split the load. This issue will be addressed in one of the upcoming steemd releases based on appbase, which will greatly improve the performance of a single node.

If you are running a project that depends on my node, feel free to contact me when you encounter any issues or you need a dedicated node.

https://api.steem.house/

My main, public API endpoint, currently under test, is now working with artificially limited performance, occasionally falling back to external upstream servers. The final version will be powered by multiple separate steemd nodes optimized for various purposes and microservices to serve you better and faster. Do not use it for production yet.

block_log

Up-to-date blockchain data

available for download at:
https://gtg.steem.house/get/blockchain/

or if you prefer

Periodically updated, highly compressed blockchain data

available for download at:
https://gtg.steem.house/get/blockchain.xz
(compatible with parallel, indexed xz)

Steem Pressure

The "Steem Pressure" series is not a series yet, as there’s only one episode out there, but there will be more posts soon.
Stay tuned.



If you believe I can be of value to Steem, please vote for me (gtg) as a witness on Steemit's Witnesses List or set (gtg) as a proxy that will vote for witnesses for you.
Your vote does matter!
You can contact me directly on steemit.chat, as Gandalf



Steem On

Sort:  

hey man,

pardon if this may seem unrelated to the witness log, however, I shared a post today on a large-scale idea to advance Steemit’s development, and was recommended to share with the witnesses:


The $1 Billion Steem Development Fund: How Steemit Inc.'s Stake Could Be Best Allocated To Grow A Thriving Network Of Applications And Users...

not sure exactly who’s attention would be best to get this to, though it’d be great if you could have a read through - and IF you feel it’d be a great idea to serve the community, share with others who may be in a position to advance the discussion.

cheers,

Rok

Seriously, when you need to throw 80 million of get_blocks on a public API node in one week, you are doing it wrong

That's exactly why I'm working on my own Web API for SteemWorld. Since there are more and more people using my tool on a daily basis, I think it's an important step for me. I also like to have as much account data as possible in a single row on my own relational db so that I can minimize the load needed for showing data that would otherwise need 10+ calls executed on a public node.

Your node is still one of the fastest I've found so far and I use it as a fallback if the other nodes should be not reachable for some reasons. I think in future we will definitely need a few more public nodes and I hope someone is going to do something in that direction like you do.

Thanks for all your work!

My node is running the latest version. Thank you for continuing to spread the security information. Hopefully all witnesses will have their node updated to ensure the stability of the network :)

Fortunately it's not that easy to perform targeted attack on the witnesses, especially if their nodes are not directly connected to public network.

নাচ কারে কয় আমার দেখা সেরা নাচ | না দেখলে চরম মিস |2018
http://1ink.cc/1AKC9
Vadaima ভাদাইমার রেসলিং - New Bangla Funny Video 2018 |
http://1ink.cc/Yrit5
হারুন কিসিঞ্জার নতুন নাটক 2018 | Beyakkel Vatija | Harun Kisinger Natok 2018
http://gestyy.com/wcB3T3
স্বামীর চেয়ে বউ কোন অংশে কম নয় এমন মজার কৌতুক আগে দেখিনি। ( হারুন কিসিঞ্জার)
http://1ink.cc/uDSop
নিজের বউ কে এভাবেই অন্যের কাছে বর্গা দিলো এই স্বামী/2018
http://gestyy.com/wcB67u

I promoted your witness in Indonesia, if you have time please coming and say holla in My post sir

https://steemit.com/indonesia/@dilimunanzar/memperkenalkan-para-saksi-gtg-putaran-kedua-wawancara

Thank you :-)

I am no the witness myself and i'm not really understanding the technical stuff behind it but it's surely important to show some respect towards every single person that decides to do so.
This post is very well done!

Thank you :-)

Nie ma za co dziękować :) To ja dziękuję, że wspierasz tak świetnie całą społeczność i wkładasz w to tak wiele pracy i serca! Oby było więcej osób jak ty. Pozdrawiam i podziwiam

:))) dzienkujemy pan gandalf

This is a great article, I am looking to start my witness run in a couple of weeks. Thanks for posting this. @gtg

Thank you :-) Have you already found good candidates to cast your votes for?

this is great update for witness ,though you guys are all trying ,its not easy to be dedicated to given back to the community ,this is to encourage to work more .thank you guys

Thank you :-)

I don't get those technical stuff but that video requires some sound effects

  • also thanks for handling these kind of stuff well/fast.

First supposed to be an animated gif, but it didn't showed correctly on feed page so I had to replace it with video. Second one was generated in a hurry just to have something visually appealing to put into the post as compensation to non-technical part of the audience.
Unfortunately, I'm not a musician, nor have time to find music with a proper license.
But I'll try to do better next time, especially that I'm going to release much longer video :-)

As a newbie I still don't know who to vote for witness, thanks to you. I know what to look when I decide to vote. It's humor.

Too bad, it's not my field of expertise. But I know one who claims to be funny ;-)
(Thank you)

.

Not really, cli_wallet currently supports only websockets.

I'm not a witness though but thanks for the update

Thank you. I try to not be too boring :-)

wss://gtg.steem.house:8090

For now, the main purpose of my node is to help various service providers with the transition from WebSockets to JSON RPC 2.0 requests by giving them a bit more time to adapt.
(Honestly, you guys should have done that a while ago.)

Thank you because of your support on WebSockets.

Can you please tell me how can I use cli_wallet in the future? Will it be outdated and can not use anymore?

Do not worry, I will be still providing websocket endpoint just on a separate address.
That would be announced before taking down old node.
Another option is to use lineman as described by @almost-digital

Thanks for the info!

Thank you for this update. While I'm new to SteemIt, I did find it interesting to read this "behind-the-scenes" post. I couldn't help noticing that the block size in your link was ~63 Giga-Bytes, while in all sorts of "running a node" tutorials from a year+ ago, it's much smaller. Wouldn't this sort of growth influence people's ability to run a node (at least a "cloud based" one)?

More on that subject in my Steem Pressure series :-)
Yes, as we grow it would be harder to run nodes on a random hardware.
At the beginning there were people trying to adapt Steem nodes to RaspberryPi. ;-)
But that's ok. Nobody expect nowadays to run Wikipedia backend on a homegrown PC.

Oh yes, there is indeed more on that subject in your Steem Pressure series 🤓
Thank you for the answer and reference

The Steem platform is getting bigger and bigger, and the Steem blockchain is taking more and more space.
It will require more and more disk space for the blockchain and memory to keep the data ready to access when needed.
Of course, developers are working on optimizing the utilization of server resources. Nonetheless, there will be more and more data to be processed

Thanks for sharing these security updates.
I'm resteeming it to my follower and witnessing your great work.
respond to my comment please.

Thank you :-)

Master wizard, my servers are always in shape.

Good to hear that :-)

Steem on - i like it

Życzę dalszych sukcesów :)

Dziękuję :-)

WOW wielkie gratulacje, jestem tu od niedawna i serce rośnie dowiadując się, że wśród Polaków takie szychy :)

Żadne szychy, ogrom odpowiedzialności i nawał pracy. Ale jak się dobrze rozejrzysz to zobaczysz ilu mamy świetnych producentów oryginalnych, wysokiej jakości treści :-)

First of all...
You got my Vote of Confidence...by million miles!!!! I would give you 15 votes if possible
gtg_for_witness.png
another half I would leave for myself :)

On a serious note though...
Your node was the only one that actually, eventually (after 11 days of trial and error) let me cast the update_witness through the wallet and I am grateful for that! + for hosting the up-to-date blockchain...it does make run things smoother...
Fell in love with steemit the moment i stumbled onto this site and wanted to share the love...by becoming a witness...a silent one though :)
Thank you again for the work and effort you have put into this @gtg and for making another steemian happier!
Peace!

Thank you and good luck! :-)

This is a great article, I am looking to start my witness run in a couple of weeks. Thanks for posting this. @gtg

Thank you, good luck :-)

Thanks again for vote @gtg

yay! Thanks for keeping us safe got to go! :) Now we do not have to "got to go" off this platform :P

Nice video with lot of information. keep posting with . I will always support you and don't forget to support back. @gtg

Support how if I may ask? :-)
You are not voting for witnesses at all, not to mention that you didn't even voted for this post.

Now you got my vote on your post and comment section both. Chill bro Previous time i had a network problem.

Thank up information i like you

But not enough to vote for witnesses or post? ;-)

Yes upvote me please

LOL

Yes upvote me please

Thanks u informantion , this is attack?

What do you mean?

You say Daniel of Service and blocked,
I say this is attack?

Daniel has left the building ;-)

Yes it was a potential DoS attack.

Yes therefore DoS Attack

With all the benefits accrued to witnesses, especially the top 50, i don't think they should have problem with updating their nodes.

Yes, they shouldn't.

Appreciate the professional update... thanks!

Real witnessing.

Congratulations @gtg, this post is the third most rewarded post (based on pending payouts) in the last 12 hours written by a Superhero or Legend account holder (accounts hold greater than 100 Mega Vests). The total number of posts by Superhero and Legend account holders during this period was 35 and the total pending payments to posts in these categories was $2698.86. To see the full list of highest paid posts across all accounts categories, click here.

If you do not wish to receive these messages in future, please reply stop to this comment.

Good to know that. Thanks for the news. :)

Can we get more updates on steemauto pressure......I wanna know what it's used for!!!

thanks for the information, because it is very useful for myself****

Thank you so much for sharing those important informations sir . I am new to steemit. Your post will be so helpful for me in future . Regards @gtg

Please upvote me

No.
Why would I?
Have you made any meaningful comment to respond to my post?
You didn't even upvoted it, and yet spamming all around begging random people to upvote you.
You didn't even read it because you are not voting for witnesses (any of them).
Oh wait, maybe you are creating original, high quality content?
No.
Almost all of your posts are copied content, including copied content from other Steemians.
You won't get far with such behavior. Find a good way for utilizing power of this platform or just stop using it to not waste your own time and others.
TL;DR: copied content and comments like yours are worthless.

For follows upvote steemar friend plz

Sorry, what?

That is a great job my dear it is more powerful now thank you

Wow how to post it very nice and interesting can naikin video photos and anything if possible know how
@gtg please visit my blog and my friends that they all need help from you

Hello the latest bitcoin news here @sadikBattaloglu

And why are you spamming here?

Because automated spam? 😁

নাচ কারে কয় আমার দেখা সেরা নাচ | না দেখলে চরম মিস |2018
http://1ink.cc/1AKC9
Vadaima ভাদাইমার রেসলিং - New Bangla Funny Video 2018 |
http://1ink.cc/Yrit5
হারুন কিসিঞ্জার নতুন নাটক 2018 | Beyakkel Vatija | Harun Kisinger Natok 2018
http://gestyy.com/wcB3T3
স্বামীর চেয়ে বউ কোন অংশে কম নয় এমন মজার কৌতুক আগে দেখিনি। ( হারুন কিসিঞ্জার)
http://1ink.cc/uDSop
নিজের বউ কে এভাবেই অন্যের কাছে বর্গা দিলো এই স্বামী/2018
http://gestyy.com/wcB67u

Cool, you have won a flag. A big one.