You are viewing a single comment's thread from:

RE: I need some help with a programming task: use Python to grab a web page, and email it so the email can be read normally

in #steemit • 7 years ago

Hey @libertyteeth I tried to googl some code but to me its not totally clear what u want to achieve, so I ask back some questions:

  • Why do u want to grab a full website? Are u not interested only in a small part of it or a text out of it. Theres gonna be lots of data garbage when u store snapshots of webpages.
  • Why do u want to email a full website to u/someone? Yes there is a good reason for email programs to not allow images/javascript/external links for security reasons. And a website in email doesnt seem comfortable to me to read/watch.

One way you could achieve ur project goal as i understand it in a bit other way is:

  • Download full website and with wget and archive it in a folder.
  • For searching u could use find or linux tools to search ur full archive.
  • If u want the archive available to others, rsync to a webdrive and share it.

Cheers J

7 years ago in #steemit by
$1.37
2 votes
Reply 4
Sort:  
  • Trending
    • [-]
     7 years ago  

    Thanks! I'm working on a project to email me when there's a new post by a Steemit user. @libertyranger (no relation :) ) had created one for @haejin, but it seems to have stopped working so I figured I'd flex my development muscles.

    I've got it working, sending an SMS to my phone. I wanted to expand on it, so that it could detect (or be told) "this email is to a phone" or "this isn't to a phone" -- and for the latter, to add the entire post.

    There are two reasons for that -- first, it saves a click; the user just has to scroll down while viewing the email. Second, it preserves it for historical reasons, in case Steemit ever goes down, or the post changes, etc.

    To your questions, it's possible that I could grab a smaller portion of the blog page. I like the way my solution is trending -- but the email doesn't read well, because apparently Steemit does some loading of page elements after the HTML is loaded. Meaning, wget might not be enough, either.

    It's more for convenience than anything else, and thus really should be an "extra credit" i.e. low priority, side task. But sometimes I get stuck on something... :)

    $0.00
      Reply
      [-]
       7 years ago  

      Ive not had the time to come up with a good solution.
      But you're a dev. You'll find a way to do this.
      J J J J J

      $0.00
        Reply