However, I do wonder if we can even process all that data as the amount can increase quite fast.
If WE can't - and it's indeed too much for us - software surely can. That's why even content discovery for human-readable content like posts becomes an issue for us.