There are known issues with joining large rooms, such as the official matrix.org room.
Largely these are already being addressed by the latest developments such as sliding sync which only load the parts of the room history needed to display the current messages on screen instead of the whole history.
Once you move to a sliding sync capable Synapse with a sliding sync server this should be a thing of the past, although it's just in testing at the moment.
@matrix Was setting up a #Matrix Synapse server to play around with today of all days, only to find that joining a handful of rooms completely maxed out the CPU and RAM, mostly because it is downloading heaps of garbage from the matrix.org Synapse.