Map of 2000+ lemmy communities

submitted by edited

danterious.codeberg.page/map.html

cross-posted from: lemmy.dbzer0.com/post/27579423

This is my first try at creating a map of lemmy. I based it on the overlap of commentors that visited certain communities.

I only used communities that were on the top 35 active instances for the past month and limited the comments to go back to a maximum of August 1 2024 (sometimes shorter if I got an invalid response.)

I scaled it so it was based on percentage of comments made by a commentor in that community.

Here is the code for the crawler and data that was used to make the map:

codeberg.org/danterious/Lemmy_map

64

Log in to comment

12 Comments

I can see my basement from here! Thanks!

this is really, really interesting. thank you for this.

instance reach and relationships are pretty wild and I can see this helping people to mix up their communities between instances.

the tight groupings of some instance communities might be source of pride or distress, depending.

would be nice to select a community and query its n closest overlap neighbors or all neighbors within a certain distance.

very cool project.

If I can figure that out I would definitely do that.

Anti Commercial-AI license (CC BY-NC-SA 4.0)

as a followup to how useful your visualization is, I have started spreading comments across a wider selection of instance communities.

this is something I have considered before, but your visulazation made the possible utility and usefulness of doing so much more “real”.

I only used communities that were on the top 35 active instances for the past month and limited the comments to go back to a maximum of August 1 2024

So it’s a map of the top 35 instances for the last month instead of a map of Lemmy.

The 36th most active instance is Lemy.lol with 143 monthly active users. Out of 47k total, that seems reasonable

fedidb.org/software/lemmy

Page doesnt load

Probably a webgl problem. I had to use ungoogled chromium to open the page. I think it works on regular firefox too.

Anti Commercial-AI license (CC BY-NC-SA 4.0)

I use Tor Browser. OP should generate an image or have some sort if fallback for noscript users

Comments from other communities

Language barriers. German feddit.org and Italian feddit.it are also outside. Partly that also might be a country thing. aussie.zone is also a bit outside. The other big group are defederated communities like lemmynsfw, lemmybear and hexbear.

Slrpnk is most English and many topics are relativly intressting to none instance users. So you get that. Besides a bunch of more solarpunk specific communities that is.

So federation seems to work rather well.

Yes, but I find it interesting to see that despite having a theme, slrpnk.net is as spread as generic instances and less clustered as, e.g. programming instances, lgbt, anime or nsfw ones.

I also find it interesting to see which communities bridge users from several instances: /c/ubuntu is the link between the french-speaking world and programming? /c/dragonball is the most mainstream anime community. I also find it interesting that the tankies communities, despite a few bridges, look extremely isolated.

Lemmygrad and Heybear both defederated from other lemmy instances. It is deliberatly its own little network. Both used to be reddit communites, with a long list of enemies for being tankies, so they like the isolation. Other then that I bet lemmy.ml has a lot of the same userbase.

So do I understand correctly that this is a Principal Component Analysis of the amount of SLRPNK.net users who comment on other instances? This is very cool.

Thanks for sharing this. I would also crosspost to the c/meta.

Yes, except this is of all lemmy users, not just slrpnk.net, which is just one of the instances measured.

(minor nitpick: change ‘x’ and ‘y’ to what the axes actually are)

I need to remember to check this out on desktop. It is a little flaky on mobile. It seems really interesting.

Something that I find interesting is how close the central clusters of beehaw.org, slrpnk.net, and lemmy.blahaj.zone are together. If you only highlight those instances then you see how close their communities tend to be.

Anti Commercial-AI license (CC BY-NC-SA 4.0)

Wouldn’t think music, bisexual, anime, and Jill stein would be a block, but I guess they are.

I can’t find !abc – I guess it overlaps with another community like !abolition so you can’t mouse-over it.

I don’t think it was included because there were no new comments made after august 1.

Anti Commercial-AI license (CC BY-NC-SA 4.0)

Yeah, not a lot of discussion in the community :/

Can anyone ELI5 what the axes mean?

Nothing. There were far more dimensions in the original data and the author asked the computer to squash that down into two axes in whatever way preserved groupings

One is labelled Y.

I’m assuming the other is X… but might be Z if they’re fun

I pretty much only browse /all , so I’m throwing the numbers off! I don’t know myself with which communities i interact most.

Yeah I’ve noticed there aren’t many clusters that encode specific ideas (there are a few like the anime, nsfw, or sometimes instance level clusters). Most of it just seems to be a blend. Sorta disappointing.

Anti Commercial-AI license (CC BY-NC-SA 4.0)

Are they clustered based on shared userbase?

Yeah pretty much. There is also a weighting based on the percentage of comments in that community that come from that user.

Anti Commercial-AI license (CC BY-NC-SA 4.0)

There’s not enough data yet for the noise to cancel itself out, I think.

Place and language-specific clusters are pretty coherent, if you go looking.

webGL is not available in my Browser :(

Most of the value comes from the labels which require the webGL though

by
[deleted]

I like how the vertical column just says y, and the horizontal says nothing at all!

that’s just poor cropping. The horizontal axis is labelled “x”

I’m finding new communities I want to explore from this thing. Very neat!

This is cool, keep adding more features. Not sure if my comment wishing this existed inspired you but nice to see a proof of concept!

Actually it did so thx for that.

Anti Commercial-AI license (CC BY-NC-SA 4.0)

Assuming you’re continuing to develop this, maybe try displaying it like a bubble graph with posting frequency being the bubble size, and having nodes show all of the community names inside the largest bubbles at a particular zoom level.

Allowing the user to sort the data based on different criteria would be useful too, and links between nodes showing size of shared userbase might be interesting although you couldn’t show the connection between all nodes at once. One quality of life feature that would be great is pinch to zoom in/out rather than the current selection zoom.

Would be great if eventually users could subscribe to communities directly through this as an interface.

Keep up the good work! Thanks for considering my idea!

Hey everybody, the fascism apologists are way down there in the corner! Let’s all point and laugh!