In general, this is definitely an area where the best approach is to just find an existing tool for what you need and use that. Especially for text data, compression is a pretty well-studied field and there are plenty of public (and open-source, if that’s a requirement) tools that will do a fantastic job at reducing size. Rolling your own is likely to result in significantly worse compression rates, and if you make an error your data could be irreparably destroyed which you won’t know until you try to access it later.

If your data is incredibly specific you might be able to do better, but it’s usually best to ignore that sort of optimization until you actually need it.

They died doing what they loved. Placing their very life into the hands of techbro con artists.

Sure, but the argument isn’t “should we ban work that is based on the study of past cultural creation” it’s “we should prevent computational/corporate exploitation of past cultural creation in order to protect the interests of humans.”

I’m not sure what EXACTLY you’d be looking for from a search feature as I’m mostly a light user myself, but there’s a search option which will search the contents of all your notes. I can’t tell you how robust it is, but it does have exclusion (desiredTerm -excludeTerm) search at least, and there’s standard Find/Replace functionality once you’re in the specific note.

The minors were charged with 20 counts of creating child sex abuse images and 20 counts of offenses against their victims’ moral integrity.

The article doesn’t make the claim that the AI is what makes it illegal, simply that AI was used. It’s literally the second sentence. Indeed, it goes on to highlight that there are legal novelties prosecuting the use of AI.

That 2600 pages of Trans hate collection is 60MB.

The article referenced is about their Desktop application

The admin has been away, and so it was basically just an error page for an extended period. Now, it seems to not be federating properly (either due to defederation, or some issue on the server side, but I honestly haven’t bothered looking into it) and bots/spam have overrun a lot of the site. The admin is apparently planning to hand over the instance which could help recover it, but it’s pretty much unusable right now.

That’s not an excellent example. If they refuse to collaborate with them, and also don’t make any claims about the quality of code, then the claim that their objectivity in reviewing code is tainted doesn’t hold.