Skip Navigation

Fediverse @lemmy.world

nutomic @lemmy.ml

1w ago

Ibis release 0.2.0 - Federated Wiki with Shiny Redesign

ibis.wiki /article/Ibis_release_0.2.0_-_Federated_Wiki_with_Shiny_Redesign

Fediverse @lemmy.ml

Ibis release 0.2.0 - Federated Wiki with Shiny Redesign

ibis.wiki /article/Ibis_release_0.2.0_-_Federated_Wiki_with_Shiny_Redesign

23 8

13 comments

Anyone know:
How to rip a wiki from something like fandom and save it in a format that could be uploaded to this and
If that's legal in the first place?
- It's legal if credit is given and it's shared under CC-BY-SA.
  https://www.fandom.com/licensing
  Except where otherwise permitted, the text on Fandom communities (known as “wikis”) is licensed under the Creative Commons Attribution-Share Alike License 3.0 (Unported) (CC BY-SA).
- You can get the raw article text from fandom by clicking the edit button. Then you need to convert it from wikitext to markdown, there are various tools for that. Finally post it on Ibis. Fandom also has an API, so you could write a script to automate all this.
- you might find some inspiration from https://breezewiki.com/ - either its codebase directly or using it as an intermediary while scraping
- Fandom offers database dumps in xml, see here https://community.fandom.com/wiki/Help:Database_download
- Paste each article's raw source to ChatGPT, ask it to do it for you. If there are too many, you can automate it through the API for a negligible cost.
  Is it not.
  
  Maybe also wget the website.
  I’d be careful with using “ai.” Sometimes ChatGPT makes up answers even when you provide it with the data. -source it lies to me all the time

This is a cute idea but I've generally been satisfied with the idea of using Gitit. That's a wiki backed by a git repo, so you can use normal git commands to propagate updates between servers. https://github.com/jgm/gitit or "apt install gitit".

13 comments