Please also visit/star our GitHub repo [1].
Linkwarden was built using TypeScript and NextJS, backed by a PostgreSQL database for the lighter-weight data. The rest of the data can be chosen either to be stored on the filesystem, or stored on the cloud on Digital Ocean Space/AWS S3, the reason for the cloud storage solution was for the Cloud offering [2], we realized that the preserved webpages (archives) take up space pretty quickly and S3 was much more efficient for this task. On the front-end we used TailwindCSS for styling and Zustand for state management.
You could either use our Cloud offering (with 14-day free trial) to directly support this project and experience Linkwarden, or you could self-host it on your own machine and have maximum flexibility.
Feel free if you had any questions, we'll do our best to answer it.
[1]: https://github.com/linkwarden/linkwarden
[2]: https://cloud.linkwarden.app/register - Hosted in Digital Ocean's datacenter located here in Toronto, ON.
Have you considered a free tier where you could monetize it maybe via sponsorships/ads with the goal to have a social aspect?
I'm a huge fan of Githubs social trending/explore/lists/topics section for finding new tools for specific things that I work on, rust, go, aws, etc. for myself and my teams. Also things like dev.to, daily.dev, etc but they're not really as useful as I thought they'd be. You can see an example of the Lists I've created here https://github.com/mikejk8s?tab=stars - I wind up putting these lists into a team notion doc right now.
There's those "Awesome-XXYZ" lists but I don't think they're the best way to do this at all. They also wind up very out of date. My Github lists aren't collaborative, I can't give people a way to contribute to them and as far as I know they're not something you can search globally to find if someone has some interesting lists.
It's quite a bit different than what you're doing here but what I've been hoping to find was some sort of technology Looking Glass/aggregator where I could click a topic/Collection, say Rust, and see rss feeds, blogs, curated and very well organized bookmarks, hashtags of other related lists, etc in a collaborative manner with lots of contributors.
I was sort-of beginning to do this via a published notion domain and treating it like a wiki.. https://mrj84.notion.site/Go-Wiki-c637ff57e00046bfbe22fb2562... - that's the closest I've been able to brain storm as something remotely near what I'm aiming for.
Sorry for the long post, maybe it'll give you some ideas or maybe someone has some ideas for me.
Imagine deciding you want to learn a new skill and not having to start from square one learning the lay of the land around your newly chosen subculture but rather it's already been curated for you and you can hit the ground running with great links to various assets and communities like software tools, forums, discords and video tutorials. I love the archiving functionality too.
Your website looks great and all the information I needed was right there. Concise, informative and neat.
I think the real value here is a tool that will allow people of all kinds to aggregate relevant content and help onboard people to the communities they know, live and love.
I feel like a freemium model would allow this tool to reach a massive scale as I see awesome utility in it but I don't expect normal people would self host or pay for it even if it cost 10 cents. It's just too much inertia.
I feel so dirty telling you how to charge for your own product.
Pagerank and SEO killed search. What you have here sounds a hell of a lot better.
Awesome work mate! I'm aways up for a chat.
I'm using linkding at the moment https://github.com/sissbruecker/linkding which also has a browser addon, the only missing thing is some form central user auth but we're using it as it is.
And if the extra environment variables are set properly, you could hook it up using the email provider, taking care of the confirmation emails and one time links.
1. What is the driving vision behind this project? For example is this just scratching a personal itch with hopes it helps others, or is the hope to expand this into a product or company in the future?
2. Is the goal to monetize somehow in the future? If so, what sort of monetization strategies are being considered? For example, "open core", "paid hosting" (what happens to self-hosted?)
Got burned with this by cal.com self-hosted version: https://blog.vasi.li/cal-com-is-making-me-lose-faith-in-the-...
It allows you to store links (title & language of the page, a pdf of the page, assign tags, to include them in collections), it has a very simple (moderated) comment system, set status of the link (online: direct link, offline: replace link by a webarchive one) a lightweight ui (remember: no js), multi-accounts (permissions), translations, some rudimentary stats and some other things (access a random page!).
See my own instance for an example with thousands of links: https://links.l3m.in/
I haven't heard anything about this, could you elaborate or link to some article?
My ideal bookmark/page archiver would have this workflow:
1) Find a page I like or find valuable for whatever reason, so I click on a browser addon button.
2) A little dialog would then show up from the button, allowing me to set the following
2a) Add tags, as well as offer suggested tags I could add or remove.
2b) Set an optional update frequency, preferably with an option that would slowly reduce the frequency of checking for changes, first if no changes are found, and eventually as an absolute regardless of changes.
2c) Set specific technical page save settings
3) Once done, I click a “save” button in the dialog, and the page would be saved at a single html file, like the browser addon “SingleFile”, (which has some adjustable default settings previously mentioned). This allows saving pages with very simple javascript/dynamic functionality instead of essentially an static image. It also inlines some media: see https://addons.mozilla.org/en-US/firefox/addon/single-file/. That said, perhaps a WARC file may be better when it comes to handling things like compression, multiple revisions, indexing, and possibly following links to download and store linked media.
4) Then it would automatically open the saved page in the browser, so I could have a quick look can make sure it’s not broken for some reason
5) Finally it would then occasionally check for updates, saving a revision. On future visists to the page, the addon would have a little badge to let me know the page has already been saved and is being watched.
It kinda sounds like I want a browser integrated front end with sane and intuitive settings for HTTrack. As and example, let’s say I find a post on hackernews full of insightful comments about something and want to save it. The post might be new, so comments are going to continue to be added (or possibly removed, though this is more of a reddit problem) after I’ve saved the link and page. It’d also be nice to automatically grab the linked webpage for the context. Something that makes this easy would be great.
It might also be nice to be able to select comments (select elements like ublock does?) for highlighting.
Saving the page as presented in my current browser session can be vastly different vs a non-logged in guest with no changes from browser addons.
Many websites require browser addons to be tolerable. Reddit likes to hide the end of comment chains to artificially inflate their fucking click metrics, and addons are required to load those comments inline. Saving pages with ublock enabled is also a must. I think selenium can do this: https://stackoverflow.com/questions/52153398/how-can-i-add-a...
So being able to use a login token or auto login with an would be useful. It’s probably best to create a special archive only user for each website. Otherwise it’d be a nightmare trying to remove the elements such as username, favorites, subscribed, etc and make sure the redactions aren’t broken by a future site design update.
1. It supports direct binding with SingleFile, enabling one-click web page saving. Because it saves in the browser, all other plugins will take effect.
2. It provides an open-source plugin https://github.com/hamsterbase/hamsterbase-highlighter, allowing you to annotate directly in the browser, and it automatically saves a snapshot of the web page when you annotate. When you visit the page again, it automatically displays the previous snapshots.
3. All data is stored on your local device, with both a docker version and a desktop version available. Different versions support P2P synchronization.
4. Provide full-text search function, which can search all the articles on the webpage.
I understand that HN tends to be more technical, but the technical details can be a single link. Right now, all I know about your project is that it's a bookmark manager and S3 is better for storing files than the filesystem.
Good luck!
(Though I'm seeing crashes on my Mac M1, which I think is being caused by Prisma)
A few questions:
- It’s not clear if this saves highlight in Ng and annotations (notes about the highlights). More than saving a bookmark we think about a sentence that can be searchable.
- Is there any plan to save the entire webpage as text (to maintain the annotations in it) in addition to pdf and screenshot?
One product I am overly dependant on is Diigo - I would love a replacement even if it was self hosted.
So yeah we’re definitely bringing more archive formats.
In your readme, in the "A bit of history", it should be `has many fewer features`
On a more technical note, I wondered if you have any stories working with Prisma and Next? It works but every ORM has its pros and cons. My annecdote with the two is on a project recently, I had issues bundling the appropriate prisma packages during a Next standalone mode build.
If really live a way to do a text search of my bookmarks.
Going to check out Linkwarden since I really like the idea of being able to self-host something similar since Raindrop could one day disappear (#googlereaderneverforget).
A feature Raindrop has is it can export bookmarks to a standard xml file, which I then have a script that automatically adds them to Archivebox[2] for a local copy and to add them to archive.org[3].
Does Linkwarden, have a feature to automatically submit a bookmark to archive.org along with the local copy? That would greatly reduce this setup and have it all in one tool.
I was looking for alternatives but couldn't really find something great with a decent UI and full-text search.
I don't really use it interactively, it's more to have a "backup" of websites I find useful after finding some I used to reference for years disappeared and were never added to archive.org or occasionally sending the Readability/PDF versions to my Kindle.
I also setup YaCY[1] at one point with the idea of having my own local personal search engine for the archived sites, but I ended up never using it.
I import around 3k bookmarks, it starts archiving them. Immediately some archival methods fail (usually screenshot and pdf), and after archiving a few hundred bookmarks it never continues to archive the rest. I‘ve let it sit and do its thing for several days, it never manages to get through all of them (or even a sizable minority).
Different machines, different filesystems, different networks. No idea what‘s wrong.
But note that it is on the roadmap (but not top priority).
Do you have a page that shows the most popular collections?
But if you mean, searching the link details, yep.
I am pointing this out, because I wish someone would have pointed it out to me.
https://j11g.com/2023/03/04/floccus-is-the-bookmark-manager-...
Or better yet, can you elaborate on how any of the content up the chain from your comment that shows why Safari shouldn't be considered a user friendly browser?
Shiori looks like it'd work infinitely better compared to floccus. It has an extension, tags, and everything is stored in a central repository you can visit from web (or server itself) any time you want. It also archives your bookmarks. It has been working flawlessly for me for a couple of years now.
Apples and oranges.
There is a value in using native browser bookmarks and syncing them cross browsers/OS's.
I already have the ability to send my tabs across devices or sync bookmarks, it's built right into Firefox. The UI could be better, but it doesn't look like Floccus changes the browser UI, which is my primary complaint with Firefox bookmarks.
I'm not sure what I'm missing.
You can use https://github.com/ishani/xSyn for self-hosting.
I use several browser profiles (stuff like social, entertainment, dev), and now I can put the usual sites I visit with each of those in the top level of the their bookmark bar directly, but also have a single folder for the ones I want to share between all of them, yay! I am very happy right now. Thanks GP.
When I looked into it I was surprised that browsers don't have this kind of bookmark management built-in. I'd be very happy with two small additions to browsers: (1) display by / sort by date added and (2) a small separate freeform text box for notes (so I can describe why I saved the link).
(Optionally it could be nice if browsers adopted some standard sync mechanism for bookmarks, maybe based on WebDAV like the Floccus extension).
Then again, these dedicated external bookmark managers do have nice features like tags, search, and offline downloads or page screenshots. Those are all great!
Linkwarden looks like a nice product. Looks like it would tick all the boxes for my use-case and the design is pleasant. I like that it's open source and has a fair price for the hosted offering. Maybe I'll give it a try!
