/hydrus/ - Hydrus Network

Bug reports, feature requests, and other discussion for the hydrus network.

Boards | Magrathea | Catalog | Bottom

Check to confirm you're not a robot
Name
Email
Subject
Comment
Password
Drawing x size canvas
File(s)

Remember to follow the rules

Max file size: 350.00 MB

Max files: 5

Max message length: 4096


Version 590 Anonymous Board owner 09/18/2024 (Wed) 21:24 Id: e6fce5 [Preview] No. 1697 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=eYN9WivpQ6M [Embed]
windows
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v590/Hydrus.Network.590.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v590/Hydrus.Network.590.-.Windows.-.Installer.exe
macOS
app: https://github.com/hydrusnetwork/hydrus/releases/download/v590/Hydrus.Network.590.-.macOS.-.App.dmg
linux
tar.zst: https://github.com/hydrusnetwork/hydrus/releases/download/v590/Hydrus.Network.590.-.Linux.-.Executable.tar.zst

I had a pretty good week and have a bunch of quality of life improvements to roll out.

Full changelog: https://hydrusnetwork.github.io/hydrus/changelog.html

highlights

The 'check now' button in 'edit subscriptions' and 'edit subscription' is now more intelligent and handles pause status. It'll ask you about paused subscriptions and queries, and it better examines and navigates what you can and will be resurrecting.

Message too long. Click here to view full text.



Simple Release Tomorrow! Anonymous Board owner 09/25/2024 (Wed) 02:57 Id: 3e7686 [Preview] No.1698 del
I had a mixed week, but I got a couple of neat things done. I fixed a handful of bugs, wrote a 'tag actually exists here' filter for tag siblings/parents export, and added local file/thumbnail path fetching to the Client API.

The release should be as normal tomorrow.



Version 589 Anonymous Board owner 09/11/2024 (Wed) 21:55 Id: 325890 [Preview] No. 1694 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=Ka4pfP2z8iA [Embed]
windows
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v589/Hydrus.Network.589.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v589/Hydrus.Network.589.-.Windows.-.Installer.exe
macOS
app: https://github.com/hydrusnetwork/hydrus/releases/download/v589/Hydrus.Network.589.-.macOS.-.App.dmg
linux
tar.zst: https://github.com/hydrusnetwork/hydrus/releases/download/v589/Hydrus.Network.589.-.Linux.-.Executable.tar.zst

I had a good couple of weeks mostly cleaning code and optimising things.

Full changelog: https://hydrusnetwork.github.io/hydrus/changelog.html

highlights

If you have a lot of files, your database update may take a couple minutes this week. Some users have had unoptimised similar-files search for a while, and this fixes it.

Message too long. Click here to view full text.



Anonymous 09/15/2024 (Sun) 15:23 Id: c2aa36 [Preview] No.1695 del
Hi dev, many moons ago back in the double digit versions I asked if there was a view to see all tags, or a count of the number of unique tags. At the time you'd mentioned that the database wasn't set up in a way that made that operation practical, and recently I've been paring down and standardizing some old tags (like starting in maybe 2016 old) so I thought I would ask if anything has changed with updates on tag meta-management.


Release Tomorrow! Anonymous Board owner 09/18/2024 (Wed) 03:06 Id: 0e7d5b [Preview] No.1696 del
I had a good week. I did the background work I wanted to do, and for the release I've got a variety of quality of life bells and whistles to roll out. Nothing huge, but a bunch of little UI improvements.

The release should be as normal tomorrow.

>>1695
Not really, I'm afraid. There's still no 'tag wiki' in hydrus, like you see in the boorus. There's some new ways to search/list all tags, or all tags of a certain namespace, under tags->manage tag display and search, so you can straight up search for '*' now, but no proper paginated tag browser.

There's much better Client API tools, though, including autocomplete search, which would allow you to inspect this stuff more programmatically or make your own tag wiki: https://hydrusnetwork.github.io/hydrus/developer_api.html#add_tags_search_tags

Maybe that would allow you to do something of what you are thinking of here. For the most part though, hydrus is still optimised to ingest as much as possible, and the PTR has like fifty or a hundred million unique tags (across 2+ billion mappings), so the various problems of presenting the 'hydrus taglist' in a form a human can handle are all the more difficult.



Version 588 Anonymous Board owner 08/28/2024 (Wed) 21:26 Id: bf4de9 [Preview] No. 1687 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=X7OpjB_8sHQ [Embed]
windows
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v588/Hydrus.Network.588.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v588/Hydrus.Network.588.-.Windows.-.Installer.exe
macOS
app: https://github.com/hydrusnetwork/hydrus/releases/download/v588/Hydrus.Network.588.-.macOS.-.App.dmg
linux
tar.zst: https://github.com/hydrusnetwork/hydrus/releases/download/v588/Hydrus.Network.588.-.Linux.-.Executable.tar.zst

I had an ok week. Multi-column lists work faster across the program.

Full changelog: https://hydrusnetwork.github.io/hydrus/changelog.html

highlights

I finished my list rewrite. Multi-column lists look and work exactly as they did before, but they initialise and sort faster. I still have some optimisation to do, but my test list of 170,000 items now sorts in about four seconds. More generally, many normal delete and insert events should have just a little less lag. I hope this makes dealing with large file logs and so on a bit less of a hassle!

Message too long. Click here to view full text.



Anonymous 08/31/2024 (Sat) 22:49 Id: 4a57b9 [Preview] No.1689 del
https://8chan.moe/t/res/15721.html#16076
> If the URL is already on a file, does pic related do it? Or are we talking file urls that might not be in this menu list?
I get the URL from a website, but I cannot download it with Hydrus, and I don't know if the file is already in Hydrus, but I want to find it there if it is.


Anonymous 09/01/2024 (Sun) 12:27 [Preview] No.1690 del
Didn't "tag display sync" (tags - sibling/parent sync - review current sync) remember the active tab? I've been having to switch it every time for a couple of versions now.


No Release Tomorrow! Anonymous Board owner 09/04/2024 (Wed) 01:05 Id: f5f315 [Preview] No.1691 del
Hey, I'm pretty sick, so no release tomorrow.

v589 should be out on the 11th. Thanks everyone!

>>1689
Ah I see, thanks. You might like to keep a page open, or save a favourite search, that has one 'system:url = http...' system predicate, and then when you want to do this search again, just open up that page and shift+double-click that predicate to edit it and paste your new URL in. Maybe that's quicker than regenerating it every time?

Another option, if you are ok doing a little bit of scripting, is asking via the Client API. You might be able to rig a .py script or something that you can paste an URL into to get a quick yes/no answer.

https://hydrusnetwork.github.io/hydrus/client_api.html
https://hydrusnetwork.github.io/hydrus/developer_api.html#add_urls_get_url_files

>>1690
If it doesn't, it should. I will check it out, thank you for the report!


Anonymous 09/08/2024 (Sun) 09:56 Id: 1372c1 [Preview] No.1692 del
>>1691
>Hey, I'm pretty sick, so no release tomorrow.
Hope you are getting well!

>shift+double-click
Didn't know that. https://hydrusnetwork.github.io/hydrus/getting_started_searching.html#editing_predicates
Yes, that's quicker, thanks.
I hadn't been using saved searches much, because I wanted to append more than replace.

>>>1690
>If it doesn't, it should. I will check it out, thank you for the report!
That made me rename my favorite tag service so it first everywhere.


I deleted a couple file services, so some watchers got "nothing", and the error message only said that there was data missing (and maybe, in the traceback, that it is a file service name), not where.


Release Tomorrow! Anonymous Board owner 09/10/2024 (Tue) 23:51 Id: b108ba [Preview] No.1693 del
I had a good couple of weeks. I mostly worked on code cleanup and optimisation, so large clients should feel snappier.

The release should be as normal tomorrow.

>>1692
I've got that dialog remembering tag service for tomorrow.

>I deleted a couple file services, so some watchers got "nothing", and the error message only said that there was data missing (and maybe, in the traceback, that it is a file service name), not where.
Interesting, I'll check what's going on here. I would have thought it should raise a nice clear error if there is no import destination. Or maybe halt all work.



Version 587 Anonymous Board owner 08/21/2024 (Wed) 21:26 Id: 93ca4c [Preview] No. 1685 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=czrmBIHANV4 [Embed]
windows
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v587/Hydrus.Network.587.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v587/Hydrus.Network.587.-.Windows.-.Installer.exe
macOS
app: https://github.com/hydrusnetwork/hydrus/releases/download/v587/Hydrus.Network.587.-.macOS.-.App.dmg
linux
tar.zst: https://github.com/hydrusnetwork/hydrus/releases/download/v587/Hydrus.Network.587.-.Linux.-.Executable.tar.zst

I had an ok week. I didn't have time to finish my big list rewrite, so I'm just rolling out some little jobs today.

Full changelog: https://hydrusnetwork.github.io/hydrus/changelog.html

highlights

I made another stupid typo last week, breaking the tags->manage tag display and search dialog! Fixed now, sorry for the trouble.

Message too long. Click here to view full text.



Release Tomorrow! Anonymous Board owner 08/28/2024 (Wed) 02:12 Id: 873bc4 [Preview] No.1686 del
I had an ok week. I finished the list rewrite, so all multi-column lists across the program now populate and sort far quicker, particularly when they have tens or hundreds of thousands of items, and I fixed some bugs.

The release should be as normal tomorrow.



Version 586 Anonymous Board owner 08/14/2024 (Wed) 22:44 Id: 7c1901 [Preview] No. 1683 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=CVAaLlOUD00 [Embed]
windows
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v586a/Hydrus.Network.586a.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v586a/Hydrus.Network.586a.-.Windows.-.Installer.exe
macOS
app: https://github.com/hydrusnetwork/hydrus/releases/download/v586a/Hydrus.Network.586a.-.macOS.-.App.dmg
linux
tar.zst: https://github.com/hydrusnetwork/hydrus/releases/download/v586a/Hydrus.Network.586a.-.Linux.-.Executable.tar.zst

Hey, I did a hotfix to fix a stupid bug when moving from videos to images. If you got the release within twenty minutes of this post going live, get the updated v586a above!

I had a great week getting siblings and parents lookups running faster and finishing some long-planned Client API work. The update may take a minute this week!

Full changelog: https://hydrusnetwork.github.io/hydrus/changelog.html

highlights

Message too long. Click here to view full text.

Edited last time by hydrus_dev on 08/15/2024 (Thu) 00:28.


Simple Release Tomorrow! Anonymous Board owner 08/20/2024 (Tue) 23:55 Id: fcbeb4 [Preview] No.1684 del
I had an ok week. I was not able to finish the list rewrite I had planned, but I did clear a mix of small jobs.

The release should be as normal tomorrow.



Version 585 Anonymous Board owner 08/07/2024 (Wed) 22:04 Id: 20471a [Preview] No. 1681 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=LREOmHLII70 [Embed]
windows
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v585/Hydrus.Network.585.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v585/Hydrus.Network.585.-.Windows.-.Installer.exe
macOS
app: https://github.com/hydrusnetwork/hydrus/releases/download/v585/Hydrus.Network.585.-.macOS.-.App.dmg
linux
tar.zst: https://github.com/hydrusnetwork/hydrus/releases/download/v585/Hydrus.Network.585.-.Linux.-.Executable.tar.zst

I had a great couple of weeks getting the tag siblings and parents dialogs to load quickly.

Full changelog: https://hydrusnetwork.github.io/hydrus/changelog.html

fast siblings and parents

The PTR has been a painful success. It is great, and I am grateful for how it keeps growing, but every time we add ten thousand or a hundred thousand new things somewhere, it lags out some bit of UI where I never thought it would be a problem. Anyone who has tried to work with PTR siblings or parents knows what I am talking about--it can take five or ten seconds, every single time, to load the manage tag siblings/parents dialogs. The same is true for anyone who has programmatically imported siblings from a booru--adding 100,000 pairs can be neat, but editing them manually is then a constant frustration.

Message too long. Click here to view full text.



Release Tomorrow! Anonymous Board owner 08/14/2024 (Wed) 01:22 Id: 508d67 [Preview] No.1682 del
I had a great week. I fixed some bugs, finished some advanced multiple local file service features for the Client API, and got siblings and parents loading faster, particularly for the new dialogs.

The release should be as normal tomorrow.



Version 584 Anonymous Board owner 07/24/2024 (Wed) 21:21 Id: cc311d [Preview] No. 1669 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=L5dcODmclFU [Embed]
windows
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v584/Hydrus.Network.584.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v584/Hydrus.Network.584.-.Windows.-.Installer.exe
macOS
app: https://github.com/hydrusnetwork/hydrus/releases/download/v584/Hydrus.Network.584.-.macOS.-.App.dmg
linux
tar.zst: https://github.com/hydrusnetwork/hydrus/releases/download/v584/Hydrus.Network.584.-.Linux.-.Executable.tar.zst

I had an ok week working on some small jobs and new Client API commands.

Full changelog: https://hydrusnetwork.github.io/hydrus/changelog.html

highlights

I fixed a bug that was allowing wasteful file re-downloads from Pixiv and Twitter. I accidentally left a hole in the recent changes to the URL 'neighbour-testing' logic, where it tries to determine if a 'already in db/previously deleted' URL determination is trustworthy, and sites where posts can have multiple files were not able to return 'already in db' or 'previously deleted' until the file itself was redownloaded. I have filled the hole in--thank you for the reports, sorry for the trouble, and let me know if you notice anything else weird going on.

Message too long. Click here to view full text.

6 posts and 2 images omitted.


Anonymous 08/04/2024 (Sun) 21:04 Id: 31fc69 [Preview] No.1676 del
>>1674
I also can't guess what in my environment would only impact PTR requests. Some weird firewall rule? Something I did to fix Hydrus years ago that is now breaking it? I'm not even 100% sure I'm on the same windows install, and I would The issue persists on a VPN, so it shouldn't be about my local network.

I'll look into it.


Release Tomorrow! Anonymous Board owner 08/07/2024 (Wed) 03:37 Id: 06457e [Preview] No.1677 del
I had an excellent couple of weeks. The manage tag siblings and parents dialogs now load and operate quickly, even when the underlying service has hundreds of thousands of pairs. I also cleared a bunch of normal small work.

The release should be as normal tomorrow.

>>1674
>>1675
>>1676
Yeah, I think you are right that this is probably something outside of hydrus, and/or something related to some borked dll somewhere.

Since it specifically cites '_ssl.c:1006' in the error, I'm pretty sure that is a .pyd file (probably _ssl.pyd either in the install dir or your python environment), or _perhaps_ some Windows dll it is calling. Since you can fetch normal https with valid certificates fine, I'm guessing this is happening because of some obscure security policy that is set in your Windows or something that requests (or the ssl pyd somehow) is force-applying despite me saying verify=false, or indeed if there is some init that happens despite the verify=false and that's triggering something else. I'm afraid I am not expert enough in this to talk too cleverly though.

Let me know what you find out! Fingers crossed, this fixes itself anyway when the guy who hosts the PTR refreshes his cert.

P.S. This is a bit in the weeds, but this is as best as I can immediately see where it is working with the 'verify=False' at the coalface: https://github.com/psf/requests/blob/79b74ef704dc0d804937c0d015c5e9c3b02b79bd/src/requests/adapters.py#L111
There's some other stuff in that same file, including line 409, where perhaps there is a route for a non-nothing cert policy to be set despite verify=False. I remembered that 'requests' is build on urllib3, so perhaps that can set a different cert security policy here.

Of course the correct answer, truly, here, is for me to write a proper management system that saves self-signed certs and lets users approve them manually, and then I'd be setting the cert to verify itself or whatever here, instead of False, although maybe that would still fail on an expired.

Message too long. Click here to view full text.



Anonymous Board owner 08/07/2024 (Wed) 03:41 Id: 06457e [Preview] No.1678 del
>>1677
As a follow-up, I was just looking through their docs--I don't suppose you have a cert file set in your environment, do you? I wonder if requests or urllib is pulling that as a fallback and since that value now isn't initialising as None, it leads to the cert policy being 'use the one from the environment'? I think it would be REQUESTS_CA_BUNDLE or CURL_CA_BUNDLE, or perhaps something similar? It would presumably have a value that pointed to a local cert file in your system dir somewhere.


Anonymous 08/07/2024 (Wed) 17:35 Id: 31fc69 [Preview] No.1679 del
>>1678
You got it, CURL_CA_BUNDLE was set by Postgres. Seems to work now. Thanks!


Anonymous Board owner 08/07/2024 (Wed) 22:04 Id: f0668f [Preview] No.1680 del
>>1679
Hell yeah! Glad we could sort it--interesting problem!



Version 583 Anonymous Board owner 07/17/2024 (Wed) 21:28 Id: cf1760 [Preview] No. 1667 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=-KWxaOmVNBE [Embed]
windows
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v583/Hydrus.Network.583.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v583/Hydrus.Network.583.-.Windows.-.Installer.exe
macOS
app: https://github.com/hydrusnetwork/hydrus/releases/download/v583/Hydrus.Network.583.-.macOS.-.App.dmg
linux
tar.zst: https://github.com/hydrusnetwork/hydrus/releases/download/v583/Hydrus.Network.583.-.Linux.-.Executable.tar.zst

I had an ok week mostly cleaning code.

Full changelog: https://hydrusnetwork.github.io/hydrus/changelog.html

highlights

The command palette (ctrl+p by default) gets some new settings under the new options->command palette panel. You can now search for page of pages, and the menubar/media actions, which were previously hidden behind advanced mode, can now be turned on or off separately. I haven't touched this thing much since it was first submitted, but let me know what you would like it to do in future. I know it currently needs some filtering to get rid of unhelpful menu actions, so let me know what is most annoying and I'll see what I can do.

Message too long. Click here to view full text.



Release Tomorrow! Anonymous Board owner 07/24/2024 (Wed) 02:16 Id: 1bceaf [Preview] No.1668 del
I had a good, simple week. I added some commands to the Client API and cleared some bug fixes and UI improvements. An issue that was causing redundant file downloads on Pixiv is fixed.



Version 582 Anonymous Board owner 07/10/2024 (Wed) 21:54 Id: bf7233 [Preview] No. 1665 [Reply] [Last 50 Posts]

Message too long. Click here to view full text.



Simple Release Tomorrow! Anonymous Board owner 07/17/2024 (Wed) 03:41 Id: 592fd2 [Preview] No.1666 del
I had an ok week mostly cleaning code. There's some new settings for the command palette, and the 'manage times' dialog gets the ability to set times to multiple domains at once.

The release should be as normal tomorrow.



Version 581 Anonymous Board owner 07/03/2024 (Wed) 21:38 Id: ffdf0a [Preview] No. 1663 [Reply] [Last 50 Posts]

Message too long. Click here to view full text.



Release Tomorrow! Anonymous Board owner 07/10/2024 (Wed) 03:40 Id: 7ca939 [Preview] No.1664 del
I had a great week working on UI fixes and quality of life. There's a new test panel for sidecars and the colours in the options->colour panel can finally be set via stylesheet.

The release should be as normal tomorrow.