/hydrus/ - Hydrus Network

Bug reports, feature requests, and other discussion for the hydrus network.

Posting mode: Reply

Check to confirm you're not a robot
Name
Email
Subject
Comment
Password
Drawing x size canvas
File(s)

Board Rules

Max file size: 350.00 MB

Max files: 5

Max message length: 4096

Manage Board | Moderate Thread

Return | Magrathea | Catalog | Bottom

Expand All Images


Version 428 Anonymous Board owner 02/11/2021 (Thu) 03:07:04 Id: f2bee9 [Preview] No. 967
https://youtube.com/watch?v=RNPnBVHSeZc [Embed]
windows
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v428/Hydrus.Network.428.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v428/Hydrus.Network.428.-.Windows.-.Installer.exe
macOS
app: https://github.com/hydrusnetwork/hydrus/releases/download/v428/Hydrus.Network.428.-.macOS.-.App.dmg
linux
tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v428/Hydrus.Network.428.-.Linux.-.Executable.tar.gz

I had a good couple weeks working on the taglist code and some other jobs.

If you are on Windows and use the 'extract' release, you may want to do a 'clean' install this week. Extra notes below.

taglists

So, I took some time to make taglists work a lot cleaner behind the scenes and support more types of data. A heap of code is cleaner, and various small logical problems related to menus are fixed. The tag right-click menu is also more compact, quicker to see and do what you want.

The main benefits though are in the manage tags dialog. Now, the '(will display as xxx)' sibling suffix colours in the correct namespace for the sibling, and parents 'hang' underneath all tags in all the lists. It is now much easier to see why a parent or sibling is appearing for a file.

This is a first attempt. I really like how these basically work, but it can get a bit busy with many tags. With the cleaner code, it will be much easier to expand in future. I expect to add 'expand/collapse parents' settings and more sorts, and maybe shade parents a bit transparent, in the coming weeks. Please let me know how it works for you IRL and I'll keep working.

the rest

The main nitter site seems to be overloaded. They have a bunch of mirrors listed here: https://github.com/zedeus/nitter/wiki/Instances

I picked two roughly at random and added new downloaders for them. If you have Nitter subs, please move their 'sources' over, and they should start working again (they might need to do a bit of 'resync' and will complain about file limits being hit since the URLs are different, but give them time). If you would rather use another mirror, feel free to duplicate your own downloaders as well. Thanks to a user who helped here with some fixed-up parsers.

I gave the recently borked grouped 'status' sort in thread watchers and downloader pages another go, and I improved the reporting there overall. The 'working' status shouldn't flicker on and off as much, there is a new 'pending' status for downloaders waiting for a work slot, and the 'file status' icon column in galleries now shows the 'stop' symbol when files are all done.

The menu entry to 'open similar-looking files' is now further up on thumbnails' 'open' submenus.

The duplicate filter has its navigation buttons on the right-hand hover window rearranged a bit. It is silly to have both 'previous' and 'next' when there are only two files, so I merged them. You can also set 'view next' as a separate shortcut for the duplicate filter, if you want to map 'flip file' to something else just for the filter.

windows clean install

If you use the Windows installer, do not worry, these issues are fixed automatically for you from now on.

I updated to a new dev machine this week. Some libraries were updated, and there is now a dll conflict, where a dll from an older version is interfering with a new one. As it happens, the library that fails to load is one I made optional this week, so it doesn't seem to actually stop you from booting the client, but it will stop you from running the Client API in https if you never did it before (the library does ssl certificate generation).

It is good to be clean, so if you extract the Windows release, you may want to follow this guide this week: https://hydrusnetwork.github.io/hydrus/help/getting_started_installing.html#clean_installs

Remember: Don't delete your db folder.


Anonymous Board owner 02/11/2021 (Thu) 03:07:45 Id: f2bee9 [Preview] No.968 del
full list

- interesting taglist changes:
- taglists work way better behind the scenes
- when siblings display with the '(will display as xxx)' suffix, this text is now coloured by the correct namespace!
- parents now show in 'manage tags dialog' taglists! they show up just like in a write/edit tag autocomplete results list
- the tag right-click menu has had a pass. 'copy' is now at the top, the 'siblings and parents' menu is split into 'siblings' and 'parents' with counts on the top menu label and the submenus for each merged, and the 'open in new page' commands are tucked into an 'open' submenu. the menu is typically much tighter than before
- when you hit 'select files with these tags' from a taglist, the thumbgrid now takes keyboard focus if you want to hit F7 or whatever
- custom tag presentation (_options->tag presentation_, when you set to always hide namespaces or use custom namespace separator in read/search views) is more reliable across the program. it isn't perfect yet, but I'll keep working
- a heap of taglist code has been cleaned up. some weird logical issues should be better
- now the code is nicer to work with, I am interested in feedback on how to further improve display and workflows here
- .
- the rest:
- added two mirrors for nitter, whose main site is failing due to load. I added them randomly from the page here: https://github.com/zedeus/nitter/wiki/Instances . if you have nitter subs, please move their download source to one of the mirrors or set up your own url classes to other mirror addresses. thanks to a user for providing other parser fixes here
- gallery download pages now show the 'stop' character in the small file column when the files are done
- gallery download pages now report their 'working' status without flicker, and they report 'pending' when waiting for a download slot (this situation is a legacy hardcoded bottleneck that has been confusing)
- thread watchers also now have the concept of 'pending', and also report when they are next checking
- improved the new grouped status sort on gallery downloader and watcher pages. the ascending order is now DONE, working, pending, checking later (for watchers), paused
- the network request delay after a system resume is now editable under the new options->system panel. default is 15 seconds
- the 'wait on files too' option is moved from 'files and trash' to this panel
- when the 'just woke' status is active, you now get a little popup with a cancel button to override it
- 'open similar-looking files' thumbnail menu entry is moved up from file relationships to the 'open' menu
- the duplicate filter right-hand hover window no longer has both 'previous' and 'next' buttons, since they both act as 'flip', and the merged button is moved down, made bigger, and has a new icon
- added 'view next' to the duplicate filter shortcut set, so you can set a custom 'flip between pair' mapping just for that filter
- thanks to a user helping me out, I was able to figure out a set of lookups in the sibling/parent system that were performing unacceptably slow for some users. this was due to common older versions of sqlite that could not optimise a join with a multi-index OR expression. these queries are now simpler and should perform well for all clients. if your autocomplete results from a search page with thumbs were achingly slow, let me know how they work now!
- the hydrus url normalisation code now treats '+' more carefully. search queries like 6+girls should now work correctly on their own on sites where '+' is used as a tag separator. they no longer have to be mixed with other tags to work


Anonymous Board owner 02/11/2021 (Thu) 03:10:12 Id: f2bee9 [Preview] No.969 del
- small/specific stuff:
- the similar files maintenance search on shutdown now reports file progress every 10 files and initialises on 0. it also has faster startup time in all cases
- when a service is deleted, all currently open file pages will check their current file and tag domains and update to nicer defaults if they were pointed at the now-missing services
- improved missing service error handling for file searches in general--this can still hit an export folder pointed at a missing service
- improved missing service error handling for tag autocomplete searches, just in case there are still some holes here
- fixed a couple small things in the running from source help and added a bit about Visual Studio Build Tools on Windows
- PyOpenSSL is now optional. it is only needed to generate the crt/key files for https hosting. if you try to boot the server or run the client api in https without the files and without the module available to generate new ones, you now get a nice error. the availability of this library is now in the client's about window
- the mpv player will no longer throw ugly errors when you try to seek on a file that its API interface cannot support
- loading a file in the media viewer no longer waits on the file system lock on the main thread (it was, very briefly), so the UI won't hang if you click a thumb just after waking up or while a big file job is going on
- the 'just woke' code is a little cleaner all around
- the user-made downloader repository link is now more obvious on Lain's import dialog
- an old hardcoded url class sorting preference that meant gallery urls would be matched against urls before post, and post before file, is now eliminated. url classes are now just preferenced by number of path components, then how many parameters, then by example url length, with higher numbers matching first (the aim is that the more 'specific' and complicated a url class, the earlier it should attempt to match)
- updated some of the labelling in manage tag siblings and parents
- when you search autocomplete tags with short inputs, they do not currently give all 'collapsed' matching results, so an input of 'a' or '/a/' does not give the '/a/' tag. this is an artifact of the new search cache. after looking at the new code, there is no way I can currently provide these results efficiently. I tested the best I could figure out, but it would have added 20-200ms lag on all PTR searches, so instead I have made a plan to resurrect an old cache in a more efficient way. please bear with me on this problem
- tag searches that only include unusual characters like ? or & are now supported without having to lead the query with an asterisk. they will be slower than normal text search
- fixed a bug in the 'add tags before import' dialog for local imports where deleting a 'quick namespace' was not updating the tag list above
- .
- windows clean install:
- I moved to a new windows dev machine this week and a bunch of libraries were updated. I do not believe the update on Windows _needs_ a clean install this week, as a new dll conflict actually hits the coincidentally now-optional PyOpenSSL, but it is worth doing if you want to start using the Client API soon, and it has been a while, so let's be nice and clean. if you extract the release on Windows, please check out this guide: https://hydrusnetwork.github.io/hydrus/help/getting_started_installing.html#clean_installs
- the Windows installer has been updated to remove many old files. it should now do clever clean installs every week, you have nothing to worry about!™


Anonymous Board owner 02/11/2021 (Thu) 03:12:25 Id: f2bee9 [Preview] No.970 del
- boring db breakup:
- the local tags cache, which caches tags for your commonly-accessed hard drive files, is now spun off to its own module
- on invalid tag repair, the new master tags module and local tags cache are now better about forgetting broken tags
- the main service store is spun off to its own module. several instances of service creation, deletion, update and basic fetching are merged and cleaned here. should improve a couple of logical edge cases with update and reset
- .
- boring taglist changes:
- taglists no longer manage text and predicates, but a generalised item class that now handles all text/tag/predicate generation
- taglist items can occupy more than one row. all position index calculations are now separate from logical index calculations in selection, sizing, sorting, display, and navigation
- all taglist items can present multiple colours per row, like OR predicates
- items are responsible for sibling and parent presentation, decoupling a heap of list responsibility mess
- tag filter and tag colour lists are now a separate type handled by their own item types
- subordinate parent predicates (as previously shown just in write/edit autocomplete result lists) are now part of multi-row items. previously they were 'quiet' rows with special rules that hung beneath the real result. some related selection/publish logic is a bit cleaner now
- string tag items are now aware of their parents and so can present them just like autocomplete results in write/edit contexts
- the main taglist content update routines have significantly reduced overhead. the various expansions this week add some, so we'll see how this all shakes out
- the asynchronous sibling/parent update routine that populates sibling and parent data for certain lists is smarter and saves more work when data is cached
- old borked out selection/hitting-skipping code that jumped over labels and parents is now removed
- 'show siblings and parents' behaviour is more unified now. basically they don't show in read/search, but do in write/edit
- a heap of bad old taglist code has been deleted or cleaned up

next week

This was a big couple of weeks. Setting up the new dev machine--I replaced my six year old HP office computer with a nice mini-pc with an SSD--worked out great, but there were some headaches as always. The taglist work was a lot too. I'll take next week a little easier, just working misc small jobs.


Anonymous 02/11/2021 (Thu) 19:17:01 Id: 25466d [Preview] No.971 del
>>967
> picked two roughly at random and added new downloaders for them. If you have Nitter subs, please move their 'sources' over, and they should start working again (they might need to do a bit of 'resync' and will complain about file limits being hit since the URLs are different, but give them time). If you would rather use another mirror, feel free to duplicate your own downloaders as well. Thanks to a user who helped here with some fixed-up parsers.
Thanks for this. How would I go about changing for when I send links from the Companion to Hydrus?


Anonymous 02/12/2021 (Fri) 08:40:20 Id: c26ba0 [Preview] No.972 del
>>967
>I expect to add 'expand/collapse parents' settings and more sorts, and maybe shade parents a bit transparent, in the coming weeks.

Thanks for updating the manage tags window. But yes a way to display the list 'flat' like it used to would be great so that tags are sorted correctly and aren't shown multiple times. Although maybe a symbol like an arrow or something before the parent/siblings would be more visible than making them transparent. And perhaps if you try to delete the siblings/tags it should ask if you want to remove the association or the tag it's associated with.

Thanks for your hard work.


Anonymous 02/13/2021 (Sat) 08:50:29 Id: 04c9d5 [Preview] No.973 del
>>967
>windows clean install
>If you use the Windows installer, do not worry, these issues are fixed automatically for you from now on.
Am I still fine if I only use the windows installer to install/update Hydrus on a external hard drive?


Anonymous 02/17/2021 (Wed) 00:40:23 Id: 3cc9e9 [Preview] No.975 del
Thanks for the update. I'm looking forward to expand/collapse options for the taglist because it indeed can get kind of cluttered. A quickly accessible checkbox to make the lists behave as they did in v427 would be appreciated


Release Tomorrow! Anonymous Board owner 02/17/2021 (Wed) 06:01:08 Id: 17b13d [Preview] No.976 del
I had a good week fixing and cleaning little issues. The annoying popup errors some people got with the new taglists are fixed, thread watchers and multi-column lists are nicer to work with, .clip files are supported, and many file database lookups are faster.

I have some IRL going on, shuffling my day about, so I expect the release to be out several hours early.


Anonymous Board owner 02/17/2021 (Wed) 19:07:00 Id: 8bc91b [Preview] No.978 del
Sorry, I am crushed for time. I'll get to these messages and the rest of the board on Saturday.


Anonymous Board owner 02/20/2021 (Sat) 18:53:47 Id: 419245 [Preview] No.988 del
This is a slightly trickier proposition. The new downloaders are for the mirrors, so you would have to be browsing nitter.eu or nitter.nixnet.services, and then HC would recognise that as the nitter mirror and line you up correct.

If you know the downloader system well, you could probably hook up an 'API link' from nitter.com to one of the mirrors, but it would be easier just to browse a mirror instead.


Anonymous Board owner 02/20/2021 (Sat) 18:57:14 Id: 419245 [Preview] No.989 del
>>973
Yeah, as long as you are using the 'Install' option in the installer. In the second screen I think, it has a dropdown for 'install' or 'extract only'. Most people will click through it, but only the former does the cleanup.

>>972
>>975
Thanks, I agree. I'll see if I can do some this week.



Top | Catalog | Post a reply | Magrathea | Return