It’s been a while since I’ve worked on IndieWeb stuff, but I finally got around to releasing an extremely preliminary version of reblob, a little commandline thingus to make this stuff easier. Eventually I’ll also have a server-based version here, at least as an example.
I’ve now released Publ v0.3.22, which is mostly a bugfix release but also adds a couple of useful things. Major changes:
- Entries which are set to status
GONEno longer function as path-alias redirections
tags, allowing templates to build in tag browsing
viewnow has tag refinements, making it easier to modify views' tag restrictions
- Fixed a silly bug which was causing top-level categories to not redirect without a trailing
- Also did a bunch of refactoring on image handling, with no functionality change but it makes the code easier to navigate (I hope)
Oh and I guess I forgot to post a release announcement of v0.3.21 back on April 2, oops! There were some pretty major fixes to that:
- Somehow the
<img alt>attribute got turned to
<img alt_text>, which is not valid. That has been fixed. (I suspect I was really tired when I was reorganizing some code.)
- JPEGs now correctly support EXIF orientations/rotations
- Added support for
entry.summary, as well as overriding the summary text on an entry..
Also, how did I miss that v0.3.21’s release was on the first anniversary of my first functioning blog post?! Wow, time flies.
I have released v0.2.5 of Pushl. The changes since v0.2.4:
- Improved the logging levels a bunch, making them more useful
- Added the ability to only send WebSub for feeds
The latter improvement makes it so that if your site is accessible from multiple URLs (e.g.
https, or multiple domain names), it won’t send multiple Webmentions to everyone with each possible URL. This helps to cut down on spamminess to sites which don’t detect multi-origin pings (such as most IndieWeb blogs or fed.brid.gy).
I also finally added a tools page to this website, to collect useful things that make Publ work better with other things. I also intend to add various useful quality-of-life things like an image cropping tool, and whatever else might occur to me down the road.
Someday I need to get around to making a proper “Features” page for this site, too. Someday…
Yep, it’s another release. New stuff in this one:
- Changed cropping to be
(x,y,w,h)(as previously mentioned) and also changed scale-cropping to be a single-pass operation
- Added a
tagsproperty to view objects
Also, on an administrative note, if you would like to help fund the development of Publ, I have switched from Patreon to Liberapay, which provides a bunch of advantages over Patreon and is much better-suited to open-source development.
While trying to figure out some weird access patterns on the day-job site I had the realization Pushl wasn’t actually specifying a user-agent, so it was just coming through as the generic
aiohttp one, which isn’t very friendly.
Now it sends a reasonable user-agent by default, and this can be overridden by the
--user-agent flag if you want to for your own analytics or whatever.
Oh, and I had quietly released 0.2.3 a few days ago; there were just some minor internal changes to logging and also declaring Pushl as beta, rather than alpha, software.
I’ve done a bunch more work on Pushl to try to get it more stable. In particular, I’ve made it so that it will only recurse into feeds that are on domains that were declared in the initial requests, and I seem to have cleared up some cases which were causing it to hang and also added a global timeout which will, hopefully, prevent it from hanging indefinitely.
I do wish I could figure out what is causing the hangs when they do happen though. Oh well. Some discussion of the issue below the cut.
I’ve been working on getting Pushl much more stable and reliable, particularly around a persistent “too many open files” error I was having, which turned out to be primarily due to a fd leak in the caching routines. Oops.
Anyway, there’s also seemingly a problem with how
aiohttp manages its connection pool, at least on macOS, so I’ve disabled connection keep-alive by default. However, if you still want to use keep-alive, there’s now a
--keepalive option to allow you to do that. I’m finding that it doesn’t really improve performance all that much anyway.
This is feeling beta-ready but I’ll give it a few days for other issues to shake out first.
The main thing is now it’s using async I/O instead of thread-per-connection, so it’s way more efficient and also times out correctly.
And oh gosh, I had so many tiny but critical errors in the way caching was implemented – no wonder it kept on acting as if there was no cached state. Yeesh.
Anyway, I’ll let this run on my site for a few days and if I like what I see I’ll upgrade it to beta status on PyPI.
I’ve released Publ v0.3.19, which now finally has a tagging system, which is only one of the oldest issues that was still open.
Here’s a list of what’s been added or changed since 0.3.18:
- The test site is now part of the Publ repository itself (as mentioned previously)
fullsize_cropto image renditions (although I’ve already decided the format should be different after using this for a day)
- Fixed an issue with unpaged archive links getting filtered
- Prune missing files from the index
I finally got my first contribution to Publ, which is really great, but it led to me finally realizing that putting the smoke tests for the software in the main site wasn’t so great. So the tests have been moved into the library itself, so they’re only really visible to people who are actually working on the code for Publ itself.
Eventually I’ll make a “features” section that demonstrates the features of Publ instead, since some of the tests were used (clumsily) for that purpose.
While I’m here, I figured I’d mention that the day job’s website is now running on Publ. Woo.
I’ve just released v0.3.18, with the following changes:
- Add date grouping properties to entry
- Add a
- Provide the current
categoryobject to the error handler
- Support linking to non-image/non-entry local files
- Added, then removed, some performance micro-optimizations that only caused problems
More details about the major changes below!
Update: I released a hotfix as 0.3.18.1 because there was a last-minute bug that snuck in while I was trying to silence a new pylint error. Oops.
Just some little fixes that I put in for the sake of the day job:
- Fixed the way that
get_view()et al parse the parameters, so now you can actually search for
- Fixed the sort order of recursive
Just another minor release of Publ! Mostly bugfixes. Here’s what’s new:
- Fixed an issue with HTML
<img>rewriting with non-lowercase attribute names
- Fixed a bug with missing entries causing Publ to die when it tried to remove them from the index
- Some code cleanups, especially removing some unneeded backwards compatibility shims for unsupported versions of Python
Redirect-Towill now resolve link targets
category.root, I’d neglected to add
category.breadcrumb to the manual when that functionality went in, and I’ve also added some usage examples, including something useful for fancy navigation bars.
For those folks who want to import their content from Movable Type over to Publ, I’ve finally gotten around to writing an importer. Currently it only attempts to convert entry content and category metadata, and only using SQLite-formatted database dumps.
README.md for the (incredibly rough) usage instructions.
Eventually I want to try to automatically convert templates from MT’s scripting language to Jinja-Publ templates, although there’s a bunch of stuff that’s going to be difficult to port across and a lot of stuff is just plain not feasible to even try, so don’t expect that to become a major thing any time soon.
It’s been a while since I’ve had a chance to work on Publ, but the great thing is that I actually had a reason to work on it for my day job. Which is to say I’m finally being paid to work on Publ. ;)
Changes since 0.3.14:
- Add requirement for Arrow 0.13.0 (issue 41)
- Fix a dumb tpyo that was the cause of issue 158
- Don’t rewrite DRAFT files; fixes 137
- Move sample-site files back to the library repo rather than in the doc repo
- Fix the way we map malformed category URLs (issue 156)
- Update upstream library versions
- Move version number to publ module
- Allow empty slug-text in entry route (fixes 161)
- Process HTML entries, to finally handle issues 136 and 154.
Some more information about that last one under the cut!
I ended up doing some more work on Pushl and have now released v0.1.7. The major changes:
- Did a bunch of refactoring to make the code a little cleaner and handle configuration more appropriately
- Added a configurable timeout for connections (which now defaults to 15)
- Added a
--versionoption on the command line arguments
Also, some suggested usage ideas below the cut!
It’s been a while since I’ve updated Pushl but today I released v0.1.6. It includes the following fixes:
- Now it supports Pingback as well as Webmention
- Improved the threading defaults and connection pooling
- Also checks entries for updates even if the feed didn’t change (in case something changed in the more text or page metadata or whatever)
Anyway, it should just be a
pip install --upgrade pushl (or
pipenv update) away.
Version 0.3.14 of Publ is now released!
This update is mostly about image stuff:
- Fixed a subtle caching bug that affects sites accessible from multiple URLs
- Fixed the way that size-clamping (
max_widthet al) work on remote and static images
- Enable JPEG optimization in the image renderer
- Add the ability to link to local rendered images in a Markdown link
Also, if you’re using Publ and hosting your repository on GitHub you may have gotten a security warning regarding the version of pyyaml that Publ depends on. Don’t worry, Publ doesn’t actually use the vulnerable code (it’s actually pulled in by one of the utility scripts from the watchdog library, and not used by watchdog itself). Watchdog has an open issue about this and they’re on track to fix it Real Soon Now.
In the future Publ may actually pull in pyyaml itself for the friends-only functionality, but when it does you can be sure it’ll be a current version. :)
While I’m fixing random stuff in Publ, I figured I’d finally fix some problems with Pushl too. Nothing major here, just:
- Stability: Fixed a bug where feeds that don’t declare links caused the worker to die before entries got processed
- Performance: Now we use a global connection pool (so connections can be reused)
- Fixed a minor correctness issue with archive feeds (which actually doesn’t make any difference in the real world but whatever)
Happy solstice! I seem to be finding lots of stuff to fix and improve these days. Huh.
Changes since v0.3.12:
- Fixed a date display issue on databases other than SQLite
- Fixed an issue where markup was being emitted in the
<og:title>element for OpenGraph cards
- Fixed a bug which prevented entry files from being moved (a side-effect of the Windows compatibility fixes)
- Added the ability to override title sort
- Also added the ability to use anchors on resolved entry links