News Posts

Posted on Sat 2018.08.11

Normal service is now resuming.

I've resolved the issue with broken updater. I had to re-provision the private SSL certificates used for the RabbitMQ broker communications.

Anyways, the RabbitMQ host server is now on Ubuntu 16.04 LTS, so it shouldn't need much for another few years other then regular updates as well.

Posted on Sat 2018.08.11

Updates are currently broken

Basically, I rebooted the rabbitmq server that manages the update communications from the web-spider backend, and rabbitmq didn't come back. It turns out that there are unhandled version incompatibilities between the latest version of erlang and the latest version of rabbitmq that is packaged by the rabbitmq devs for ubuntu 14.04.

Anyways, I'm in the process of updating the rabbitmq server, but distribution updates are always kind of dangerous, particularly when (as in this case) you use a lot of non-standard apt-get repositories. We'll see what happens.

Posted on Sun 2018.07.01

Normal service is now resuming.

The database versioning table has been migrated to a 4 TB partition, which should mean it has plenty of space to grow for the next few years.

Posted on Sun 2018.07.01

Feeds down for a little while.

I'm migrating database backing volumes. The feed feeder database is down at the moment, and it'll probably take several more hours for the copy to complete.

Posted on Mon 2017.10.16

Mitigating Qidian's annoying feeds

If you follow any of the novels posted by Qidian, you've probably noticed the annoying interstitial pages they publish for their RSS feeds, as well as the fact that the latest few chapters of every series are hidden behind a watch-an-ad/paywall.

This is annoying, as it generally means you're a few chapters behind what the site thinks is the "latest" chapter, because you can't actually view those chapters yet, making one's watches somewhat confusing.

As such, I've implemented a feed parser module that both unwraps the feed-interstitial page, and properly ignores releases you can't actually view. This should make following Qidian series much more pleasant, because you won't be falsely alerted for new chapters that aren't yet actually available.