Fixed Feedjira feed parsing.
API changed in version 3.0.0 Also removed unused require statement.
View ArticleUpdated nokogiri gem 1.10.3 -> 1.10.4
Fixes vulnerability CVE-2019-5477 (https://nvd.nist.gov/vuln/detail/CVE-2019-5477)
View ArticleFaster deletion of users and feeds
When deleting a user or a feed, many depending objects are mass-deleted with a single SQL sentence (bypassing activerecord callbacks and validations), instead of instantiating each model and deleting...
View ArticleChange order of deletion
Trying to use the associated entries to reach entry_states for deletion obviously fails if entries have already been deleted.
View ArticleFixed deleting entry_states when deleting a feed
Also removed unnecessary transitive association between models.
View ArticleAdded Rails version to migrations.
Otherwise an error is raised when running all migrations since the beginning with Rails 5.2. This seems to be a new mandatory feature since Rails 5.0 Not very happy to rewrite migrations that I've...
View ArticleTemporarily disabled bootsnap gem
This is necessary to debug using latest rubymine, until these bugs are fixed: https://youtrack.jetbrains.com/issue/RUBY-24642https://github.com/denofevil/debase/issues/79 Will enable it when debugging...
View ArticleDetect duplicated entries based on content, not just guid
Unfortunately some feed owners are less than careful and change the way guids are generated for already published entries. This means that sometimes FeedBunch fetches an entry (or, usually, many in...
View ArticleRevert "Temporarily disabled bootsnap gem"
This reverts commit a65eaba749950b1f3f9223e5c4f8335751c0409e.
View ArticleMore accurate entry hashing
The hash that uniquely identifies an entry in the scope of a feed is now calculated using the concatenation of its content (if present), summary (if present) and title (which is always present). This...
View ArticleCorrect order when deleting duplicate entries in migration
Last implemented rails migration deletes duplicate entries in a single feed based on title+summary+content md5 hash, not just guid. The oldest entry for each set of duplicates in a feed is left in the...
View ArticleFixed log generation
unique_hash attribute of DeletedEntry model may be nil, we have to guard against this when generating log messages.
View ArticleWIP: validate that new entry is not already deleted using unique_hash
This complements checking for duplicate guids in deleted entries when creating a new entry.
View ArticleUse id to order entries in migration
When deleting entries with duplicate hashes in this migration it is important to leave the oldest entry alone and delete any newer duplicates. The id attribute is used in the case of duplicate entries...
View ArticleFix: allow multiple deleted entries with nil hash for the same feed
Also fix a test that should be testing for this but wasn't actually testing anything.
View ArticleFixed migration
Now it doesn't invoke activerecord validations or callbacks, which can fail if the model class is out of sync with the db schema when running the migration. Instead we use methods that update the db...
View ArticleFixed error in migration
The wrong model was being deleted. Fortunately the migration failed because it generated the wrong SQL when trying to delete records from deleted_entries; the correct thing to do is delete from...
View ArticleRewritten migrations to update db indexes
The addition of the unique_hash column to entries and deleted_entries tables means it's a good idea to drop a couple old db indexes and create new ones adding the unique_hash column in each one. The...
View Article
