Title: FeedWordPress Duplicate Post Filter
Author: Mark Allen
Published: <strong>Igbe 13, 2008</strong>
Last modified: Ẹrẹ́nà 2, 2012

---

Ṣàwárí àwọn plugin

Plugin yìí **kò tíì ṣe àyẹ̀wò pẹ̀lú àwọn ìtújáde mẹ́ta pàtàkì tó kẹ́yìn ti WordPress**.
Ó lè jẹ́ pé a kò tọ́jú tàbí ṣe àtìlẹ́yìn fún un mọ́, ó sì lè ní àwọn ọ̀ràn ìbámu
nígbà tí a bá lò ó pẹ̀lú àwọn ẹ̀yà WordPress tuntun.

![](https://s.w.org/plugins/geopattern-icon/feedwordpress-duplicate-post-filter.
svg)

# FeedWordPress Duplicate Post Filter

 Láti ọwọ́ [Mark Allen](https://profiles.wordpress.org/mrallen1/)

[Ṣe ìgbàsílẹ̀](https://downloads.wordpress.org/plugin/feedwordpress-duplicate-post-filter.1.5.zip)

 * [Àwọn àlàyé](https://yor.wordpress.org/plugins/feedwordpress-duplicate-post-filter/#description)
 * [Àwọn àgbéyẹ̀wò](https://yor.wordpress.org/plugins/feedwordpress-duplicate-post-filter/#reviews)
 *  [Ìgbéwọlẹ̀](https://yor.wordpress.org/plugins/feedwordpress-duplicate-post-filter/#installation)
 * [Ìdàgbàsókè](https://yor.wordpress.org/plugins/feedwordpress-duplicate-post-filter/#developers)

 [Ìrànlọ́wọ́](https://wordpress.org/support/plugin/feedwordpress-duplicate-post-filter/)

## Àpèjúwe

This is a filter for the FeedWordPress plugin. **If you donÌtumọ̀ Yorùbá: ’t use
FeedWordPress this plugin will not be useful to you.**

I wrote this filter after seeing the same post in my database 32 times. Maybe youÌtumọ̀
Yorùbá: ’ve had the same problem, and I hope this filter helps you solve it.

The filter works by hooking the “syndicated_post” action of FeedWordPress and the“
save_post” action in the core of WordPress.

For each potential post from a feed, the plugin attempts to find an identical SHA1
hash of the first 1024 non-whitespace characters (stripped of HTML tags) of the 
post content.
 If it finds a match the post is skipped. If not, the post is processed
and a hash is inserted into the postÌtumọ̀ Yorùbá: ’s metadata. (Stored as key _dpf.)

**NOTE:** No filter is going to be 100% accurate. This filter will stop _most_ or
_some_ duplicates, but in all likelihood, will not stop _all_ of them.
 If you want
a filter that stops _all_ duplicates, this isnÌtumọ̀ Yorùbá: ’t your solution. In
my test installation I had 5 posted duplicates out of 125 syndicated posts (4% false
negative) out of a corpus of about 300 duplicates. Most of those false negatives
were due to slightly different HTML markup in the post content itself. So my approach
isnÌtumọ̀ Yorùbá: ’t perfect, but it is “good enough” for me.

### Important Note

This filter can only check future syndication posts. Whatever duplicates are already
present in your WordPress installation youÌtumọ̀ Yorùbá: ’ll have to remove/clean-
up on your own.

### License

Copyright (C) 2012 by Mark R. Allen
 All rights reserved.

Redistribution and use in source and binary forms, with or without modification,
are permitted provided that the following conditions are met:

 * Redistributions of source code must retain the above copyright notice, this list
   of conditions and the following disclaimer.
 * Redistributions in binary form must reproduce the above copyright notice, this
   list of conditions and the following disclaimer in the documentation and/or other
   materials provided with the distribution.
 * Neither the name of Mark Allen nor the names of any contributors may be used 
   to endorse or promote products derived from this software without specific prior
   written permission.

## Ìgbéwọlẹ̀

 1. Download the plugin and uncompress it.
 2. Plop it in the same directory as feedwordpress.php
 3. Enable this filter in WordPress by visiting the “Plugin” menu and activating it.

## Àwọn àgbéyẹ̀wò

Kò sí àwọn àgbéyẹ̀wò fún plugin yìí.

## Àwọn Olùkópa & Olùgbéejáde

“FeedWordPress Duplicate Post Filter” jẹ́ ètò ìṣàmúlò orísun ṣíṣí sílẹ̀. Àwọn ènìyàn
wọ̀nyí ti ṣe ìkópa sí plugin yìí.

Àwọn Olùkópa

 *   [ Mark Allen ](https://profiles.wordpress.org/mrallen1/)

[Túmọ̀ “FeedWordPress Duplicate Post Filter” sí èdè rẹ.](https://translate.wordpress.org/projects/wp-plugins/feedwordpress-duplicate-post-filter)

### Ṣe o nífẹ̀ẹ́ sí ìdàgbàsókè?

[Ṣàwárí koodu](https://plugins.trac.wordpress.org/browser/feedwordpress-duplicate-post-filter/),
ṣàyẹ̀wò [ibi ìpamọ́ SVN](https://plugins.svn.wordpress.org/feedwordpress-duplicate-post-filter/),
tàbí ṣe àgbékalẹ̀ sí [àkọsílẹ̀ ìdàgbàsókè](https://plugins.trac.wordpress.org/log/feedwordpress-duplicate-post-filter/)
nípasẹ̀ [RSS](https://plugins.trac.wordpress.org/log/feedwordpress-duplicate-post-filter/?limit=100&mode=stop_on_copy&format=rss).

## Àkọsílẹ̀ àwọn àyípadà

1.5 Ìtumọ̀ Yorùbá: – Remove HTML tags before computing hash.

1.4 Ìtumọ̀ Yorùbá: – Overhauled strategy for duplicate detection. This works better
than previous strategies.

1.3 Ìtumọ̀ Yorùbá: – Fixed a dumb typo. Rewrote the DB query using better wpdb methods(
prepare and query). Changed from htmlescape2 to esc_html WP function.

1.2 Ìtumọ̀ Yorùbá: – Escaping the single quote (‘) character sometimes gives a conversion
of ’ instead of ’ This caused a false negative and duplicate posts would be stored.
Consider this release a temporary hack until I write a proper regex based title 
escape function.

1.1 Ìtumọ̀ Yorùbá: – Characters in post-titles like ‘&’ were not getting converted
to HTML entities. This caused the post title comparison to register a false negative.(
So duplicate posts would be added to your feed.)

1.0 Ìtumọ̀ Yorùbá: – initial release

## Àkójọpọ̀ Meta

 *  Ẹ̀yà **1.5**
 *  Ìgbàgbọ́hùn tó kẹ́yìn **ọdún 14 sẹ́yìn**
 *  Àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ **200+**
 *  Ẹ̀yà WordPress ** 2.8 tàbí ju bẹ́ẹ̀ lọ **
 *  Dánwò dé **3.3.2**
 *  Èdè
 * [English (US)](https://wordpress.org/plugins/feedwordpress-duplicate-post-filter/)
 * Àwọn àmì
 * [duplicate posts](https://yor.wordpress.org/plugins/tags/duplicate-posts/)[feedwordpress](https://yor.wordpress.org/plugins/tags/feedwordpress/)
 *  [Ìwòye Tó Péye](https://yor.wordpress.org/plugins/feedwordpress-duplicate-post-filter/advanced/)

## Àwọn ìbò

Kò sí ìwádìí tí a tíì fi ránṣẹ́.

[Your review](https://wordpress.org/support/plugin/feedwordpress-duplicate-post-filter/reviews/#new-post)

[See all reviews](https://wordpress.org/support/plugin/feedwordpress-duplicate-post-filter/reviews/)

## Àwọn Olùkópa

 *   [ Mark Allen ](https://profiles.wordpress.org/mrallen1/)

## Ìrànlọ́wọ́

Nǹkan wà tí o fẹ́ sọ? Ṣé o nílò ìrànlọ́wọ́?

 [Wo àpéjọ ìrànlọ́wọ́](https://wordpress.org/support/plugin/feedwordpress-duplicate-post-filter/)