Problem with junk and spam filters

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

Problem with junk and spam filters

Dennis Myhand
Is there a special trick to getting the filters to work?  They do not
seem to work at all on my Ubuntu 5.10 system.  If I make a filter that
is supposed to check the subject for breaking news in the subject line I
still get e-mail with breaking news in the subject line.  Under setting
I have checked both "Check incoming mail for junk," and "Include remote
tests."  Evolution is 2.4.1.  Thanks, Dennis

_______________________________________________
Evolution-list mailing list
[hidden email]
http://mail.gnome.org/mailman/listinfo/evolution-list
Reply | Threaded
Open this post in threaded view
|

Re: Problem with junk and spam filters

Andre Klapper
hi dennis,

Am Donnerstag, den 24.11.2005, 15:41 -0600 schrieb Dennis Myhand:
> Is there a special trick to getting the filters to work?  They do not
> seem to work at all on my Ubuntu 5.10 system.  If I make a filter that
> is supposed to check the subject for breaking news in the subject line I
> still get e-mail with breaking news in the subject line.  Under setting
> I have checked both "Check incoming mail for junk," and "Include remote
> tests."  Evolution is 2.4.1.  Thanks, Dennis

either you use message filters to move messages to other folders than
inbox (which has nothing to do with spam filtering at all, so please
tell us the action of the filter rule you have set up) or you want to
use the built-in spam filter.
for the latter one, make sure that SpamAssassin is installed on your
system and that the sa-plugin is enabled (see "Edit | Plugins").
also, SpamAssassin needs at least 200 messages marked as spam or ham to
kick in, so you have to train your filter.

cheers,
andre

--
 mailto:[hidden email] | failed!
 http://www.iomc.de

_______________________________________________
Evolution-list mailing list
[hidden email]
http://mail.gnome.org/mailman/listinfo/evolution-list

signature.asc (196 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Problem with junk and spam filters

Karsten Bräckelmann-2

> for the latter one, make sure that SpamAssassin is installed on your
> system and that the sa-plugin is enabled (see "Edit | Plugins").
> also, SpamAssassin needs at least 200 messages marked as spam or ham to
> kick in, so you have to train your filter.

Slight correction: SpamAssassins built-in /Bayes/ filters need to be
trained. The default SA rules work from the very first message, as do
the network tests. Bayes needs to learn 200 Spam and Ham /each/, before
kicking in (default install).

Note: "Learn", not identify. Messages are learned either by manually
classifying them, or if a certain threshold is reached (which is more
extreme than the line between Spam and Ham.

...guenther


--
char *t="\10pse\0r\0dtu\0.@ghno\x4e\xc8\x79\xf4\xab\x51\x8a\x10\xf4\xf4\xc4";
main(){ char h,m=h=*t++,*x=t+2*h,c,i,l=*x,s=0; for (i=0;i<l;i++){ i%8? c<<=1:
(c=*++x); c&128 && (s+=h); if (!(h>>=1)||!t[s+h]){ putchar(t[s]);h=m;s=0; }}}

_______________________________________________
Evolution-list mailing list
[hidden email]
http://mail.gnome.org/mailman/listinfo/evolution-list
Reply | Threaded
Open this post in threaded view
|

Re: Problem with junk and spam filters

Brian Whiting
On Sat, 2005-11-26 at 23:59 +0100, guenther wrote:

> Slight correction: SpamAssassins built-in /Bayes/ filters need to be
> trained. The default SA rules work from the very first message, as do
> the network tests. Bayes needs to learn 200 Spam and Ham /each/, before
> kicking in (default install).
>
> Note: "Learn", not identify. Messages are learned either by manually
> classifying them, or if a certain threshold is reached (which is more
> extreme than the line between Spam and Ham.
If I click the "junk" button on a message, is that a "learned" message
or just "identified"?
>
> ...guenther
>
Brian

_______________________________________________
Evolution-list mailing list
[hidden email]
http://mail.gnome.org/mailman/listinfo/evolution-list
Reply | Threaded
Open this post in threaded view
|

Re: Problem with junk and spam filters

Karsten Bräckelmann-2

> > Slight correction: SpamAssassins built-in /Bayes/ filters need to be
> > trained. The default SA rules work from the very first message, as do
> > the network tests. Bayes needs to learn 200 Spam and Ham /each/, before
> > kicking in (default install).
> >
> > Note: "Learn", not identify. Messages are learned either by manually
> > classifying them, or if a certain threshold is reached (which is more
> > extreme than the line between Spam and Ham.
>
> If I click the "junk" button on a message, is that a "learned" message
> or just "identified"?

Learned. That's what I expressed by "manually classifying". If you
manually classify a mail as either Junk or non Junk (using the Evo UI),
those mails are being re-fed to SA for learning. Sorry, if this wasn't
obvious.

All mails "identified" as being Spam by SA will end up in your Junk
folder. Although they [1] might not have been learned as being Spam, if
they score high enough to be considered Spam but not high enough to
reach the threshold. This is for safety -- SA itself learnes mails as
Spam or Ham only, if it really feels confident. ;)

...guenther


[1] Actually, "mails" are never learned. Their contents, the words are
learned and identified with the overall score of the message. So
according to the Bayes filter, some words are strong signs of being
either Ham or Spam, whereas others aren't. (Basically, just keep in mind
that words are learned, rather than entire mails.)


--
char *t="\10pse\0r\0dtu\0.@ghno\x4e\xc8\x79\xf4\xab\x51\x8a\x10\xf4\xf4\xc4";
main(){ char h,m=h=*t++,*x=t+2*h,c,i,l=*x,s=0; for (i=0;i<l;i++){ i%8? c<<=1:
(c=*++x); c&128 && (s+=h); if (!(h>>=1)||!t[s+h]){ putchar(t[s]);h=m;s=0; }}}

_______________________________________________
Evolution-list mailing list
[hidden email]
http://mail.gnome.org/mailman/listinfo/evolution-list
Reply | Threaded
Open this post in threaded view
|

Re: Problem with junk and spam filters

Brian Whiting
On Sun, 2005-12-04 at 01:38 +0100, guenther wrote:
> > > Slight correction: SpamAssassins built-in /Bayes/ filters need to be
> > > trained. The default SA rules work from the very first message, as do
> > > the network tests. Bayes needs to learn 200 Spam and Ham /each/, before
> > > kicking in (default install).
> > >
<snip>

> [1] Actually, "mails" are never learned. Their contents, the words are
> learned and identified with the overall score of the message. So
> according to the Bayes filter, some words are strong signs of being
> either Ham or Spam, whereas others aren't. (Basically, just keep in mind
> that words are learned, rather than entire mails.)

I find that the "learning" is still producing too many negatives.  I'm
getting repeat spam that is similar to "learned" messages.
I found my SpamAssassin settings in webmin & the "Hits above which a
message is considered spam" setting is at 5.  I don't know what a good
SA setting is for this.  I'd like to make it more discriminating in
reasonable steps, but need some practical pointers for a good way to
fine tune it.  Is there a generally accepted start setting for this? Are
the other settings more applicable to it?  I have:
Hits above which a message is considered spam 5
Whitelist score factor .5
Number of times to check From: address MX 2
Seconds to wait between MX checks 2
Skip RBL open-relay check? No
Seconds to wait for RBL queries 30
Number of Received: headers to check with RBL  2




_______________________________________________
Evolution-list mailing list
[hidden email]
http://mail.gnome.org/mailman/listinfo/evolution-list
Reply | Threaded
Open this post in threaded view
|

Re: Problem with junk and spam filters

Karsten Bräckelmann-2
Well, this thread is getting a little off-topic for this particular
list, but anyway... :)

On Tue, 2005-12-06 at 07:51 -0500, Brian Whiting wrote:

> On Sun, 2005-12-04 at 01:38 +0100, guenther wrote:
> > > > Slight correction: SpamAssassins built-in /Bayes/ filters need to be
> > > > trained. The default SA rules work from the very first message, as do
> > > > the network tests. Bayes needs to learn 200 Spam and Ham /each/, before
> > > > kicking in (default install).
> > > >
> <snip>
>
> > [1] Actually, "mails" are never learned. Their contents, the words are
> > learned and identified with the overall score of the message. So
> > according to the Bayes filter, some words are strong signs of being
> > either Ham or Spam, whereas others aren't. (Basically, just keep in mind
> > that words are learned, rather than entire mails.)
>
> I find that the "learning" is still producing too many negatives.  I'm
> getting repeat spam that is similar to "learned" messages.

I assume your Bayes filter did not learn the necessary 200 ham and spam
messages each. See above.


> I found my SpamAssassin settings in webmin & the "Hits above which a
> message is considered spam" setting is at 5.  I don't know what a good
> SA setting is for this.  I'd like to make it more discriminating in
> reasonable steps, but need some practical pointers for a good way to
> fine tune it.  Is there a generally accepted start setting for this? Are
> the other settings more applicable to it?  I have:

> Hits above which a message is considered spam 5

Yes, this is the "generally accepted" setting. It is the SA default. I
highly recommend to keep this, unless you really know about SA internals
and what you are doing.


> Whitelist score factor .5
> Number of times to check From: address MX 2
> Seconds to wait between MX checks 2
> Skip RBL open-relay check? No
> Seconds to wait for RBL queries 30
> Number of Received: headers to check with RBL  2

Well, I do use SA for years already, though I never ever touched the
webmin module for it. :)  I assume these are default values, so they are
just fine.

Btw, most of em are effective only, if you do have "network tests"
enabled for your Evolution mail accounts Junk settings...

...guenther


--
char *t="\10pse\0r\0dtu\0.@ghno\x4e\xc8\x79\xf4\xab\x51\x8a\x10\xf4\xf4\xc4";
main(){ char h,m=h=*t++,*x=t+2*h,c,i,l=*x,s=0; for (i=0;i<l;i++){ i%8? c<<=1:
(c=*++x); c&128 && (s+=h); if (!(h>>=1)||!t[s+h]){ putchar(t[s]);h=m;s=0; }}}

_______________________________________________
Evolution-list mailing list
[hidden email]
http://mail.gnome.org/mailman/listinfo/evolution-list