Difference between revisions of "UtterChaosEmail"

From UtterChaos
Jump to: navigation, search
(Bayes score increase example)
m (Updates)
Line 1: Line 1:
This page contains information on how to use the UtterChaos email system provided on Siranna.
+
This page contains information on how to use the UtterChaos email system provided on Kemelin.
  
 
==Webmail==
 
==Webmail==
Webmail is easily accessed by connecting to https://siranna.utter-chaos.net/mail/
+
Webmail is easily accessed by connecting to https://kemelin.utter-chaos.net/horde/
  
 
The more easily remembered http://mail.utter-chaos.net will redirect you to the secure URL.
 
The more easily remembered http://mail.utter-chaos.net will redirect you to the secure URL.
Line 9: Line 9:
 
I suggest at the very least creating a Junk or Spam folder on your account and setting up a filter for incoming SPAM as follows:
 
I suggest at the very least creating a Junk or Spam folder on your account and setting up a filter for incoming SPAM as follows:
  
At mail.utter-chaos.net, Click the "Options" Tab. Then click "Mail Filters".
+
At mail.utter-chaos.net, Open the "Mail" Application. Click the "Filters" Link listed under "Mail".
  
 
Example Junk Mail Filter:
 
Example Junk Mail Filter:
Line 24: Line 24:
 
===IMAPS===
 
===IMAPS===
  
Siranna only supports IMAP connections over SSL. This keeps your passwords safe and email archive secure.
+
Kemelin only supports IMAP connections over SSL. This keeps your passwords safe and email archive secure.
  
#Configure your client to connect to siranna.utter-chaos.net on port 993 via SSL enabled IMAP. If your client does not support SSL, then you will need to find another client, figure out stunnel, or use the webmail services.
+
#Configure your client to connect to kemelin.utter-chaos.net on port 993 via SSL enabled IMAP. If your client does not support SSL, then you will need to find another client, figure out stunnel, or use the webmail services.
 
#Configure your client to use password authentication (plaintext, not CRAM) and provide your username and password as needed.
 
#Configure your client to use password authentication (plaintext, not CRAM) and provide your username and password as needed.
#If your client asks, Siranna supports having messages and subfolders in the same folder. (Mozilla & Netscape ask this)
+
#If your client asks, Kemelin supports having messages and subfolders in the same folder. (Mozilla & Netscape ask this)
  
 
===Setting up SMTPS===
 
===Setting up SMTPS===
Line 35: Line 35:
  
 
#Configure your client to send email by SMTP.
 
#Configure your client to send email by SMTP.
#Choose siranna.utter-chaos.net as your outgoing mail server. The SSL/TLS port is 25. If port 25 does not work due to your ISP blocking it, use port 26. (If you live at Utter-Chaos, use port 26.)
+
#Choose siranna.utter-chaos.net as your outgoing mail server. The SSL/TLS port is 25. If port 25 does not work due to your ISP blocking it, use port 26.
 
#Enable SSL for outgoing mail, and choose to always use SSL if appropriate for your client.
 
#Enable SSL for outgoing mail, and choose to always use SSL if appropriate for your client.
 
#Choose password authentication (not CRAM) for SMTP, and supply your username and password to your client as appropriate.
 
#Choose password authentication (not CRAM) for SMTP, and supply your username and password to your client as appropriate.
Line 45: Line 45:
 
If you have saved lots of messages (both HAM & SPAM) in separated folders, Nybble has written a script that will make use of your piles of crap that you have kept. It is important that you train it on HAM and not just SPAM. In fact, it is recommended that you use at least as much HAM as SPAM to keep the classifier from flagging too much of your real email as SPAM.
 
If you have saved lots of messages (both HAM & SPAM) in separated folders, Nybble has written a script that will make use of your piles of crap that you have kept. It is important that you train it on HAM and not just SPAM. In fact, it is recommended that you use at least as much HAM as SPAM to keep the classifier from flagging too much of your real email as SPAM.
  
#ssh to siranna.utter-chaos.net
+
#ssh to kemelin.utter-chaos.net
#Run 'learnspam.sh' at the prompt.
+
#Run 'learnspam.rb' at the prompt.
 
#Answer the questions that it asks you.
 
#Answer the questions that it asks you.
#Wait 1 hour.
+
#Wait 3 to 20 minutes depending on how long since you last ran it.
 
#'logout' or 'exit'
 
#'logout' or 'exit'
 +
  
 
For those of you who can't stay logged in for an hour to let this run, here is a quick tutorial on how to use screen:
 
For those of you who can't stay logged in for an hour to let this run, here is a quick tutorial on how to use screen:
#ssh to siranna.utter-chaos.net
+
#ssh to kemelin.utter-chaos.net
 
#Run 'screen' at the prompt
 
#Run 'screen' at the prompt
#Run 'learnspam.sh' at the new blank prompt.
+
#Run 'learnspam.rb' at the new blank prompt.
 
#Answer the questions that it asks you.
 
#Answer the questions that it asks you.
 
#Once it has started learning, type '<ctrl>a' then hit 'd'
 
#Once it has started learning, type '<ctrl>a' then hit 'd'
Line 60: Line 61:
 
#'logout' or 'exit'
 
#'logout' or 'exit'
 
at this point the learning process will continue while you do other stuff. When you want to check on it do this:
 
at this point the learning process will continue while you do other stuff. When you want to check on it do this:
#ssh to siranna.utter-chaos.net
+
#ssh to kemelin.utter-chaos.net
 
#Run 'screen -r' at the prompt
 
#Run 'screen -r' at the prompt
 
#Observe the progress
 
#Observe the progress
 
#If everything is done, then type 'exit' until you are logged out else follow step 5 above.
 
#If everything is done, then type 'exit' until you are logged out else follow step 5 above.
 
To make correcting mistakes easier, I have added SPAM/NOT SPAM buttons to the webmail interface. These buttons will tell the classifier to learn the message as the appropriate type. They do not move the message for you. I recommend placing SPAM that you have used the button on into your Junk/Spam folder so that later learning sessions can make use of it and not mistake it for HAM.
 
  
 
SPAM evolves over time so I recommend running the 'learnspam.sh' script occasionally (monthly)  or whenever it seems like it is missing lots of your SPAM or hitting lots of your HAM. Subsequent runs of the script should be faster than the first as the messages that it has already looked at before will be glossed over.
 
SPAM evolves over time so I recommend running the 'learnspam.sh' script occasionally (monthly)  or whenever it seems like it is missing lots of your SPAM or hitting lots of your HAM. Subsequent runs of the script should be faster than the first as the messages that it has already looked at before will be glossed over.
Line 72: Line 71:
 
In the event that you wish to remove or restart the classifier from scratch, this is how you delete your classifier's database.
 
In the event that you wish to remove or restart the classifier from scratch, this is how you delete your classifier's database.
  
#ssh to siranna.utter-chaos.net
+
#ssh to kemelin.utter-chaos.net
 
#Run 'rm .spamassassin/bayes*' at the prompt.
 
#Run 'rm .spamassassin/bayes*' at the prompt.
  

Revision as of 17:11, 18 October 2008

This page contains information on how to use the UtterChaos email system provided on Kemelin.

Webmail

Webmail is easily accessed by connecting to https://kemelin.utter-chaos.net/horde/

The more easily remembered http://mail.utter-chaos.net will redirect you to the secure URL.

Mail Filters

I suggest at the very least creating a Junk or Spam folder on your account and setting up a filter for incoming SPAM as follows:

At mail.utter-chaos.net, Open the "Mail" Application. Click the "Filters" Link listed under "Mail".

Example Junk Mail Filter:

If "Any Header" "Contains" "X-Spam-Status: Yes" then "move" to Folder "INBOX.Junk".

("INBOX.Junk" is some folder that you created for your spam to be dropped into. It must be created before it can be selected here.)

Additional filters can be added here as well. The filter matching program starts at the top and works its way down. It only applies the first rule that it finds.

IMAP

This page specifies the appropriate configurations for an email client to connect to your email account on Siranna.

IMAPS

Kemelin only supports IMAP connections over SSL. This keeps your passwords safe and email archive secure.

  1. Configure your client to connect to kemelin.utter-chaos.net on port 993 via SSL enabled IMAP. If your client does not support SSL, then you will need to find another client, figure out stunnel, or use the webmail services.
  2. Configure your client to use password authentication (plaintext, not CRAM) and provide your username and password as needed.
  3. If your client asks, Kemelin supports having messages and subfolders in the same folder. (Mozilla & Netscape ask this)

Setting up SMTPS

Siranna will only relay messages from authenticated users. This method uses STARTTLS (SSL) enabled SMTP with authentication to protect a user/password login.

  1. Configure your client to send email by SMTP.
  2. Choose siranna.utter-chaos.net as your outgoing mail server. The SSL/TLS port is 25. If port 25 does not work due to your ISP blocking it, use port 26.
  3. Enable SSL for outgoing mail, and choose to always use SSL if appropriate for your client.
  4. Choose password authentication (not CRAM) for SMTP, and supply your username and password to your client as appropriate.

SPAM

The antispam system on Siranna has support for a Bayesian statistical classifier. This classifier needs to be trained to identify SPAM and HAM (valid non-spam email). By default the system will try to learn what your SPAM & HAM look like based on the normal SPAM rules that are installed. This auto learning will only occur on new mail and will take take forever to learn well enough to be useful.

If you have saved lots of messages (both HAM & SPAM) in separated folders, Nybble has written a script that will make use of your piles of crap that you have kept. It is important that you train it on HAM and not just SPAM. In fact, it is recommended that you use at least as much HAM as SPAM to keep the classifier from flagging too much of your real email as SPAM.

  1. ssh to kemelin.utter-chaos.net
  2. Run 'learnspam.rb' at the prompt.
  3. Answer the questions that it asks you.
  4. Wait 3 to 20 minutes depending on how long since you last ran it.
  5. 'logout' or 'exit'


For those of you who can't stay logged in for an hour to let this run, here is a quick tutorial on how to use screen:

  1. ssh to kemelin.utter-chaos.net
  2. Run 'screen' at the prompt
  3. Run 'learnspam.rb' at the new blank prompt.
  4. Answer the questions that it asks you.
  5. Once it has started learning, type '<ctrl>a' then hit 'd'
  6. The screen will disappear leaving you with a prompt that says [detached]
  7. 'logout' or 'exit'

at this point the learning process will continue while you do other stuff. When you want to check on it do this:

  1. ssh to kemelin.utter-chaos.net
  2. Run 'screen -r' at the prompt
  3. Observe the progress
  4. If everything is done, then type 'exit' until you are logged out else follow step 5 above.

SPAM evolves over time so I recommend running the 'learnspam.sh' script occasionally (monthly) or whenever it seems like it is missing lots of your SPAM or hitting lots of your HAM. Subsequent runs of the script should be faster than the first as the messages that it has already looked at before will be glossed over.

Wiping out the SPAM classifier

In the event that you wish to remove or restart the classifier from scratch, this is how you delete your classifier's database.

  1. ssh to kemelin.utter-chaos.net
  2. Run 'rm .spamassassin/bayes*' at the prompt.

Congratulations, you no longer have a SPAM classifier. The rule based anti-spam system will still be in place.

Playing with SpamAssassin's configuration

Those of you with the desire to tweak your anti-spam system will find the preference file located in .spamassassin/user_prefs

The default config file provided should explain some of the simple settings that you can edit. These include the threshold for tripping the SPAM flag for filtering, scores for various rules, and white-listing addresses.

Some of you may want to increase the score that the SPAM classifier gets. By default the highest contribution that it will give is 3.6 while 5.0 is the default threshold. If you want the classifier to flag a message as SPAM even if there are not other rules that are triggered on that message, you should increase the score for the classifier. Add the following line to your .spamassassin/user_prefs

score BAYES_99 5.00

This will allow the classifier to trip the threshold when it thinks that a message has a probability of being SPAM of >= 99%.