Spam e-mail is now officially near epidemic levels. Anti-spam software firm MessageLabs says that 53 percent of e-mail received in the UK is spam. In the US it has now reached 78 percent. So isn't it time service providers (ISPs) took more action to stamp out spam before it reaches subscribers?
Some of the larger ISPs already believe they are. Last month, AOL announced that it was filtering
out 2 billion spam e-mails a day. Yahoo! and Hotmail filter out about 1 billion each.
ILLUSTRATION MOUNTAIN PEOPLE
In the UK, the Internet Service Providers Association (ISPA), which represents the interests of about 100 British ISPs, says spam should be tackled at all levels: by legislation, by consumer awareness of desktop spam blockers, and by ISPs themselves.
But the ISPA admits that many of its members do not have anti-spam filtering in place because they are concerned about how to make it pay. In addition, it says they are finding it complex negotiating their way around the legal issues of blocking spam on behalf of users. As a result, the ISPA recommends that ISPs offer centralized filtering services as well as urging subscribers to install anti-spam software at the desktop -- a double defense against spam.
The reality is that most ISPs do a certain amount of filtering that is never seen by subscribers. They monitor bulk e-mails and use blacklists provided by spam watchers to block those that they believe are from known spam-mers or carrying viruses -- so called "blackholing."
But filtering e-mail before it gets to users is somewhat problematic. The main concern is the issue of "false positives" -- the blocking of e-mails that subscribers actually want, or that have been sent by legitimate e-mail marketers.
Most spam filters get around this to some degree by placing spam in an accessible folder for a defined period of time: users can look through the spam folder if they wish. Once they have found that the filters are working effectively, users rarely check, but it only needs a few to complain about losing important e-mail to cause a problem.
Another drawback with spam folders is that they put a storage burden on the ISP while it temporarily holds huge volumes of filtered e-mails. AOL tackles this problem by operating a two-tier system: it filters some spam centrally and also gets its subscribers to install anti-spam software on their desktops for free, setting up a spam folder for them to manage. This software allows spam to be blocked collaboratively, in that information about the spam blocked by users is fed back to
the in-house system.
But AOL has been criticized for its in-house filtering. In 2002, it angered US publisher ZDnet because it was filtering out ZDnet's e-mail newsletters. More recently, it has been involved in a legal dispute with US web-hosting company C I Host, which claims its customers are being unfairly filtered by AOL. AOL maintains it is only filtering out bulk mail that its subscribers have rejected.
Not surprisingly, the direct marketing industry is monitoring the situation, bolstered by recent research by Return Path which found that 17 percent of legitimate e-mails were being blocked by America's top 12 ISPs. In the US, a marketing e-mail is allowed unless a subscriber chooses to opt out, whereas in Europe it can only be sent if the receiver has opted in.
Some ISPs are still testing filtering with small numbers of users before a full-scale roll out. In the UK for example, Pipex has been running a service using Brightmail software for 1,500 Cix subscribers as part of a bundle of services costing ?7 (US$13) per month.
But Pipex found that, despite the small number of users, the service has been unable to cope with the volume of spam and was not filtering satisfactorily. It now plans to install a new system using different technology, which it hopes will be more effective.
BT Yahoo! also started filtering using Brightmail last year, but switched to the Spamguard system developed by Yahoo! so that it could offer users more customization. Like AOL's system, which swallows the cost, it is essentially collaborative in that it uses spam reports from subscribers to constantly update the database of known spam.
Mike Galvin, director of online services at BT Retail, says that around 50 percent of BT Yahoo!'s traffic is spam, which is filtered directly or ends up in users' spam folders. Users have up to four weeks to check before spams are automatically deleted. BT typically handles 25 million e-mails a day, but recently this jumped to 100 million when it was the victim of a spam attack.
Galvin is at pains to point out the central conundrum for ISPs: "There is no agreed definition of what spam is, but we say it's anything that causes distress to a subscriber."
He says that BT has won court cases against e-mail marketers who claim they are being unfairly filtered on the basis of this definition, but admits that BT has had the same problem as AOL in occasionally blacklisting legitimate newsletters due to the difficulty of differentiating such e-mails from spam. He estimates that the service, which is free, cuts spam to an average of 10 percent.
He says: "I think spam is peaking now: it will slowly begin to be less of a problem because the software is getting more sophisticated and ISPs are working more collaboratively."
But not everyone is so optimistic, and Dan Scobie, business solutions manger at Star Internet, reckons most ISPs are still not doing enough: "There is something of a wall of silence on the matter.
Most ISPs don't want to invest in these services right now, but I question their thinking. How can they afford not to do it? ISPs are expected to protect their customers: the industry has to face up to this," he said.
Scobie is convinced that ISPs can cover the cost of anti-spam services if they charge appropriate amounts. Star Internet
runs an anti-spam service using MessageLabs' CleanMail software, which costs around ?1 (US$1.80) per month.
But he admits that Star also faces the "false positives" problem, and says the company is about to introduce spam folders so that subscribers can keep an eye on the filtering themselves.
It will hold spam for 24 hours before it's deleted.
Graham Cluley, senior
technology consultant at anti-virus vendor Sophos, believes that the in-house approach is often not effective enough: "The anti-spam technology is often failing to deliver effective barriers against spam and in-house solutions often fall short of users' expectations."
He blames the problems on poor installations and ineffective product updates.
It is employment pass renewal season in Singapore, and the new regime is dominating the conversation at after-work cocktails on Fridays. From September, overseas employees on a work visa would need to fulfill the city-state’s new points-based system, and earn a minimum salary threshold to stay in their jobs. While this mirrors what happens in other countries, it risks turning foreign companies away, and could tarnish the nation’s image as a global business hub. The program was announced in 2022 in a bid to promote fair hiring practices. Points are awarded for how a candidate’s salary compares with local peers, along
China last month enacted legislation to punish —including with the death penalty — “die-hard Taiwanese independence separatists.” The country’s leaders, including Chinese President Xi Jinping (習近平), need to be reminded about what the Chinese Communist Party (CCP) has said and done in the past. They should think about whether those historical figures were also die-hard advocates of Taiwanese independence. The Taiwanese Communist Party was established in the Shanghai French Concession in April 1928, with a political charter that included the slogans “Long live the independence of the Taiwanese people” and “Establish a republic of Taiwan.” The CCP sent a representative, Peng
Japan and the Philippines on Monday signed a defense agreement that would facilitate joint drills between them. The pact was made “as both face an increasingly assertive China,” and is in line with Philippine President Ferdinand Marcos Jr’s “effort to forge security alliances to bolster the Philippine military’s limited ability to defend its territorial interests in the South China Sea,” The Associated Press (AP) said. The pact also comes on the heels of comments by former US deputy national security adviser Matt Pottinger, who said at a forum on Tuesday last week that China’s recent aggression toward the Philippines in
The Ministry of National Defense on Tuesday announced that the military would hold its annual Han Kuang exercises from July 22 to 26. Military officers said the exercises would feature unscripted war games, and a decentralized command and control structure. This year’s exercises underline the recent reforms in Taiwan’s military as it transitions from a top-down command structure to one where autonomy is pushed down to the front lines to improve decisionmaking and adaptability. Militaries around the world have been observing and studying Russia’s war in Ukraine. They have seen that the Ukrainian military has been much quicker to adapt to