Excellent tunes -- free! And on your browser right now. Just click on Radio Bojack!

Meter updates every 30 seconds. Click here for
an instant update.
Our complete Portland debt series linked here.




E-mail us here.

About

This page contains a single entry from the blog posted on November 6, 2005 10:46 PM. The previous post in this blog was I have no idea. The next post in this blog is All's well that ends well. Many more can be found on the main index page or by looking through the archives.

Links

Law
How Appealing
Bag and Baggage
TaxProf Blog
Mauled Again
Tax.com
Josh Marquis
Native America, Discovered and Conquered
The Yin Blog
OrCon Law
Ernie the Attorney
Conglomerate
Above the Law
The Volokh Conspiracy
Going Concern
myCorporateResource.com
World of Work
The Faculty Lounge

Hap'nin' Guys
Tony Pierce
Parkway Rest Stop
Utterly Boring.com
The Vig
Dwight Jaynes
Various Observations...
The Daily E-Mail
Saving James
Bob Borden
Dingleberry Gazette
The Red Electric
Positively Glorious
The Rural Bus Route
Another Blogger
The World of Today
Izzle Pfaff
Jeremy Blachman
Dean's Rhetorical Flourish
Straight White Guy
Furious Nads (b!X)
The Grich
HinesSight
Onfocus
AntSaint
Kevin Allman
Jalpuna
MTPolitics
The Naive Optimist
Beerdrinker.org
As Time Goes By
AboutItAll - Oregon
Jeff Selis
Quark Soup
Alas, a Blog
Whitman Boys
Worldwide Pablo
Misterblue
Tales from the Stump
Two Pennies
Scott Hendison
Sansego
The View Through the Windshield
Mikeyman's Computer Treehouse
Appliance Blog
The Bleat
Rosenblog

Hap'nin' Gals
My Whim is Law
I Count to 4 (Nth of Pril)
Miss in Your Business
Lelo in Nopo
Rose City Journal
Type Like the Wind
Linda Kruschke
Margaret and Helen
Kimberlee Jaynes
Evidently
And Sew It Goes
Mile 73
Frances de Florida
Rainy Day Thoughts
Ready or Not
Marchmoon Chronicles
That Black Girl
Posie Gets Cozy
Lao Ocean Girl
{A}
Cat Eyes
Chantel Williams
Kerianne
Melissa Lion
Gina Rau
Rhi in Pink
Althouse
Frytopia
Ragwaters, Bitters, and Blue Ruin
This Stony Planet
Heather Bea
GirlHacker

Portland and Oregon
Isaac Laquedem
StumptownBlogger
Rantings of a TriMet Bus Driver
Jeff Mapes
Our PDX Network
Stumptown Lunch
Amanda Fritz
PolitickerOR.com
O City Hall Reporters
RoguePundit
Guilty Carnivore
Metroblogging Portland
Old Town by Larry Norton
The Alaunt
Bend Blogs
Lost Oregon
Cafe Unknown
Tin Zeroes
Another Portland Blog
Mark Nelsen's Weather Blog
Oregon Media Central
Portland Building Ads
Portland Food and Drink.com
Dave Knows Portland
Idaho's Portugal
Alameda Old House History
MLK in Motion
LoveSalem
ORblogs Site News

Retired from Blogging
Portland Freelancer
1221 SW 4th
Twisty
I am a Fish
Here Today
What If...?
Superinky Fixations
Pinktalk
Mellow-Drama

Wonderfully Wacky
Dave Barry
Borowitz Report
Blort
Stuff White People Like
The Dullest Blog in the World
Worst of the Web
The Ultimate Insult
Scrabo's Mad World
Lancow's E-mail

Valuable Time-Wasters
My Gallery of Jacks
Litterbox, On the Prowl
Litterbox, Bag of Bones
Litterbox, Scratch
Maukie
Ride That Donkey
Singin' Horses
Rally Monkey
Simon Swears
Strong Bad's E-mail

Oregon News
KGW-TV
The Oregonian
Portland Tribune
KOIN
Willamette Week
KATU
The Sentinel
Southeast Examiner
Sellwood Bee
Mid-County Memo
Eugene Register-Guard
OPB
Topix.net - Portland
Salem Statesman-Journal
Portland Business Journal
Daily Journal of Commerce
Oregon Business
KPTV
Portland Info Net
McMinnville News Register
Lake Oswego Review
The Daily Astorian
Bend Bulletin
Corvallis Gazette-Times
Roseburg News-Review
Medford Mail-Tribune
Ashland Daily Tidings
Newport News-Times
Albany Democrat-Herald
The Eugene Weekly
Portland IndyMedia
Not the Oregonian, the Oregonion
Oregon's Future
Brainstorm Northwest
The Columbian

Music-Related
The Beatles
Bruce Springsteen
Seal
Sting
Joni Mitchell
Ella Fitzgerald
Steve Earle
Joe Ely
Stevie Wonder
Lou Rawls

E-mail, Feeds, 'n' Stuff

Sunday, November 6, 2005

Referrer spam attack! Or is it?

One of the peculiar aspects of having a blog is that you're not only a writer, but also a website administrator. If you have your own domain, you pay for bandwidth, and you allow people to come on and write whatever pops into their heads. As a result, there are things you have to watch.

And so it was with some alarm that I determined the other night that I was suddenly getting an enormous amount of traffic from a host of domains, all ending with ".listenernetwork.com/SearchWeb.asp." Before the first dot were the names of various radio stations around the country. When I went to my logs and clicked on the referral sources (or, as I've now learned, "referer" as the computer servers know it), you couldn't tell what they were searching for. But if you went to the various "listenernetwork.com" home pages, you would see that they're all a template, no doubt generated at a single location, that various radio stations use as a site for their listeners to visit. Generic and cheap, but seemingly unique at first glance. And shades of OregonLive and its sister sites in the anemic Advance Publications chain, they're all almost identical.

That was all very interesting to notice, but it didn't solve my problem. The evil hits were coming fast and heavy, and they were landing on various category archive pages on this site. After nearly three and a half years, those archive pages have gotten mighty long. And there are tons of images on them, which makes them a heavy load to send out. If that's a robot spamming me, there's going to be nothing but trouble ahead. It's going to chew up huge hunks of bandwidth, and sully my hit counter with fake traffic.

And so off I went to find a solution. Blocking the IP addresses of the visitors wouldn't work, because the hits were coming in from all sorts of different addresses, and I was sure they were all being faked. The advice I most often received was that I could keep these referrals away by making a modification to a file on my server called "htaccess." It is only with grave, grave trepidation that I mess with such things, but in the heat of yet another battle with spammers, off I went to try to set up a barrier.

Based on various highly technical posts I found on various sites, I came up with a number of different ways that it could be done. But try as I might with my limited technical skills, I couldn't keep the "listenernetwork" hits away. And so I brooded for the better part of two days about how I could save my bandwidth and keep the visits from artificially inflating my hit count.

During all this stewing, I noticed that the hostile searches all landed on the same archives on my site: Family, Food, International, National, and Nostalgia, with the last being the most prevalent. As a temporary fix, I renamed all those archives by sticking a "2" on the end of each name, and deleting the archive page that had each name on it without the "2." Sure enough, that kept "listenernetwork" referrals from making it to my hit counter -- they were still arriving, looking for, say, the "Nostalgia" archive, but instead of seeing any of my pages, they'd get a "404 - File Not Found" error. I was o.k., for now at least.

Still trickling in, though, were a smaller number of hits from various search engines, including Yahoo and a Denver newspaper's site, and on these, you could see the same bizarre search term: "What Manhattan deli served up a corned beef and tongue sandwich called 'Tongue’s for the Memory'?" While trying to figure out what to do to try to block that, it finally dawned on me that maybe that was what the listenernetwork searches were looking for, too.

Yes! Of course! It was that post I had written a while back about Hobby's Deli in Newark! Many of those search terms were in that post! And guess what? That post appears in exactly five archive categories -- the same five that were being hit by the listenernetwork searches. So the listenernetwork attack and the tongue sandwich attack were all part of one and the same evil plot, and they were all looking for the Hobby's piece.

Just for kicks, I ran the search through Google. Tons of hits, including this one as No. 1. Still no clue as to who the evil spammer is, but at last I'm getting somewhere. Then I tried running the search with the word "listnernetwork" up front, and ...

...lo and behold, the scales fell from my eyes. Check it out. It looks as though it's not a spam robot hitting my site at all, but a nationwide internet trivia quiz sponsored by a bunch of radio stations. And all those IP addresses? They may not be fake. Those may be actual radio listeners trying to earn "points" in a giveaway contest.

So what to do now? I'm thinking of taking down the defenses I've been throwing up. If those are legitimate hits, I should let my counter count them -- and just hope I don't run out of bandwidth at the end of the month. But there are so many of them, at so many odd hours, I can't believe they're all real readers. What to do?

Wherever this leads, I'm determined to figure out how to block referrals like this in the future. If "htaccess" will do it, I've got to become more expert at it and figure out how.

One last note: While checking those referral logs, I noticed that the teenagers of America are major bandwidth thieves. All those "MySpace" pages are chock full of images being lifted from other servers via hotlinks. Among the ones the teens liked best from me were this, this and this. But if they are hotlinked to the original places where I had them stored until yesterday, their sites are now displaying this. Clean up your act, kids!

P.S. To answer the trivia question, it's the Carnegie Deli. I've put up this post, with a fake date and an archive category all its own, to see if I can distract the traffic over there. I'll get the hits without the bandwidth drain.

Posted at 10:46 PM | Bookmark and Share

Comments (6)

Interesting post Jack. And I'm sure your message about stealing bandwith will stop the myspace kids from using your pictures. hahahahaha...

a more clever message would have been a picture of Nancy Regan proclaiming "Just say No".

Actually, I believe I've got them all "forbidden" now. They can steal the pictures all they want, but they'll have to show them via their own bandwidth, as they can no longer hotlink successfully to my server.

I did get a sadistic pleasure out of that "revised version." One kid had an image from my server tiled across his page as wallpaper. Wish I could be there when he saw what it looked like after my little change. Dude!

touche...

... and you have to keep this blog around, until your daughters become teenagers. Besides suicide bombers, teenagers are the most irrational group of people alive.

MySpace. If there's a bigger cesspool of inanity available on the infobahn, I'm not sure where to find it. They gleefully give Joe Average Nitwit the easy ability to create an wholly-unreadable "home page", complete with retina-searing color combinations and tiled backgrounds the likes of which went out of style... oh, about five minutes after they came INTO style, lo the many years ago. *shudder*

(Disclaimer: I have a MySpace account, but only because my closest buddies in the office have accounts there and insisted I join the collective, as it were. It's much the same with with LiveJournal... I have an LJ so I can comment on LJs.)

I am, however, curious about my website traffic for the first time in ages. Hmm, where'd I put those log processing scripts...?

The problem is that people who do not pay for bandwidth have no idea how much of someone else's they are using when they hotlink an image that will be viewed on a website (like, say, Fark.com) that gets tens of thousands of hits. I make it a rule to only hotlink images from large corporate websites--CNN, Yahoo, etc.

Just a technical point: Contrary to popular opinion, it’s nearly impossible to fake an IP address on a TCP connection. Had those been actual spambots, they would likely have used borrowed*, but real, IP addresses, i.e., when a computer gets taken over by a virus, it allows spammers to post from your computer without your knowledge.

* technical term is “trojanned”

Sponsors



We accept advertising through Blogads. If you're interested, click the "Advertise here" link above, or go here to place your ad through Blogads. For assistance, e-mail me here; I'd be glad to help. Reach lots of viewers -- we're up to about 2,800 unique visits a day, and more than 44,000 page views a week (as of October 26). Our rates are dirt cheap for the exposure you'll get!

As a lawyer/blogger, I get
to be a member of:



In Vino Veritas

Dom Martinho, Tinto 2005
Chateau St. Jean, Cabernet, California 2007
Kirkland, Napa Cabernet 2007
Revelry, The Reveler, 2007
Joseph Drouhin, Chablis 2006
Altos Las Hormigas, Mendoza Malbec 2008
Alodio, Ribeira Sacra Mencia 2007
Charles Smith, Kung Fu Girl Riesling 2008
Kiona, Lemberger 2006
Chateau Ste. Michelle, Columbia Valley Merlot 2005
Paranga, Kir-Yianni 2005
L. Guigal, Cotes du Rhone Rose 2007
Gloria Ferrer, Sonoma Brut
Kirkland, Napa Valley Meritage 2006
Abacela, Tempranillo 2006
Woodward Canyon, Columbia Valley Red
Santa Margherita, Pinot Grigio 2007
Mas Donis Barrica, Celler de Capcanes Red, 2005
Three Rivers, Merlot 2006
Raptor Ridge, Pinot Gris 2008
Lezaun, Rosado, Navarra
Lezaun, Red, Navarra
Hedges, Three Vineyards, Red Mountain 2005
Raptor Ridge, Pinot Gris 2008
Vega Sindoa, Cabernet-Tempranillo 2006
Inama, Soave Classico 2007
Alois Lageder, Lagrein Rosato 2008
Broglia, Gavi 2007
Marqués de Cáceres, Rioja Rose 2008
Spaltagna, Riserva Pinot Noir 2008
Portuga, Rose 2008
Warre's Warrior Port
Lange, Pinot Noir 2007
Chateau Guiraud, Le G, 2007
Falset, Garnacha Rose, Montsant 2006
Castello di Bossi, Chianti Classico 2004
Domaine Chandon, Pinot Noir, La Riviere Sonoma 2006
Brazin, Old Vine Zinfandel, Lodi 2006
B.R. Cohn, Silver Label Cabernet 2006
Casillero del Diablo, Cabernet 2007
Gentil Hugel, Alsace 2006
Mesoneros de Castilla, Ribero del Duero, Rosado 2008
Cor, Momentum 2007
Santa Margherita, Pinot Grigio 2006
Rubico, Lacrima di Morro d'Alba 2007
Gilstrap Brothers, Reserve Merlot 2003
Conundrum 2007
Chandler Reach, 36 Red
Santa Rita, Reserve Cabernet 2005
Marietta, Old Vine Red Lot 47
L'Ecole No. 41, Recess Red 2006
Dom Martinho, Red 2004
Beaulieu, Georges Latour 1994
Caymus, Cabernet 1995
Columbia Winery, Merlot 2005
Bergevin Lane, Columbia Valley Cabernet 2005
Savigny-les-Beaune, Les Lavieres 2003
David Hill, Reserve Merlot, Rogue Valley 2006
Educated Guess, Cabernet 2006
Maquis Lien, Red 2005
Charles Smith, Kung Fu Girl Riesling 2007
David Hill, Farmhouse White
Robert Mondavi Solaire, Cabernet 2005
Castello Monaci, Liante, Salice Salentino 2006
Ricardo Santos, Malbec 2006
Quinta da Espiga, Tinto 2006
Charles Smith, Holy Cow Merlot 2006
Charles Smith, Boom Boom Syrah 2006
Charles Smith, The Honorable Pinot Gris 2007
Santa Rita, Cabernet Reserva 2005
King Estate, Pinot Gris 2007
Gloria, Douro, Tinto 2002
Bogle, Petite Sirah Port, Clarksburg 2005
Cardwell Hill, Pinot Noir 2004
Silkwood, Red Duet Cabernet-Syrah 2004
Portuga, Vinho Branco 2006, 2007
Osborne, Solaz 2004
Santa Rita, Cabernet, Reserva 2005
Penfold's, Koonunga Hill, Shiraz Cabernet 2006
Chateau Ste. Michelle, Cabernet, Indian Wells 2004
Chateau Ste. Michelle, Merlot, Horse Heaven Hills 2004
Hannah Nicole, Red 2004
Penfold's, Koonunga Hill Shiraz Cabernet 2005
Protocolo, Red 2005
Woodbridge, Chardonnay 2006
Portuga, Vinho Branco 2006
Beaulieu, Cabernet, Rutherford 1998
Beaulieu, Cabernet, Rutherford 1996
Kirkland, Roogle Shiraz 2004
Garda, Classico Chiaretto
A to Z, Oregon Pinot Gris 2005
I Giusti & Zanza, Nemorino 2006
Treana, Marsanne-Viognier, Central Coast 2005
Fife, Syrah, "Stanford" 2000
B.R. Cohn, Silver Label Cabernet 2005
Marques de Casa Concha, Cabernet 2005
Santi, Sortesele Pinot Grigio 2006
Al Muvedre, Tinto Joven 2006
Layer Cake, Shiraz 2006
Gritti, Ca' Andrea, Umbria red 2005
Altos de Luzon, Jumilla 2004
Thomas Leithner, Zweigelt 2004
Cain Cuvee NV 3
Chateau Ste. Michelle, Merlot 2003
Meridian, Sauvignon Blanc 2005
Canoe Ridge, Merlot 2003
Paringa, Shiraz 2005

The Occasional Book

F. Scott Fitzgerald - The Great Gatsby
William Shakespeare - A Midsummer Night's Dream
Ivan Doig - Bucking the Sun
Penda Diakité - I Lost My Tooth in Africa
Grace Lin - The Year of the Rat
Oscar Hijuelos - Mr. Ives' Christmas
Madeline L'Engle - A Wrinkle in Time
Steven Hart - The Last Three Miles
David Sedaris - Me Talk Pretty One Day
Karen Armstrong - The Spiral Staircase
Charles Larson - The Portland Murders
Adrian Wojnarowski - The Miracle of St. Anthony
William H. Colby - Long Goodbye
Steven D. Stark - Meet the Beatles
Phil Stanford - Portland Confidential
Rick Moody - Garden State
Jonathan Schwartz - All in Good Time
David Sedaris - Dress Your Family in Corduroy and Denim
Anthony Holden - Big Deal
Robert J. Spitzer - The Spirit of Leadership
James McManus - Positively Fifth Street
Jeff Noon - Vurt

Road Work

Miles run year to date: 64
At this date last year: 28
Total run in 2008: 28
In 2007: 113
In 2006: 100
In 2005: 149
In 2004: 204
In 2003: 269
Clicky Web Analytics