Reduce your suppression files by 90% [how to]

Discussion in 'Mail Chat' started by asiatiki, Oct 10, 2011.

  1. asiatiki

    asiatiki VIP

    Joined:
    Apr 12, 2011
    Messages:
    121
    Likes Received:
    8
    Trophy Points:
    18
    Location:
    Montreal, Quebec, Canada
    A lot of merchants supply HUGE suppression lists containing millions of records and expect you to upload 150MB+ files... That not only takes time to upload (not to mention bandwith if you run a lot of campaigns), but also increase your server load & processing time, etc. You all know what I am talking about...

    I tried a tool that you probably heard about (or seen the banner when downloading suppression files from UnsubCentral & Optizmo and found it *very* useful. It's called Scrubbly and only costs $59 per year - they offer a 48-h free trial if you want to try it.

    If you go to their website scrubbly.com, you will see that the way they show you to use it is to scrub your list against the suppression file (MD5 is supported) and upload your clean list to mail to.

    That's one way to do it but what's the point in re-uploading your mailing lists everytime you want to do a drop, right? Well the cool thing about scrubbly is that you can choose to only keep the matching rows (the records that are on your list AND on the scrub list) and upload the generated file as your suppression list. That will tremendously reduce your suppression file.

    I scrubbed a 8 million records suppression list today and only about 200 of them were actually on my list. So I only have to upload a 6kb suppression file.. woohoo!! :party:

    Here's the website: scrubbly.com

    [​IMG]
     
    Last edited: Oct 10, 2011
  2. chillbrah

    chillbrah VIP

    Joined:
    Jul 29, 2011
    Messages:
    48
    Likes Received:
    2
    Trophy Points:
    8
    Nice tip. Thanks
     
  3. dynamik

    dynamik Member

    Joined:
    May 5, 2011
    Messages:
    46
    Likes Received:
    2
    Trophy Points:
    8
    Lol... What the hell? Are people really that desperate for money? Bit of a joke if you ask me. You can do all that garbage with simple bash lines, like...

    clean/remove whitespaces/lowercase/convert to md5

    or

     
    Last edited: Oct 10, 2011
  4. roundabout

    roundabout Well-Known Member

    Joined:
    Feb 17, 2011
    Messages:
    2,713
    Likes Received:
    155
    Trophy Points:
    63
    Spoken only like a true programmer/coder. lol

    Dude, I understand what you wrote. Maybe 10-15% of this board does. The rest of the board looked at it and thought "simple for YOU. not or ME".

    Hence, programs like Scrubbly are important for those who want simplicity via point and click. There's a whole market out there for people who don't know how to program, or are computer illiterate. Don't forget that core audience if you want to make money writing software, or you're screwed.
     
  5. johnengler

    johnengler New Member

    Joined:
    Apr 20, 2011
    Messages:
    3
    Likes Received:
    0
    Trophy Points:
    0
    The guy that wrote Scrubbly knows his stuff too... good friend of mine.
     
  6. asiatiki

    asiatiki VIP

    Joined:
    Apr 12, 2011
    Messages:
    121
    Likes Received:
    8
    Trophy Points:
    18
    Location:
    Montreal, Quebec, Canada
    Dynamik, how would I use that from my desktop?

    Thanks

    P.S. Can you scrub lists with more than one column (email, fname, lname) with a batch command?
     
  7. DoldGigga

    DoldGigga VIP

    Joined:
    Mar 25, 2011
    Messages:
    817
    Likes Received:
    104
    Trophy Points:
    43
    What I don't get is why a program which is basically performing a simple regex loop on a textfile costs $59 per year when it should be more like $10 one time.
     
  8. nickphx

    nickphx VIP

    Joined:
    Apr 2, 2011
    Messages:
    1,294
    Likes Received:
    430
    Trophy Points:
    83
    Gender:
    Male
    Location:
    phoenix.
    Because some people will pay 59$ year?
     
  9. asiatiki

    asiatiki VIP

    Joined:
    Apr 12, 2011
    Messages:
    121
    Likes Received:
    8
    Trophy Points:
    18
    Location:
    Montreal, Quebec, Canada
    Because some people are not programmers.

    Why don't someone of the other group share one of these handy regex/batch/whatever here? :22:
     
    Last edited: Oct 10, 2011
  10. DoldGigga

    DoldGigga VIP

    Joined:
    Mar 25, 2011
    Messages:
    817
    Likes Received:
    104
    Trophy Points:
    43
    Don't need to be a programmer. What Dynamik posted is a regex statement, and I agree that regex is not user-friendly...but $59 per year for a program that essentially does what you can do with one command line statement? It's not a service; it's a program so there is no justification for a recurring charge and the price is too high for the function it performs...but hey, spend your money how you want.
     
  11. asiatiki

    asiatiki VIP

    Joined:
    Apr 12, 2011
    Messages:
    121
    Likes Received:
    8
    Trophy Points:
    18
    Location:
    Montreal, Quebec, Canada
    That regex statement did not work from my Windows desktop computer so I assumed it was to be used on a Linux machine (I replaced 'cat' by 'copy'). My servers are Linux but I wanted to be able to scrub lists without having to upload the whole suppression file which was the reason I posted this thread. Can you help and post a windows command line equivalent?

    Regarding Scrubbly, I agree that a yearly license for the use of the software might be a little too much. On another note, I have talked to the developer today and he might offer a nice discount to MF members. Let's wait and see :)
     
  12. DoldGigga

    DoldGigga VIP

    Joined:
    Mar 25, 2011
    Messages:
    817
    Likes Received:
    104
    Trophy Points:
    43
    The "cat" command basically dumps the output of a text file to the screen (aka standard output) without making any changes to it. In the case of the example, it passes the output to the "sed" command. The windows/dos equivalent of "cat" is "type"...copy would be useful only for combining two or more files into one. Anyway, if you wanted to do this in windows:

    findstr /i /x /v /g:NewSuppressionFile.txt ExistingSuppressionFile.txt > UpdatedSuppressionFile.txt

    NewSuppressionFile.txt = one you just downloaded from CPA network.
    ExistingSuppressionFile.txt = the suppression file you already have
    UpdatedSuppressionFile.txt = results of the findstr command, which would be what you upload before mailing.

    What this will do is read the text file specified in /g: line-by-line, searching for each matching line in the second specified file, and finally outputting the new lines into the third file. In other words, the "updatedsuppressionfile.txt" will contain the addresses that you don't already have on your suppression list.

    See, Windows makes it easy. Don't even need regex...also, if you wanted to output matching rows you'd only need to remove the /v from the command I posted.
     
    Last edited: Oct 11, 2011
  13. rain

    rain VIP

    Joined:
    Jul 12, 2011
    Messages:
    27
    Likes Received:
    0
    Trophy Points:
    1
    Also you can do ' sort listname | uniq > whateveroutputfileyouwant '
     
  14. gspot

    gspot VIP

    Joined:
    Apr 8, 2011
    Messages:
    616
    Likes Received:
    14
    Trophy Points:
    18
    Location:
    I live here
    Its a pretty awesome program for those who don't have programming skills for sure. However, I also disagree with the reoccurring charge. Even if you have no programming skills you can easily outsource the project for less than 50$ but for those of you who use any of their partners like Optizmo you can get it for 20$
     
  15. asiatiki

    asiatiki VIP

    Joined:
    Apr 12, 2011
    Messages:
    121
    Likes Received:
    8
    Trophy Points:
    18
    Location:
    Montreal, Quebec, Canada
  16. gspot

    gspot VIP

    Joined:
    Apr 8, 2011
    Messages:
    616
    Likes Received:
    14
    Trophy Points:
    18
    Location:
    I live here
    Humm...strange it was $20 when we signed up. Well either way, $39 isn't that bad
     
  17. DKPMO

    DKPMO VIP

    Joined:
    Mar 31, 2011
    Messages:
    1,452
    Likes Received:
    68
    Trophy Points:
    48
    Location:
    Elaborate Underground Base
    That's way too cheap. Should be selling the same thing for at least $59K as "enterprise scrub management solution".
     
  18. bumpies

    bumpies VIP

    Joined:
    Apr 18, 2011
    Messages:
    122
    Likes Received:
    1
    Trophy Points:
    18
    lol yea I agree

    Who cares how valuable it is... do you know how much junk is sold waay over priced every day *cough gspot's shoes cough*...

    I thought you guys were Email MARKETERS... if you can sell it to someone for more caus u got skillz, good for you. If I can figure out a way to do it for cheaper/free, good for me.

    on the flip side, the value it is offering is probably worth the value...

    Will you save more than $59 a year in processing power and thus mail out? Will you save more than a few hours of your time each year?

    if so, its probably worth it.
     
    Last edited: Oct 19, 2011
  19. bfons

    bfons VIP

    Joined:
    Oct 17, 2011
    Messages:
    44
    Likes Received:
    7
    Trophy Points:
    8
    FWIW,

    I'm a Linux Geek of 15 years. Although I can run my MD5 file suppression lists on a Linux box, I found it easier to use Scrubbly. I have a dedicated Windows box that handles tasks such as this and nothing else.

    Way worth the cost!
     
  20. asiatiki

    asiatiki VIP

    Joined:
    Apr 12, 2011
    Messages:
    121
    Likes Received:
    8
    Trophy Points:
    18
    Location:
    Montreal, Quebec, Canada
    Agreed. Plus you can deduct it from your company expenses. And $59 is peanuts compared to what most mailers make in one day.
     

Share This Page