I have a script that checks for duplicates using a self-join method but appears not to compare the entire string. If I do a manual search for the offending items, they are not found.

 

Sample:

This is likely because the first line of each field is the same
"http://chase.com.freedom.activate.jp.aid.a.cc.5pctcashback2013q1.int.cards.freedom"
and is not comparing the full URL

 

http://chase.com.freedom.activate.jp.aid.a.cc.5pctcashback2013q1.int.cards.freedom.5pctcashback2013q1.trip.a30356b.hp.trip.otherkin.com/f7af7e978f04ce6eb086f3dc046e9cc2/
http://chase.com.freedom.activate.jp.aid.a.cc.5pctcashback2013q1.int.cards.freedom.5pctcashback2013q1.trip.a30356b.hp.trip.otherkin.com/f7af7e978f04ce6eb086f3dc046e9cc2
http://chase.com.freedom.activate.jp.aid.a.cc.5pctcashback2013q1.int.cards.freedom.5pctcashback2013q1.trip.a30356b.hp.trip.otherkin.com/8ccf70430c0fba303dce7323ce8f565f/
http://chase.com.freedom.activate.jp.aid.a.cc.5pctcashback2013q1.int.cards.freedom.5pctcashback2013q1.trip.a30356b.hp.trip.otherkin.com/cf1c17a3359e8dd6281e7b3520c595eb/
http://chase.com.freedom.activate.jp.aid.a.cc.5pctcashback2013q1.int.cards.freedom.5pctcashback2013q1.trip.a30356b.hp.trip.otherkin.com/6e37bd36e3ec7806c8b3dfcb9a717dd6/
http://chase.com.freedom.activate.jp.aid.a.cc.5pctcashback2013q1.int.cards.freedom.5pctcashback2013q1.trip.a30356b.hp.trip.otherkin.com/e2c7e9e02d06b0d03a0c13e9b5b39bd0/
 

Script steps:

If [not isEmpty (OtherURLs 3:s_URL)]

 

Relationship:

OtherURLs:s_URL = OtherURLs 3:s_URL

 

Is there a limit to the string length? Each of the lines are around 165 characters..

 

Hi,

 

I believe that Index is based on the first 100 characters of each word or value.

Also there are some characters depending on the (language) setting of the index that are deemed delimiters, for example in English one@two is two words in the index, in German only one.

 

So solve the length issue you could also simplify your URLs, having http:// on every record might not be necessary.

 

Best,

Alexander

Thanks Alexander. I will test the 100 character limit. Also trying to think of a different way to do the same job.. slow but would work I guess, would be to do a search for each instance then allow or diss-allow based on results...