Word Frequency

[smithcc]

I am in the process of trying to make filemaker read. I need a calculation to list the words according to frequency preferably from a field from all related records. I also need to exclude a custom list of common words, ie A, The, An, Etc. the output i need is as a carriage return value list in one field. I know i can script it but is it possible to calculate it?

Similar to the below but witht he ability to exclude words of up to a particular length and custom words.

http://www.writewords.org.uk/word_count.asp

Can this be done with filemaker or do i need to use java?

[smithcc]

http://www.darylkinsman.ca/tools/wordfreq.shtml

This was the optimal java script i found which does all that is needed, can filemaker replicate this?

[comment]

preferably from a field from all related records.

Approximately, how many words in the entire text do you expect?

Do you need this "live" or can it be scripted (i.e. calculate on demand)?

[smithcc]

It would need to be Live. approximately 15,000 to 40,000 words. I can script an ondemand solution but i'm wondering if it can be done through a live calculation.

[comment]

I believe it can, but a custom function is limited to 50,000 recursions (provided it's tail-recursive, otherwise the limit is 10,000). Also, if the calculation is referencing related fields, it must be unstored - and as such will recalculate at every screen refresh. This may prove to be too annoying, as there is quite a lot of processing to do here.

OTOH, you can probably simulate "live" by using script triggers.