Jump to content

Talk:Tokenization (lexical analysis)

Page contents not supported in other languages.
From Wikipedia, the free encyclopedia

A New Beginning

[edit]

As everybody's noticed, the tokenization page previously contained information about data security. I have begun the rather convoluted process of disambiguation by creating this new page, moving the data security information (not the primary usage) to its own page, and beginning the tokenization disambiguation page. So now, it's time to chip in and start adding information, whether on this page or on another page for a secondary meaning of the term.

The last comment was rather strident and complaint-full (and did not contain a signature, so it's likely the person who posted it knew it was inappropriate to complain rather than to just do some work), so here's a reminder: this is a community-built resource. You are part of the community. If you complain, you're basically just complaining about yourself not having done the work you know you should have done. I know, I know: you've got a paper about tokenization due tomorrow so you don't have time. Next time, start earlier. This public service announcement has been paid for by Your Mother. ;p Rehjanis (talk) 17:06, 2 October 2009 (UTC)[reply]

British English spelling

[edit]

Is the British English spelling of this 'tokenisation'? That tends to be the case with words like this. Does anyone know about this, and should it be added? 2.25.62.56 (talk) 00:01, 5 December 2014 (UTC)[reply]