Talk:Tokenization (lexical analysis)
 | This redirect does not require a rating on Wikipedia's content assessment scale. It is of interest to the following WikiProjects: | ||||||||||
| |||||||||||
 | The contents of the Tokenization (lexical analysis) page were merged into Lexical analysis on 10 June 2017 and it now redirects there. For the contribution history and old versions of the merged article please see its history. |
A New Beginning
[edit]As everybody's noticed, the tokenization page previously contained information about data security. I have begun the rather convoluted process of disambiguation by creating this new page, moving the data security information (not the primary usage) to its own page, and beginning the tokenization disambiguation page. So now, it's time to chip in and start adding information, whether on this page or on another page for a secondary meaning of the term.
The last comment was rather strident and complaint-full (and did not contain a signature, so it's likely the person who posted it knew it was inappropriate to complain rather than to just do some work), so here's a reminder: this is a community-built resource. You are part of the community. If you complain, you're basically just complaining about yourself not having done the work you know you should have done. I know, I know: you've got a paper about tokenization due tomorrow so you don't have time. Next time, start earlier. This public service announcement has been paid for by Your Mother. ;p Rehjanis (talk) 17:06, 2 October 2009 (UTC)
British English spelling
[edit]Is the British English spelling of this 'tokenisation'? That tends to be the case with words like this. Does anyone know about this, and should it be added? 2.25.62.56 (talk) 00:01, 5 December 2014 (UTC)