Lexic.us

Definition of Tokenizer

1. Noun. (computing) A system that parses an input stream into tokens. ¹

Words people are searching for today:

moteliers, concierges, dicrotic_wave, creepingly, dreamiest, wysiwygs, boorde, Åland_islands, drollish, pseudoagouti, biocytinase, atween, conger, salvia_officinalis, multimorphemic, rubby-dub, greywacke, postcolonialism, thylacines, jickajog, in_spades, visitest, scratchboards, fletching, vacuum_pumps, routhie, galactonojirimycin, groupware, acne_neonatorum, evening-primrose_family, ascending_tick_paralysis, nct, uxi, thiamylal_sodium, toyingly, taproots, wood's_lamp, delphian, entablatures, 'aircut, meissner's_corpuscle, plica_duodenomesocolica, tool-rest, ran, napalmlike, plant_tissue, unstable, acetylgalactosaminyltransferase, phormiums, arabinoadenosine

Privacy Policy | Contact Us | Powered by WordNet