;ò ~$„@c@sBdkZdkZdkZdkZdkTdfd„ƒYZdS(N(s*s Tokenizerc†BstZd„Zdd„Zhdd<dd<dd <d d <d d <dd<dd<dd<dd<dd<dd<dd<dd<dd<d d!<d"d#<d$d%<d&d'<d(d)<d*d+<d,d-<d.d/<d0d1<d2d3<d4d5<d6d7<d8d9<d:d;<d<d=<d>d?<d@dA<dBdC<dDdE<dFdG<dHdI<dJdK<dLdM<dNdO<dPdQ<dRdS<dTdU<dVdW<dXdY<dZd[<d\d]<d^d_<d`dad‡<d@dˆ<dBd‰<dDdŠ<dFd‹<dHdŒ<dJd<dLdŽ<ddŽ<dNd<dPd‘<dRd’<dTd“<d”d•<dVd–<dXd—<d˜d—<dZd™<d\dš<d^d›<d`dœ<ddž<dŸd{<d d¡<d¢d£<d¤d¥<d¦d§<d¨d©<dªd«<d¬d­<d®d¯<d°do<d±d²<d³d´<dµd¶<d·d¸<d¹dº<d»d¼<d½d¾<d¿dÀd?d@dAdBdCdDdEdFg†ZRS(GNcCsdS(N((sself((sNC:\Documents and Settings\Administrator\Desktop\pyCSVoice\omcsnet\Tokenizer.pys__init__sicCsœd|d}dddddddd d d d d dddddddddddg} dddddg}x+| D]#} ti|| d| dƒ}quWti|ƒ}xtt |ƒƒD]}||}|i ƒ|ijoq¾ntid|ƒ} t| ƒtjoq¾ntid|ƒ} t| ƒtjo;| id ƒdjo||d! dd||s[.]?)$speriodiÿÿÿÿs (?P)(?Ps )(?P) iiswordsbeginsends's s 's s'd s 'd s'll s will s 'll s i s I ($ssentences punctuationsspecial_punctuationspsstringsreplacessplitstokssrangeslensistokslowersselfscommon_abbrev_and_acrosressearchsmstypesNoneTypesgroupsstripsjoinsexpand_contractions_pscontractions_unwounds contractionsscontractions_separatedsregexpskeysswordsdirtyBits replace_withsstarts uppercasesuppersend(sselfssentencesexpand_contractions_pstokss contractionsswordsregexpsspecial_punctuationsis punctuationsms replace_withspsdirtyBitstok((sNC:\Documents and Settings\Administrator\Desktop\pyCSVoice\omcsnet\Tokenizer.pystokenize slK! )     (sain'tsai n'tsaren'tsare n'tsisn'tsis n'tswasn'tswas n'tsweren'tswere n'tsdidn'tsdid n'tsdoesn'tsdoes n'tsdon'tsdo n'tshadn'tshad n'tshasn'tshas n'tshaven'tshave n'tscan'tsca n'tscouldn'ts could n'tsneedn'tsneed n'ts shouldn'ts should n'tsshan'tssha n'tswon'tswo n'tswouldn'ts would n'tsi'msi 'msyou'resyou 'reshe'sshe 'ssshe'ssshe 'ssit'ssit 'sswe'reswe 'resthey'resthey 'resi'vesi 'vesyou'vesyou 'veswe'veswe 'vesthey'vesthey 'veswho'veswho 'veswhat'veswhat 'veswhen'veswhen 'veswhere'ves where 'veswhy'veswhy 'veshow'veshow 'vesi'dsi 'dsyou'dsyou 'dshe'dshe 'dsshe'dsshe 'dswe'dswe 'dsthey'dsthey 'dsi'llsi 'llsyou'llsyou 'llshe'llshe 'llsshe'llsshe 'llswe'llswe 'llsthey'llsthey 'llsai notsare notsis notswas notswere notsdid notsdoes notsdo notshad notshaftashave toshas notshave notscan nots could notsneed nots should nots shall notswill nots would notsI amsyou aresu'reshe issshe issit isswe aresthey aresy'all'res you all aresI havesyou havesu'veswe haves they havesy'all'ves you all haveswho haves what haves when haves where haveswhy haveshow havesI woulds you wouldsu'dshe woulds she wouldswe woulds they wouldsy'all'ds you all wouldsI willsyou willsu'llshe willsshe willswe wills they willsy'all'lls you all wills'tiss'twassit wass'tweres they weres'twouldsit wouldsy'allsyou allsi'd'ves I would havesaintsam notsaintchas are you notsc'monscome onscannotsdunnos do not knowsgimmesgive mesgonnasgoing tosgottasgot tosoughtasought toswannaswant tosyasyousursyoursmr.smrs.sms.ssr.sesq.sjr.sdr.ss.b.sph.d.sm.d.sm.eng.sm.f.a.sd.d.s.ssc.d.sb.s.sb.sc.sb.a.sa.b.sm.a.sc.p.a.sprof.scapt.scol.sgen.ssgt.slt.spriv.sft.snav.sa.f.su.s.a.f.s a.f.b.i.e.setc.se.g.sc.f.sp.s.sq.e.d.si.sii.siii.siv.sv.svi.svii.sviii.six.sx.sa.m.sp.m.smorn.seve.scorp.sinc.sco.sltd.sreg.su.p.s.su.s.p.s.sfedex.si.b.m.sa.o.l.sjan.sfeb.sfebr.smar.sapr.smay.sjun.sjul.saug.ssep.ssept.soct.snov.sdec.sala.sariz.sark.scalif.scolo.sconn.sdel.sd.c.sfla.sga.sill.sind.skans.sky.sla.smd.smass.smich.sminn.smiss.smo.snebr.snev.sn.h.sn.j.sn.m.sn.y.sn.c.sn.d.soklasore.spa.sp.r.sr.i.ss.c.ss.d.stenn.stex.svt.sva.sv.i.swash.sw.va.swis.swyo.sv.c.r.sv.h.s.sd.v.d.sv.c.d.sc.d.stele.stv.st.v.sp.c.sd.s.l.sa.s.a.p.sr.s.v.p.sn.y.c.sc.o.d.(s__name__s __module__s__init__stokenizescontractions_separatedscontractions_unwoundscommon_abbrev_and_acro(((sNC:\Documents and Settings\Administrator\Desktop\pyCSVoice\omcsnet\Tokenizer.pys Tokenizers  6ÿ®1ÿÿ¢L(ssyssstringsossrestypess Tokenizer(ssyssresossstrings Tokenizer((sNC:\Documents and Settings\Administrator\Desktop\pyCSVoice\omcsnet\Tokenizer.pys?s$