tsql - Lucene.Net Underscores causing token split -


i've scripted mssqlserver databases tables,views , stored procedures directory structure indexing lucene.net. of table, view , procedure names contain underscores.

i use standardanalyzer. if query table named tir_invoicebtnwtn01, example, recieve hits tir , invoicebtnwtn01, rather tir_invoicebtnwtn01.

i think issue tokenizer splitting on _ (underscore) since punctuation.

is there (simple) way remove underscores punctuation list or there analyzer should using sql , programming languages?

yes, standardanalyzer splits on underscore. whitespaceanalyzer not. note can use perfieldanalyzerwrapper use different analyzers each field - might want keep of standard analyzer's functionality except table/column name.

whitespaceanalyzer whitespace splitting though. won't lowercase tokens, example. might want make own analyzer combines whitespacetokenizer , lowercasefilter, or lowercasetokenizer.

edit: simple custom analyzer (in c#, can translate java pretty easily):

// chains standard tokenizer, standard filter, , lowercase filter class myanalyzer : analyzer {     public override tokenstream tokenstream(string fieldname, system.io.textreader reader)     {         standardtokenizer basetokenizer = new standardtokenizer(lucene.net.util.version.lucene_29, reader);         standardfilter standardfilter = new standardfilter(basetokenizer);         lowercasefilter lcfilter = new lowercasefilter(standardfilter);         return lcfilter;      } }

Comments

Post a Comment

Popular posts from this blog

asp.net - repeatedly call AddImageUrl(url) to assemble pdf document -

i'm using abcpdf , i'm curious if can recursively call addimageurl() function assemble pdf document compile multiple urls? something like: int pagecount = 0; int theid = thedoc.addimageurl("http://stackoverflow.com/search?q=abcpdf+footer+page+x+out+of+", true, 0, true); //assemble document while (thedoc.chainable(theid)) { thedoc.page = thedoc.addpage(); theid = thedoc.addimagetochain(theid); } pagecount = thedoc.pagecount; console.writeline("1 document page count:" + pagecount); //flatten document (int = 1; <= pagecount; i++) { thedoc.pagenumber = i; thedoc.flatten(); } //now try again theid = thedoc.addimageurl("http://stackoverflow.com/questions/1980890/pdf-report-generation", true, 0, true); //assemble document while (thedoc.chainable(theid)) { thedoc.page = thedoc.addpage(); theid = thedoc.addimagetoc...
Read more

java - Android recognize cell phone with keyboard or not? -

in android app, want detect user's device if device has keyboard(like motorola milestone) , show corresponding user interface. guys know how that? ! regards justicepenny http://developer.android.com/reference/android/content/res/configuration.html public int keyboard the kind of keyboard attached device. 1 of: keyboard_nokeys, keyboard_qwerty, keyboard_12key. that's it!
Read more

iphone - How would you achieve a LED Scrolling effect? -

how achieve led scrolling effect example below? led sign - led ticker emulator iphone , ipad http://img.skitch.com/20101201-rsfh4p1bajb1wp94k466pdpiuj.preview.jpg sometimes remunerates comment in other posts :) have put code you, should implement font '8pin matrix' realistic feeling. uilabel *label; - (void)viewdidload { [super viewdidload]; label = [[uilabel alloc]initwithframe:cgrectmake(10, 50, 300, 20)]; label.font = [uifont fontwithname:@"courier-bold" size:16.0]; label.backgroundcolor = [uicolor blackcolor]; label.textcolor = [uicolor greencolor]; label.linebreakmode = uilinebreakmodecharacterwrap; // otherwise "…" label.text = @"this led text scrolled "; // blanks space between [self.view addsubview:label]; [nstimer scheduledtimerwithtimeinterval:0.12f target:self selector:@selector(scrolllabel) use...
Read more