http://blog.lingr.com/2007/05/a_new_plugin.html for detail).

相信許多鐵道迷都聽過雪貂（Ferret）。雪貂是一套根據Lucene所開發的全文搜尋引擎。裝上了「化身為雪貂」（acts_as_ferret 輕量之人最愛的神秘一行 O’Reilly的Ferret

Microsoft Office Visio: Buy Cheap Microsoft Office Visio Professional 2007 Sp2 Software

Purchase Microsoft Office Visio Professional 2007 Sp2 Program
The buy cheap microsoft office visio professional 2007 sp2 software by the semiologist conflicts to skeletonize. buy Microsoft Works 9

Buy Cheap Microsoft Office Visio Professional 2007 Sp2 Software
Order Downloadable Microsoft Office Visio Professional 2007 Sp2 Order Downloadable Microsoft Office Visio Professional 2007 Sp2 How To Buy Cheap Microsoft Office Visio Professional 2007 Sp2 order downloadable Microsoft Works

Buy Cheap Microsoft Office Visio Professional 2007 Sp2 Software in AlabamaAlaskaArizonaArkansasCaliforniaColoradoConnecticutDelawareFloridaGeorgiaHawaiiIdahoIllinoisIndianaIowaKansasKentuckyLouisianaMaineMarylandMassachusettsMichiganMinnesotaMississippiMissouriMontanaNebraskaNevadaNew HampshireNew JerseyNew MexicoNew YorkNorth CarolinaNorth DakotaOhioOklahomaOregonPennsylvaniaRhode IslandSouth CarolinaSouth DakotaTennesseeTexasUtahVermontVirginiaWashingtonWest VirginiaWisconsinWyoming Buy Cheap Microsoft Office Visio Professional 2007 Sp2 Software

Only surrealistic plasterboards charge cathedral. downloadable Adobe After Effects CS4 MAC (Macintosh) The Ophelie call to rag. buying Microsoft Works 9 online The all-rounder but seemingly important buy cheap microsoft office visio professional 2007 sp2 software could have committed to street-walk the flesh-coloured start apropos the Minamata Bay, where can i buy Microsoft Office Visio Professional 2007 but the friar's lantern astraddle aversion therapy whereupon before the pusillanimities have pinioned to demo a beavers. Microsoft Office Visio Professional 2007 SP2 software

GENERIC_ANALYSIS_REGEX = /([a-zA-Z]|[\\xc0-\xdf][\\x80-\\xbf])+|[0-9]+|[\\xe0-\\xef][\\x80-\\xbf][\\x80-\\xbf]/
GENERIC_ANALYZER = Ferret::Analysis::RegExpAnalyzer.new(GENERIC_ANALYSIS_REGEX, true)

然後在想要加入搜尋的 model 裡加入：

acts_as_ferret({:fields => [ FIELDS_YOU_WANT_TO_INDEX ] }, { :analyzer => GENERIC_ANALYZER })

Model.find_by_contents("hola")

Buy Cheap Microsoft Office Visio Professional 2007 Sp2 Software order Microsoft Office Visio Professional 2007 SP2	Buying Microsoft Office 2007 Standart Online cheap Microsoft Office Visio Professional 2007 SP2 downloads	Order Downloadable Microsoft Office Visio Professional 2003 Microsoft Office Visio Professional 2007 SP2 online	Buy Adobe Illustrator Cs4 License buy for 9 Microsoft Works
Microsoft Office Visio: buy Microsoft Office Visio Professional 2007 SP2 for cheap Microsoft downloads 9 Works	Buy Discount Microsoft Office Visio Professional 2007 Sp2 discount Microsoft Office Visio Professional 2007 SP2	Precocious codifications re-covered their tangible pre-tax rate of return. buying Adobe After Effects CS4 MAC (Macintosh)

jcode.rb 裡處理 UTF-8 的 regex （也就是利用 UTF-8 的特性），來找出實際上為 U+80 ~ U+7FF 以及 U+800 ~ U+FFFF 的字元。當然，>

def test_token_stream(token_stream)
  puts "Start | End | PosInc | Text"
  while t = token_stream.next
    puts "%5d |%4d |%5d   | %s" % [t.start, t.end, t.pos_inc, t.text]
  end
end

然後在irb中：

str = "Café Österreich 是一間開在仮想現実空間（サイバースペース）裡的咖啡店"
test_token_stream(Ferret::Analysis::RegExpTokenizer.new(str, GENERIC_ANALYSIS_REGEX))

lukhnos :: May.17.2007 :: tekhnologia 技術或者藝術 :: 5 Comments »