
Hi
We are trying to optimise our application to work with large files, and on of the whole the main bottleneck we are hitting is calls to GetReader(offset) where we are specifying large offsets (the call that actually takes the time is the ITextSnapshotReader.Token, but I guess its lazy loading it).
I'm guessing its lexing the whole file up to the offset (which is time consuming for large files)?
Is it possible to cache the Lexer tokens, or get a token reader in the middle of a file without incuring such a hit?
The kind of senarios we are looking at are auto indent, where we need the token stream, or spell checking where we need the tokens to break out specific types of text to check.
Thanks
Simon