Some files are not indexed about codesearch HOT 11 CLOSED

Still, can’t help a feeling binary file skipping merits to be done via some command line switch, like -maxlinelen defaulting to 2000.

You might be interested in using my fork that implements this and some other options https://github.com/junkblocker/codesearch .

from codesearch.

The files that are skipped generally are thought to be binary files -- those with very long lines or too many invalid utf8 characters.

from codesearch.

Here is how the file skipping is decided:

// Tuning constants for detecting text files.
// A file is assumed not to be text files (and thus not indexed)
// if it contains an invalid UTF-8 sequences, if it is longer than maxFileLength
// bytes, if it contains a line longer than maxLineLen bytes,
// or if it contains more than maxTextTrigrams distinct trigrams.
const (
	maxFileLen      = 1 << 30
	maxLineLen      = 2000
	maxTextTrigrams = 20000
)

When I faced the same file skipping issue, I just changed maxLineLen to 10000 and recompiled and reindexed and everything worked just fine. Quick and dirty hack as it is.

Still, can’t help a feeling binary file skipping merits to be done via some command line switch, like -maxlinelen defaulting to 2000.

from codesearch.

@nmklong go build, go install as described in https://golang.org/cmd/go/#hdr-Compile_packages_and_dependencies after changing the source file locally.

I’m not quite sure about that, but go get -u might well undo any changes you made locally.

from codesearch.

You can run with -logskip flag to see why the files were skipped.

from codesearch.

@junkblocker I ran csearch -logskip "terms" but it's saying it's an incorrect flag

from codesearch.

The flag applies at indexing time to cindex and not at search time to csearch.

from codesearch.

@junkblocker Tried cindex -logskip ./ but it's still saying incorrect flag

from codesearch.

@junkblocker: ah, good to know, thanks!

from codesearch.

@rns thanks for that, but a noob question: how to recompile go after modifying the code locally?

I tried go get -u ~/localgocode/src/github.com/google/codesearchbut it didn't work, ~/localgocode is my GOPATH

from codesearch.

@rns thanks for your great help! got it working now

from codesearch.