Opengrok Starting New took just 1 project

[sahoode]

Hello Team,

I removed all the info inside data and did a reindex with the below command for opengrok 1.7.11.

nohup java -verbose -Djava.util.logging.config.file=/var/opengrok/etc/logging.properties \
    -jar /var/opengrok/dist/lib/opengrok.jar \
    -c /usr/local/bin/bin/ctags \
    -s /var/opengrok/src/margot -d /var/opengrok/data -H -S -G \
    -W /var/opengrok/etc/tomcat10/configuration.xml -U http://localhost:8080/source &

it just shows only one project from /var/opengrok/src/margot

where as I have 3 projects

/var/opengrok/src/margot
drwxr-xr-x 166 p4build users     4096 Jul 12 06:05 mainline-git
drwxr-xr-x 142 p4build users     4096 Jul 12 08:05 92xx_scale-git
drwxr-xr-x 143 p4build users     4096 Aug  1 19:28 c2c-git

in /var/opengrok/data/xref i see all 3 reference are there

92xx_scale-git  
c2c-git  
mainline-git

How I can redo the steps, Please let me know which will be a suitable command to get all projects without any issue.

[ahornace]

Do you see all 3 mentioned in /var/opengrok/etc/tomcat10/configuration.xml ? Is there anything interesting in the logs (error, warning level entries)?

[sahoode]

Archive.zip
Yes I see 3 references there in the configuration files.
uploading it and the logs as registered in nohup.out

Thank you

[ahornace]

The uploaded logs contain only class loading details. Could you try to add the -P option and monitor the logs? Both in indexer and webapp. There should be a hint for what is happening (and what the problem is).

[sahoode]

catalina.out.zip
I get warining like:

Aug 02, 2021 3:40:23 PM org.opengrok.indexer.util.Executor exec
WARNING: Non-zero exit status 1 from command [p4 files $'*'] in directory /var/opengrok/src/margot/c2c-git/openssl-regular/openssl-1.0.2s/shlib: * - must create client 'opengrok3' to access local files.

Aug 02, 2021 3:40:23 PM org.opengrok.indexer.util.Executor exec
WARNING: Non-zero exit status 1 from command [p4 files $'*'] in directory /var/opengrok/src/margot/mainline-git/openssl-fips/openssl-fips-1.2/shlib: * - must create client 'opengrok3' to access local files.

Aug 02, 2021 3:40:23 PM org.opengrok.indexer.util.Executor exec
WARNING: Non-zero exit status 1 from command [p4 dirs $'*'] in directory /var/opengrok/src/margot/92xx_scale-git/webui/automation/src: */... - must create client 'opengrok3' to access local files.

Aug 02, 2021 3:40:23 PM org.opengrok.indexer.util.Executor exec
WARNING: Non-zero exit status 1 from command [p4 dirs $'*'] in directory /var/opengrok/src/margot/c2c-git/openssl-regular/openssl-1.0.2s/certs: */... - must create client 'opengrok3' to access local files.

Aug 02, 2021 3:40:23 PM org.opengrok.indexer.util.Executor exec
WARNING: Non-zero exit status 1 from command [p4 dirs $'*'] in directory /var/opengrok/src/margot/mainline-git/openssl-fips/openssl-fips-1.2/fips: */... - must create client 'opengrok3' to access local files.

is this fine?

this is a git repo

Log files has entry like:
</record> <record> <date>2021-08-02T23:12:59.172278Z</date> <millis>1627945979172</millis> <nanos>278000</nanos> <sequence>1231674</sequence> <logger>org.opengrok.indexer.analysis</logger> <level>FINEST</level> <class>org.opengrok.indexer.analysis.Ctags</class> <method>trySplitSource</method> <thread>42695</thread> <message>Re-read /var/opengrok/src/margot/92xx_scale-git/aos-cmn/platform/os/linux-3.18/drivers/misc/genwqe/card_ddcb.h</message> </record> <record> <date>2021-08-02T23:12:59.174524Z</date> <millis>1627945979174</millis> <nanos>524000</nanos> <sequence>1231675</sequence> <logger>org.opengrok.indexer.index</logger> <level>FINER</level> <class>org.opengrok.indexer.index.DefaultIndexChangedListener</class> <method>fileAdded</method> <thread>42684</thread> <message>Added: /92xx_scale-git/aos-cmn/platform/os/linux-4.4.60/arch/sh/kernel/sh_ksyms_64.c (CAnalyzer)</message> </record> <record> <date>2021-08-02T23:12:59.174667Z</date> <millis>1627945979174</millis> <nanos>667000</nanos> <sequence>1231676</sequence> <logger>org.opengrok.indexer.index</logger> <level>FINEST</level> <class>org.opengrok.indexer.util.Statistics</class> <method>logIt</method> <thread>42684</thread> <message>file '/var/opengrok/src/margot/92xx_scale-git/aos-cmn/platform/os/linux-4.4.60/arch/sh/kernel/sh_ksyms_64.c' indexed (took 9 ms)</message> </record>

I see some errors related to repo mainline and 92xx in the catalina.out hence attaching it.

[ahornace]

It seems that the other projects are not marked as indexed in the configuration. Did indexing actually finish successfully?

Can you try simply adding 1 project at a time and monitor the indexer and webapp logs?

[sahoode]

Yes, the index finished successfully.

yes in configuration.xml I see the projects are not set as indexed.I will try to index individially

when I run the indexer I get the below waring is this something related

Aug 04, 2021 6:38:55 AM org.opengrok.indexer.util.Executor exec
WARNING: Non-zero exit status 1 from command [p4 files $'*'] in directory /var/opengrok/src/margot/mainline-git/platform/sb_bpinfo: * - must create client 'opengrok3' to access local files.

[sahoode]

Thank you @ahornace for the help and guidance.
Now
I have removed all the projects and trying to index just one I see few severe in the logs.

WARNING: CTags parsing problem:
java.io.IOException: Stream closed
	at java.base/java.io.BufferedInputStream.getBufIfOpen(BufferedInputStream.java:176)
	at java.base/java.io.BufferedInputStream.read(BufferedInputStream.java:342)
	at java.base/sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284)
	at java.base/sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326)
	at java.base/sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178)
	at java.base/java.io.InputStreamReader.read(InputStreamReader.java:181)
	at java.base/java.io.BufferedReader.fill(BufferedReader.java:161)
	at java.base/java.io.BufferedReader.readLine(BufferedReader.java:326)
	at java.base/java.io.BufferedReader.readLine(BufferedReader.java:392)
	at org.opengrok.indexer.analysis.Ctags.readTags(Ctags.java:565)
	at org.opengrok.indexer.analysis.Ctags.lambda$doCtags$2(Ctags.java:473)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:834)

Aug 05, 2021 5:42:01 AM org.opengrok.indexer.analysis.Ctags readTags
SEVERE: CTag reader cycle was interrupted!
Aug 05, 2021 5:42:01 AM org.opengrok.indexer.analysis.Ctags readTags
WARNING: CTags parsing problem:
java.io.IOException: Stream closed
	at java.base/java.io.BufferedInputStream.getBufIfOpen(BufferedInputStream.java:176)
	at java.base/java.io.BufferedInputStream.read(BufferedInputStream.java:342)
	at java.base/sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284)
	at java.base/sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326)
	at java.base/sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178)
	at java.base/java.io.InputStreamReader.read(InputStreamReader.java:181)
	at java.base/java.io.BufferedReader.fill(BufferedReader.java:161)
	at java.base/java.io.BufferedReader.readLine(BufferedReader.java:326)
	at java.base/java.io.BufferedReader.readLine(BufferedReader.java:392)
	at org.opengrok.indexer.analysis.Ctags.readTags(Ctags.java:565)
	at org.opengrok.indexer.analysis.Ctags.lambda$doCtags$2(Ctags.java:473)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:834)

Is it something related ?

[sahoode]

Now I use

nohup java -verbose -Djava.util.logging.config.file=/var/opengrok/logging.properties \
    -jar /var/opengrok/dist/lib/opengrok.jar \
    -c /usr/local/bin/bin/ctags \
    -s /var/opengrok/src/margot -d /var/opengrok/data -H -S -G -P \
    -W /var/opengrok/etc/tomcat10/configuration.xml \
    -i *.o -i *.a -i *.so -i *.d -i *.gz -i *.p -i *.cmd -i *.la -i *.lo -i *.html -i *.gif -i *.png -i *.pyc \
    -U http://localhost:8080/source &

What command I should use to index one project?

[vladak]

Aug 05, 2021 5:42:01 AM org.opengrok.indexer.analysis.Ctags readTags
SEVERE: CTag reader cycle was interrupted!
Aug 05, 2021 5:42:01 AM org.opengrok.indexer.analysis.Ctags readTags
WARNING: CTags parsing problem:
java.io.IOException: Stream closed
...
Is it something related ?

Looks like ctags crashed or was killed. Neither should cause indexer to fail. Still, consider upgrading Universal ctags.

[vladak]

Now I use

nohup java -verbose -Djava.util.logging.config.file=/var/opengrok/logging.properties \
    -jar /var/opengrok/dist/lib/opengrok.jar \
    -c /usr/local/bin/bin/ctags \
    -s /var/opengrok/src/margot -d /var/opengrok/data -H -S -G -P \
    -W /var/opengrok/etc/tomcat10/configuration.xml \
    -i *.o -i *.a -i *.so -i *.d -i *.gz -i *.p -i *.cmd -i *.la -i *.lo -i *.html -i *.gif -i *.png -i *.pyc \
    -U http://localhost:8080/source &

What command I should use to index one project?

Convert this to something like (assuming the configuration file was created beforehand and the project with its repositories is already present there) this:

nohup java -verbose -Djava.util.logging.config.file=/var/opengrok/logging.properties \
    -jar /var/opengrok/dist/lib/opengrok.jar \
    -R /var/opengrok/etc/tomcat10/configuration.xml \
    -U http://localhost:8080/source \
    -H INSERT_THE_NAME_OF_THE_PROJECT_TO_INDEX_HERE \
    INSERT_THE_NAME_OF_THE_PROJECT_TO_INDEX_HERE &

[sahoode]

Thank you for the help.

when I index the folder
I get below error for the mainline-git which is not getting indexed.

17-Aug-2021 01:29:47.148 WARNING [ajp-nio-127.0.0.1-8009-exec-3] org.opengrok.web.api.v1.suggester.provider.service.impl.SuggesterServiceImpl.lambda$getNamedIndexReaders$0 Could not get index reader for mainline-git
	org.apache.lucene.index.IndexNotFoundException: no segments* file found in MMapDirectory@/var/opengrok/data/index/mainline-git lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ca370ae: files: []
		at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:715)
		at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:84)
		at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:64)
		at org.apache.lucene.search.SearcherManager.<init>(SearcherManager.java:125)
		at org.opengrok.indexer.configuration.RuntimeEnvironment.getIndexSearcher(RuntimeEnvironment.java:1764)
		at org.opengrok.web.api.v1.suggester.provider.service.impl.SuggesterServiceImpl.lambda$getNamedIndexReaders$0(SuggesterServiceImpl.java:136)
		at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
		at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1655)
		at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
		at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
		at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
		at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
		at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
		at org.opengrok.web.api.v1.suggester.provider.service.impl.SuggesterServiceImpl.getNamedIndexReaders(SuggesterServiceImpl.java:143)
		at org.opengrok.web.api.v1.suggester.provider.service.impl.SuggesterServiceImpl.getSuggestions(SuggesterServiceImpl.java:113)
		at org.opengrok.web.api.v1.controller.SuggesterController.getSuggestions(SuggesterController.java:123)
		at jdk.internal.reflect.GeneratedMethodAccessor115.invoke(Unknown Source)
		at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
		at java.base/java.lang.reflect.Method.invoke(Method.java:566)
		at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52)
		at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124)
		at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167)
		at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219)
		at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79)
		at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:475)
		at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:397)
		at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:81)
		at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:255)
		at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
		at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
		at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
		at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
		at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
		at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
		at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:234)
		at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680)
		at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
		at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
		at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:366)
		at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:319)
		at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:224)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.opengrok.web.CookieFilter.doFilter(CookieFilter.java:50)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.opengrok.web.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.opengrok.web.StatisticsFilter.doFilter(StatisticsFilter.java:67)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202)
		at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97)
		at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:543)
		at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
		at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
		at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:690)
		at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:261)
		at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78)
		at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:353)
		at org.apache.coyote.ajp.AjpProcessor.service(AjpProcessor.java:439)
		at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65)
		at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:870)
		at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1696)
		at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
		at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
		at java.base/java.lang.Thread.run(Thread.java:834)
17-Aug-2021 01:29:48.782 WARNING [ajp-nio-127.0.0.1-8009-exec-7] org.opengrok.web.api.v1.suggester.provider.service.impl.SuggesterServiceImpl.lambda$getNamedIndexReaders$0 Could not get index reader for mainline-git
	org.apache.lucene.index.IndexNotFoundException: no segments* file found in MMapDirectory@/var/opengrok/data/index/mainline-git lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ca370ae: files: []
		at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:715)
		at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:84)
		at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:64)
		at org.apache.lucene.search.SearcherManager.<init>(SearcherManager.java:125)
		at org.opengrok.indexer.configuration.RuntimeEnvironment.getIndexSearcher(RuntimeEnvironment.java:1764)
		at org.opengrok.web.api.v1.suggester.provider.service.impl.SuggesterServiceImpl.lambda$getNamedIndexReaders$0(SuggesterServiceImpl.java:136)
		at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
		at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1655)
		at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
		at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
		at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
		at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
		at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
		at org.opengrok.web.api.v1.suggester.provider.service.impl.SuggesterServiceImpl.getNamedIndexReaders(SuggesterServiceImpl.java:143)
		at org.opengrok.web.api.v1.suggester.provider.service.impl.SuggesterServiceImpl.getSuggestions(SuggesterServiceImpl.java:113)
		at org.opengrok.web.api.v1.controller.SuggesterController.getSuggestions(SuggesterController.java:123)
		at jdk.internal.reflect.GeneratedMethodAccessor115.invoke(Unknown Source)
		at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
		at java.base/java.lang.reflect.Method.invoke(Method.java:566)
		at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52)
		at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124)
		at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167)
		at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219)
		at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79)
		at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:475)
		at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:397)
		at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:81)
		at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:255)
		at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
		at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
		at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
		at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
		at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
		at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
		at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:234)
		at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680)
		at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
		at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
		at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:366)
		at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:319)
		at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:224)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.opengrok.web.CookieFilter.doFilter(CookieFilter.java:50)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.opengrok.web.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.opengrok.web.StatisticsFilter.doFilter(StatisticsFilter.java:67)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202)
		at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97)
		at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:543)
		at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
		at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
		at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:690)
		at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:261)
		at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78)
		at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:353)
		at org.apache.coyote.ajp.AjpProcessor.service(AjpProcessor.java:439)
		at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65)
		at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:870)
		at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1696)
		at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
		at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
		at java.base/java.lang.Thread.run(Thread.java:834)
17-Aug-2021 01:29:50.540 WARNING [ajp-nio-127.0.0.1-8009-exec-8] org.opengrok.web.api.v1.suggester.provider.service.impl.SuggesterServiceImpl.lambda$getNamedIndexReaders$0 Could not get index reader for mainline-git
	org.apache.lucene.index.IndexNotFoundException: no segments* file found in MMapDirectory@/var/opengrok/data/index/mainline-git lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ca370ae: files: []
		at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:715)
		at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:84)
		at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:64)
		at org.apache.lucene.search.SearcherManager.<init>(SearcherManager.java:125)
		at org.opengrok.indexer.configuration.RuntimeEnvironment.getIndexSearcher(RuntimeEnvironment.java:1764)
		at org.opengrok.web.api.v1.suggester.provider.service.impl.SuggesterServiceImpl.lambda$getNamedIndexReaders$0(SuggesterServiceImpl.java:136)
		at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
		at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1655)
		at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
		at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
		at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
		at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
		at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
		at org.opengrok.web.api.v1.suggester.provider.service.impl.SuggesterServiceImpl.getNamedIndexReaders(SuggesterServiceImpl.java:143)
		at org.opengrok.web.api.v1.suggester.provider.service.impl.SuggesterServiceImpl.getSuggestions(SuggesterServiceImpl.java:113)
		at org.opengrok.web.api.v1.controller.SuggesterController.getSuggestions(SuggesterController.java:123)
		at jdk.internal.reflect.GeneratedMethodAccessor115.invoke(Unknown Source)
		at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
		at java.base/java.lang.reflect.Method.invoke(Method.java:566)
		at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52)
		at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124)
		at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167)
		at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219)
		at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79)
		at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:475)
		at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:397)
		at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:81)
		at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:255)
		at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
		at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
		at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
		at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
		at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
		at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
		at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:234)
		at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680)
		at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
		at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
		at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:366)
		at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:319)
		at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:224)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.opengrok.web.CookieFilter.doFilter(CookieFilter.java:50)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.opengrok.web.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.opengrok.web.StatisticsFilter.doFilter(StatisticsFilter.java:67)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202)
		at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97)
		at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:543)
		at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
		at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
		at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:690)
		at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:261)
		at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78)
		at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:353)
		at org.apache.coyote.ajp.AjpProcessor.service(AjpProcessor.java:439)
		at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65)
		at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:870)
		at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1696)
		at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
		at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
		at java.base/java.lang.Thread.run(Thread.java:834)
17-Aug-2021 01:29:51.903 WARNING [ajp-nio-127.0.0.1-8009-exec-1] org.opengrok.web.api.v1.suggester.provider.service.impl.SuggesterServiceImpl.lambda$getNamedIndexReaders$0 Could not get index reader for mainline-git
	org.apache.lucene.index.IndexNotFoundException: no segments* file found in MMapDirectory@/var/opengrok/data/index/mainline-git lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ca370ae: files: []
		at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:715)
		at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:84)
		at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:64)
		at org.apache.lucene.search.SearcherManager.<init>(SearcherManager.java:125)
		at org.opengrok.indexer.configuration.RuntimeEnvironment.getIndexSearcher(RuntimeEnvironment.java:1764)
		at org.opengrok.web.api.v1.suggester.provider.service.impl.SuggesterServiceImpl.lambda$getNamedIndexReaders$0(SuggesterServiceImpl.java:136)
		at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
		at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1655)
		at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
		at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
		at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
		at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
		at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
		at org.opengrok.web.api.v1.suggester.provider.service.impl.SuggesterServiceImpl.getNamedIndexReaders(SuggesterServiceImpl.java:143)
		at org.opengrok.web.api.v1.suggester.provider.service.impl.SuggesterServiceImpl.getSuggestions(SuggesterServiceImpl.java:113)
		at org.opengrok.web.api.v1.controller.SuggesterController.getSuggestions(SuggesterController.java:123)
		at jdk.internal.reflect.GeneratedMethodAccessor115.invoke(Unknown Source)
		at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
		at java.base/java.lang.reflect.Method.invoke(Method.java:566)
		at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52)
		at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124)
		at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167)
		at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219)
		at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79)
		at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:475)
		at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:397)
		at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:81)
		at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:255)
		at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
		at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
		at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
		at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
		at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
		at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
		at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:234)
		at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680)
		at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
		at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
		at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:366)
		at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:319)
		at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:224)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.opengrok.web.CookieFilter.doFilter(CookieFilter.java:50)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.opengrok.web.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.opengrok.web.StatisticsFilter.doFilter(StatisticsFilter.java:67)
		at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
		at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:159)
		at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202)
		at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97)
		at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:543)
		at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
		at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
		at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:690)
		at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:261)
		at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78)
		at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:353)
		at org.apache.coyote.ajp.AjpProcessor.service(AjpProcessor.java:439)
		at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65)
		at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:870)
		at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1696)
		at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
		at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
		at java.base/java.lang.Thread.run(Thread.java:834)

[vladak]

If there is no segments* file under /var/opengrok/data/index/mainline-git, this means the project was not indexed properly. You need to look into the indexer log to see why is that.