ERROR: Service 'kafka' failed to build

[paulhendricks]

Trying to run this application on AWS. Details and reproducible steps below.

Instance: NVIDIA Volta Deep Learning AMI 18.09.1 - ami-09affadd70a78d6cb
NVIDIA Volta Deep Learning AMI 18.09.1

# clone repository
git clone https://github.com/NVIDIA-AI-IOT/deepstream_360_d_smart_parking_application.git
cd deepstream_360_d_smart_parking_application

#  set exports
export IP_ADDRESS=<IP_ADDRESS>
export GOOGLE_MAP_API_KEY=<GOOGLE_MAP_API_KEY>

#  install docker-compose
sudo curl -L https://github.com/docker/compose/releases/download/1.21.0/docker-compose-$(uname -s)-$(uname -m) -o /usr/local/bin/docker-compose
sudo chmod +x /usr/local/bin/docker-compose
sudo ln -s /usr/local/bin/docker-compose /usr/bin/docker-compose

# setup analytics server
cd ./analytics_server_docker
sudo -E docker-compose up -d

This is where I get an error (shown below). It looks like Kafka cannot be pulled from any of the open repositories. Any thoughts?

ubuntu@<IP ADDRESS>:~/deepstream_360_d_smart_parking_application/analytics_server_docker$ sudo -E docker-compose up -d
Building kafka
Step 1/11 : FROM openjdk:8u171-jre-alpine
 ---> 0fe3f0d1ee48
Step 2/11 : ARG kafka_version=1.1.0
 ---> Using cache
 ---> f78b62f19d0e
Step 3/11 : ARG scala_version=2.12
 ---> Using cache
 ---> 0e203acfbd3a
Step 4/11 : ARG glibc_version=2.27-r0
 ---> Using cache
 ---> e879b981f445
Step 5/11 : MAINTAINER wurstmeister
 ---> Using cache
 ---> 64f1e9c8de72
Step 6/11 : ENV KAFKA_VERSION=$kafka_version     SCALA_VERSION=$scala_version     KAFKA_HOME=/opt/kafka     GLIBC_VERSION=$glibc_version
 ---> Using cache
 ---> 674fa76840fb
Step 7/11 : ENV PATH=${PATH}:${KAFKA_HOME}/bin
 ---> Using cache
 ---> 79f87916e194
Step 8/11 : COPY download-kafka.sh start-kafka.sh broker-list.sh create-topics.sh versions.sh /tmp/
 ---> Using cache
 ---> db1c177e89f0
Step 9/11 : RUN apk add --no-cache bash curl jq docker  && mkdir /opt  && chmod a+x /tmp/*.sh  && mv /tmp/start-kafka.sh /tmp/broker-list.sh /tmp/create-topics.sh /tmp/versions.sh /usr/bin  && sync && /tmp/download-kafka.sh  && tar xfz /tmp/kafka_${SCALA_VERSION}-${KAFKA_VERSION}.tgz -C /opt  && rm /tmp/kafka_${SCALA_VERSION}-${KAFKA_VERSION}.tgz  && ln -s /opt/kafka_${SCALA_VERSION}-${KAFKA_VERSION} /opt/kafka  && rm /tmp/*  && wget https://github.com/sgerrand/alpine-pkg-glibc/releases/download/${GLIBC_VERSION}/glibc-${GLIBC_VERSION}.apk  && apk add --no-cache --allow-untrusted glibc-${GLIBC_VERSION}.apk  && rm glibc-${GLIBC_VERSION}.apk
 ---> Running in c2d65bca3b14
fetch http://dl-cdn.alpinelinux.org/alpine/v3.8/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.8/community/x86_64/APKINDEX.tar.gz
(1/19) Installing ncurses-terminfo-base (6.1_p20180818-r1)
(2/19) Installing ncurses-terminfo (6.1_p20180818-r1)
(3/19) Installing ncurses-libs (6.1_p20180818-r1)
(4/19) Installing readline (7.0.003-r0)
(5/19) Installing bash (4.4.19-r1)
Executing bash-4.4.19-r1.post-install
(6/19) Installing nghttp2-libs (1.32.0-r0)
(7/19) Installing libssh2 (1.8.0-r3)
(8/19) Installing libcurl (7.61.1-r1)
(9/19) Installing curl (7.61.1-r1)
(10/19) Installing libmnl (1.0.4-r0)
(11/19) Installing jansson (2.11-r0)
(12/19) Installing libnftnl-libs (1.1.1-r0)
(13/19) Installing iptables (1.6.2-r0)
(14/19) Installing device-mapper-libs (2.02.178-r0)
(15/19) Installing libltdl (2.4.6-r5)
(16/19) Installing libseccomp (2.3.3-r1)
(17/19) Installing docker (18.06.1-r0)
Executing docker-18.06.1-r0.pre-install
(18/19) Installing oniguruma (6.8.2-r0)
(19/19) Installing jq (1.6_rc1-r1)
Executing busybox-1.28.4-r1.trigger
OK: 269 MiB in 71 packages
Downloading kafka 1.1
Downloading Kafka from http://mirror.reverse.net/pub/apache/kafka/1.1.0/kafka_2.12-1.1.0.tgz
Connecting to mirror.reverse.net (208.100.14.200:80)
wget: server returned error: HTTP/1.1 404 Not Found
ERROR: Service 'kafka' failed to build: The command '/bin/sh -c apk add --no-cache bash curl jq docker  && mkdir /opt  && chmod a+x /tmp/*.sh  && mv /tmp/start-kafka.sh /tmp/broker-list.sh /tmp/create-topics.sh /tmp/versions.sh /usr/bin  && sync && /tmp/download-kafka.sh  && tar xfz /tmp/kafka_${SCALA_VERSION}-${KAFKA_VERSION}.tgz -C /opt  && rm /tmp/kafka_${SCALA_VERSION}-${KAFKA_VERSION}.tgz  && ln -s /opt/kafka_${SCALA_VERSION}-${KAFKA_VERSION} /opt/kafka  && rm /tmp/*  && wget https://github.com/sgerrand/alpine-pkg-glibc/releases/download/${GLIBC_VERSION}/glibc-${GLIBC_VERSION}.apk  && apk add --no-cache --allow-untrusted glibc-${GLIBC_VERSION}.apk  && rm glibc-${GLIBC_VERSION}.apk' returned a non-zero code: 1

Edits: Formatting to make it easier to read.

[aiyerganapathy]

Hey Paul,

There was an issue with kafka version. I have updated the Dockerfile to resolve this issue. Thanks for pointing it out. Closing the bug.

[velushomaz]

Hi aiyerganapathy, I ran to the same bug and managed to fix it by forcing the url to be from apache's central repo instead of my local one as it doesn't have the 1.1.1 kafka mirror.

[aiyerganapathy]

@velushomaz Hey, I checked the github repo of kafka-docker (https://github.com/wurstmeister/kafka-docker) and noticed that they had made a change to download-kafka.sh. I have made changes to my script accordingly. Now the kafka script will download from central apache repo if that version is not available in a mirror.

[velushomaz]

@velushomaz Hey, I checked the github repo of kafka-docker (https://github.com/wurstmeister/kafka-docker) and noticed that they had made a change to download-kafka.sh. I have made changes to my script accordingly. Now the kafka script will download from central apache repo if that version is not available in a mirror.

Thank you! I also ran to an error with the python tracker module.

Had to put this line in on the Dockerfile for apt update to run properly.:

COPY tracker.zip .
RUN sed -i '/jessie-updates/d' /etc/apt/sources.list
RUN apt-get update && apt-get install unzip

[aiyerganapathy]

@velushomaz In what kind of system are you testing? I am not facing any errors in Ubuntu 16.04. Can you give me more details?

[velushomaz]

@velushomaz In what kind of system are you testing? I am not facing any errors in Ubuntu 16.04. Can you give me more details?

My bad! I'm on 18.04 as there were some issues with the nvidia graphics driver with 16.04. I can now run everything properly with some tinkering on your dockerfile you provided.