random failures during apt-get update

[drzraf]

For an unkown reason the image (at least the php:5.6 version) fails randomly at apt-get update'ing things:

It works:

$ apt-get -y update
Get:1 http://security.debian.org jessie/updates InRelease [63.1 kB]
Get:2 https://deb.nodesource.com jessie InRelease [4634 B]
Get:3 https://dl.yarnpkg.com stable InRelease [11.5 kB]
Ign http://deb.debian.org jessie InRelease
Get:4 http://deb.debian.org jessie-updates InRelease [145 kB]
Get:5 http://deb.debian.org jessie Release.gpg [2373 B]
Get:6 http://deb.debian.org jessie Release [148 kB]
Get:7 http://security.debian.org jessie/updates/main amd64 Packages [535 kB]
Get:8 https://deb.nodesource.com jessie/main Sources [765 B]
Get:9 https://deb.nodesource.com jessie/main amd64 Packages [960 B]
Get:10 https://dl.yarnpkg.com stable/main amd64 Packages [5555 B]
Get:11 http://deb.debian.org jessie-updates/main amd64 Packages [17.8 kB]
Get:12 http://deb.debian.org jessie/main amd64 Packages [9065 kB]
Fetched 10.0 MB in 3s (2580 kB/s)
Reading package lists...

Then, same job, same image, same commit:

$ apt-get -y update
Get:1 http://security.debian.org jessie/updates InRelease [63.1 kB]
Get:2 https://deb.nodesource.com jessie InRelease [4634 B]
Get:3 https://dl.yarnpkg.com stable InRelease [11.5 kB]
Ign http://httpredir.debian.org jessie InRelease
Get:4 http://deb.debian.org jessie-updates InRelease [145 kB]
Get:5 http://httpredir.debian.org jessie Release.gpg [2373 B]
Get:6 http://httpredir.debian.org jessie Release [148 kB]
Get:7 http://security.debian.org jessie/updates/main amd64 Packages [535 kB]
Get:8 https://deb.nodesource.com jessie/main Sources [765 B]
Get:9 https://deb.nodesource.com jessie/main amd64 Packages [960 B]
Get:10 https://dl.yarnpkg.com stable/main amd64 Packages [5555 B]
Get:11 http://httpredir.debian.org jessie/contrib amd64 Packages [59.5 kB]
Get:12 http://httpredir.debian.org jessie/non-free amd64 Packages [101 kB]
Get:13 http://deb.debian.org jessie-updates/main amd64 Packages [17.8 kB]
Fetched 1096 kB in 2s (370 kB/s)
Reading package lists...

so it fails to grab deb.debian.org jessie/main amd64, so the next apt-get install is likely to fail.
Could you please double-check image's state of /etc/apt/sources.list*? I'd not surprised if it'd contain oddities.

Side note: none of this package distribution URLs should use clear-HTTP.

[abcdmitry]

Yes, it fails also while using hub.docker.com's autobuild. I used to blame the build server itself + connectivity / timeouts to repository servers.

Though if you think there can be another issue, it would be nice if you share your suggestions.

[drzraf]

see PR #57
Other question:

• why/who need yarn in the default image
• why is there a need for an almost empty/unconfigured msmtprc?
• using Debian 9 would provide node.js 6.x without the need for an extra repository
  All of these may help reducing further down the size/complexity of the image.

[lukasleitsch]

I had the same issue. I guess that the additional apt source could be the issue.

My workaround is to remove /etc/apt/sources.list.d/additional.list before I use apt-get in the CI. After removing this file the random failures are gone.